Hmm. When I go tabix my_fav.bcf I get a my_fav.bcf.csi. Then I am able to use bcftools view -R just like I would with the .tbi file generated from a vcf. I guess I thought .csi was just the bcf counterpart.
Oh no...
I think I might have just answered my own question and the faster alternative to tabix might be to use:
bcftools index --threads 64 my_fav.bcf