Thank you for your comment! I didn't know a UMAP embedding can be learnt from a subset like that. The UMAP documentation seems to have a section discussing this, so I'll look it over (https://umap-learn.readthedocs.io/en/latest/supervised.html).
Concerning bias, I'm not sure why its an issue in the first place if I'm intentionally trying to separate my cells based off a restricted set of genes? It just strikes me as sensible if one wants first a broad grouping (i.e. EX neurons, IN neurons, Glia), before going in on those groups for fine-grained analysis.