But I am confused why we can not drop these genes in feature selection steps.
You absolutely can. This is even the most "mild" method as it does not alter the counts of all other genes. I personally prefer to do exactly that. This is a good idea if you see that e.g. cell cycle drives some unwanted cluster separation purely based on these genes. Here is an example from a yet unpublished project of mine in which cell cycle was driving some unwanted cluster separation.
tl;dr
You see in the below plot our dataset colored by clusters (A) and colored by three canonical lineage markers (B-D) for the celltypes we were interested in. Basically what you see is that the UMAP is separated into two large "islands" of clusters (that is shown in E as left/right group) and each of these islands contained cells that highly expressed these lineage markers. That means cells were somehow separated by a factor we did not know about. We observed then that the left group expressed the cell cycle gene Mki67 highly and the right group lowly. Mki67 is canonically low for cells in G1 phase and this suggested us that the "right" group was mainly in G1 phase and the "left" one in non-G1/mixed phases. This was confirmed by running the cyclone classifier from scran (F), and by running differential expression between "left" and "right" with DE genes being enriched for cell-cycle realted terms (G).
That having said, simply dropping the DE genes from left_vs_right from the highly variable genes was completely sufficient to remove this separation into the two islands. Rerunning the clustering and UMAPing after the removal resulted in a separation driven by the expected cell type differences with no sign of cell cycle confounding as before. In this case we droppe about 70 genes out of 1000 highly variable ones. Of note, it was really necessary to do the DE analysis. Simply dropping genes that were annotated in the "Cell Cycle" GO-term was not sufficient to remove that confounding, so it really must be data-driven.
That is an example were simply dropping genes was sufficient. Regression would probably be preferred when you have evidence that many other non-cell cycle genes were co-regulated by the cell cycle phase so removing cc genes alone would not be enough but I do not have any dataset or example to demonstrate that.
Also see OSCA (http://bioconductor.org/books/3.15/OSCA.advanced/cell-cycle-assignment.html) for a discussion on cell cycle. I basically agree with @jared.andrews07 above that regression (and generally methods that alter the counts of all genes) should only be applied of there is good data-driven evidence that this is necessary and beneficial.
