That depends on how samples are distributed with regard to experimental groups. If in the worst all controls are undersequenced and all treatments are not then there is not much you can do. Maybe remove genes that consistently have low counts in controls.
If it is somewhat balanced between groups you might use voomWithQualityWeigts() or arrayWeights() from limma to downweight outliers rather than hard-filtering them. Can you add any details or diagnostic plots as suggested by Trivas?