Thanks for the suggestion, but unfortunately this doesn't seem to be driven by the pattern you describe. I had already been filtering for sites with >0 counts in at least 75% of the dataset and added an additional filter to remove sites where one sample had an expression level that was 5x higher than the mean (using cpm), but the pattern remained.
Do you have any suggestions for figuring out what these genes may be? I've been unable to create the mean/variance plot from the raw data, but I suspect that's a limitation on my understanding of what exactly voom is doing.