Hi dear community,
Could anyone tell me what changes in the p-value distribution mean?
I mean, for example, what does mean that the p-values follow a uniform distribution? and what happens if the p-values distribution has many p-values between 0 and 0.05 and then it flattens out?
Thanks in advance
1 answer
While this is really a statistics question, this concept is used often enough in bioinformatics that it's still topical (IMHO).
Let's suppose we wanted to waste some money and took liver samples from 20 wild-type mice and sent them out for RNAseq. We then aligned/etc. the data and randomly divided the results into 2 groups of 10 samples (don't ask why, this is a made-up example). We then used DESeq2 or edgeR or pretty much anything else to compare these two artificially created groups. Since we don't expect there to be any real difference between the artificial groups, what do we expect the raw p-values to look like? Well, we expect ~5% of them to be <=0.05, ~10% to be <= 0.1, and so on. Why, because that's one of the definitions of a p-value (we'll use frequentist definitions, because that's appropriate here). In short, a p-value of 0.05 says that you should see an effect size of this magnitude or greater 5% of the time if the null hypothesis is actually true.
Knowing that, if we see p-values following a uniform (i.e., a flat histogram) distribution, then odds are good that we didn't find much different between the groups. If there's an enrichment in low p-values, then there's probably something interesting in the results. This then leads to how Benjamini-Hochberg p-value adjustment works (using the graphical method). In short, you order your p-values and then plot them versus their rank in the order. You then superimpose a straight line on top of this. Any points below the line are significant (apparently there's an example of this in the TeachingDemos CRAN package).
Edit: People sometimes run into the case where there's actually a depletion of p-values in the 0-0.05 range or a significant slant from lower left or to upper right in the p-value histogram and wonder what that's about. The common cause of this is a batch effect or some other variable that's not being properly controlled.
Log in to answer this question.
Cross Validated is a question and answer site for people interested in statistics...". You should get quicker and more professional answer their :-)
See this post.
The comments from whuber in that thread are especially informative, since he considers somewhat less traditional null assumptions that most of us (myself included) don't normally think about.
Hello corderov!
We believe that this post does not fit the main topic of this site.
You have some excellent suggestions below that show you the best places to ask broad statistical questions.
For this reason we have closed your question. This allows us to keep the site focused on the topics that the community can help with.
If you disagree please tell us why in a reply below, we'll be happy to talk about it.
Cheers!