This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Calculate average mapping quality at a position

Hello,

I want to filter my non-variant positions for mapping quality. I used mpileup to output the mapping qualities across all sites. To do the filtering, can I take an arithmetic mean of the mapping qualities for each read that the base belong to?

For example:

NW_008793873.1 13 G 2 .^S. AB HS

Position 13 is covered by two reads with mapping qualities H and S. Would (39 + 50)/2 = 44.5 be correct?

I ask this because in connection to mapping qualities, usually root mean square is mentioned so I was wondering what would the correct approach be in this case?

Thank you!

mapping quality mpileup
• 4,128 views • link
updated by Gabriel R. Gabriel R. • written by hpapoli hpapoli

I am not concerned about the variant positions as GATK calculates average MQ for those. I need average MQ for non-variant positions.

• 1 views • link
written by hpapoli hpapoli

aren't you mixing up MAPQ mapping qualities and read qualities ?

• 1 views • link
written by Pierre Lindenbaum Pierre Lindenbaum

I think this is using "samtools mpileup -s" which outputs the base quality followed by the mapping qualities for the read that supports the base.

• 1 views • link
written by Gabriel R. Gabriel R.

1 answer

These are probabilities of mismapping on a PHRED scale. For the first one, the probability of mismapping is:

(10^(-(39/10)) = 0.0001258925

For the second it is:

10^(-(50/10)) =  1e-05

So on average, your probability of mismapping is:

(0.0001258925+1e-05)/2 =  6.794627e-05

On a PHRED scale it is:

 -10*log10(6.794625e-05) =  41.67835
• 1 views • link
written by Gabriel R. Gabriel R.

Thanks! By the way, do you know what kind of probability distribution do mapping qualities have?

• 1 views • link
written by hpapoli hpapoli

Log in to answer this question.

More posts like this