This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Filtering Overlapping Paired-end Reads

Greetings,

I have a metagenomics dataset of Illumina overlapping paired-end reads in which the quality deteriorates rapidly. The sequences are already joined. When I filter by sliding window I end up losing 85% of the dataset.

http://imgur.com/a/8GO1T

Would separating the sequences, doing trailing-end filtering and then using them as separate files be a viable approach? I'm currently using Diamond which only seems to accept one input file, however.

Any ideas welcome, and thank you for your time.

fastqc ngs illumina
• 4,483 views • link
written by ScubaChris • ScubaChris

If you map to a reference, do you see an overlap of paired-ends? What is you insert size distribution (after mapping)?

• 0 views • link
written by Gabriel R. Gabriel R.

Hi, I'm not using a reference genome, just blasting against a list of specific protein sequences.

• 0 views • link
written by ScubaChris • ScubaChris

DNA to Protein blast?

• 0 views • link
written by Gabriel R. Gabriel R.

Yes, like I said, I'm using Diamond.

• 0 views • link
written by ScubaChris • ScubaChris

3 answers

If the sequences are already successfully merged using a pair-merging tool, the low-quality overlapping ends should have already been error-corrected into consensus sequence and they won't need trimming. Why are you trying to trim or filter them? And anyway, you can't separate them once they are merged since it's a lossy process. What exactly do you mean by "joined", anyway - how was the procedure performed? And what command line are you trying to use for filtering?

• 0 views • link
written by Brian Bushnell Brian Bushnell

Thank you for your reply.

The sequences are part of a public dataset I got from iMicrobe. The study paper I got the link from said, and I quote, "sequences are QC’d fasta files of joined paired-end reads, also with internal standards and rRNA sequences (metatranscriptomes only) removed." The sequences however were FASTQ instead, and this is how the FastQC output looks like. I can easily trim the trailing end, but I can't clean up the middle of the joined sequences (I am using a sliding window) without losing 85% of my dataset. I am also in the process of contacting the original researcher directly. My main goal is to blastx them (Diamond) against some specific protein databases.

• 0 views • link
written by ScubaChris • ScubaChris

Right - you have to do quality trimming on the paired reads, if you want to do it. You can't effectively quality-trim merged (joined) reads, and you can't separate them once they have been merged. So, just use them as-is. You can filter out the very low quality ones if you want, though.

• 0 views • link
written by Brian Bushnell Brian Bushnell

Thank you for your answer, I will use them as-is then.

• 0 views • link
written by ScubaChris • ScubaChris

To close this post myself, it turned out that the sequences I wanted to use had been incorrectly deposited, and should not have been like that in the first place. Thanks for all the answers!

• 0 views • link
written by ScubaChris • ScubaChris

For your dataset, assess the reads on FASTQC separately, that should give you an idea of where the quality is deteriorating and then you can trim them using PRINSEQ. Merge them later after quality trimming and map it to your reference sequence.

• 0 views • link
written by sridhar56 sridhar56

Hi, thank you for your reply. If I split them in order to trim, should I merge them by adding "N"s to the gaps? Is this normally a good practice? Thanks.

• 0 views • link
written by ScubaChris • ScubaChris

Log in to answer this question.

More posts like this