Hello to the Galaxy community,
I was wondering what is the quickest and the simplest way of extracting fastq unique reads from two fastq files.
What I have is: 2 fastq files with sequences and their quality scores What I want: one fastq file that has only the unique reads that are seen in the first fastq file, but not the second.
What would be the way to go around it? Both of the files have 42M reads each.
Thank you in advance for all of the help.
Erika
1 answer
FastUniq and sequniq can parse paired-end read data for duplicated sequences, while FASTX Toolkit collapses single-end data into unique reads.. For your application, you may have to add read groups using Picard, deduplicate each individually, merge, deduplicate, and split by read group. I don't believe any of those tools takes quality scores into account, and you may have to tweak the data so it returns only the copy from the first FASTQ file (e.g., FastUniq returns the longer of two duplicates, so you could trim the data in the second FASTQ to ensure that outcome).
Log in to answer this question.
-
Weird fastq quality distributions
written by evissc •
-
Galaxy Quality Trimmer
written by istloui1 •
-
QC of Oxford Nanopore fastq files with NanoPlot
written by s.m.frampton •
-
FASTQ- Reverse reads of paired end sequence worse than forward reads
written by dilawerkh4 •
-
trim special lenght from special tile in a fastq file
written by mary •
-
Problems creating Galaxy Admin privilages
written by Erika Gedvilaite •
-
Adding headers/ identifiers to List of lists in R
written by Erika Gedvilaite •
-
R: Creating a boxplot from List of data lists that contain data
written by Erika Gedvilaite •
-
Quickest Way To Get Human Gene Symbols From Refseq Build 37
written by Fred Fleche
-
Trimming A Fastq File Representing Rna-Seq Data
written by Varun Gupta
This is Biostars community :-)
Dedupe.sh from BBMap package.
I second @genomax2's recommendation for dedup.sh. I totally forgot that it's a sequence-based (as opposed to alignment-based) deduplicator. I would definitely try this tool first.
Thanks to all!
harold.smith.tarheel, your explanation was very detailed and helpful, I'll see what I can get done with the data that I am working with.
Please use
ADD COMMENT/ADD REPLYwhen responding to existing comments. This keeps threads logically organized.