+1 for GNU parallel. Great tool.
I'll check out elPrep and speedseq
Hi all,
We are thinking about ways to make our production pipeline run faster. Right now we're settled on aligner, but everything to get us from the SAM/BAM creation up to a sorted, merged, duplicate marked BAM could be updated.
We'll need tools to help us:
On my list of tools to evaluate, I have some combination of the following:
Are there any tools that I am missing? Are there any combinations of tools that people find particularly effective?
Right now, our current workflow involves
Looking forward to your suggestions!
Interesting question.
Five years ago, we need multiple libraries and and multiple Illumina runs to sequence a human individual to high coverage. At that time, the reads were short. The base quality was not good. The indel models used by the SNP callers were primitive. The best practice was appropriate in the old time.
Now is very different. We typically sequence one human sample from one library in one run. Reads are longer. Quality is more calibrated. The indel models of modern callers are much better. Nowadays, I usually recommend:
Following these practices, you can typically get an "analysis-ready" 30X BAM in <24 hours on 8-16 CPU cores.
As to other tools, I think vt is for VCF processing not for BAM processing (right?). elPrep sounds very interesting, but it seems to require quite a lot of RAM not everyone has. In addition, BGI has a GPU-powered pipeline which is much faster. You need to use SOAP for mapping. ADAM provides massively parallelized MarkDuplicates, realignment and variant calling, though probably it does not save CPU time. The SNAP group from UC Berkeley has shown me a pipeline that does SNAP mapping, deduping and sorting in one go in very short time.
GATK : realign , recalibrate ... see Best Practices: http://gatkforums.broadinstitute.org/discussion/1186/best-practice-variant-detection-with-the-gatk-v4-for-release-2-0-retired
You might also consider elPrep as a replacement for samtools/Picard (supposed to be fast, have not used it myself)
I would also recommend you look into what speedseq does since it might be doing something similar to what you are trying to achieve
Keep in mind that using Gnu Parallel - Parallelize Serial Command Line Programs Without Changing Them and Piping With Samtools, Bwa And Bedtools could also be help you increase speed.
+1 for GNU parallel. Great tool.
I'll check out elPrep and speedseq
you should also use vt normalize on your BAM files to left-align and trim.
See this paper: http://bioinformatics.oxfordjournals.org/content/early/2015/02/19/bioinformatics.btv112.abstract
for the difference it can make.
Log in to answer this question.