Hadoop InputFormat for FASTA files?
I'm interested in analyzing large FASTA files (like the human genome and proteome) in parallel using Spark or pydoop. Is there a library which implements FASTA parsing as a Hadoop InputFormat?
hadoop
fasta
• 3,087 views
•
link
updated
by
Ram
4.5K
• |
written
by
alex.rubinsteyn
19
0 answers
No answers yet.
Log in to answer this question.
More posts like this
-
FASTQ to SAM File converter
written by inkprs 7Hi, I have a FASTQ file and a reference genome file in FASTA format. What are the fastest tools available to convert into SAM file? …
-
Endophytic proteom databases
written by gayanigimhanianandagoda 1Hi . I ' m looking for the proteome of Harpophora oryzae for my undegraduate research in which i'm interested in comparing the effector proteins …
-
Why less number of hadoop/spark based de novo assemblers?
written by saranpons3 7As the reads data set which has to be assembled by de novo assembler is large, the assembly problem can be considered as a big …
-
genome viewer java API
written by bell 2<p>Hi,</p> <p>I'm currently working on an java annotation tools, and I would like to implement a visualization of the genome with various options. So I'm …
-
MitoSeek to extract animal mtDNA
written by mpjuers 0<p>I have whole-genome data for some <em>Tribolium</em> that I'm trying to pull mtDNA out of. I'm trying to get set up using MitoSeek after aligning …
-
macs2 "Effective genome size" for repetitive genomes
written by Menachem Sklarz 1<p>Hi everyone</p> <p>I'm working on a chip-seq experiment in Wheat, which has a very large and repeptitive genome.</p> <p>I'm a bit baffled by the "effective …
-
Looking for a short read mapping tool (Bioinformatics) based on Hadoop YARN
written by benarnon 3<p>I'm looking for a bioinformatics tool which maps short reads to long references. I need a tool that is working on the Hadoop YARN framework. …
-
Why is Hadoop not used a lot in bio-informatics?
written by William 540Why is Hadoop not used a lot in bio-informatics? At least in my experience I don't see Hadoop being used at local research groups or …
-
Sequence identity in syngenic region (mouse, human), pairwise alignment
written by bio2185-google 0<p>Hi,</p> <p>I have a question which hopefully is easy to answer for you (but hard for me ;-) )</p> <p>I'm interested in a specific genomic …
-
Help Needed To Run Seal For Genome Mapping.
written by bashwin.u 4<p>Hello, I managed to build an index file from the reference genome using <a href='http://biodoop-seal.sourceforge.net/index.html'>Seal</a>. Now I am trying to run <a href='http://biodoop-seal.sourceforge.net/seqal_index.html#seqal-index'>Seqal</a> but I …
"Hadoop FASTA reader" at gist.github.com/jflatow/45551 ?
This looks like it works well for a FASTA file with many small records (since it seeks locally on each worker). However, for a FASTA file with large contigs (like the genome) this wouldn't perform very well.