This is a test version of Biostars. For the public version, visit https://www.biostars.org.
What Raw Sequence File Formats Do You Work With?

I'd like to build a parser to load all output from various sequencer technologies into an database. There are many various file formats. I am mostly familiar with FASTQ and FASTA/QUAL produced by Illumina and 454, respectively. What raw sequence file formats do you work with?

sequence format
• 3,716 views • link
updated by Istvan Albert Istvan Albert • written by Science_Robot Science_Robot

You want to put some FASTQs (or whatever) in a database ? why ? what kind of data to you need to index ? What kind of information do you need to quickly find that won't be available using samtools or the Samtools API ?

• 0 views • link
written by Pierre Lindenbaum Pierre Lindenbaum

Forget about the database. I really just want to know what kind of raw sequence file formats are common.

• 0 views • link
written by Science_Robot Science_Robot

The reason being that I need random access.

• 0 views • link
written by Science_Robot Science_Robot

1 answer

Your the best strategy might be to convert everything to FASTQ and build your service for the FASTQ format. Each platform has utilities that convert to FASTQ.

Check out Screed as well, a simple read-only sequence database, designed for short reads

https://github.com/ctb/screed

• 1 views • link
written by Istvan Albert Istvan Albert

+1. Screed is interesting. It would be even better if it supports gzip compression. Pretty much everything larger than 1GB is compressed on my disk.

• 0 views • link
written by lh3 lh3

I'm trying to move away from flat files. Screed looks interesting. Wouldn't be hard to add compression.

• 0 views • link
written by Science_Robot Science_Robot

Log in to answer this question.

More posts like this