This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Do People Import VCF Files Into Databases? (2016 version)

This is a duplicate of:

  1. Do People Import Vcf Files Into Databases? from 5.4 years ago and
  2. Which Type Of Database Systems Are More Appropriate For Storing Information Extracted From Vcf Files from 3.5 years ago.

Nevertheless, I found the answers on the second post enlightening, and 3.5 years later it seems worthwhile to have an update from the community (and @lh3) on how you deal with these issues.

Notably, @Aaronquinlan's gemini from the second most upvoted answer to question #2 is still under active development. Are people using it? What else are people doing?

vcf database ngs genomics
• 2,295 views • link
updated by Jeremy Leipzig Jeremy Leipzig • written by leekaiinthesky leekaiinthesky

If I need to query the contents in the VCF, especially large ones like ExAC, I normally use HDF5.

• 1 views • link
written by Eric Lim Eric Lim

2 answers

This is called "variant warehousing" and there are several open source and commercial efforts in various stages:

Golden Helix VSWarehouse
Paradigm4 SciDB
WuXi NextCODE
CMH Variant Warehouse
ViaGenetics Genesis
Curoverse Lightning
Intel GenomicsDB
Cloudera OMICS
• 1 views • link
written by Jeremy Leipzig Jeremy Leipzig

PlinkSeq can read vcf files into a database format, then generate summary stats and extract gene, individual or cohort level data. There is an online tutorial that is helpful.

• 1 views • link
written by rbagnall rbagnall

Log in to answer this question.

More posts like this