This is a test version of Biostars. For the public version, visit https://www.biostars.org.
VEP annnotation on millions of variants

I am trying to perform VEP annotation on around 8 million small variants but the process takes around 10 hours using 14 threads and 64 GB RAM. Are there any feasible ways for reducing the time taken to run VEP annotation? I have read that excluding HGVS nomenclature annotation reduces run times, however I am reluctant to exclude HGVS annotation as HGVS reporting is considered a standard requirement for clinical reporting of variants.

variants vcf annotation vep

1 answer

  • convert your vcf to bed (eg: Mince a vcf into n bins of a given range )
  • annotate each region using bcftools view --regions-file the.bed | vep in parallel using your favourite workflow manager ( snakemake, nextflow...)
  • merge all annotated vcf using bcftools concat

Thanks for your reply, I will try to mince the VCF and annotate the regions in parallel. How many threads and memory do you think would be suitable for parallel annotation of these variants?

How many threads and memory do you think would be suitable for parallel annotation of these variants?

42 ...

otherwise, it depends of your infrastructure (cluster, cores, memory...)

Log in to answer this question.