This is a test version of Biostars. For the public version, visit https://www.biostars.org.
bcftools to GATK

I removed indels using bcftools in 2 gvcf files. when i try to merge them using combineGVCFs/gatk, i see this error

can anyone help me, how to fix this?

INFO  19:05:26,829 ProgressMeter -  chr22:16051001       1.6E7    30.0 s       1.0 s       53.6%    56.0 s      26.0 s
##### ERROR --
##### ERROR stack trace
java.lang.ClassCastException: java.lang.Double cannot be cast to java.lang.Integer
    at java.lang.Integer.compareTo(Integer.java:52)
    at java.util.ComparableTimSort.countRunAndMakeAscending(ComparableTimSort.java:320)
    at java.util.ComparableTimSort.sort(ComparableTimSort.java:188)
    at java.util.Arrays.sort(Arrays.java:1312)
    at java.util.Arrays.sort(Arrays.java:1506)
    at java.util.ArrayList.sort(ArrayList.java:1454)
    at java.util.Collections.sort(Collections.java:141)
    at org.broadinstitute.gatk.utils.MathUtils.median(MathUtils.java:999)
    at org.broadinstitute.gatk.tools.walkers.variantutils.ReferenceConfidenceVariantContextMerger.combineAnnotationValues(ReferenceConfidenceVariantContextMerger.java:83)
    at org.broadinstitute.gatk.tools.walkers.variantutils.ReferenceConfidenceVariantContextMerger.merge(ReferenceConfidenceVariantContextMerger.java:194)
    at org.broadinstitute.gatk.tools.walkers.variantutils.CombineGVCFs.endPreviousStates(CombineGVCFs.java:365)
    at org.broadinstitute.gatk.tools.walkers.variantutils.CombineGVCFs.reduce(CombineGVCFs.java:253)
    at org.broadinstitute.gatk.tools.walkers.variantutils.CombineGVCFs.reduce(CombineGVCFs.java:115)
    at org.broadinstitute.gatk.engine.traversals.TraverseLociNano$TraverseLociReduce.apply(TraverseLociNano.java:291)
    at org.broadinstitute.gatk.engine.traversals.TraverseLociNano$TraverseLociReduce.apply(TraverseLociNano.java:280)
    at org.broadinstitute.gatk.utils.nanoScheduler.NanoScheduler.executeSingleThreaded(NanoScheduler.java:279)
    at org.broadinstitute.gatk.utils.nanoScheduler.NanoScheduler.execute(NanoScheduler.java:245)
    at org.broadinstitute.gatk.engine.traversals.TraverseLociNano.traverse(TraverseLociNano.java:144)
    at org.broadinstitute.gatk.engine.traversals.TraverseLociNano.traverse(TraverseLociNano.java:92)
    at org.broadinstitute.gatk.engine.traversals.TraverseLociNano.traverse(TraverseLociNano.java:48)
    at org.broadinstitute.gatk.engine.executive.LinearMicroScheduler.execute(LinearMicroScheduler.java:99)
    at org.broadinstitute.gatk.engine.GenomeAnalysisEngine.execute(GenomeAnalysisEngine.java:311)
    at org.broadinstitute.gatk.engine.CommandLineExecutable.execute(CommandLineExecutable.java:113)
    at org.broadinstitute.gatk.utils.commandline.CommandLineProgram.start(CommandLineProgram.java:255)
    at org.broadinstitute.gatk.utils.commandline.CommandLineProgram.start(CommandLineProgram.java:157)
    at org.broadinstitute.gatk.engine.CommandLineGATK.main(CommandLineGATK.java:108)
##### ERROR ------------------------------------------------------------------------------------------
##### ERROR A GATK RUNTIME ERROR has occurred (version 3.6-0-g89b7209):
##### ERROR
##### ERROR This might be a bug. Please check the documentation guide to see if this is a known problem.
##### ERROR If not, please post the error message, with stack trace, to the GATK forum.
##### ERROR Visit our website and forum for extensive documentation and answers to
##### ERROR commonly asked questions https://www.broadinstitute.org/gatk
##### ERROR
##### ERROR MESSAGE: java.lang.Double cannot be cast to java.lang.Integer
snp
• 3,699 views • link
updated by Pierre Lindenbaum Pierre Lindenbaum • written by GK1610 GK1610

You should minimise the mixing of GATK with tools from the 'other' main germline variant calling pipeline, i.e., BWA, SAMtools, and BCFtools. They are incompatible in certain areas.

A good pipeline that will give you what you want:

  1. Alignment (bwa)
  2. Remove duplicates (Picard)
  3. Local re-alignment (GATK IndelRealigner, etc)
  4. BQSR (GATK)
  5. Variant calling per file (GATK HaplotypeCaller)
  6. Produce gVCF (GATK GenotypeGVCF)
  7. Separate out SNVs (remove indels (GATK SelectVariants)
• 0 views • link
written by Kevin Blighe Kevin Blighe

2 answers

On the surface, this very much seems like a bug - I'm not too familiar with the inner workings of GATK, but the final bit of that error message is telling me that some kind of object coercion is going on when it shouldn't be. However, this may also have to do with the fact that (iirc) CombineGVCFs can only accept gVCFs generated from a GATK tool like HaplotypeCaller, and so the removal of indels with a non-GATK tool might be causing this error.

From the GATK forums:

The underlying problem is a lack of consensus in the field as to what constitutes a gvcf. By the standards of samtools and some Illumina-derived files we've seen, a gvcf is essentially an all-sites VCF, potentially with non-variant block records. Within the scope of GATK, gvcf means much more than that -- it includes a symbolic non-ref allele and metrics that relate to the confidence level of both reference and non-ref calls. As a result, the GATK tools that process gvcfs are only able to handle GATK-derived gvcfs, because those are the only ones that fulfill the expectations regarding that extra information.

• 1 views • link
written by aays aays

Yes I get that. My problem is I want to remove indels from my gvcf files before I start combinGVCFs to merge GVCF files.

I am using this command. java -Xmx2g -jar $GenomeAnalysisTK_jar SelectVariants -R $REF -V $file -O output.vcf.gz --select-type-to-exclude INDEL

Unfortunately it does nothing. when I grep

zcat output.vcf.gz | grep AAAAAACAAC

chr22 31470782 . AAAAAACAAC A,<non_ref> 0.60 . BaseQRankSum=-0.736;ClippingRankSum=0.736;DP=3;ExcessHet=3.0103;MLEAC=1,0;MLEAF=0.500,0.00;MQRankSum=-0.736;RAW_MQ=10800.00;ReadPosRankSum=0.736 GT:AD:DP:GQ:PL:SB 0/1:2,1,0:3:29:29,0,46,35,49,84:1,1,0,1

This shouldn't happen!!!

bcftools removes indels nicely which is why I had to detour from GATK to bcftools. I don't know what s going on.

• 0 views • link
written by GK1610 GK1610

What about combining gvcfs first, and then filtering indels from the obtained vcf?

• 0 views • link
written by WouterDeCoster WouterDeCoster

removed indels using bcftools in 2 gvcf files

Well there is your problem. Why would you do that? I don't think there is a good enough reason to change gvcf files.

• 1 views • link
written by WouterDeCoster WouterDeCoster

Log in to answer this question.

More posts like this
  • HaplotypeCaller: java.lang.NullPointerException when multiple-line bed file is used
    written by Bio-gen-B Bio-gen-B
    I used HaplotypeCaller on the cram file of sample NA12878 from IGSR, the reference fasta is also downloaded from them, the bed interval is self-made …
  • Key DP found in VariantContext field FILTER error
    written by Learner Learner
    I am trying to merge 4 samples vcfs that are different from each other before annotation. I am using this technique https://www.biostars.org/p/216212/ but I get …
  • GATK Error on variant filteration
    written by DanielC DanielC
    Dear All, I am running GATK variant calling analysis and came around an error which I could really use your suggestions on: command line is …
  • GATK AnnotateLikelyPathogenic strange error
    written by Ram Ram
    I'm facing a strange GATK error in one of my operations. I'm not sure what's happening here. See: ``` ##### ERROR ------------------------------------------------------------------------------------------ ##### ERROR stack …
  • error while running realignerTargetCreator
    written by raya.girish • raya.girish
    Hello All I have sample obtain from Ion torrent machines I looking for somatic mutations I already did preprocessing of samples but when i am …
  • MarkDuplicates memory issue
    written by cacampbell • cacampbell
    <p>Hello,</p> <p>I am having major problems with getting MarkDuplicates to run to completion.</p> <p>Relevant Programs:</p> <p>- Java 1.8.0 64-bit</p> <p>- picard-tools 2.0.1</p> <p>I was under …
  • Why muTect Error?
    written by naruto1nrt • naruto1nrt
    When I use muTect to call somatic SNVs, I got this error: ``` INFO 10:05:12,111 ProgressMeter - 1:1249156 3.86e+05 51.1 s 2.2 m 0.1% 12.7 …
  • Gatk Baserecalibrator Phase 2 Error
    written by youngcsong • youngcsong
    Hello, I am running second round of BaseRecalibrator, using the output table generated from first round of BaseRecalibrator (pretty much the similar command, except in …
  • Realignertargetcreator --- Arrayindexoutofboundsexception
    written by sandeep.deverasetty • sandeep.deverasetty
    <pre><code>[sandeep@login2 chr16]$ java -Xmx2G -jar /u/home/sandeep/Tools/GATK/GenomeAnalysisTK.jar -R /u/home/sandeep/Files/hg19/ucsc/ucsc.hg19.fasta -I gatk/Genomic.alignment.recalibrated.bam -T RealignerTargetCreator --known /u/home/sandeep/Files/dbSNP/dbsnp132.ucsc.hg19.vcf -L ./Genomic.alignment.merged.bed -o gatk/Genomic.alignment.forRealigner.intervals INFO 17:36:03,903 RodBindingArgumentTypeDescriptor - Dynamically determined type …
  • Gatk Error
    written by Leandro Batista • Leandro Batista
    <p>Hello,</p> <p>I've been using GATK tools for Bam processing and SNP calling in whole exome and whole genome sequencing data. It has been doing just …