vcf-compare?

GATK has a tool that you can use to compute the precision and recall of a variant call set versus another variant call set (your benchmark / gold standard set). GATK GenotypeConcordance:

SiteConcordance_Summary

• ALLELES_MATCH: counts of calls at the same site where the alleles match
• ALLELES_DO_NOT_MATCH: counts of calls at the same location with different alleles, such as the EVAL set calling a 'G' alternate allele, and the comp set calling a 'T' alternate allele
• EVAL_SUBSET_TRUTH: (multi-alleleic sites only) ALT alleles for EVAL are a subset of ALT alleles for COMP. See also below.
• EVAL_SUPERSET_TRUTH: (multi-allelic sites only) ALT alleles for COMP are a subset of ALT alleles for EVAL. See also below.
• EVAL_ONLY: counts of sites present only in the EVAL set, not in the COMP set
• TRUTH_ONLY: counts of sites present only in the COMP set, not in the EVAL set

http://www.broadinstitute.org/gatk/gatkdocs/org_broadinstitute_gatk_tools_walkers_variantutils_GenotypeConcordance.html

You can use bedtools substract to get the variant positions that are in one vcf file and not in another vcf file. This does not take genotypes into account.

http://bedtools.readthedocs.org/en/latest/content/tools/subtract.html

Is this what you're after?.. GATKs Variant Quality Score Recalibration

From the website:

Introduction

The purpose of variant recalibration is to assign a well-calibrated probability to each variant call in a call set. This enables you to generate highly accurate call sets by filtering based on this single estimate for the accuracy of each call.