This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Duplicate ID in bed file

I am using PLINK v1.90b3s 64-bit (17 Jun 2015) to generate a LD matrix from 1000G VCF file for a long list of SNPs.

I use this command to convert VCF to bed file

plink --vcf ALL.chr22.phase3_shapeit2_mvncall_integrated_v5a.20130502.genotypes.vcf.gz --make-bed --out binary_fileset

I then use this command to generate LD statistic reports

plink --r2 --bfile binary_fileset --ld-snp-list snp_chr22_sample.txt --ld-window-r2 0.8

But it returns the below error

Error: Duplicate ID 'rs10656307'.

The SNP file does not contain this SNP. So I think it is the bed file contain duplicated record of rs10656307. Is there a way to remove duplicated SNP in the bed file?

bed duplicate id
• 14,723 views • link
updated by wenbinm • wenbinm • written by janhuang.cn janhuang.cn

2 answers

I had the same problem. Solved in two steps:

1) Got all the duplicated ids from the bim file: cut -f 2 ALL.chr1.bim | sort | uniq -d > 1.dups

2) Excluded these ids from the bfile:

plink --bfile ALL.chr1  --exclude 1.dups --make-bed --out ALL.filt.chr1;

With these new filtered files there were no errors while generating LD reports

• 0 views • link
written by Sergei Slavskii • Sergei Slavskii

For some reason cut command doesn't work for my bim file. I used awk -F ' ' '{print $2}' ALL.chr1.bim | sort | uniq -d > 1.dups instead

• 0 views • link
written by wenbinm • wenbinm

Using --list-duplicate-vars you can identify the duplicates in the data plink website identifying duplicates

And using --exlcude you can remove your snps plink website removing snps

• 0 views • link
written by Floris Brenk Floris Brenk

I used the --list-duplicate-vars to generate a list of duplicated SNPs, but it does not contain the one reported as dulicate in the analysis.

• 0 views • link
written by janhuang.cn janhuang.cn

Right, I think --list-duplicate-vars only find SNPs duplicated by position.

• 1 views • link
written by Phoenix Mu • Phoenix Mu

Log in to answer this question.

More posts like this