This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Getting Watson Snps From Biomart

Hello

I was wondering if anyone could give me advice about how to get the watson snps from biomart. I have already emailed the biomart user group.

I presume the problem I am having is due to the size of the data. I tried downloading all of the watson snps. A file download started but downloaded at a rate of 1kb per second and timed out after 12 hours. I then tried requesting the data by email but still hadn't received an email within 2 days. I tried the same thing by requesting just a single chromosome and faced the same problems: nothing received by an email request and a very slow download of about 1kb per second which i gave up on after 12 hours as it seemed stuck at 10mb and obviously wasn't going to get me the data.

What am i doing wrong? I appreciate it is a large data set and a slow query with complicated joins in the table but that doesn't seem to be the problem as the data starts to download.

I have seen this query here which seems related http://biostar.stackexchange.com/questions/2356/problem-with-dbsnp-sequence-variation-download-using-biomart

I am also trying to get the watson snps via the ensembl perl api but there are 3mil and my code has only got 3k so far and I'm scared I'll have my ip blocked if i keep it running

thanks a lot

biomart
• 4,738 views • link
updated by Prateek Prateek • written by Andrea_Bio • Andrea_Bio

Just had a reply from them. They are checking the issue. I will let you know what they say

• 3 views • link
written by Andrea_Bio • Andrea_Bio

3 answers

Try getting it directly from the source

The file is watson_snp.gff.gz

looks like this..

#gff-version 1 
chr1    JW  gt_novel    41921   41921   .   +   .   SNP BJW-   1117373;alleles G/C;ref_allele G;ref_counts 2;oth_counts 2
chr1    JW  genotype    42101   42101   .   +   .   SNP rs2691277.1;alleles T/G;ref_allele T;ref_counts 0;oth_counts 1
chr1    JW  genotype    45408   45408   .   +   .   SNP rs28396308;alleles C/T;ref_allele C;ref_counts 0;oth_counts 3
chr1    JW  gt_novel    46244   46244   .   +   .   SNP BJW-1120399;alleles T/C;ref_allele T;ref_counts 1;oth_counts 4
chr1    JW  genotype    47815   47815   .   +   .   SNP rs2691334;alleles A/C;ref_allele A;ref_counts 0;oth_counts 1
• 2 views • link
updated by Ram Ram • written by Prateek Prateek 
#gff-version 1
chr1    JW  gt_novel    41921   41921   .   +   .   SNP BJW-1117373;alleles G/C;ref_allele G;ref_counts 2;oth_counts 2
chr1    JW  genotype    42101   42101   .   +   .   SNP rs2691277.1;alleles T/G;ref_allele T;ref_counts 0;oth_counts 1
chr1    JW  genotype    45408   45408   .   +   .   SNP rs28396308;alleles C/T;ref_allele C;ref_counts 0;oth_counts 3
chr1    JW  gt_novel    46244   46244   .   +   .   SNP BJW-1120399;alleles T/C;ref_allele T;ref_counts 1;oth_counts 4
chr1    JW  genotype    47815   47815   .   +   .   SNP rs2691334;alleles A/C;ref_allele A;ref_counts 0;oth_counts 1
• 0 views • link
updated by Ram Ram • written by Prateek Prateek

much better - thx for reformatting.

• 0 views • link
written by Prateek Prateek

don't forget to go through the 00readme.txt file

• 0 views • link
written by Prateek Prateek

thanks for the comment but i need the ensembl data really as I am getting their consequences at the same time as getting the data

• 0 views • link
written by Andrea_Bio • Andrea_Bio

i awarded you the answer as I ended up having to get the snps this way. thanks a lot

• 0 views • link
written by Andrea_Bio • Andrea_Bio

retry or check your connection , it works fine here:

time curl  "ftp://jimwatsonsequence.cshl.edu/jimwatsonsequence/watson_snp.gff.gz" > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 27.2M  100 27.2M    0     0   114k      0  0:04:03  0:04:03 --:--:--  123k

real    4m3.558s
user    0m0.336s
sys     0m0.568s
• 1 views • link
updated by Ram Ram • written by Pierre Lindenbaum Pierre Lindenbaum

its not my connection thanks as I asked other people in different locations to try for me and they couldn't get it either.

• 0 views • link
written by Andrea_Bio • Andrea_Bio

If you tried this earlier today, try again. BioMart has been very unresponsive for much of the day; they might be having issues or doing maintenance.

• 1 views • link
written by Neilfws Neilfws

just had an email from them. they are looking into it for me

• 0 views • link
written by Andrea_Bio • Andrea_Bio

Log in to answer this question.

More posts like this
  • Convert 4 million SNPs' positions to rsID
    written by Weiqiong • Weiqiong
    I have a list of SNPs of the form chromesome:position and I want convert them to rsIDs. I tried Biomart package in R but it …
  • dbSNP build in ENSEMBL biomaRt?
    written by 09meh • 09meh
    I'm wondering how to determine what dbSNP build (i.e. 150 or 151) the variation annotations are based on. For example, I can find that for …
  • Download Snp Data From Dbsnp Using Eutils?
    written by BioInfo1010 • BioInfo1010
    <p>can i download SNPs data(rsID,chromosomal position, function, variation class, contig,contig position,Allele etc..) of <strong>a gene</strong> from dbSNP using eUtils?</p> <p>eg. i want to download SNPs …
  • Biomart Snp Download Problem.
    written by Hugh • Hugh
    <p>Can anyone download this [http://i.imgur.com/ompc0.png] file in its entirety ? I cant seem to get it and the URL does not work--</p> <p>Related: <a href="http://biostar.stackexchange.com/questions/2356/problem-with-dbsnp-sequence-variation-download-using-biomart">http://biostar.stackexchange.com/questions/2356/problem-with-dbsnp-sequence-variation-download-using-biomart</a></p>
  • How Can I Find Out What Assembly Data Is Mapped To?
    written by Andrea_Bio • Andrea_Bio
    <p>Hello</p> <p>If i have a set of data for an organism and do not know which assembly it has been mapped to, is there a …
  • Explanation Of Fields In Watson Snp Gff File
    written by Andrea_Bio • Andrea_Bio
    <p>Hello</p> <p>Here are a few lines from the watson snp data in gff format:</p> <pre><code>#chr1 JW genotype 42101 42101 . + . SNP rs2691277.1;alleles T/G;ref_allele …
  • Allele Frequencies Of Snps
    written by Andrea_Bio • Andrea_Bio
    <p>Hello</p> <p>Do any data sources other than dbSNP record information about allele frequencies for SNPs. I'm also interested to know other sources that provide the …
  • Variation Synonyms In Ensembl
    written by Andrea_Bio • Andrea_Bio
    <p>Hi</p> <p>I will post this question to the ensembl mailing list but i thought i would try this forum too.</p> <p>ensembl variation database has the …
  • Snp Data Mining
    written by Andrea_Bio • Andrea_Bio
    <p>Hello</p> <p>Are there any tools available that will collect all of the known SNPs for a particular organism?</p> <p>I can see that Ensembl uses dbSNP …
  • Problem With Dbsnp Sequence Variation Download Using Biomart
    written by Khader Shameer Khader Shameer
    <p>I need to download the the following attributes for all entries in dbSNP Build 131 via BioMart </p> <blockquote> <p>Ensembl Transcript ID, Variation start in …