I have a 30Gb fasta file. I'd like to upload it to IMG/ER, but they asked me to provide a FTP link (with the link, the data can be downloaded by 'wget' command). I tried to follow this instruction and generate a FTP link https://stackoverflow.com/questions/37453841/download-a-file-from-google-drive-using-wget. But when they tried to download data with 'wget my_ftp_link', they only got a useless html file. Does anybody know how to generate a FTP link for my data and anyone with my link can download my fasta file with 'wget' command? Thanks a lot!
•
written
by
xuling2015 •
1 answer
The trick is to use the Google drive API, in particular, the export command specifying the desired format:
wget "https://docs.google.com/document/d/1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8/export?format=txt" -O test.txt
You can also do
https://drive.google.com/uc?export=download&id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8
but only for files that you uploaded. It doesn't seem to work for files that were created in Google docs.
The API seems to have evolved over time so a lot of things found on the net probably doesn't work anymore. It's best to check the docs.
Log in to answer this question.
-
Submitting NGS data to ArrayExpress via Aspera
written by Meisam •
-
Unable to resolve host address
written by Meghna •
-
Command for Downloading All Strains of Bacteria as a Single FASTA file from NCBI
written by Huzaifa •
-
Forum: How to download multiple .gz files from Ensembl Protists database
written by rohitsatyam102
-
Get wget to download only new items from a list
written by michael.flower.14 •
-
Uncommon wget behavior with ncbi genomes
written by flogin
-
nr database Diamond
written by Dave Th •
-
download refseq of thousand of assembly file from NCBI
written by Shelle •
-
Issue downloading files from FTP server to Ubuntu 16.04.2 VM (Azure)
written by parism9 •
-
Getting multiple *.sra files from NCBI using a list
written by chrys •
https://meta.stackexchange.com/questions/147616/
I understand correctly that you uploaded your data to google-drive such that they can download it from there, right?
then why not ask them for a ftp link so you can upload (ftp) to them?
Yes, you're right! Although I uploaded my data to google drive and generated a FTP link as the instruction, but IMG staff only got a html file with 'wget my_ftp_link' command. I don't understand why it doesn't work. 'I'm wondering what do you mean by "ask them for a ftp link so you can upload (ftp) to them"? Thanks!
If they host an ftp server, they can provide you with access to it (or even anonymous) so you can then upload your data directly to their system
alternatively, if you have access to an ftp server (or a public web server) you can put the file online for them to download it directly from your system
Have you seen this? You can check yourself to see if this works.
It doesn't work. :(
wget "https://drive.google.com/uc?export=download&id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8" --2018-04-05 16:14:46-- https://drive.google.com/uc?export=download&id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8 Resolving drive.google.com drive.google.com)... 172.217.9.206, 2607:f8b0:4004:811::200e Connecting to drive.google.com drive.google.com)|172.217.9.206|:443... connected. HTTP request sent, awaiting response... 404 Not Found 2018-04-05 16:14:46 ERROR 404: Not Found.
Some more suggestions to try here.
I tried this page before, it doesn't work. Same error :(
are you sure your google drive link is OK? if i check the link I get the 404 as well ?
Yes, that file ID is ok. It's here https://drive.google.com/open?id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8. I replaced it with https://drive.google.com/uc?export=download&id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8 as the instruction. But I don't understand why it doesn't work.
For a command-line interface for Google Drive, you may gdrive. The site provides statically linked binaries, so there is no trouble to install it.
Someone else is supposed to download the file and they insist on using
wgetand a working link.I just assumed the
wgetrequirement is actuallysome command-lineprogram.I don't see how this is a proper bioinformatics question, sorry.