Hi, all. I have a very large result set (150k results) from NCBI Entrez that I want to download as genbank files. I just found the Aspera plugin for file transfer...does anyone know if it's possible to download very large query results using this tool? Thanks.
3 answers
AFAIK the aspera tool is for uploading/downloading large datasets that exist as separate files on disk. The results of dynamically generated queries do not exist in such a form.
There is a command-line version (ascp), maybe you could incorporate it in a script?
http://www.ncbi.nlm.nih.gov/books/NBK47527/ also: http://betascience.blogspot.com/2010/02/using-aspera-instead-of-ftp-to-download.html
I couldn't even make ascp accept wildcards, although the documentation suggests it is possible. Basically you need to know which files you want a priori.
Log in to answer this question.