How to download a 100 fastq files at once using SraToolkit fastq-dump?
How to download a 100 fastq files at once using SraToolkit fastq-dump? Is there any software with GUI or shell codes published somewhere?
• 2,920 views
•
link
written
by
flight029000 •
0 answers
No answers yet.
Log in to answer this question.
More posts like this
-
SRA ToolKit: can't verify binaries
written by Izzy •
-
Accessing SRA file with multiple fastqs under one accession
written by tony_88888 •
-
How to download oxford nanopore sequencing fast5 files from SRA
written by va90 •
-
Tutorial: High Speed Downloading of SRA, SAM and Fastq Files
written by Wenhu_Cao
-
Is there a way to download FASTq files from SRR IDs?
written by Paul
-
Is it possible to download Neisseria Meningitidis whole gneomes using fastq-dump from SRAToolkit?
written by bioinform •
-
How can I change the default path to which SRA files are downloaded?
written by Cacau
-
Fastq-dump crashing with core dump?
written by alan •
-
Converting .sra files to fastq
written by Linda
-
Sra-Toolkit 2.3.1 Fastq-Dump Multiplefiles At Once Windows Command Line
written by deepbiofever •
Did you try using a for loop already?
no, post an example, pls
What did you try already?
use GNU parallel
Gnu Parallel - Parallelize Serial Command Line Programs Without Changing Them
No, that is not recommended for this type of job! As fastq-dump is mainly a downloader, the limiting factor is mostly network bandwidth and IO. Unless you have a much larger bandwidth on your side than NCBI's load balancer is willing to assign to your ip for each connection, it is most likely to be slower with so many connections. It depends on how their load balancing is implemented but you might even be throttled or blacklisted. I would try max. 4-6 parallel downloads and monitor the network traffic.