This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Download SRR by parallel and fastq dump with a weird problem

Here is my script

project='PRJNA1100523'

esearch -db sra -query $project | efetch -format runinfo > runinfo.csv
cat runinfo.csv | cut -d "," -f 1 > SRR.numbers
cat SRR.numbers | parallel fastq-dump --split-files --origfmt --gzip -X 1000 {}  ## just test
cat SRR.numbers | parallel fastq-dump --split-files --origfmt --gzip {}  ## download complete

I just want to download SRR files here.

In PRJNA1100523, there are only 8 SRR files and SRR ID is saved in SRR.numbers.

But when running cat SRR.numbers | parallel fastq-dump --split-files --origfmt --gzip {}, there are extra strange SRR related fastq files download in folder.

SRR28698742
SRR28698743
SRR28698744
SRR28698745
SRR28698738
SRR28698739
SRR28698740
SRR28698741

Such as SRR29377445, SRR29377574 and SRR29413198, I don not know where they come from.

I am sure these strange SRR IDs are not saved in SRR.numbers.

And I don not know where it is wrong with my script. So I hope some of you could give me some advice or solutions.

Thanks in advance.

scrna-seq linux parallel
• 2,384 views • link
written by diqixiaoyaoer • diqixiaoyaoer

3 answers

I would suggest you to use fastq-dl https://github.com/rpetit3/fastq-dl to download at project level

• 0 views • link
written by Ming Tommy Tang Ming Tommy Tang

Refer this repository SRA-tookit automation.

• 0 views • link
written by atharvakarkare14 • atharvakarkare14

Thanks a lot. I have starred it. I will also have a try.

• 0 views • link
written by diqixiaoyaoer • diqixiaoyaoer

Hey I did this on my bachelor thesis days, I used SRA-Toolkit and FastQdump (isntalled bia anaconda) and by running this script on my laptop I was able to download the list of SRR entries that I wished. You type the name of the SRR archives you want to download and when executing the bash file and they will be downloaded and transformed into fastq format. It was a bit slow but it did the job. Sorry if the coding is not very clean but it was the best I could do in my Bachelor's days.

https://github.com/Iggi-29/SRA-fastq-downloader/blob/master/getSRAfastq.sh

Please feel free to reuse the code if you need it.

• 0 views • link
written by ijarne • ijarne

I think it is cool ! I am also a bioinformatician but mainly focus on R and python data analysis.

I believe I can learn something from your script. Very grateful.

• 0 views • link
written by diqixiaoyaoer • diqixiaoyaoer

Log in to answer this question.

More posts like this