This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Does .sra.cache file means failed download?

I am using fastq-dump to download some files from sra. It turned that .sra files was downloaded into my home directory. So, there was a "disk quota exceeded" error, and a number of .sra.cache instead of .sra files were generated. But, the downloading is continuing. I wonder if the fastq.gz files downloaded in this case are deprecated? Thanks

sra

2 answers

The cache files are downloaded by default, see e.g. here. You can (and should IMHO) disable that, see here. In any case, using fastq-dump for download is not efficient, for a suggested workflow see my answer in this thread: Method to Check Fastq Completeness after Fastq-dump

Most data are anyway backed up at the European Nucleotide Archive, where you can download them much more efficiently and directly in fastq format. See my tutorial on that matter: Fast download of FASTQ files and metadata from the European Nucleotide Archive (ENA)

If you see .sra.cache files under SRA directory, it means your download is not complete and got interrupted for some reason. vdb-validate command will fail for the corresponding accession. See this post for downloading SRA datasets: https://reneshbedre.github.io/blog/fqutil.html

I have also met with the same problem recently: some of the fastq file generate "SRR3532923.sra.cache", and I used vdb-validate SRR3532923.sra.cache to check it, which shows:

2020-09-17T20:04:18 vdb-validate.2.10.7 info: Table 'SRR3532923.sra.cache' metadata: md5 ok
2020-09-17T20:04:18 vdb-validate.2.10.7 info: Column 'ALTREAD': checksums ok
2020-09-17T20:04:31 vdb-validate.2.10.7 info: Column 'QUALITY': checksums ok
2020-09-17T20:04:44 vdb-validate.2.10.7 info: Column 'READ': checksums ok
2020-09-17T20:04:45 vdb-validate.2.10.7 info: Column 'X': checksums ok
2020-09-17T20:04:48 vdb-validate.2.10.7 info: Column 'Y': checksums ok
2020-09-17T20:04:48 vdb-validate.2.10.7 info: Table 'SRR3532923.sra.cache' is consistent

Should I trust the download files? Thanks a lot,

Log in to answer this question.