Entering edit mode
5.4 years ago
rrbutleriii
▴
260
For reasons outside my control, I have to fetch fastq files from sra on a Windows computer. Currently I have a list of SRRs in a file, and a batch cmd file:
for /F "tokens=*" %%X in (SRR_Acc_List.txt) do (
prefetch %%X && vdb-validate %%X && fastq-dump [options] %%X
)
Which works I think, but I don't know if it will prevent the fastq-dump command if the vdb-validate function says the sra is corrupt. Does anyone know the exit status of vdb-validate when it completes but the validation failed?
If you have to fetch fastq files then it would be much better to do so by getting them from EBI-ENA.
Wouldn't you believe the silliness of the situation, this machine also only has Internet Explorer, and won't allow java (or aspera connect). I would batch query the fastq files via ftp, but I want to verify file integrity after download using vdb-validate, as I had heard of incomplete transfers of fastq files resulting in corrupted data. Is there a way to obtain checksums on the fastqs?
Have you considered downloading on a different machine and then moving the data to this one, if you must use it?
Indeed I have. This gets deep into the weeds of our institutional politics (of the type that would make Kafka blush). The short of it is this the actual server is airgapped, and virtual machine with internet access for the purposes of shuttling data is this one (a Win Server 2008 R2 OS, with heavily restricted privileges). I could daisy chain across three computers, but this does the trick, I just don't see the status of the vdb-validate if query a large batch.
Oh, and properly filled out request for service paperwork submitted to the appropriate group will sit in an inbox for three months before returning the response 'What is the NCBI?'. Meditation is important here :)