This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Error in downloading scRNA data from ENA with wget

Hello,

I am trying to download some data from my cluster using sbatch. My script is (using Bash on Mac M1 Big Sur),

#!/bin/sh
#SBATCH --job-name=sample10
#SBATCH --nodes=2
#SBATCH --ntasks=48
#SBATCH --time=02:00:00
#SBATCH --error=sample10.err
wget ftp://ftp.sra.ebi.ac.uk/vol1/run/SRR136/SRR13644609/possorted_genome_bam10.bam.1

However, when I run sbatch sample10.sh, my error file has multiple repeats of the following error:

--2022-06-25 10:53:49--  ftp://ftp.sra.ebi.ac.uk/vol1/run/SRR136/SRR13644609/possorted_genome_bam10.bam.1
  (try: 2) => ‘possorted_genome_bam10.bam.1’
Connecting to ftp.sra.ebi.ac.uk (ftp.sra.ebi.ac.uk)|... connected.
Error in server response. Closing.
Retrying.

I thought this might mean something is wrong with the wget function. However, if I use wget ftp://ftp.sra.ebi.ac.uk/vol1/run/SRR136/SRR13644609/possorted_genome_bam10.bam.1 by itself on Terminal, everything works properly.

However, if something was wrong with my slurm commands, then the job itself wouldn't proceed to the wget line, right?

Has anyone encountered anything like this?

scrna
• 1,279 views • link
updated by GenoMax GenoMax • written by Aryan • Aryan

1 answer

Probably nothing wrong. Looks like a configuration restriction on your local cluster. Your job gets submitted to a worker node. Job is then able to connect to the FTP site but then the connection gets broken. Perhaps the worker nodes are not allowed to use FTP.

• 0 views • link
written by GenoMax GenoMax

Log in to answer this question.

More posts like this