This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Busco on genomes using slurm

Hello,

I have been attempting to run BUSCO on genomes using SBATCH, which is done offline. I keep running into the issue that larger genomes (mammals) get stuck at the metaeuk step and does not proceed. I have tried the following:

  1. Run bacterial genome which worked.
  2. Took a partial portion of the mammal genome (koala) and it ran successfully giving an output.

however, when i run the whole mammal genome which is about 2GB in size, it shows:

2022-11-10 12:50:59 INFO: Running 1 job(s) on metaeuk, starting at 11/10/2022 12:50:59

slurmstepd: error: JOB 71 CANCELLED AT 2022-11-10T13:50:30 DUE TO TIME LIMIT ***

My slurm script: (that worked for the partial genome of 200MB but doesn't for the whole genome of 2GB)

#!/bin/bash
#SBATCH --account=nn****k 
#SBATCH --job-name=Busco_mam
#SBATCH --time=2:0:0
#SBATCH --mem-per-cpu=10G
#SBATCH --ntasks=16 --cpus-per-task=4 --ntasks-per-node=4

set -o errexit  # Exit the script on any error
set -o nounset  # Treat any unset variables as an error
module --quiet purge  # Reset the modules to the system default

module load BUSCO/5.4.3-foss-2021b

cd /cluster/projects/nn****k/Busco_genomes/mammal_genomes

busco -i koala_genome.fa -l mammalia_odb10 -o ../koala_busco_output -m genome -c 24 --offline  --download_path  /cluster/projects/nn****k/Busco_genomes/busco_downloads

I am new to using clusters and slurm, i apologise if it is a trivial issue. Any advice would be appreciated. Thank you in advance!

metaeuk busco genome saga slurm

1 answer

Error is cleary noted.

slurmstepd: error: JOB 71 CANCELLED AT 2022-11-10T13:50:30 DUE TO TIME LIMIT ***

Please increase the time you are asking for the job by changing this line in your script (currently the job runs for 2 hr)

#SBATCH --time=2:0:0

If you are allowed say 2 days then the command will become

#SBATCH --time=2-0

Thank you for your response! I will try that, however, the aim is to ultimately run more such genomes as a batch. In that case, it might be necessary to specify too many days for them to successfully complete? Would there be a faster way?

Simply submit individual jobs like this for each genome so they run in parallel. Depending on resources your account is allowed to use some may run right away others may pend but will run in sequence as first jobs finish.

Okay, I see. Thank you so much:)

Log in to answer this question.