This is a test version of Biostars. For the public version, visit https://www.biostars.org.
how to speed up snakemake workflow

Dear guys,

Are there ways to speed up the snakemake rnaseq workflow? After 4h running, still in the install package status...

Thanks a lot!strong text

Downloading and installing remote packages.
Environment for https://github.com/snakemake/snakemake-wrappers/raw/0.77.0/bio/star/index/environment.yaml created (location: .snakemake/conda/ac8f19afa7afaa9828ae54d2d1e62573_)
Creating conda environment https://github.com/snakemake-workflows/rna-seq-star-deseq2/raw/v1.2.0/workflow/envs/gffutils.yaml...
Downloading and installing remote packages.
Environment for https://github.com/snakemake-workflows/rna-seq-star-deseq2/raw/v1.2.0/workflow/envs/gffutils.yaml created (location: .snakemake/conda/533adc3d3517303afab58bc67cbde5fe_)
Creating conda environment https://github.com/snakemake-workflows/rna-seq-star-deseq2/raw/v1.2.0/workflow/envs/rseqc.yaml...
Downloading and installing remote packages.
Environment for https://github.com/snakemake-workflows/rna-seq-star-deseq2/raw/v1.2.0/workflow/envs/rseqc.yaml created (location: .snakemake/conda/ad4d7671d9f68682c910f27087482a51_)
Creating conda environment https://github.com/snakemake-workflows/rna-seq-star-deseq2/raw/v1.2.0/workflow/envs/deseq2.yaml...
Downloading and installing remote packages.
workflow rna-seq snakemake

Thanks a lot! Bless!

2 answers

Make a container once, use that. It’s more reproducible anyway since all dependencies and the OS is pinned.

Thanks a lot! Best!

consider also whether Docker or Singularity might be an option for you. what is your expected usage and what type of environment?

Thanks a lot!

Yeah, Docker and Singularity would be good options. Trying to make the analysis pipeline easier/reproducible to use on the HPC, say, just prepare the samplesheet.csv and units.csv files, then submit the job, and maybe after the time of a cup of coffee, all the results are ready for download and summarize.

Log in to answer this question.