This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Chia-pipe cannot find the module pigz

Hi All,

I am using Chia-pipe to run chia-pet (cell line) data. I followed the installation process and modified the config file to run the tool. All the modules (pigz,perl,java,samtools,bedtools) are also installed in the chia-pipe folder. However, the program terminates with the following error:

Such error is repeated for all the modules mentioned in the config file:

Lmod has detected the following error: The following module(s) are unknown:
"pigz"

Please check the spelling or version number. Also try "module spider ..."
It is also possible your cache file is out-of-date; it may help to try:
  $ module --ignore-cache load "pigz"

Also make sure that all modulefiles written in TCL start with the string
#%Module

I also get the following errors:

/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 208: pigz: command not found
/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 307: pigz: command not found
/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 406: pigz: command not found
mv: cannot stat ‘rep1.e500.clusters.cis.chiasig.gz’: No such file or directory
mv: cannot stat ‘rep1.e500.clusters.trans.chiasig.gz’: No such file or directory
gzip: rep1.e500.clusters.cis.gz: No such file or directory
Can't open input bam file rep1.singlelinker.paired.UU.nr.bam
/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 498: java: command not found
/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 528: samtools: command not found
/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 530: samtools: command not found
/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 532: samtools: command not found
/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 535: samtools: command not found
/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 541: samtools: command not found
[E::hts_open_format_impl] Failed to open file rep1.for.BROWSER.bam
Failed to open BAM file rep1.for.BROWSER.bam
needLargeMem: trying to allocate 0 bytes (limit: 100000000000)
ls: cannot access rep1.singlelinker.paired.*.bam: No such file or directory
Traceback (most recent call last):
  File "/WGS_tools/ChIA-PIPE/util/scripts/annotate_loops_with_peak_support.py", line 2, in <module>
    import commands
ModuleNotFoundError: No module named 'commands'

It seems that the tool is not able to find the modules/tools from the config file, however I have mentioned the path. Any help for resolving this issue would be great. Thanks!

next-gen chip-seq chia-pet
• 3,236 views • link
updated by Ram Ram • written by bioinfo89 • bioinfo89

This appears to be case of $PATH not correctly set to account for the location of the programs you mention.

That said what do you mean by all the modules are present? modules is a software program that is used for managing version of programs on larger compute servers/clusters. Are you using that modules or something else?

• 0 views • link
written by GenoMax GenoMax

Yes, I did set the $PATH to the location of the programs.

I mean that the modules are present in the ChIA-PIPE folder as suggested by the installation guide. I am just running the shell script of the tool which is using these modules:

### 5) Uncomment below to module load dependencies
 module --ignore-cache load "pigz"
 module --ignore-cache load "java/1.7.0"
 module --ignore-cache load "perl/5.26.0"
 module --ignore-cache load "bedtools/2.26.0"
 module --ignore-cache load "samtools/1.5"
 module --ignore-cache load "R/3.2.1"
 module --ignore-cache load "MACS/2.1.0.20151222"

The above mentioned lines are provided in the config file which I am running.

• 0 views • link
written by bioinfo89 • bioinfo89

Can you check the contents of echo $PATH and verify that all program directories appear there? It would help to confirm with which samtools, which pigz (you get the idea) once you verify $PATH.

• 0 views • link
written by GenoMax GenoMax 
 echo $PATH
/opt/ohpc/pub/mpi/openmpi3-gnu8/3.1.4/bin:/opt/ohpc/pub/compiler/gcc/8.3.0/bin:/opt/ohpc/pub/utils/prun/1.3:/opt/ohpc/pub/utils/autotools/bin:/opt/ohpc/pub/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/krc190002/scratch/WGS_tools/bedtools2/bin:/home/krc190002/scratch/WGS_tools/root/bin:/home/krc190002/.local/bin:/home/krc190002/bin:/scratch/krc190002/WGS_tools/ChIA-PIPE/pigz:/scratch/krc190002/WGS_tools/ChIA-PIPE/bedtools:/scratch/krc190002/WGS_tools/ChIA-PIPE/samtools:/scratch/krc190002/WGS_tools/ChIA-PIPE/macs2:/scratch/krc190002/WGS_tools/ChIA-PIPE/java:/scratch/krc190002/WGS_tools/ChIA-PIPE/R-3.2.1/bin/:/scratch/krc190002/WGS_tools/ChIA-PIPE/bin/perl:/scratch/krc190002/WGS_tools/ChIA-PIPE/jre/bin/java

which samtools
/usr/bin/which: no samtools in (echo $PATH)

which pigz
 /usr/bin/pigz

which java
/usr/bin/java

which perl
/usr/bin/perl

which macs2
/usr/bin/which: no macs2 in (echo $PATH)

which bedtools
~/scratch/WGS_tools/bedtools2/bin/bedtools

It looks like only bedtools path is correct. Though the $PATH includes other tools, it does not match with which command output. What should I do to resolve this?

• 0 views • link
written by bioinfo89 • bioinfo89

Even if you set $PATH to point to your local directories it looks like the system installed programs (that are in /use/bin) are ones found by your OS.

Can you check if there are other sub-dir under /scratch/krc190002/WGS_tools/ChIA-PIPE/samtools that contain the actual executable? You may need to add that full path added (e.g. /scratch/krc190002/WGS_tools/ChIA-PIPE/samtools/bin).

• 0 views • link
written by GenoMax GenoMax

Right ok. There are no sub dir under /scratch/krc190002/WGS_tools/ChIA-PIPE/samtools

• 0 views • link
written by bioinfo89 • bioinfo89

Is that the actual executable? Does it have execute permissions?

• 0 views • link
written by GenoMax GenoMax

Yes it is the actual executable and it has execute permissions.

• 0 views • link
written by bioinfo89 • bioinfo89

How are you launching the pipeline? As they show in on help page?

bash chia_pipe-master/0.chia_pipe_shell.sh -c chia_pipe-master/example_config_file.sh

If so you are starting a new bash shell which no longer has your personal $PATH settings but can still access programs that are installed in system default $PATH.

• 0 views • link
written by GenoMax GenoMax

I took a look at the config file they mention. I think the module commands are for Jackson Lab HPC. So if you are running this on a stand-alone machine they shouldn't apply.

Did the following part work without any errors?

dep_dir="dep_dir"
bash local_install_chia_pipe_dependencies.sh -i ${dep_dir}
• 0 views • link
written by GenoMax GenoMax

It did not throw any errors as such. I guess I should have mentioned the dir path for dep_dir, I think I missed that. Now it makes more sense why I am getting this error. I'll try to install it again.

Thanks @genomax!

• 0 views • link
written by bioinfo89 • bioinfo89

Hi bioinfo89

/WGS_tools/ChIA-PIPE/0.chia_pipe_shell.sh: line 208: pigz: command not found

I could also see this error in your original post; were you able to resolve this?

• 0 views • link
written by lakhujanivijay lakhujanivijay

0 answers

No answers yet.

Log in to answer this question.

More posts like this
  • Problems running discoSnp++ sample example
    written by tsi.insilico • tsi.insilico
    Hello all, I downloaded discoSnp++ on ubuntu 22 -04 running on oracle vm.I downloaded and extracted the linux binaries from the releases tab on github …
  • ImportError: No module named xgboos
    written by Neel • Neel
    Hi, i am trying to run mic_prediction (https://github.com/PATRIC3/mic_prediction) tool and i also follow their manual still i am getting this error. If anyone know please …
  • Stampy make fails
    written by shpak.max • shpak.max
    I obtained the most recent version of Stampy from github, and makefile execution fails. Specifically, as instructed I ran make python=python2.7 because the default python …
  • Error in pan-genome-analysis tool panX.
    written by Kumar Kumar
    I have been using `panX` tool for pan-genome analysis (My computer info: Ubuntu 16.04 LTS, 64 bit version). I followed the instructions mentioned in the …
  • FastUniq ./Makefile gcc error
    written by SheRa • SheRa
    Hello, I have a MacOS Catalina - 10.15.4. Yesterday I downloaded Macports (latest version), gcc compiler (v5.5) and $gcc -v gave me the right version. …
  • ChIA-PET2: Error: Don't have enough confident interactions to learn the model.
    written by bioinfo89 • bioinfo89
    Hi All, I am currently getting the following error when I use ChIA-PET2: Running MICC... Intra data: ChIAPET_rawdata/rep1_ChIAPET.interactions.intra.bedpe Inter data: ChIAPET_rawdata/rep1_ChIAPET.interactions.inter.bedpe Output file: ChIAPET_rawdata/rep1_ChIAPET.interactions.MICC PET …
  • Pindel installation failing due to htslib
    written by cdastmalchi • cdastmalchi
    I have made the following Dockerfile to install pindel: # Use Python base image from DockerHub FROM python:2.7 RUN apt-get update && apt-get install -y …
  • How to quantify the RNA-seq reads using Kallisto?
    written by Farah Farah
    Hello, I am running Kallisto (for three paired files) as below. However, I got the following Errors: mkdir /scratch/fs/ye/kallisto cd /scratch/fs/ye/kallisto find /scratch/fs/ye/trimmomatic -name "*trimmomatic_[12].fq.gz" …
  • Getting error in running rMATS
    written by Reza • Reza
    Hi everyone, I'm trying to run rMATS to get alternative splicing but encountered some errors. Errors found: ========== Done processing each gene from dictionary to …
  • Tba- Multiz Problem
    written by vasilislenis vasilislenis
    Hello everybody, I have a problem with multiz and please I need your help. I am trying to make a multiple alignment among 20 bird …