Hi,
I've been trying to run kissplice on my institution's cluster. I run the following script:
kissplice -t 6 -s 1 -k 51 -v -o kiss_results3 --experimental --max-memory 60000 -r ............
and get a '179971 Bus error', suggesting a memory issue. I've also tried running without --max-memory flag (to let memory be unlimited), but get this error:
Problem with /nesi/nobackup/nesi00431/miniconda_envs/kisspl/libexec/kissplice/ks_debruijn4
Here is the log output for the second script (I've removed path and file info with xxx):
This is KisSplice, version 2.4.0-p1 ~ The command line was:
xxxx/miniconda_envs/kisspl/bin/kissplice -t 6 -s 1 -k 51 -v -o kiss_results3 --experimental -r xxxx Using the read files: xxxx Results will be stored in: /scale_wlg_nobackup/filesets/nobackup/nesi00431/kiss_results3 Summary log file will be saved in: /scale_wlg_nobackup/filesets/nobackup/nesi00431/kiss_results3/kissplice_log_summary_21-47-53_17-12-2018_231354[21:47:53 17/12/2018] --> Building de Bruijn graph... Graph will be written in kiss_results3/graph_F22merged_trimmedQ20_R1_F22merged_trimmedQ20_R2_F24merged_trimmedQ20_R1_F24merged_trimmedQ20_R2_F25merged_trimmedQ20_R1_F25merged_trimmedQ20_R2_F26merged_trimmedQ20_R1_F26merged_trimmedQ20_R2_F29mergek51.[edges/nodes]
We can successfully run the program with 2 data files, suggesting its a memory issue. I have a large-ish dataset of 14 total data files, of about 600MB each.
Any help would be greatly appreciated.
1 answer
Dear Erica,
The log shows that KisSplice failed when building the de Bruijn graph. Such errors are usually memory-related, but since this is the first time we have this specific error, we can't be sure. Your output also shows that KisSplice used 47.3 Gb of RAM before crashing. KisSplice failing with the 247 exit code is new for us, so it is a little bit cryptic to debug since we can't replicate the issue. Are you using some kind of container or environment? Although the cluster has fairly substantial memory available, is it possible that KisSplice is going over the allowed maximum memory for your process? I found an user with the same exit code as you when using GATK: https://gatkforums.broadinstitute.org/gatk/discussion/10420/getbayesianhetcoverage-exits-with-code-247 in a Docker container , so I am wondering if this could also be your problem. Would it be possible for you to run KisSplice with ~150 Gb of available RAM to check if this is the issue?
Kind regards.
Log in to answer this question.
Dear Erica,
to check if it is a memory error, could you please paste the output of the following commands.
To retrieve the amount of memory in your machine:
To get the maximum resident set size used by a command:
Where
<your_command>is your KisSplice command. After<your_command>finishes executing,time --verbosewill output some log information that might help us debug. As a concrete example, we need the information that looks like this:Thanks for the report!
Kind regards.
May thanks for the response.
We're running this on a national computing cluster, with fairly substantial memory available. The most we've tried allocating thus far was 105GB and 36 cores. This ran but stopped without reporting an obvious error. However, I see this error buried in the output:
Any insights into the problem would be greatly appreciated.
Thanks again for the quick response. Happy to say we were able to run KisSplice to completion by installing on a different server. Seems likely something in the configuration of the previous server may have interfered with memory allocation at some stage, despite requesting sufficient memory in the script.
Thanks again.
Hello,
happy to hear it worked out for you!
Kind regards.