Thank you for your comments. Very helpful.
samtools sort has a -T option to define a temporary directory for these files. Does the laptop has enough free space on the internal disk to at least take these tmp files during the sort? It will automatically be removed once sorting is done.
I do have the space for this! definitely adding the -T option.
Does your institution not provide any sort of computational solutions for this, like server or HPC access? Larger data require some computational power. Imagine you find out that you missed a parameter in the pipeline, do you want to wait 2 weeks again for the re-run?
Just starting out with bioinformatics at a command-line level, had previously worked with bioinformaticians on projects at a high/conceptual level. Trying to add it to my skill set, taking classes in my personal time, etc. If I can show theres value add, I get resources for cloud compute. Learned a lesson here for sure.
That having said, why do you need it sorted?
Was told I needed it for use in a genome browser like seqmonk. Need to do more reading.
Are you aware that bowtie2 is not splice-aware, and do you work with eukaryotes?
Yes and yes. Was told not to worry about splicing for this run, for a few reasons... but, I will absolutely be switching to a splice-aware aligner in the future. STAR seems highly rated, but I've read RUM is also excellent.
Still very new to this and brute-forcing my way through learning. Seriously appreciate the comments.
If you aren't committed to using bowtie2 for alignment, use STAR. It's likely faster for alignment, and can directly write a sorted bam file.
It still does sorting and once memory is full it has to out the files somewhere. I cannot imagine that this would be any different. STAR is splice-aware though and generally a great aligner for RNA-seq so using it is generally a good idea.
This is not clear. I strongly encourage blizard.wizard to use STAR, after all it's a single command as opposed to the bowtie2/samtools -> sam -> bam -> sort pipeline. If blizard.wizard can afford to write everything locally first and move after this might be much faster (only one way to find out). In any case, blizard.wizard should downsize fastq files to test a pipeline before running on everything.