This is a test version of Biostars. For the public version, visit https://www.biostars.org.
subsample fasta to certain size

Hi there,

Can anyone suggest a tool or method to extract random 10GB reads with minimum read length of (1000bp) from a huge 100 Gb file.

I have 50 different fa.gz files with varying size (20 -100GB) and I like to subsample fasta with 10gb size each.

Thanks

Best
sam

fasta sequence
• 1,951 views • link
updated by Ram Ram • written by Sam • Sam

sampling 100 Gb file takes long time and requires enough computational resources. You can use seqkit to random sample fasta files. use -m and -M options depending on your requirements. Use two pass and threads.

• 0 views • link
written by cpad0112 cpad0112

1 answer

reformat.sh from the BBTools package can do that.

reformat.sh in=in.fq out=out.fq samplereadstarget=5000000

Instead of specifying the exact number of reads (5 million above), you can use a fraction (samplerate=0.2).

Not sure that random subsampling is a good idea, especially if you have a metagenome and some MAGs may be in low abundance. A longer way to do this, but I think also better, is by digital normalization as implemented in khmer.

PS Never mind my khmer suggestion - I just realized that you have fasta files.

• 0 views • link
written by Mensur Dlakic Mensur Dlakic

Log in to answer this question.

More posts like this