This is a test version of Biostars. For the public version, visit https://www.biostars.org.
How to remove duplicate reads after ONT basecalling from fastq.gz files

Hi

I ran into an error when my PC was halfway through basecalling, it errored on a fast5 file - number 577. I restarted basecalling from 578, and then when finished I basecalled 577 on its own. It looks like originally it failed after processing about 1000 reads. I can create a text file with a list of read IDs that were completed the first time, but I need something to search through the fastq.gz files for read IDs in that list and remove them. Does anyone know how I can do that?

Thanks.

fastq

1 answer

You should be able to use filterbyname.sh from BBTools. Provide it with the names of reads you want to filter.

Log in to answer this question.