Hello
Given Two Fasta Files(DNA)-How to remove duplicated sequences(most similar 90%-80%)? Or keep one of them at the first file. Which tools to use and how to performa that?
Best Malik
•
written
by
malik.yousef •
You can try seqkit:
seqkit rmdup --by-seq --ignore-case --md5 file1.fasta file2.fasta > clean.fasta
It's very fast!
Thanks for your reply. I cant run it as i'm using cygwin and getting the fellowing error: -bash: ./seqkit: cannot execute binary file: Exec format error
You can download the Windows version ~~~ NO ANY dependencies
seqkit_windows_386.exe.tar.gz or seqkit_windows_amd64.exe.tar.gz
Ok i have it in Windows and its ok. Still i prefer to run it in CygWin...What i should do?
Well, it seems that golang could not compile cygwin executable binaries. Both linux and windows, mac os x are supported, but cygwin :(
ok..so this SeqKit rmdup -remove duplicated sequences..how to remove sequences with similarity of let say 90% and above?
dedupe.sh from BBmap. Can be as simple as: dedupe.sh in=<file or stdin> out=<file or stdout>
Description: Accepts one or more files containing sets of sequences (reads or scaffolds). Removes duplicate sequences, which may be specified to be exact matches, subsequences, or sequences within some percent identity. Can also find overlapping sequences and group them into clusters.
Log in to answer this question.
