This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Remove lines if duplicated values in column 1 has specific condition for column 2

Hi Community,

I have a multi-column file, but here I am mentioning just two columns:

Contig0.100010-snap.2                                   93.4065934066
Contig0.100014-snap.1                                   67.3611111111
Contig0.100025-snap.1                                   72.9411764706
Contig0.100025-snap.1                                   74.1176470588
Contig0.100025-snap.1                                   82.3529411765
Contig0.100051-snap.1                                   95

Column one has three duplicated values, that is, Contig0.100025-snap.1. So, I want that if column one has duplicated values, remove those line in which the corresponding values in column 2 are smaller. My desired output would be:

Contig0.100010-snap.2                                   93.4065934066
Contig0.100014-snap.1                                   67.3611111111
Contig0.100025-snap.1                                   82.35229411765
Contig0.100051-snap.1                                   95

Any unix sed awk etc or help from excel???

Thanks,

Waqas.

snp sequence alignment blast
• 3,479 views • link
updated by Sej Modha Sej Modha • written by waqasnayab waqasnayab 
datamash -g 1 min 2 <input.txt

columns are tab separated. Datamash is gnu tool and is available in most of the linux distro repos.

• 0 views • link
written by cpad0112 cpad0112

1 answer

Simple bash sort solution:

 sort -k1,1 -k2,2nr test_file | sort -u -k1,1
• 0 views • link
written by Sej Modha Sej Modha

GREAT Thanks, it worked perfectly for me,

Regards,

Waqas.

• 0 views • link
written by waqasnayab waqasnayab

Log in to answer this question.

More posts like this