This is a test version of Biostars. For the public version, visit https://www.biostars.org.
how to remove rows based on certain characters

Dear all ,

I have a file over 30000 rows (\t as the space), I want to remove some based on certain characters:

for example:

Name    Len Name2   Order

KCNQ2_32937 2535    KCNQ2   32937

KCNQ2_32938 2733    KCNQ2   32938

KCNQ2_32939 2616    KCNQ2   32939

KCNQ2_32940 2544    KCNQ2   32940

KCNQ2_32941 1809    KCNQ2   32941

.
.
.

the filter is like this:

In Name2 column, if the name of each cell is the same, I want keep the largest one in Len column:

Name    Len Name2   Order

KCNQ2_32938 2733    KCNQ2   32938

...

How can I do it like this?

TJ

r
• 1,882 views • link
updated by 5heikki 5heikki • written by zqwu • zqwu

2 answers

sort column 3 and then column 2 (reverse number) , followed by a stable sort/uniq on column 3

sort -t $'\t ' -k3,3 -k2,2rn input.tsv | sort -t $'\t ' -k3,3 -u --stable
• 0 views • link
written by Pierre Lindenbaum Pierre Lindenbaum

thanks. It is fast and exactly what I need.

• 0 views • link
written by zqwu • zqwu

If this answer solved your problem then go ahead and "accept" (green check mark). @5heikki's answer which appears to have been written almost at the same time may also be fine and can be accepted in addition to @Pierre's.

• 0 views • link
written by GenoMax GenoMax 
sort -t $'\t' -k3,3 -k2,2gr file | sort -t $'\t' -u -k3,3

Also: man sort

• 0 views • link
written by 5heikki 5heikki

Log in to answer this question.

More posts like this

No similar posts found.