This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Merging multiple tsv files

Hi!

i have a multiple tsv files, do you have any methods to merge them in a single file with only header ?

genome sequencing next-gen
• 9,266 views • link
updated by tothepoint tothepoint • written by Nobody • Nobody

hard to know what exactly you have and what you want, you can use cat to concatenate files

• 0 views • link
written by JC JC 
head -n 1 file1.txt > merged.txt
for F in file*.txt ; do tail -n +2 ${F} >> merged.txt ; done

or if your header is at the top after a sort

cat file*.txt |sort | uniq > merged.txt

• 0 views • link
written by Pierre Lindenbaum Pierre Lindenbaum

i want to do it with python

• 0 views • link
written by Nobody • Nobody

if you need to merged them (column-wise , we don't have enough info to figure that out), have a look at the linux paste command

• 0 views • link
written by lieven.sterck lieven.sterck

it works with python ?

• 0 views • link
written by Nobody • Nobody

1 answer

I think this will work for you. Python code to merge tsv files in to one with only header.

#merge_tsv_files
from glob import glob

filename = 'merge.tsv'

with open(filename, 'a') as singleFile:
    first_tsv = True
    for tsv in glob('*.tsv'):
        if tsv == filename:
            pass
        else:
            header = True
            for line in open(tsv, 'r'):
                if first_tsv and header:
                    singleFile.write(line)
                    first_tsv = False
                    header = False
                elif header:
                    header = False
                else:
                    singleFile.write(line)
    singleFile.close()
• 0 views • link
written by tothepoint tothepoint

thank you so much this is what i wanted to do exactly

• 0 views • link
written by Nobody • Nobody

Log in to answer this question.

More posts like this