This is a test version of Biostars. For the public version, visit https://www.biostars.org.
Large file download

Hi everyone,

I need to download a large file (~40Gb) from this online repository (https://data.goettingen-research-online.de/dataverse/gro) which, unfortunately, has some sort of timeout setting that interrupts the connection after 15 minutes.

I already tried to exploit wget in order to re-start the download but it is not working.

Do you have any suggestion on how to proceed in similar situations?

Thank you!

Mattia

bash

1 answer

wget has a --continue flag and this should work unless the URL changes upon retry.

Alternatively, you could use curl with the -C flag so it resumes automatically.

Log in to answer this question.