This is a test version of Biostars. For the public version, visit https://www.biostars.org.
transfer data from cluster to cluster

Heys,

I'm working with two ssh clusters and I want to transfer some data from one to another. I could download it to my pc and then to the other cluster, but is more than 100 GB and I imagined there would be an easy way to transfer the data between both clusters.

I've been trying to look for info in internet, but I didn't fully got it. If anybody could help me would be great!

Thanks in advance!

cluster data
• 1,927 views • link
written by gubrins gubrins

2 answers

Anything wrong with just rsync it from A to B directly?

Something like this, assuming only the files to be transferred were in the current directory on the source cluster:

rsync --progress ./* username@servername:/path/to/destination
• 0 views • link
written by ATpoint ATpoint

Thank you very much! Your advice worked and was really useful to me! I appreciate it a lo!

• 0 views • link
written by gubrins gubrins

thanks for your answer too! I used ATpoint's advice but this post explains something similar, thanks!

• 0 views • link
written by gubrins gubrins

Log in to answer this question.

More posts like this
  • Problem creating new conda environment
    written by gubrins gubrins
    Heys, So I am trying to install a new conda environment with an .yml file but I encountered this error: ``` ResolvePackageNotFound: - r-base==3.2.2=0 ``` …
  • Decontamination of genome assembly
    written by gubrins gubrins
    Heys, I am starting to work on the world of genome assembly and I was wondering if you could recommend me any software to decontaminate …
  • change name several files
    written by gubrins gubrins
    Heys, I'm trying to change a specific part of several files I have but I'm not accomplishing it. I looked for it in the internet …
  • Introgression analyses
    written by gubrins gubrins
    Heys, I'm working with whole-genome data of several non-model species and I'm studying the introgression patterns with Dsuite software (https://github.com/millanek/Dsuite). I have several samples per …
  • Genome-wide heterozygosity
    written by gubrins gubrins
    Heys, I want to calculate genome-wide heterozygosity for a couple of samples I have. I have been looking in internet but I just find theoretical …
  • GNU plot problem
    written by gubrins gubrins
    Heys, I'm trying to create a PSMC plot (https://github.com/lh3/psmc). However, when I run this command `utils/psmc_plot.pl diploid diploid.psmc` I get this error message: Can't find …
  • How much weights a million reads
    written by gubrins gubrins
    Heys, I have a quick question: I was wondering how much weights a million Illumina reads of let's say 100 bp long in Gb. May …
  • Convert vcf to eigenstrat
    written by gubrins gubrins
    Heys, I'm working on population genomics and I would like to convert my vcf file to eigenstrat. I've been looking for internet but I did …
  • genome coverage visualization
    written by gubrins gubrins
    Heys, I'm working with whole-genome sequencing data and I already did the alignment and I have my bam files. I calculated the coverage per genome …
  • comparing softwares for trimming adaptors
    written by gubrins gubrins
    Heys, I'm working with WGS data and after running the fastqc I detected that my samples still have adapters. I succesfully removed them with AdapterRemoval …