File migrations, archivals, and age-outs in tiered storage

Question

[Jeremy Leipzig]

What do you use to automatically archive and "age-out" old files from fast expensive disks to slower cheaper ones?

Yes I could post this to serverfault but they tend to get cranky over general questions

Answer 1

[h.mon]

Nowadays I do this manually as I do not take care of huge amounts of data, but when I did it was a cron job with a "find files older than" on specific folders, coupled with an rsync, and fastq files were (re-)compacted with Quip, if I remember well (could be other compression algorithm). It wasn't very elaborate nor elegant, but did the job - the number of users and amount of data wasn't that impressive, anyway.