On Tue, Nov 5, 2013 at 1:28 PM, m.roth@5-cent.us wrote:
As I noted, we make sure rsync uses hard links... but we have a good number of individual people and projects with who *each* have a good number of terabytes of data and generated data. Some of our 2TB drives are over 90% full, and then there's the honkin' huge RAID, and at least one 14TB partition is over 9TB full....
If you have database dumps or big text files that aren't compressed, backuppc could be a big win. I think it is the only thing that can keep a compressed copy on the server side and work directly with a stock rsync and uncompressed files on the target hosts (and it can cache the block-checksums so it doesn't have to uncompress and recompute them every run). While it is 'just a perl script' it's not quite what you expect from simple scripting...