22 Jun
2008
22 Jun
'08
3:27 a.m.
On Sat, 2008-06-21 at 09:33 -0400, Mag Gam wrote:
I need to copy over 100TB of data from one server to another via network. What is the best option to do this? I am planning to use rsync but is there a better tool or better way of doing this?
At gigabit speeds, you're looking at over a week of transfer time: 1 gigabit = 125MB/sec = 800,000 seconds = 9.25 days, not counting protocol overhead. You could speed this up with link bonding, which from previous threads sounds like something you're working on already.
If it's a oneoff transfer and you can afford downtime while you're fiddling with hardware, you may consider directly attaching both sets of storage to the same machine and doing a local copy.