23 Jun
2008
23 Jun
'08
5:24 a.m.
If you do end up using rsync for something like this via ssh, you might want to look at some of the Pittsburgh Supercomputing Center's patches. The high-performance patches can allow you to see dramatic increases in throughput.
Or, if it's over a secure network, drop ssh entirely and use the rsync protocol.
--Erek