[CentOS] recommendations for copying large filesystems

Mogens Kjaer mk at crc.dk
Mon Jun 23 05:46:30 UTC 2008


Rainer Duffner wrote:
...
> Can anybody comment on the feasibility of rsync on 1 million files?

I rsync 2.6M files daily. No problem.

It takes 15 minutes, if there's only a few changes.

For fast transfer of files between two machines
I usually use ttcp:

 From machine:

tar cf - .|ttcp -l5120 -t to_machine

To machine

cd /whatever
ttcp -l5120 -r | tar xf -

I get ~100Mbytes/sec on a gigabit connection.

Note this is unsecure, no way of restarting, etc.

Mogens

-- 
Mogens Kjaer, Carlsberg A/S, Computer Department
Gamle Carlsberg Vej 10, DK-2500 Valby, Denmark
Phone: +45 33 27 53 25, Fax: +45 33 27 47 08
Email: mk at crc.dk Homepage: http://www.crc.dk



More information about the CentOS mailing list