[CentOS] recommendations for copying large filesystems

Matt Morgan minxmertzmomo at gmail.com
Sat Jun 21 21:44:33 UTC 2008


On Sat, Jun 21, 2008 at 5:12 PM, nightduke <nightduke2005 at gmail.com> wrote:

> Can add fiber network card to each server? fiber switch? if not try to
> plugin to each server giga ethernet card.... put a crossover cable and
> start rsync... i did that with 1tb of photos and takes a lot of
> time....keep power supply working and cross the fingers....
>
> I hope this can help
>
> 2008/6/21 John R Pierce <pierce at hogranch.com>:
> > Mag Gam wrote:
> >>
> >> Network is a 10/100
> >> 1 million large files
> >> No SAN, JBOD
> >
> > assuming 100baseT wire speed of about 10Mbyte/sec, moving 100TB will take
> a
> > minimum of 100TB/10MB/s = 10,000,000 seconds or 2900 hours, or about 4
> > months.   even on a gigE network, this would still take about 2 weeks or
> > more.
>

Then if you get the network sorted out, the fastest & most reliable way I
know to copy lots of files is

star --copy

You can get star with

yum install star

--Matt
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.centos.org/pipermail/centos/attachments/20080621/7e63dd97/attachment.htm


More information about the CentOS mailing list