[CentOS] error rsyncing large file

Wed Jan 20 21:19:28 UTC 2010
Kwan Lowe <kwan.lowe at gmail.com>

On Wed, Jan 20, 2010 at 1:01 PM, Joseph L. Casale
<jcasale at activenetwerx.com> wrote:
> Trying to rsync a rather large file from a windows server to a centos server
> and all but this is working fine.
>
> As it's a 20 gig file I am trying to send the diff of with a -c, I suspect over
> the low bandwidth this presents an issue. I also stage this file locally on another
> centos server and could calc the diff and create a patch and send that, comparing
> checksums etc...
>
> A quick look at bsdiff and bspatch and the mem requirements on my 20 gig file make
> that solution rather not acceptable.
>
> Anyone know a better solution to accomplish this?
>
I had to do a similar thing across a satellite link. I ended up
splitting the files into 500M segments then rsyncing those. When
completed, I ssh'ed into the remote and rejoined then checksummed.