[CentOS] rsync optimization

[xufengnju]

We are now doing on the work to reduce the amount of images that would be compared before rsync many of which maybe aready exist on the receiving end.
After we do a successful rsync, we log the images transfered, and we use another script to delete them on the send end. And that turns out to be helpful in this case.



2010-01-12 



xufengnju 



发件人： Kwan Lowe 
发送时间： 2010-01-11  21:14:58 
收件人： CentOS mailing list 
抄送： 
主题： Re: [CentOS] rsync optimization 
 
On Mon, Jan 11, 2010 at 4:36 AM, xufengnju <xufengnju at sina.com> wrote:
> Hi,
>
> We currently have upload servers in one data center(A), and users upload the
> images there. We have storage server in another data center(B). When users
> upload many images at the same time, we face sync difficulties.
>
> On B, we use rsync in server mode, with authentication.
> On A, we use  `rsync -azpogtRv --safe-links 1/
> rsync://user@serverB/img/ --password-file=/var/www/r.passwd `
>
> Both ends run centos 5.3 X86_64.
>
> Any suggestions to optimize rsync in this case?
You can add the following options:
--ignore-times
--delay-updates
The first will speed up the comparison. The second can prevent some
errors related to synchronization on the receiving side.
BTW, have you considered using a DRBD volume with GFS?  This might
work better than rsync, depending on your configuration.
_______________________________________________
CentOS mailing list
CentOS at centos.org
http://lists.centos.org/mailman/listinfo/centos
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.centos.org/pipermail/centos/attachments/20100112/01d8faf6/attachment.html>