[CentOS-mirror] Flip-Floping contents at msync.centos.org::CentOS-incdvd [ Re: flip-flopping timestamp by pulling CentOS [Re: Wrong timestamp by pulling CentOS-incdvd

Tue May 19 11:44:25 UTC 2009
Serge A Krashakov <sakr at chg.ru>

Hi, everybody

I have found that msync.centos.org is flipping at least between two 
servers: 76.79.76.39 (centosq2) and 87.249.30.203 (centosb3)

ftp# rsync 76.79.76.39::CentOS/

msync.CentOS.org rsync service (centosq2)
---------------------------------------

This service is intended for the sole use of the CentOS worldwide mirror 
network
to synchronize mirrors.

Unless you are running or intending to run a listed public CentOS mirror
use a mirror listed at 
http://www.CentOS.org/modules/tinycontent/index.php?id=13

If you intend to populate a mirror for public use please read the
notes at :- http://www.CentOS.org/modules/tinycontent/index.php?id=15

If you do use this service then it is implied that you are providing a
mirror for public use and giving us authority to publicise such mirror.

drwxr-xr-x        4096 2008/09/14 02:48:21 .
lrwxr-xr-x           3 2007/07/20 20:14:17 2
lrwxr-xr-x           3 2007/07/27 01:36:05 3
lrwxr-xr-x           3 2007/07/20 20:14:17 3.1
lrwxr-xr-x           3 2007/07/20 20:14:17 3.3
lrwxr-xr-x           3 2007/07/20 20:14:17 3.4
lrwxr-xr-x           3 2007/07/20 20:14:17 3.5
lrwxr-xr-x           3 2007/07/20 20:14:17 3.6
lrwxr-xr-x           3 2007/07/20 20:14:17 3.7
lrwxr-xr-x           3 2007/10/23 03:49:21 3.8
lrwxr-xr-x           3 2008/09/14 03:00:06 4
-rw-r--r-x        2008 2005/10/13 14:43:32 HEADER.html
lrwxr-xr-x          26 2007/07/20 20:14:17 RPM-GPG-KEY-CentOS-2
-rw-r--r--        1795 2004/03/16 02:16:56 RPM-GPG-KEY-CentOS-3
lrwxr-xr-x          19 2007/07/20 20:14:17 RPM-GPG-KEY-CentOS-4
-rw-r--r--        1504 2007/02/19 20:57:47 RPM-GPG-KEY-CentOS-5
-rw-r--r--        1512 2007/02/19 20:56:17 RPM-GPG-KEY-beta
-rw-r--r--        1795 2005/02/26 20:51:45 RPM-GPG-KEY-centos4
-rw-r--r--          11 2009/05/19 15:30:01 TIME
-rw-r--r--          29 2009/05/19 15:30:01 timestamp.txt
drwxr-xr-x        4096 2005/09/16 03:34:29 2.1
drwxr-xr-x        4096 2007/07/05 01:38:51 3.9
drwxr-xr-x        4096 2005/07/19 01:11:11 4.0
drwxr-xr-x        4096 2005/10/21 21:54:07 4.1
drwxr-xr-x        4096 2006/11/04 15:43:58 4.2
drwxr-xr-x        4096 2006/11/11 01:15:15 4.3
drwxr-xr-x        4096 2007/07/07 22:21:53 4.4
drwxr-xr-x        4096 2008/01/10 19:12:02 4.5
drwxr-xr-x        4096 2009/03/31 15:55:52 4.6
drwxr-xr-x        4096 2008/09/29 03:27:57 4.7
drwxr-xr-x        4096 2008/01/10 19:11:22 5.0
drwxr-xr-x        4096 2008/07/30 01:01:22 5.1
drwxr-xr-x        4096 2008/06/19 03:34:57 5.2
drwxr-xr-x        4096 2009/03/30 17:26:40 5.3
drwxr-xr-x        4096 2009/04/01 03:54:26 5
drwxr-xr-x        4096 2005/11/25 01:28:12 HEADER.images
drwxr-xr-x        4096 2005/06/12 16:56:32 build
drwxr-xr-x        4096 2007/04/04 13:45:32 dostools
drwxr-xr-x        4096 2007/12/02 09:49:01 graphics

ftp# rsync 87.249.30.203::CentOS/

msync.CentOS.org rsync service (centosb3)
---------------------------------------

This service is intended for the sole use of the CentOS worldwide mirror 
network
to synchronize mirrors.

Unless you are running or intending to run a listed public CentOS mirror
use a mirror listed at 
http://www.CentOS.org/modules/tinycontent/index.php?id=13

If you intend to populate a mirror for public use please read the
notes at :- http://www.CentOS.org/modules/tinycontent/index.php?id=15

If you do use this service then it is implied that you are providing a
mirror for public use and giving us authority to publicise such mirror.

drwxr-xr-x        4096 2008/09/14 02:48:21 .
lrwxr-xr-x           3 2008/04/08 02:12:25 2
lrwxr-xr-x           3 2008/04/08 02:12:25 3
lrwxr-xr-x           3 2008/04/08 02:12:25 3.1
lrwxr-xr-x           3 2008/04/08 02:12:25 3.3
lrwxr-xr-x           3 2008/04/08 02:12:25 3.4
lrwxr-xr-x           3 2008/04/08 02:12:25 3.5
lrwxr-xr-x           3 2008/04/08 02:12:25 3.6
lrwxr-xr-x           3 2008/04/08 02:12:25 3.7
lrwxr-xr-x           3 2008/04/08 02:12:25 3.8
lrwxr-xr-x           3 2008/09/14 03:01:45 4
-rw-r--r-x        2008 2005/10/13 14:43:32 HEADER.html
lrwxr-xr-x          26 2008/04/08 02:12:25 RPM-GPG-KEY-CentOS-2
-rw-r--r--        1795 2004/03/16 02:16:56 RPM-GPG-KEY-CentOS-3
lrwxr-xr-x          19 2008/04/08 02:12:25 RPM-GPG-KEY-CentOS-4
-rw-r--r--        1504 2007/02/19 20:57:47 RPM-GPG-KEY-CentOS-5
-rw-r--r--        1512 2007/02/19 20:56:17 RPM-GPG-KEY-beta
-rw-r--r--        1795 2005/02/26 20:51:45 RPM-GPG-KEY-centos4
-rw-r--r--          11 2009/05/19 13:40:01 TIME
-rw-r--r--          29 2009/05/19 13:40:01 timestamp.txt
drwxr-xr-x        4096 2005/09/16 03:34:29 2.1
drwxr-xr-x        4096 2007/07/05 01:38:51 3.9
drwxr-xr-x        4096 2005/07/19 01:11:11 4.0
drwxr-xr-x        4096 2005/10/21 21:54:07 4.1
drwxr-xr-x        4096 2006/11/04 15:43:58 4.2
drwxr-xr-x        4096 2006/11/11 01:15:15 4.3
drwxr-xr-x        4096 2007/07/07 22:21:53 4.4
drwxr-xr-x        4096 2008/01/10 19:12:02 4.5
drwxr-xr-x        4096 2009/03/31 15:55:52 4.6
drwxr-xr-x        4096 2008/09/29 03:27:57 4.7
drwxr-xr-x        4096 2008/01/10 19:11:22 5.0
drwxr-xr-x        4096 2008/07/30 01:01:22 5.1
drwxr-xr-x        4096 2008/06/19 03:34:57 5.2
drwxr-xr-x        4096 2009/03/30 17:26:40 5.3
drwxr-xr-x        4096 2009/04/01 03:54:26 5
drwxr-xr-x        4096 2005/11/25 01:28:12 HEADER.images
drwxr-xr-x        4096 2005/06/12 16:56:32 build
drwxr-xr-x        4096 2007/04/04 13:45:32 dostools
drwxr-xr-x        4096 2007/12/02 09:49:01 graphics

You can see that even in the parent directory timestamp differs. I guess 
that some files differ too.

Best regards,
Serge Krashakov

Takashi Ichihara wrote:
> Hi Tru, and CentOS master mirror server Admin.
>
> Our user notified that the contents of Centos 4 at our ftp server
> ftp.riken.jp is flip-flopping between new one and old one in these few
> days.
>
> We already noticed that the time stamp was flip-flopping before
> in this Mailing list as:
>
> On 09.5.5 0:13 PM (UT+9)
> [CentOS-mirror] flip-flopping timestamp by pulling CentOS [Re: Wrong
> timestamp by pulling CentOS-incdvd
>
> On 09.4.21 11:28 PM (UT+9)
> [CentOS-mirror] Wrong timestamp by pulling CentOS-incdvd
>
> But It was not only the time stamp, but also all the contents at
> msync.centos.org::CentOS-incdvd seems to be flip flopping till now.
>
> Could you please look into and fix this problem ?
>
> We are now now mirroring using the script below, since we
> cannot believe the time stamp at msync.centos.org::CentOS-incdvd.
>
> rsync -avzH --delete --exclude=timestamp.txt --exclude=TIME
> --exclude=".~tmp~/" msync.centos.org::CentOS-incdvd /ftp/Linux/centos
> date -u > /ftp/Linux/centos/timestamp.txt
> date +%s > /ftp/Linux/centos/TIME
>
> For example, same file was deleted and created and deleted and created
> in our rsync log to msync.centos.org::CentOS-incdvd. (We are rsyncing
> to msync.centos.org::CentOS-incdvd every 4 hours if the previous rsync
> process does not exit)
>
> A part of the rsync log is shown below.
>
> CentOS.log: 2.1/updates/headers/tzdata-0-2009f-1.el2_1.noarch.hdr
> CentOS.log.4 :deleting 2.1/updates/headers/tzdata-0-2009f-1.el2_1.noarch.hdr
> CentOS.log:8 2.1/updates/headers/tzdata-0-2009f-1.el2_1.noarch.hdr
> CentOS.log.17 :deleting
> 2.1/updates/headers/tzdata-0-2009f-1.el2_1.noarch.hdr
>
> (time zone of the log files beleow is JST = UT+8)
> -rw-rw-r-- 1 archive archive 30662 May 19 18:42 CentOS.log
> -rw-rw-r-- 1 archive archive 91659 May 19 18:15 CentOS.log.4
> -rw-rw-r-- 1 archive archive 84518 May 19 18:03 CentOS.log.8
> -rw-rw-r-- 1 archive archive 91493 May 18 18:24 CentOS.log.17
>
> Thank you in advance.
>
> Regards,
> Takashi Ichihara
>
> 09.5.11 5:26 PM Tru Huynh wrote,
>   
>> On Tue, Apr 21, 2009 at 11:28:54PM +0900, Takashi Ichihara wrote:
>>   
>>     
>>> Hi all
>>>
>>> ( I resubmit a mail to the Centos-morror List for your information)
>>> (sorry to sent again, because previous one was sorted in the
>>> different thread in the ML archives)
>>>
>>>
>>> Tru Huynh wrote,
>>>     
>>>       
>>>>> Hi,
>>>>>
>>>>> http://ftp.riken.jp/Linux/centos/ is being listed as 12 days late.
>>>>>
>>>>> Any issue on your mirror or on the centos mirror your are
>>>>> pulling from?
>>>>>
>>>>> Best regards,
>>>>>
>>>>> Tru
>>>>>         
>>>>>           
>>> Hi
>>>
>>> Yes, we ftp.riken.jp are pulling from the CentOS master site by
>>> rsync -avzH --delete msync.centos.org::CentOS-incdvd /ftp/Linux/centos
>>>
>>> every 4 hours when the previous rsync to msync.centos.org::CentOS-incdvd
>>> is not running. In addition, we kill the previous rsync once a day if there
>>> is a previous rsync to msync.centos.org::CentOS-incdvd running and start
>>> a new rsync to msync.centos.org::CentOS-incdvd .
>>>     
>>>       
>> ...
>>
>> We have lost (hoster pinged but no reply since 10+days) 2 donated centos.org
>> servers one of them being listed in the msync/msync-dvd pdns list. They have
>> now been removed but the dvd mirrors centos.org server count has been reduced.
>>
>> Best regards,
>>
>> Tru
>>   
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> CentOS-mirror mailing list
>> CentOS-mirror at centos.org
>> http://lists.centos.org/mailman/listinfo/centos-mirror
>>   
>>     
> _______________________________________________
> CentOS-mirror mailing list
> CentOS-mirror at centos.org
> http://lists.centos.org/mailman/listinfo/centos-mirror
>