Just noticed this (since I needed to snag something from centos 5) that something weird happened yesterday with regards to syncing from rsync://msync-dvd.centos.org/CentOS-incdvd/ (to zeus1.kernel.org - ip: 204.152.191.4) Specifically Centos 5 was completely deleted from my repository (running rsync with --delete) along with a huge amount of other sections of Centos. Thought I'd alert people and see what was going on.
John 'Warthog9' Hawley
----------------------- Log snippet as follows -----------------------
--- BEGIN RSYNC --- Fri May 11 21:43:01 UTC 2007
receiving file list ... done ./ .~tmp~/ .~tmp~/RPM-GPG-KEY-CentOS-3 .~tmp~/RPM-GPG-KEY-beta .~tmp~/TIME .~tmp~/timestamp.txt 2.1/extras/SRPMS/ ..... deleting dostools/sha1sum.exe deleting dostools/md5sum.exe deleting dostools/ deleting 5/updates deleting 5/os deleting 5/isos-dvd deleting 5/isos deleting 5/fasttrack deleting 5/extras deleting 5/centosplus deleting 5/addons deleting 5/ deleting 5.0/updates/x86_64/repodata/repomd.xml deleting 5.0/updates/x86_64/repodata/primary.xml.gz deleting 5.0/updates/x86_64/repodata/other.xml.gz deleting 5.0/updates/x86_64/repodata/filelists.xml.gz deleting 5.0/updates/x86_64/repodata/ deleting 5.0/updates/x86_64/RPMS/yelp-2.16.0-14.0.1.el5.x86_64.rpm ...... deleting 5.0/addons/x86_64/ deleting 5.0/addons/i386/repodata/repomd.xml deleting 5.0/addons/i386/repodata/primary.xml.gz deleting 5.0/addons/i386/repodata/other.xml.gz deleting 5.0/addons/i386/repodata/filelists.xml.gz deleting 5.0/addons/i386/repodata/ deleting 5.0/addons/i386/RPMS/ deleting 5.0/addons/i386/ deleting 5.0/addons/SRPMS/ deleting 5.0/addons/ deleting 5.0/ deleting 4.1/readme deleting 4.1/ deleting 4.0/readme deleting 4.0/ deleting timestamp.txt deleting TIME deleting RPM-GPG-KEY-centos4 deleting RPM-GPG-KEY-beta deleting RPM-GPG-KEY-CentOS-5 deleting RPM-GPG-KEY-CentOS-3 deleting 2.1/extras/SRPMS/original.txt ..... The list keeps going and deletes a huge amount of data
last time rsync ran on my mirror, was at 18:00 GMT+2, and i have ~28GB in centos/5.0, looks fine to me.
J.H. wrote:
Just noticed this (since I needed to snag something from centos 5) that something weird happened yesterday with regards to syncing from rsync://msync-dvd.centos.org/CentOS-incdvd/ (to zeus1.kernel.org - ip: 204.152.191.4) Specifically Centos 5 was completely deleted from my repository (running rsync with --delete) along with a huge amount of other sections of Centos. Thought I'd alert people and see what was going on.
John 'Warthog9' Hawley
Log snippet as follows
--- BEGIN RSYNC --- Fri May 11 21:43:01 UTC 2007
receiving file list ... done ./ .~tmp~/ .~tmp~/RPM-GPG-KEY-CentOS-3 .~tmp~/RPM-GPG-KEY-beta .~tmp~/TIME .~tmp~/timestamp.txt 2.1/extras/SRPMS/ ..... deleting dostools/sha1sum.exe deleting dostools/md5sum.exe deleting dostools/ deleting 5/updates deleting 5/os deleting 5/isos-dvd deleting 5/isos deleting 5/fasttrack deleting 5/extras deleting 5/centosplus deleting 5/addons deleting 5/ deleting 5.0/updates/x86_64/repodata/repomd.xml deleting 5.0/updates/x86_64/repodata/primary.xml.gz deleting 5.0/updates/x86_64/repodata/other.xml.gz deleting 5.0/updates/x86_64/repodata/filelists.xml.gz deleting 5.0/updates/x86_64/repodata/ deleting 5.0/updates/x86_64/RPMS/yelp-2.16.0-14.0.1.el5.x86_64.rpm ...... deleting 5.0/addons/x86_64/ deleting 5.0/addons/i386/repodata/repomd.xml deleting 5.0/addons/i386/repodata/primary.xml.gz deleting 5.0/addons/i386/repodata/other.xml.gz deleting 5.0/addons/i386/repodata/filelists.xml.gz deleting 5.0/addons/i386/repodata/ deleting 5.0/addons/i386/RPMS/ deleting 5.0/addons/i386/ deleting 5.0/addons/SRPMS/ deleting 5.0/addons/ deleting 5.0/ deleting 4.1/readme deleting 4.1/ deleting 4.0/readme deleting 4.0/ deleting timestamp.txt deleting TIME deleting RPM-GPG-KEY-centos4 deleting RPM-GPG-KEY-beta deleting RPM-GPG-KEY-CentOS-5 deleting RPM-GPG-KEY-CentOS-3 deleting 2.1/extras/SRPMS/original.txt ..... The list keeps going and deletes a huge amount of data
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
The problem stemmed from mainly bad luck - looks like I was the only one to make it into the mirror right at that moment (before the rsync was turned off) and got a screwed up sync (they were in the process of fixing something)
So more or less - my bad luck nothing to be concerned with.
- John 'Warthog9' Hawley Kernel.org Admin
On Sun, 2007-05-13 at 23:29 +0300, Imre Gergely wrote:
last time rsync ran on my mirror, was at 18:00 GMT+2, and i have ~28GB in centos/5.0, looks fine to me.
J.H. wrote:
Just noticed this (since I needed to snag something from centos 5) that something weird happened yesterday with regards to syncing from rsync://msync-dvd.centos.org/CentOS-incdvd/ (to zeus1.kernel.org - ip: 204.152.191.4) Specifically Centos 5 was completely deleted from my repository (running rsync with --delete) along with a huge amount of other sections of Centos. Thought I'd alert people and see what was going on.
John 'Warthog9' Hawley
Log snippet as follows
--- BEGIN RSYNC --- Fri May 11 21:43:01 UTC 2007
receiving file list ... done ./ .~tmp~/ .~tmp~/RPM-GPG-KEY-CentOS-3 .~tmp~/RPM-GPG-KEY-beta .~tmp~/TIME .~tmp~/timestamp.txt 2.1/extras/SRPMS/ ..... deleting dostools/sha1sum.exe deleting dostools/md5sum.exe deleting dostools/ deleting 5/updates deleting 5/os deleting 5/isos-dvd deleting 5/isos deleting 5/fasttrack deleting 5/extras deleting 5/centosplus deleting 5/addons deleting 5/ deleting 5.0/updates/x86_64/repodata/repomd.xml deleting 5.0/updates/x86_64/repodata/primary.xml.gz deleting 5.0/updates/x86_64/repodata/other.xml.gz deleting 5.0/updates/x86_64/repodata/filelists.xml.gz deleting 5.0/updates/x86_64/repodata/ deleting 5.0/updates/x86_64/RPMS/yelp-2.16.0-14.0.1.el5.x86_64.rpm ...... deleting 5.0/addons/x86_64/ deleting 5.0/addons/i386/repodata/repomd.xml deleting 5.0/addons/i386/repodata/primary.xml.gz deleting 5.0/addons/i386/repodata/other.xml.gz deleting 5.0/addons/i386/repodata/filelists.xml.gz deleting 5.0/addons/i386/repodata/ deleting 5.0/addons/i386/RPMS/ deleting 5.0/addons/i386/ deleting 5.0/addons/SRPMS/ deleting 5.0/addons/ deleting 5.0/ deleting 4.1/readme deleting 4.1/ deleting 4.0/readme deleting 4.0/ deleting timestamp.txt deleting TIME deleting RPM-GPG-KEY-centos4 deleting RPM-GPG-KEY-beta deleting RPM-GPG-KEY-CentOS-5 deleting RPM-GPG-KEY-CentOS-3 deleting 2.1/extras/SRPMS/original.txt ..... The list keeps going and deletes a huge amount of data
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Yesterday J.H. said:
The problem stemmed from mainly bad luck - looks like I was the only one to make it into the mirror right at that moment (before the rsync was turned off) and got a screwed up sync (they were in the process of fixing something)
So more or less - my bad luck nothing to be concerned with.
It was more than that. I saw it too Sunday. And had to quickly hardlink everything back into position. The magic of keeping a hardlinked shadow copy.
Even though rsync went on a delete frenzy, I brought the content back online without too much repeat download nonsense. Something was amuck at kernel.org for sure; but they got it squared away eventually.
../C
On Mon, 2007-05-14 at 18:01 -0700, Curtis Doty wrote:
Yesterday J.H. said:
The problem stemmed from mainly bad luck - looks like I was the only one to make it into the mirror right at that moment (before the rsync was turned off) and got a screwed up sync (they were in the process of fixing something)
So more or less - my bad luck nothing to be concerned with.
It was more than that. I saw it too Sunday. And had to quickly hardlink everything back into position. The magic of keeping a hardlinked shadow copy.
Yeah it happened on Sunday, we got 'lucky' and zeus2 didn't make it in on that sync cycle so it was saved
Even though rsync went on a delete frenzy, I brought the content back online without too much repeat download nonsense. Something was amuck at kernel.org for sure; but they got it squared away eventually.
Problem was upstream with Centos's mirrors, we just happened to be the unlucky mirror to get in right under the gun. Luckily the zeus2 had a copy and syncing from zeus2 -> zeus1 is a very fast operation.
It shouldn't happen again from my understanding, just the typical occasional fluke.
- John 'Warthog9' Hawley
../C
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
-
Curtis Doty -
Imre Gergely -
J.H.