[CentOS-devel] Repository metadata problems

Thu Apr 9 21:53:03 UTC 2009

Hi,

I today have a problem as well with metadata being newer than what is 
available on disk. I wonder whether we should require from mirrors to use 
rsync with --delay-updates as problems with repository metadata was 
exactly why we got this feature added to rsync a couple of years ago.

We could enforce it from the CentOS mirrors by checking the rsync version 
and/or options provided to the server. Is something like this feasible ?

----
[root at moria ~]# apt-get update; apt-get upgrade
Get:1 http://centos.mirrors.skynet.be centos/5/os/x86_64 repomd.xml [1140B]
Get:2 http://centos.mirrors.skynet.be centos/5/updates/x86_64 repomd.xml [951B]
Get:3 http://centos.mirrors.skynet.be centos/5/extras/x86_64 repomd.xml [951B]
Get:4 http://apt.sw.be redhat/el5/en/x86_64/rpmforge repomd.xml [1095B]
Get:5 http://rpm.guifications.org centos/5/x86_64/ repomd.xml [951B]
Get:6 http://rpm.pidgin.im centos/5/x86_64/ repomd.xml [951B]
Fetched 6039B in 0s (8752B/s)
Hit http://centos.mirrors.skynet.be centos/5/os/x86_64/ primary.xml
Hit http://centos.mirrors.skynet.be centos/5/os/x86_64/ filelists.xml
Get:1 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ primary.xml [110kB]
Hit http://apt.sw.be redhat/el5/en/x86_64/rpmforge/ primary.xml
Hit http://apt.sw.be redhat/el5/en/x86_64/rpmforge/ filelists.xml
Get:2 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ filelists.xml [674kB]
Hit http://rpm.guifications.org centos/5/x86_64/ primary.xml
Hit http://rpm.pidgin.im centos/5/x86_64/ primary.xml
Hit http://rpm.guifications.org centos/5/x86_64/ filelists.xml
Hit http://rpm.pidgin.im centos/5/x86_64/ filelists.xml
Hit http://centos.mirrors.skynet.be centos/5/extras/x86_64/ primary.xml
Hit http://centos.mirrors.skynet.be centos/5/extras/x86_64/ filelists.xml
Fetched 784kB in 0s (936kB/s)
Reading Package Lists... Done
Building Dependency Tree... Done
Reading Package Lists... Done
Building Dependency Tree... Done
The following packages will be upgraded
    NetworkManager (0.7.0-3.el5 => 0.7.0-4.el5_3)
    NetworkManager-glib (0.7.0-3.el5 => 0.7.0-4.el5_3)
    NetworkManager-glib.32bit (0.7.0-3.el5 => 0.7.0-4.el5_3)
    NetworkManager-gnome (0.7.0-3.el5 => 0.7.0-4.el5_3)
    NetworkManager.32bit (0.7.0-3.el5 => 0.7.0-4.el5_3)
    firefox (3.0.6-1.el5.centos => 3.0.7-1.el5.centos)
    firefox.32bit (3.0.6-1.el5.centos => 3.0.7-1.el5.centos)
    ntp (4.2.2p1-9.el5.centos => 4.2.2p1-9.el5.centos.1)
    xen (3.0.3-80.el5 => 3.0.3-80.el5_3.2)
    xen-libs (3.0.3-80.el5 => 3.0.3-80.el5_3.2)
    xen-libs.32bit (3.0.3-80.el5 => 3.0.3-80.el5_3.2)
    xulrunner (1.9.0.6-1.el5 => 1.9.0.7-3.el5)
    xulrunner.32bit (1.9.0.6-1.el5 => 1.9.0.7-3.el5)
13 upgraded, 0 newly installed, 0 removed and 0 not upgraded.
Need to get 52.5MB of archives.
After unpacking 3968kB disk space will be freed.
Do you want to continue? [Y/n]
Get:1 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ NetworkManager-gnome 1:0.7.0-4.el5_3 [344kB]
Get:2 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ NetworkManager-glib.32bit 1:0.7.0-4.el5_3 [82.1kB]
Get:3 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ NetworkManager.32bit 1:0.7.0-4.el5_3 [1093kB]
Get:4 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ NetworkManager 1:0.7.0-4.el5_3 [1096kB]
Get:5 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ NetworkManager-glib 1:0.7.0-4.el5_3 [83.4kB]
Err http://centos.mirrors.skynet.be centos/5/updates/x86_64/ xulrunner 1.9.0.7-3.el5
   404 Not Found
Err http://centos.mirrors.skynet.be centos/5/updates/x86_64/ xulrunner.32bit 1.9.0.7-3.el5
   404 Not Found
Get:6 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ firefox 3.0.7-1.el5.centos [12.5MB]
Get:7 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ firefox.32bit 3.0.7-1.el5.centos [12.5MB]
Err http://centos.mirrors.skynet.be centos/5/updates/x86_64/ ntp 4.2.2p1-9.el5.centos.1
   404 Not Found
Get:8 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ xen-libs 3.0.3-80.el5_3.2 [145kB]
Get:9 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ xen 3.0.3-80.el5_3.2 [1845kB]
Get:10 http://centos.mirrors.skynet.be centos/5/updates/x86_64/ xen-libs.32bit 3.0.3-80.el5_3.2 [148kB]
Fetched 29.8MB in 24s (1209kB/s)
Failed to fetch http://centos.mirrors.skynet.be/pub//centos/5/updates/x86_64/RPMS/xulrunner-1.9.0.7-3.el5.x86_64.rpm  404 Not Found
Failed to fetch http://centos.mirrors.skynet.be/pub//centos/5/updates/x86_64/RPMS/xulrunner-1.9.0.7-3.el5.i386.rpm  404Not Found
Failed to fetch http://centos.mirrors.skynet.be/pub//centos/5/updates/x86_64/RPMS/ntp-4.2.2p1-9.el5.centos.1.x86_64.rpm 404 Not Found
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
----

-- 
--   dag wieers,  dag at wieers.com,  http://dag.wieers.com/   --
[Any errors in spelling, tact or fact are transmission errors]