OK, I've run your scripts on my own home-mirror (still not fully satisfied with it's setup, but centos/dag/dries el4 i[3456]86/noarch/src rpms are all there).
repodata/other.xml.gz: OK repodata/filelists.xml.gz: OK repodata/primary.xml.gz: OK --- RPMS/*.rpm: [OK|FAILED] --- sha1sum: WARNING: 22 of 2910 computed checksums did NOT match FAILED: RPMS/aircrack-2.41-1.2.el4.rf.i386.rpm FAILED: RPMS/interbench-0.29-1.2.el4.rf.i386.rpm FAILED: RPMS/irssi-0.8.10-0.rc7.2.el4.rf.i386.rpm FAILED: RPMS/libextractor-0.5.5-1.2.el4.rf.i386.rpm FAILED: RPMS/libextractor-devel-0.5.5-1.2.el4.rf.i386.rpm FAILED: RPMS/libgc-6.6-0.2.el4.rf.i386.rpm FAILED: RPMS/libgc-devel-6.6-0.2.el4.rf.i386.rpm FAILED: RPMS/mcabber-0.7.0-1.2.el4.rf.i386.rpm FAILED: RPMS/omcmd-0.4.6-1.2.el4.rf.i386.rpm FAILED: RPMS/opencdk-0.5.8-1.2.el4.rf.i386.rpm FAILED: RPMS/opencdk-devel-0.5.8-1.2.el4.rf.i386.rpm FAILED: RPMS/perl-Devel-StackTrace-1.12-1.2.el4.rf.noarch.rpm FAILED: RPMS/perl-IO-Socket-SSL-0.97-1.2.el4.rf.noarch.rpm FAILED: RPMS/perl-Mail-POP3Client-2.17-1.2.el4.rf.noarch.rpm FAILED: RPMS/perl-MIME-tools-5.418-1.2.el4.rf.noarch.rpm FAILED: RPMS/perl-Spoon-0.23-1.2.el4.rf.noarch.rpm FAILED: RPMS/perl-SVG-Metadata-0.28-1.2.el4.rf.i386.rpm FAILED: RPMS/perl-Test-Prereq-1.028-1.2.el4.rf.noarch.rpm FAILED: RPMS/perl-Tie-Array-Sorted-1.4-1.2.el4.rf.noarch.rpm FAILED: RPMS/perl-Time-Piece-2.00_01-1.2.el4.rf.i386.rpm FAILED: RPMS/prima-1.19-2.2.el4.rf.i386.rpm FAILED: RPMS/unfs3-0.9.13-1.2.el4.rf.i386.rpm
(all others were OK, please note that the weird line format "FAILED: ..." instead of "...: FAILED" is because this has already been par'sed')
I deleted the above 22 files (and all their hardlinks). Re rsync'ed everything from dag.freshrpms.net:
[opening tcp connection to dag.freshrpms.net port 873 opening connection using --server --sender -vvlHDtprSz --bwlimit=1024 --partial . pub/freshrpms/pub/dag/ plus lots of excludes]
and the problem would appear to persist (same 22 files)...
The below list also shows hardlinks [/opt/mirrors/dag is the base]
=== BAD: RPMS/aircrack-2.41-1.2.el4.rf.i386.rpm === aircrack-2.41-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/aircrack-2.41-1.2.el4.rf.i386.rpm === BAD: RPMS/interbench-0.29-1.2.el4.rf.i386.rpm === interbench-0.29-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/aircrack-2.41-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/aircrack/aircrack-2.41-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/interbench/el4-i386/interbench-0.29-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/interbench-0.29-1.2.el4.rf.i386.rpm === BAD: RPMS/irssi-0.8.10-0.rc7.2.el4.rf.i386.rpm === irssi-0.8.10-0.rc7.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/interbench-0.29-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/interbench-0.29-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/interbench/interbench-0.29-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/irssi/el4-i386/irssi-0.8.10-0.rc7.2.el4.rf.i386.rpm === BAD: RPMS/libextractor-0.5.5-1.2.el4.rf.i386.rpm === libextractor-0.5.5-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/irssi-0.8.10-0.rc7.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/irssi-0.8.10-0.rc7.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/irssi-0.8.10-0.rc7.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/irssi/irssi-0.8.10-0.rc7.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/libextractor-0.5.5-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/libextractor-0.5.5-1.2.el4.rf.i386.rpm === BAD: RPMS/libextractor-devel-0.5.5-1.2.el4.rf.i386.rpm === libextractor-devel-0.5.5-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/packages/libextractor/libextractor-0.5.5-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/libextractor-devel-0.5.5-1.2.el4.rf.i386.rpm === BAD: RPMS/libgc-6.6-0.2.el4.rf.i386.rpm === libgc-6.6-0.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/libextractor-devel-0.5.5-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/libextractor/libextractor-devel-0.5.5-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/libgc/el4-i386/libgc-6.6-0.2.el4.rf.i386.rpm === BAD: RPMS/libgc-devel-6.6-0.2.el4.rf.i386.rpm === libgc-devel-6.6-0.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/libgc-6.6-0.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/libgc-6.6-0.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/libgc-6.6-0.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/libgc/libgc-6.6-0.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/libgc/el4-i386/libgc-devel-6.6-0.2.el4.rf.i386.rpm === BAD: RPMS/mcabber-0.7.0-1.2.el4.rf.i386.rpm === mcabber-0.7.0-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/libgc-devel-6.6-0.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/libgc-devel-6.6-0.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/libgc-devel-6.6-0.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/libgc/libgc-devel-6.6-0.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/mcabber-0.7.0-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/mcabber-0.7.0-1.2.el4.rf.i386.rpm === BAD: RPMS/omcmd-0.4.6-1.2.el4.rf.i386.rpm === omcmd-0.4.6-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/packages/mcabber/mcabber-0.7.0-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/omcmd/el4-i386/omcmd-0.4.6-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/omcmd-0.4.6-1.2.el4.rf.i386.rpm === BAD: RPMS/opencdk-0.5.8-1.2.el4.rf.i386.rpm === opencdk-0.5.8-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/omcmd-0.4.6-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/omcmd-0.4.6-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/omcmd/omcmd-0.4.6-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/opencdk/el4-i386/opencdk-0.5.8-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/opencdk-0.5.8-1.2.el4.rf.i386.rpm === BAD: RPMS/opencdk-devel-0.5.8-1.2.el4.rf.i386.rpm === opencdk-devel-0.5.8-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/opencdk-0.5.8-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/opencdk-0.5.8-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/opencdk/opencdk-0.5.8-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/opencdk/el4-i386/opencdk-devel-0.5.8-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/opencdk-devel-0.5.8-1.2.el4.rf.i386.rpm === BAD: RPMS/perl-Devel-StackTrace-1.12-1.2.el4.rf.noarch.rpm === perl-Devel-StackTrace-1.12-1.2.el4.rf.noarch.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/opencdk-devel-0.5.8-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/opencdk-devel-0.5.8-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/opencdk/opencdk-devel-0.5.8-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-Devel-StackTrace/el4-i386/perl-Devel-StackTrace-1.12-1.2.el4.rf.noarch.rpm === BAD: RPMS/perl-IO-Socket-SSL-0.97-1.2.el4.rf.noarch.rpm === perl-IO-Socket-SSL-0.97-1.2.el4.rf.noarch.rpm === --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-Devel-StackTrace-1.12-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-Devel-StackTrace-1.12-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-Devel-StackTrace-1.12-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/packages/perl-Devel-StackTrace/perl-Devel-StackTrace-1.12-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-IO-Socket-SSL/el4-i386/perl-IO-Socket-SSL-0.97-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-IO-Socket-SSL-0.97-1.2.el4.rf.noarch.rpm === BAD: RPMS/perl-Mail-POP3Client-2.17-1.2.el4.rf.noarch.rpm === perl-Mail-POP3Client-2.17-1.2.el4.rf.noarch.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-IO-Socket-SSL-0.97-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-IO-Socket-SSL-0.97-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/packages/perl-IO-Socket-SSL/perl-IO-Socket-SSL-0.97-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-Mail-POP3Client/el4-i386/perl-Mail-POP3Client-2.17-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-Mail-POP3Client-2.17-1.2.el4.rf.noarch.rpm === BAD: RPMS/perl-MIME-tools-5.418-1.2.el4.rf.noarch.rpm === perl-MIME-tools-5.418-1.2.el4.rf.noarch.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-Mail-POP3Client-2.17-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-Mail-POP3Client-2.17-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/packages/perl-Mail-POP3Client/perl-Mail-POP3Client-2.17-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-MIME-tools/el4-i386/perl-MIME-tools-5.418-1.2.el4.rf.noarch.rpm === BAD: RPMS/perl-Spoon-0.23-1.2.el4.rf.noarch.rpm === perl-Spoon-0.23-1.2.el4.rf.noarch.rpm === --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-MIME-tools-5.418-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-MIME-tools-5.418-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-MIME-tools-5.418-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/packages/perl-MIME-tools/perl-MIME-tools-5.418-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-Spoon/el4-i386/perl-Spoon-0.23-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-Spoon-0.23-1.2.el4.rf.noarch.rpm === BAD: RPMS/perl-SVG-Metadata-0.28-1.2.el4.rf.i386.rpm === perl-SVG-Metadata-0.28-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-Spoon-0.23-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-Spoon-0.23-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/packages/perl-Spoon/perl-Spoon-0.23-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-SVG-Metadata/el4-i386/perl-SVG-Metadata-0.28-1.2.el4.rf.i386.rpm === BAD: RPMS/perl-Test-Prereq-1.028-1.2.el4.rf.noarch.rpm === perl-Test-Prereq-1.028-1.2.el4.rf.noarch.rpm === --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-SVG-Metadata-0.28-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-SVG-Metadata-0.28-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-SVG-Metadata-0.28-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/perl-SVG-Metadata/perl-SVG-Metadata-0.28-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-Test-Prereq/el4-i386/perl-Test-Prereq-1.028-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-Test-Prereq-1.028-1.2.el4.rf.noarch.rpm === BAD: RPMS/perl-Tie-Array-Sorted-1.4-1.2.el4.rf.noarch.rpm === perl-Tie-Array-Sorted-1.4-1.2.el4.rf.noarch.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-Test-Prereq-1.028-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-Test-Prereq-1.028-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/packages/perl-Test-Prereq/perl-Test-Prereq-1.028-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-Tie-Array-Sorted/el4-i386/perl-Tie-Array-Sorted-1.4-1.2.el4.rf.noarch.rpm === BAD: RPMS/perl-Time-Piece-2.00_01-1.2.el4.rf.i386.rpm === perl-Time-Piece-2.00_01-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-Tie-Array-Sorted-1.4-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-Tie-Array-Sorted-1.4-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-Tie-Array-Sorted-1.4-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/packages/perl-Tie-Array-Sorted/perl-Tie-Array-Sorted-1.4-1.2.el4.rf.noarch.rpm --- BAD: /opt/mirrors/dag/dries/packages/perl-Time-Piece/el4-i386/perl-Time-Piece-2.00_01-1.2.el4.rf.i386.rpm === BAD: RPMS/prima-1.19-2.2.el4.rf.i386.rpm === prima-1.19-2.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/perl-Time-Piece-2.00_01-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/perl-Time-Piece-2.00_01-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/perl-Time-Piece-2.00_01-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/perl-Time-Piece/perl-Time-Piece-2.00_01-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/prima/el4-i386/prima-1.19-2.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/prima-1.19-2.2.el4.rf.i386.rpm === BAD: RPMS/unfs3-0.9.13-1.2.el4.rf.i386.rpm === unfs3-0.9.13-1.2.el4.rf.i386.rpm === --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/prima-1.19-2.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/prima-1.19-2.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/prima/prima-1.19-2.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/packages/unfs3/el4-i386/unfs3-0.9.13-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/dries/redhat/el4/en/i386/RPMS.dries/unfs3-0.9.13-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/RPMS.dag/unfs3-0.9.13-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/redhat/el4/en/i386/dag/RPMS/unfs3-0.9.13-1.2.el4.rf.i386.rpm --- BAD: /opt/mirrors/dag/packages/unfs3/unfs3-0.9.13-1.2.el4.rf.i386.rpm
Could we perhaps get a
find / -type f -print0 | xargs -0 md5sum find / -type f -print0 | xargs -0 sha1sum
from the mirror? (perhaps even keep such a file there...)
Cheers, MaZe.
On Mon, 5 Dec 2005, Dries Verachtert wrote:
It would be nice if we could get a full list of packages which have a wrong sha1 checksum. I don't have the bandwidth for a full mirror of all of Dag's rpms and i also don't have shell access to such a mirror. So a small request for a mirror admin:
Of course this is far from perfect: it doesn't check the .hdr files, apt config or old yum config stuff.. but it might give the list of rpm packages with a wrong checksum so we can ask heanet to check those files.
thanks in advance! Dries