Hi all,
I'm working on configuring a full mirror of CentOS. I have some questions.
People seem to be providing HTTP/FTP/rsync connection methods. Is one of those better than the others? Which one is the most useful?
I'd like to mirror the DVD isos too, but they don't seem to be included in the main server. Is there a separate procedure for mirroring the DVDs?
So far, I have this line scheduled via cron every 4 hours:
rsync -avH --delete us-msync.centos.org::CentOS /opt/mirror/pub/CentOS > /tmp/rsync.log
HTTP: No
FTP: ftp://repo.bioinformatics.upenn.edu/pub/CentOS/
Rsync: No
Sync times: 6x per day
Releases: ALL
ISOs: Yes
Location: Philadelphia, PA, US
Bandwidth: ~100Mb/s
Sponsoring Organization: Penn Center for Bioinformatics
URL: http://www.pcbi.upenn.edu/
Contact Email: manager(a)pcbi.upenn.edu
--
Alex Chekholko
Hi.
I'd like to ask for access to CentOS-incdvd on msync-dvd.centos.org
for 85.14.85.4 .
Now pbone.net has 100mbps connection to global internet.
Best regards.
---
Grzegorz Paszka
RPM Search Developer
http://rpm.pbone.net
Hi,
i have rsync from sync-dvd.centos.org (eurovps.centos.org) and this
server is too slow:
rsync -avzH --delete msync-dvd.centos.org::CentOS-incdvd ...
Any problem in this server, or bad rsync URL?
--
Vaclav Dusek
Mirror Admins,
We expect to release the CentOS-4.5 tree to the external mirrors
(msync / msync-dvd) sometime in the next 8-16 hours.
We are releasing i386, x86_64, ia64 in this release ... s390 and s390x
will come at a later time ... so alpha, s390 and s390x will start out as
sym links back to the 4.4 tree.
Initially, we will sync with the 4.5 directory at 700 so that it is not
useable on our webservers ... we will shift the directory to 775 after
we get 40-50% of the external mirrors synced.
The increased size for this release will be:
WithDVD: 19G
NoDVDs: 11G
We will expect a +8GB (no DVD) and +12GB (with DVD) more when s390/s390x
is released. We will expect that number to then go down when we move
4.4 to vault.centos.org (a week or so after s390/s390x release). The
final end result should be 2-4GB increase after moving 4.4 to vault.
Thanks,
Johnny Hughes
Just noticed this (since I needed to snag something from centos 5) that
something weird happened yesterday with regards to syncing from
rsync://msync-dvd.centos.org/CentOS-incdvd/ (to zeus1.kernel.org - ip:
204.152.191.4) Specifically Centos 5 was completely deleted from my
repository (running rsync with --delete) along with a huge amount of
other sections of Centos. Thought I'd alert people and see what was
going on.
John 'Warthog9' Hawley
-----------------------
Log snippet as follows
-----------------------
--- BEGIN RSYNC ---
Fri May 11 21:43:01 UTC 2007
receiving file list ... done
./
.~tmp~/
.~tmp~/RPM-GPG-KEY-CentOS-3
.~tmp~/RPM-GPG-KEY-beta
.~tmp~/TIME
.~tmp~/timestamp.txt
2.1/extras/SRPMS/
.....
deleting dostools/sha1sum.exe
deleting dostools/md5sum.exe
deleting dostools/
deleting 5/updates
deleting 5/os
deleting 5/isos-dvd
deleting 5/isos
deleting 5/fasttrack
deleting 5/extras
deleting 5/centosplus
deleting 5/addons
deleting 5/
deleting 5.0/updates/x86_64/repodata/repomd.xml
deleting 5.0/updates/x86_64/repodata/primary.xml.gz
deleting 5.0/updates/x86_64/repodata/other.xml.gz
deleting 5.0/updates/x86_64/repodata/filelists.xml.gz
deleting 5.0/updates/x86_64/repodata/
deleting 5.0/updates/x86_64/RPMS/yelp-2.16.0-14.0.1.el5.x86_64.rpm
......
deleting 5.0/addons/x86_64/
deleting 5.0/addons/i386/repodata/repomd.xml
deleting 5.0/addons/i386/repodata/primary.xml.gz
deleting 5.0/addons/i386/repodata/other.xml.gz
deleting 5.0/addons/i386/repodata/filelists.xml.gz
deleting 5.0/addons/i386/repodata/
deleting 5.0/addons/i386/RPMS/
deleting 5.0/addons/i386/
deleting 5.0/addons/SRPMS/
deleting 5.0/addons/
deleting 5.0/
deleting 4.1/readme
deleting 4.1/
deleting 4.0/readme
deleting 4.0/
deleting timestamp.txt
deleting TIME
deleting RPM-GPG-KEY-centos4
deleting RPM-GPG-KEY-beta
deleting RPM-GPG-KEY-CentOS-5
deleting RPM-GPG-KEY-CentOS-3
deleting 2.1/extras/SRPMS/original.txt
.....
The list keeps going and deletes a huge amount of data
Hi again,
I did not get any feedback on this mail (posted 2007-05-02). Have I
missed any reply ?
----------------------------------------------------------------------
Hello,
I have put together a new mirror site at Halmstad University in Sweden
and I want to be listed in the "CentOS Public Mirrors".
Name of organization: Halmstad University ( http://www.hh.se )
City: Halmstad
Country: Sweden
Protocols:
HTTP - http://mirror.hh.se/centos
FTP - ftp://mirror.hh.se/centos
RSYNC - no
Releases: all
Arch: i386 x86_64 (all when more disk is installed)
Dvd: no
Syncing: Every 6th hour
Bandwidth: 1000 Mbit/sec (machine), 10000 Mbit/sec (Internet)
Contact: magnus.moren(a)cite.hh.se
--
Magnus Morén____________________________________________
Central IT (CITE), Halmstad University, +46 35 167100
Box 823, 301 18 HALMSTAD, epost: magnus.moren(a)cite.hh.se
With the release of 5 we have seen a tremendous increase in the use of the
dvd.iso , so that from bitorrent it is now downloaded 5 times more than
the cd isos.
That may be due in part to it being hard to find and more readily
available by Bt, but I think is also down to increased prevalance of
dvd-rom drives.
The main issue with having the dvd isos available from mirrors is that
Apache < 2.2 running on 32 bit architecture wont display files larger
than 2.0 GB , however CentOS 5 has Apache 2.2 with large file support so
that problem will now start to go away - alternative is also to use
lighttpd.
(CentOS now has its first server up running C5 and able to display
large dvd images under http :)
I have updated our isoredirect system to detect and verify dvd isos on
mirrors , and sources with current dvd isos are now listed separately on
the isoredirect page - what this is showing is that very few of our
mirrors have the dvd isos and we need to get more out there ...
To test :-
http://isoredirect.centos.org/mirrorscripts/chooseisolist.pl?release=5.0&ar…
It will give you local info based on your ip
you can also add &cc=xx to test other country codes
I know a lot of mirrors are wanting to download the dvd isos and we have
just configured two new servers with msync-incdvd.
However, we would still like mirrors to do their initial sync of the dvd
isos to one of our tier 1 mirrors that have them , and then we will add
their ip addres to our acl for syncing.
We also have no problem if mirrors want to sync to a local tier 1 mirror,
our system will still detect that they are up to date.
It is likely that in the near future we will restrict access to msync
rsync to current registered mirrors, and new mirrors will either have to
register first or do an initial sync from a registered mirror *hmm - we
have said this before - but now we have 160 mirrors we really will have to
do something ...)
There has been some confusion about the CentOS and CentOS-incdvd rsync
targets , and the fact that some mirrors have dvd isos included in the
CentOS target, so what we would like to do is to have a list of tier 1
mirrors that :-
1. provide rsync access to the complete CentOS release tree
2. would be prepared to act as a seed for new mirrors
3. would be prepared to set up separate CentOS and CentOS-incdvd targets
for other mirrors to sync against, either initial or recurring syncs (the
trees would be hardlinked, so extra space required is minimal).
We will then publish details for other and new mirrors of how they can
sync against these master sync servers.
If you would be prepared for your mirror to act as one, and have the
bandwidth and capacity for it then please respond.
Whilst writing I would like to thank all of our mirrors for the tremendous
support that you provide for CentOS and our users and especially during
the release of 5.0
Regards
Lance
--
uklinux.net -
The ISP of choice for the discerning Linux user.