Due to the split of mirrors with cAos , it will be necessary for mirrors
to make some changes to the way that they mirror the CentOS tree, as
moving forward it will no longer be a part of the caosity tree.
Firstly mirrors need to decide whether they are mirroring CentOS or cAos
or both. They are distinct operating systems, CentOS is a rebuild of
Enterprise Linux , whereas cAos is an rpm based distribution in its own
right.
For more information see www.centos.org or caos.caosity.org
At present both trees are mirrored with a single rsync of
mirror.caosity.org::cAos - moving forward two rsyncs will be needed :-
mirror.caosity.org::caosity that will get the caos tree
and
msync.centos.org::CentOS that will get the CentOS tree
Please note that at present CentOS will be listed and stored within the
cAos tree, this should not be the case in the future - CentOS should never
be stored or listed as a part of cAos or caosity.
Mirror Changes
--------------
In order to achieve the changes required with minimum download bandwidth
the following steps should be carried out. (Note that individual
circumstances may vary - if in doubt do nothing and ask) .
1. Stop cron based rsync job from syncing
2. Move the CentOS tree to its new location, which should be at the root
of the publically served tree.
This can either be achieved with 'mv' or if you want a 2nd chance at it
'cp -al' which will create a hardlinked copy of the tree (as long as it
is on the same partition)
eg with directory structure /pub
/pub/caos
/pub/caos/centos
cp -al /pub/caos/centos /pub/
or
mv /pub/caos/centos /pub
to end up with /pub/
/pub/caos
/pub/centos
(and /pub/caos/centos/ if using cp -al)
3. Create a new rsync cron job to sync the CentOS tree (if required) .
This should be something like :-
rsync -aqzH --delete msync.centos.org::CentOS /pub/
*** note the change to msync.centos.org *** mirror.centos.org is
deprecated for rsync use - to allow us to use different servers for yum
mirrors.
please use rsync -anvzH --delete msync.centos.org::CentOS /pub/
first to test that the command will do the right thing ('n' is dry run
and will just show what wil be transferred - which in theory should be very
little - if it says 40 GB + then the command is wrong !!)
Note that due to the way that rsync works any updates will only be written
to this new tree and not the hardlinked tree left behind if using cp -al
above ( that can be deleted once you are happy with the new location
working).
4. Create a new rsync cron job to sync the cAos tree (if required). This
should be something like :-
rsync -aqzH --delete mirror.caosity.org::caosity /pub/
*** note the change to ::caosity - ::cAos will still sync both trees
for mirrors that havent restructured yet. ***
This will also delete the CentOS tree left underneath the caos tree
above.
You should now have both trees in the correct places.
5. Please email the list to say that you have restructured your mirror and
what the new urls will be for public use. We will update the databases to
reflect these new locations.
6. It is not necessary to mirror all of centos if you do not wish to - eg
you can choose whether to carry 2.1 , 3.3, 3.4, 4.0 - but please note in
the email any trees that you will not be carrying and we will note that in
the database.
7. In the very near future we will be restricting access to
msync.centos.org to publically listed mirrors only - we have to establiush
a way for new mirrors to sync first though.
8. We will be tracking which mirrors have/havent restructured and will
contact individual mirrors accordingly.
There is now an irc channel - #centos-mirror
on irc.freenode.net where mirroring discussions may be held.
Lance
--
uklinux.net -
The ISP of choice for the discerning Linux user.
As you will have read in a recent post, the CentOS mirror system is
separating from cAos so as to be an independent project in its own right.
There will be more information regarding how to change the mirror setup
and where to sync from shortly, however for now we are creating new
mailing lists.
If you were subscribed to the caos-mirror mailing list then you will jave
been subscribed to this list automatically. (If not - apologies).
The options you subscribed with should be maintained - although your
password will have changed.
If you want to know the password that has been set in order to login and
change options then you can have it emailled to you here :-
http://lists.centos.org/mailman/options/centos-mirror
Regards
Lance
--
uklinux.net -
The ISP of choice for the discerning Linux user.
I already replied to this kind of question :
simply do a dry run with rsync with the verbose option.
The last numbers give the total size of what would have been tranferred.
man rync :
-n, --dry-run show what would have been transferred
-----Message d'origine-----
De : centos-mirror-bounces(a)centos.org
[mailto:centos-mirror-bounces@centos.org]De la part de Jason Boles
Envoyé : mardi 26 avril 2005 22:55
À : centos-mirror(a)centos.org
Objet : [CentOS-mirror] centos mirror disk space requirements
Hello all,
I'm interested in setting up a mirror, however I couldn't find the
total size of everything (without downloading it). Could someone
reply with the sizes of the 3.4 and 4.0 subdirectories ?
should be as simple as " find /path/to/mirror/centos -type d -exec du
-shS {} \; "
Also, how can I search the archives of this mailing list ?
(I would like to know preferred cron method for rsync, and howto
configure yum to point to my mirror)
thanks,
-Jason
_______________________________________________
CentOS-mirror mailing list
CentOS-mirror(a)centos.org
http://lists.centos.org/mailman/listinfo/centos-mirror
Can you please add 138.23.169.46 to the list of available mirrors for t3
or faster? We ave resolved our routing issues. Also, our access to the
main mirror needs to be resolved as well. Thanks.
Benjamin
I've set up a Tier 1 mirror for CentOS in Romania:
URLs:
http://ftp.lug.ro/centos/
ftp://ftp.lug.ro/centos/
rsync://ftp.lug.ro/centos/ (available on request)
Location:
Bucharest / Romania
Sponsoring organization:
Romanian Linux Users Group (http://www.lug.ro)
Contact address:
ftpadm _at_ lug.ro
Bandwidth:
155 Mbps
Synchronizing with eu-msync.centos.org::CentOS twice a day:
07:22 EEST
19:22 EEST
Mihai
--
This message was scanned for spam and viruses by BitDefender.
For more information please visit http://linux.bitdefender.com/
Hi, All
I want to mirror the msync.centos.org::CentOS.
And, I completed mirror.
Please, I want to adds My URL in you mirror list.
my information
city: daegu
country: korea
available bandwidth: 100M/bps
frequency of updates: syncronize 3 times per day
mysite: http://www.secuidc.com
mirror URL: http://mirror.secuidc.comftp://mirror.secuidc.com
thank you.
Location: Vienna Univ. of Technology, Austria
URL: < ftp://gd.tuwien.ac.at/opsys/linux/centos/>
URL: < http://gd.tuwien.ac.at/opsys/linux/centos/>
URL: <rsync://gd.tuwien.ac.at/opsys/linux/centos/>
Update freq: 4 times a day
Accessab.: OC3
Admin: Antonin.Sprinzl(a)tuwien.ac.at
Status: available
Cheers,
Antonin
--
Homepage <sts.tuwien.ac.at/staff/Sprinzl.html>
Goodie Domain Service <gd.tuwien.ac.at>
Wiener Klassik Ensemble <www.wienerklassik.at>
Böhmisch/mährische Blasmusik <www.makos.at>
Akademische Bläserphilharmonie Wien <www.blaeserphilharmonie.at>
Hi.
I'd like to tell that new centos mirror is synced in Poland.
ftp://ftp.pbone.net/pub/centosrsync://ftp.pbone.net/centos/
Bandwidth to some polish isp 100mbps.
Bandwidth to rest world 10mbps.
I mirror i386 and x86_64 tree.
Regards.
--
Grzegorz Paszka
The /3.4/os/s390x/ directory includes a lot of subdirectories that do not have
write permission for the owner. For example:
# rsync msync.centos.org::CentOS/3.4/os/s390x/
[...snip...]
dr-xr-xr-x 4096 2005/05/15 21:01:50 RedHat
[...snip...]
Of course that rsync fails creating some symlinks in that directory if it runs
as an unpriviledged user.
Running rsync as root is not an acceptable workaround.
Mihai
--
This message was scanned for spam and viruses by BitDefender.
For more information please visit http://linux.bitdefender.com/
Hi all,
I run the LittleProjects.org mirror. To ensure that the mirrors are
running properly I have the cron job send me an email after each run
(every 4 hours). Most of the time I check the message date and note
that it is on schedule. About once a day I look at the contents to see
if anything new has come up.
Recently I noticed rsync had the following output:
<rsync output>
2.1/
2.1/extras/
2.1/extras/HEADER.html -> /home/centos/centos/HEADER.html
2.1/extras/HEADER.images -> /home/centos/centos/HEADER.images
2.1/extras/SRPMS/
2.1/extras/SRPMS/HEADER.html -> /home/centos/centos/HEADER.html
2.1/extras/SRPMS/HEADER.images -> /home/centos/centos/HEADER.images
</rsync output>
My script also runs chown (and selinux's chcon) after the rsync so that
the files have the correct permissions/types.
If I hadn't seen these errors I wouldn't have thought to look at the
text above:
<chown errors>
/bin/chown: changing ownership of
`/misc/mirrors/centos.org/2.1/extras/SRPMS/HEADER.html': No such file or
directory
/bin/chown: changing ownership of
`/misc/mirrors/centos.org/2.1/extras/SRPMS/HEADER.images': No such file
or directory
/bin/chown: changing ownership of
`/misc/mirrors/centos.org/2.1/extras/headers/HEADER.html': No such file
or directory
/bin/chown: changing ownership of
`/misc/mirrors/centos.org/2.1/extras/headers/HEADER.images': No such
file or directory
</chown errors>
I have no '/home/centos/centos' directory for these symlinks to point
to. They are all over the place. Was this a momentary mistake? Or, am
I just running rsync with the wrong options?
My rsync command is
/usr/bin/rsync -avzH --delete us-msync.centos.org::CentOS
/misc/mirrors/centos.org
I believe I can change the rsync options to copy the files the links
point to, rather than preserving the links. Essentially, I'll remove
the -a option and replace it with its useful constituent options.
Any suggestions?
Sincerely,
Shawn M. Jones