mirror May 2005

mirror@lists.centos.org

17 participants
20 discussions

Mirror Changes - Important
by Lance Davis 16 Jun '05

16 Jun '05

Due to the split of mirrors with cAos , it will be necessary for mirrors to make some changes to the way that they mirror the CentOS tree, as moving forward it will no longer be a part of the caosity tree. Firstly mirrors need to decide whether they are mirroring CentOS or cAos or both. They are distinct operating systems, CentOS is a rebuild of Enterprise Linux , whereas cAos is an rpm based distribution in its own right. For more information see www.centos.org or caos.caosity.org At present both trees are mirrored with a single rsync of mirror.caosity.org::cAos - moving forward two rsyncs will be needed :- mirror.caosity.org::caosity that will get the caos tree and msync.centos.org::CentOS that will get the CentOS tree Please note that at present CentOS will be listed and stored within the cAos tree, this should not be the case in the future - CentOS should never be stored or listed as a part of cAos or caosity. Mirror Changes -------------- In order to achieve the changes required with minimum download bandwidth the following steps should be carried out. (Note that individual circumstances may vary - if in doubt do nothing and ask) . 1. Stop cron based rsync job from syncing 2. Move the CentOS tree to its new location, which should be at the root of the publically served tree. This can either be achieved with 'mv' or if you want a 2nd chance at it 'cp -al' which will create a hardlinked copy of the tree (as long as it is on the same partition) eg with directory structure /pub /pub/caos /pub/caos/centos cp -al /pub/caos/centos /pub/ or mv /pub/caos/centos /pub to end up with /pub/ /pub/caos /pub/centos (and /pub/caos/centos/ if using cp -al) 3. Create a new rsync cron job to sync the CentOS tree (if required) . This should be something like :- rsync -aqzH --delete msync.centos.org::CentOS /pub/ *** note the change to msync.centos.org *** mirror.centos.org is deprecated for rsync use - to allow us to use different servers for yum mirrors. please use rsync -anvzH --delete msync.centos.org::CentOS /pub/ first to test that the command will do the right thing ('n' is dry run and will just show what wil be transferred - which in theory should be very little - if it says 40 GB + then the command is wrong !!) Note that due to the way that rsync works any updates will only be written to this new tree and not the hardlinked tree left behind if using cp -al above ( that can be deleted once you are happy with the new location working). 4. Create a new rsync cron job to sync the cAos tree (if required). This should be something like :- rsync -aqzH --delete mirror.caosity.org::caosity /pub/ *** note the change to ::caosity - ::cAos will still sync both trees for mirrors that havent restructured yet. *** This will also delete the CentOS tree left underneath the caos tree above. You should now have both trees in the correct places. 5. Please email the list to say that you have restructured your mirror and what the new urls will be for public use. We will update the databases to reflect these new locations. 6. It is not necessary to mirror all of centos if you do not wish to - eg you can choose whether to carry 2.1 , 3.3, 3.4, 4.0 - but please note in the email any trees that you will not be carrying and we will note that in the database. 7. In the very near future we will be restricting access to msync.centos.org to publically listed mirrors only - we have to establiush a way for new mirrors to sync first though. 8. We will be tracking which mirrors have/havent restructured and will contact individual mirrors accordingly. There is now an irc channel - #centos-mirror on irc.freenode.net where mirroring discussions may be held. Lance -- uklinux.net - The ISP of choice for the discerning Linux user.

16 22

Welcome to the new CentOS-mirror mailing list.
by lance＠uklinux.net 13 Jun '05

13 Jun '05

As you will have read in a recent post, the CentOS mirror system is separating from cAos so as to be an independent project in its own right. There will be more information regarding how to change the mirror setup and where to sync from shortly, however for now we are creating new mailing lists. If you were subscribed to the caos-mirror mailing list then you will jave been subscribed to this list automatically. (If not - apologies). The options you subscribed with should be maintained - although your password will have changed. If you want to know the password that has been set in order to login and change options then you can have it emailled to you here :- http://lists.centos.org/mailman/options/centos-mirror Regards Lance -- uklinux.net - The ISP of choice for the discerning Linux user.

2 1

RE: [CentOS-mirror] centos mirror disk space requirements
by Sydney Bogaert 10 Jun '05

10 Jun '05

I already replied to this kind of question : simply do a dry run with rsync with the verbose option. The last numbers give the total size of what would have been tranferred. man rync : -n, --dry-run show what would have been transferred -----Message d'origine----- De : centos-mirror-bounces(a)centos.org [mailto:centos-mirror-bounces@centos.org]De la part de Jason Boles Envoyé : mardi 26 avril 2005 22:55 À : centos-mirror(a)centos.org Objet : [CentOS-mirror] centos mirror disk space requirements Hello all, I'm interested in setting up a mirror, however I couldn't find the total size of everything (without downloading it). Could someone reply with the sizes of the 3.4 and 4.0 subdirectories ? should be as simple as " find /path/to/mirror/centos -type d -exec du -shS {} \; " Also, how can I search the archives of this mailing list ? (I would like to know preferred cron method for rsync, and howto configure yum to point to my mirror) thanks, -Jason _______________________________________________ CentOS-mirror mailing list CentOS-mirror(a)centos.org http://lists.centos.org/mailman/listinfo/centos-mirror

2 1

Mirror for UCr
by barai＠cs.ucr.edu 05 Jun '05

05 Jun '05

Can you please add 138.23.169.46 to the list of available mirrors for t3 or faster? We ave resolved our routing issues. Also, our access to the main mirror needs to be resolved as well. Thanks. Benjamin

3 5

New CentOS mirror (Romania)
by Mihai Maties 30 May '05

30 May '05

I've set up a Tier 1 mirror for CentOS in Romania: URLs: http://ftp.lug.ro/centos/ ftp://ftp.lug.ro/centos/ rsync://ftp.lug.ro/centos/ (available on request) Location: Bucharest / Romania Sponsoring organization: Romanian Linux Users Group (http://www.lug.ro) Contact address: ftpadm _at_ lug.ro Bandwidth: 155 Mbps Synchronizing with eu-msync.centos.org::CentOS twice a day: 07:22 EEST 19:22 EEST Mihai -- This message was scanned for spam and viruses by BitDefender. For more information please visit http://linux.bitdefender.com/

3 9

New Mirror
by 씨큐 28 May '05

28 May '05

Hi, All I want to mirror the msync.centos.org::CentOS. And, I completed mirror. Please, I want to adds My URL in you mirror list. my information city: daegu country: korea available bandwidth: 100M/bps frequency of updates: syncronize 3 times per day mysite: http://www.secuidc.com mirror URL: http://mirror.secuidc.com ftp://mirror.secuidc.com thank you.

2 1

The .at mirror back again
by Antonin Sprinzl 20 May '05

20 May '05

Location: Vienna Univ. of Technology, Austria URL: < ftp://gd.tuwien.ac.at/opsys/linux/centos/> URL: < http://gd.tuwien.ac.at/opsys/linux/centos/> URL: <rsync://gd.tuwien.ac.at/opsys/linux/centos/> Update freq: 4 times a day Accessab.: OC3 Admin: Antonin.Sprinzl(a)tuwien.ac.at Status: available Cheers, Antonin -- Homepage <sts.tuwien.ac.at/staff/Sprinzl.html> Goodie Domain Service <gd.tuwien.ac.at> Wiener Klassik Ensemble <www.wienerklassik.at> Böhmisch/mährische Blasmusik <www.makos.at> Akademische Bläserphilharmonie Wien <www.blaeserphilharmonie.at>

1 0

New mirror setuped
by Grzegorz Paszka 18 May '05

18 May '05

Hi. I'd like to tell that new centos mirror is synced in Poland. ftp://ftp.pbone.net/pub/centos rsync://ftp.pbone.net/centos/ Bandwidth to some polish isp 100mbps. Bandwidth to rest world 10mbps. I mirror i386 and x86_64 tree. Regards. -- Grzegorz Paszka

2 1

Wrong permissions on master mirror
by Mihai Maties 17 May '05

17 May '05

The /3.4/os/s390x/ directory includes a lot of subdirectories that do not have write permission for the owner. For example: # rsync msync.centos.org::CentOS/3.4/os/s390x/ [...snip...] dr-xr-xr-x 4096 2005/05/15 21:01:50 RedHat [...snip...] Of course that rsync fails creating some symlinks in that directory if it runs as an unpriviledged user. Running rsync as root is not an acceptable workaround. Mihai -- This message was scanned for spam and viruses by BitDefender. For more information please visit http://linux.bitdefender.com/

1 0

Mirror Symlinks?
by Shawn M. Jones 16 May '05

16 May '05

Hi all, I run the LittleProjects.org mirror. To ensure that the mirrors are running properly I have the cron job send me an email after each run (every 4 hours). Most of the time I check the message date and note that it is on schedule. About once a day I look at the contents to see if anything new has come up. Recently I noticed rsync had the following output: <rsync output> 2.1/ 2.1/extras/ 2.1/extras/HEADER.html -> /home/centos/centos/HEADER.html 2.1/extras/HEADER.images -> /home/centos/centos/HEADER.images 2.1/extras/SRPMS/ 2.1/extras/SRPMS/HEADER.html -> /home/centos/centos/HEADER.html 2.1/extras/SRPMS/HEADER.images -> /home/centos/centos/HEADER.images </rsync output> My script also runs chown (and selinux's chcon) after the rsync so that the files have the correct permissions/types. If I hadn't seen these errors I wouldn't have thought to look at the text above: <chown errors> /bin/chown: changing ownership of `/misc/mirrors/centos.org/2.1/extras/SRPMS/HEADER.html': No such file or directory /bin/chown: changing ownership of `/misc/mirrors/centos.org/2.1/extras/SRPMS/HEADER.images': No such file or directory /bin/chown: changing ownership of `/misc/mirrors/centos.org/2.1/extras/headers/HEADER.html': No such file or directory /bin/chown: changing ownership of `/misc/mirrors/centos.org/2.1/extras/headers/HEADER.images': No such file or directory </chown errors> I have no '/home/centos/centos' directory for these symlinks to point to. They are all over the place. Was this a momentary mistake? Or, am I just running rsync with the wrong options? My rsync command is /usr/bin/rsync -avzH --delete us-msync.centos.org::CentOS /misc/mirrors/centos.org I believe I can change the rsync options to copy the files the links point to, rather than preserving the links. Essentially, I'll remove the -a option and replace it with its useful constituent options. Any suggestions? Sincerely, Shawn M. Jones

1 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

mirror May 2005