I am trying to set up a Mirror of Version 4.0 with updates. When I try to use rsync (which is the method I prefer), I get all versions. Can I rsync and get only version 4?
--
Vicki Stanfield
Linux User #30705 http://counter.li.org
Certified Red Hat Engineer - RHCE Number 806200695901889
Due to space restrictions on the current mirror server I am migrating
everything to a new server. I should have it completed tomorrow and I
have temporarily stopped caos/centos updates on mirror.trouble-free.net.
No paths or ips will change.
--
Regards,
John Quaglieri
InterServer, Inc
201-643-0135x101
Here's my rsync script, kind of a quick write so it could be better.. One thing some of you might like is that the script checks to make sure that the process is actually running if the pid file exists. If the pid file exists but the process doesnt, it clears the pid and continues...
Note: the script has be to run as root to write the pid, other wise you'll need to make a dir in /var/run and chown that dir, chown it to your user and edit the script to use that dir...
--------------[CODE]----------------
#!/bin/sh
RSYNC="/usr/bin/rsync"
RSYNC_OPTS="-aHv --delete --bwlimit=512 "
if [ -f "/var/run/mirror.pid" ]; then
RUNPID=`cat /var/run/mirror.pid`
if ps -p $RUNPID; then
echo "Mirror is already running..."
exit 1
else
echo "Mirror pid found but process dead, cleaning up"
rm -f /var/run/mirror.pid
fi
else
echo "No Mirror Process Detected"
fi
echo $$ > /var/run/mirror.pid
echo -n "Mirror Started at "
date
#CentOS Mirror
$RSYNC $RSYNC_OPTS rsync://mirror.centos.org/cAos/centos/ /data/mirrors/centos/
echo -n "Mirror Ended at "
date
rm -f /var/run/mirror.pid
----------------------------------------------------------------------------------------------------------------------------------------
Best Regards,
Shaun Reitan
Best Regards,
Shaun Reitan
Account Specialist
www.NDCHost.comwww.cPlicensing.net
Hello,
this is my script. :
centos.cmd
------------------------
#!/bin/sh
lockfile=/var/lock/centos.cmd.lock
if [ -f $lockfile ]; then
echo "already running"
exit
fi
touch $lockfile
rsync -azH --delete --bwlimit=wanted_bandwidth rsync://your.preferred.mirror/packages/centos/ /path/to/centos/repository/
rm -f $lockfile
------------------------
don't forget the trailing slashes.
the bandwidth is in kilobytes (ex: 2048 -> 16Mbps), and may be omitted if you don't care of saturating your line.
put the command in your crontab, running one or more times a day.
-----Message d'origine-----
De : centos-mirror-bounces(a)centos.org
[mailto:centos-mirror-bounces@centos.org]De la part de Brian Watters
Envoyé : vendredi 1 avril 2005 4:27
À : 'Mailing list for CentOS mirrors.'
Objet : [CentOS-mirror] RSYNC Script
Hello all,
Some time back I saw a posting of scripts that some of you are using for
running RSYNC, I have searched the list however the list appears to only now
go back a few days .. If those of you that have these sample scripts could
share again I would appreciate.
BRW
_______________________________________________
CentOS-mirror mailing list
CentOS-mirror(a)centos.org
http://lists.centos.org/mailman/listinfo/centos-mirror
Hello,
The URL given as
http://mirrors.cs.hacettepe.edu.tr/centos/
should be
http://mirrors.cs.hacettepe.edu.tr/CentOS/
and
ftp://ftp.cs.hacettepe.edu.tr/pub/mirrors/centos/
should be
ftp://ftp.cs.hacettepe.edu.tr/pub/mirrors/CentOS/
Also our departments name is "Hacettepe Univ. Dept. of Computer Sci. &
Eng." We'll be glad if corrected.
Thanks.
The urls listed at http://centos.org/modules/tinycontent/index.php?id=13
for us should be:
http://centos.westmancom.com/ftp://centos.westmancom.com/
Without the centos/ path added at the end of each.
Thanks,
Bob
-----Original Message-----
From: centos-mirror-bounces(a)centos.org
[mailto:centos-mirror-bounces@centos.org] On Behalf Of Lance Davis
Sent: Wednesday, March 30, 2005 7:02 PM
To: Mailing list for CentOS mirrors.
Subject: RE: [CentOS-mirror] Mirror Changes - Important
On Wed, 30 Mar 2005, Bob Pierce wrote:
> That wasn't intentional at all...
>
> Found we had to add the following to your instructions:
>
> rm /pub/centos/2.1
> mv /pub/caos/centos-2 /pub/centos/2.1
ah - ok - you may not have synced since I made that change earlier to
the
master mirror.
Thanks
Lance
>
>
>
> -----Original Message-----
> From: centos-mirror-bounces(a)centos.org
> [mailto:centos-mirror-bounces@centos.org] On Behalf Of Lance Davis
> Sent: Wednesday, March 30, 2005 6:06 PM
> To: Mailing list for CentOS mirrors.
> Subject: RE: [CentOS-mirror] Mirror Changes - Important
>
> On Wed, 30 Mar 2005, Bob Pierce wrote:
>
> > Our new mirror locations are as follows:
> >
> > http://centos.westmancom.com/
> > ftp://centos.westmancom.com/
> >
> > We won't be mirroring caos for now.
> >
> > Let me know if there's any questions about our setup.
>
> Thanbks - you dont seem to have 2.1 - is that deliberate ?? or again
> something wrong at our end ??
>
> Regards
> Lance
>
> >
> > Good day,
> > Bob Pierce
> >
> > -----Original Message-----
> > From: centos-mirror-bounces(a)centos.org
> > [mailto:centos-mirror-bounces@centos.org] On Behalf Of Lance Davis
> > Sent: Wednesday, March 30, 2005 2:42 PM
> > To: centos-mirror(a)centos.org
> > Cc: caos-mirror(a)caosity.org
> > Subject: [CentOS-mirror] Mirror Changes - Important
> >
> >
> >
> > Due to the split of mirrors with cAos , it will be necessary for
> > mirrors
> >
> > to make some changes to the way that they mirror the CentOS tree, as
> > moving forward it will no longer be a part of the caosity tree.
> >
> > Firstly mirrors need to decide whether they are mirroring CentOS or
> > cAos
> >
> > or both. They are distinct operating systems, CentOS is a rebuild of
> > Enterprise Linux , whereas cAos is an rpm based distribution in its
> > own right.
> >
> > For more information see www.centos.org or caos.caosity.org
> >
> > At present both trees are mirrored with a single rsync of
> > mirror.caosity.org::cAos - moving forward two rsyncs will be needed
:-
> >
> > mirror.caosity.org::caosity that will get the caos tree
> >
> > and
> >
> > msync.centos.org::CentOS that will get the CentOS tree
> >
> > Please note that at present CentOS will be listed and stored within
> > the cAos tree, this should not be the case in the future - CentOS
> > should never be stored or listed as a part of cAos or caosity.
> >
> > Mirror Changes
> > --------------
> >
> > In order to achieve the changes required with minimum download
> > bandwidth
> >
> > the following steps should be carried out. (Note that individual
> > circumstances may vary - if in doubt do nothing and ask) .
> >
> > 1. Stop cron based rsync job from syncing
> >
> > 2. Move the CentOS tree to its new location, which should be at the
> > root
> >
> > of the publically served tree.
> >
> > This can either be achieved with 'mv' or if you want a 2nd chance
> > at it
> > 'cp -al' which will create a hardlinked copy of the tree (as long
> > as it
> > is on the same partition)
> >
> > eg with directory structure /pub
> > /pub/caos
> > /pub/caos/centos
> >
> > cp -al /pub/caos/centos /pub/
> > or
> > mv /pub/caos/centos /pub
> >
> > to end up with /pub/
> > /pub/caos
> > /pub/centos
> > (and /pub/caos/centos/ if using cp -al)
> >
> > 3. Create a new rsync cron job to sync the CentOS tree (if required)
> > .
>
> > This should be something like :-
> >
> > rsync -aqzH --delete msync.centos.org::CentOS /pub/
> >
> > *** note the change to msync.centos.org *** mirror.centos.org is
> > deprecated for rsync use - to allow us to use different servers
> > for
>
> > yum
> > mirrors.
> >
> > please use rsync -anvzH --delete msync.centos.org::CentOS /pub/
> > first to test that the command will do the right thing ('n' is
> > dry
> > run
> > and will just show what wil be transferred - which in theory
should
>
> > be very
> > little - if it says 40 GB + then the command is wrong !!)
> >
> > Note that due to the way that rsync works any updates will only be
> > written to this new tree and not the hardlinked tree left behind if
> > using cp -al
> >
> > above ( that can be deleted once you are happy with the new location
> > working).
> >
> > 4. Create a new rsync cron job to sync the cAos tree (if required).
> > This
> >
> > should be something like :-
> >
> > rsync -aqzH --delete mirror.caosity.org::caosity /pub/
> >
> > *** note the change to ::caosity - ::cAos will still sync both
> trees
> > for mirrors that havent restructured yet.
> > ***
> >
> > This will also delete the CentOS tree left underneath the caos
> > tree
>
> > above.
> >
> > You should now have both trees in the correct places.
> >
> > 5. Please email the list to say that you have restructured your
> > mirror
>
> > and what the new urls will be for public use. We will update the
> > databases to reflect these new locations.
> >
> > 6. It is not necessary to mirror all of centos if you do not wish to
> > -
>
> > eg you can choose whether to carry 2.1 , 3.3, 3.4, 4.0 - but please
> > note in
> >
> > the email any trees that you will not be carrying and we will note
> > that in the database.
> >
> > 7. In the very near future we will be restricting access to
> > msync.centos.org to publically listed mirrors only - we have to
> > establiush a way for new mirrors to sync first though.
> >
> > 8. We will be tracking which mirrors have/havent restructured and
> > will
>
> > contact individual mirrors accordingly.
> >
> > There is now an irc channel - #centos-mirror on irc.freenode.net
> > where mirroring discussions may be held.
> >
> > Lance
> >
> >
>
> --
> uklinux.net -
> The ISP of choice for the discerning Linux user.
>
> _______________________________________________
> CentOS-mirror mailing list
> CentOS-mirror(a)centos.org
> http://lists.centos.org/mailman/listinfo/centos-mirror
> _______________________________________________
> CentOS-mirror mailing list
> CentOS-mirror(a)centos.org
> http://lists.centos.org/mailman/listinfo/centos-mirror
>
--
uklinux.net -
The ISP of choice for the discerning Linux user.
_______________________________________________
CentOS-mirror mailing list
CentOS-mirror(a)centos.org
http://lists.centos.org/mailman/listinfo/centos-mirror
On Wed, 30 Mar 2005, Lance Davis wrote:
> 5. Please email the list to say that you have restructured your mirror
and
> what the new urls will be for public use. We will update the databases
to
> reflect these new locations.
EU - Spain - Universidad de Valladolid (Grupo Universitario de
Informática)
CentOS:
http://ftp.gui.uva.es/sites/centos.org/ftp://ftp.gui.uva.es/sites/centos.org/
Symbolic links at:
http://ftp.gui.uva.es/pub/CentOS/
ftp://ftp.gui.uva.es/pub/CentOS/
cAos:
http://ftp.gui.uva.es/sites/caosity.org/ftp://ftp.gui.uva.es/sites/caosity.org/
Symbolic links at:
http://ftp.gui.uva.es/pub/cAos/
ftp://ftp.gui.uva.es/pub/cAos/
Next week we'll install a new HDD and we'll reach 0.5 TB :D (I hope we can
have rsync access...)
See ya!
Guillermo R
<------------------------------------------------------------------>
< Guillermo Rodriguez Cano ||| billy(a)gui.uva.es >
< Everything that has a beginning, has an end >
< (The Matrix Revolutions 2003) >
<------------------------------------------------------------------>
< Grupo Universitario de Informatica ||| Universidad de Valladolid >
<------------------------------------------------------------------>
All,
There are instructions on CentOS.org concerning how to become a mirror.
Those instructions are for _NEW_ mirrors only. (And for mirroring CentOS
only via the new mirror). If you want to do that, the instructions are
here:
http://www.centos.org/modules/tinycontent/index.php?id=22
We are currently working out a plan to split cAos and CentOS mirrors, so
if you have an existing CentOS mirror (or cAos mirror), you should
continue to use your current mirror method until the detailed plan (and
instructions) are put in place and mailed to this list. You will then
be able to split the process into a cAos and CentOS mirroring process
and pick one, the other, or both to mirror.
Thanks,
Johnny Hughes
Hello,
We have been rsyncing CentOS mirror for a while. Now we have adopted to
the new structure. Our server is a public server and serves from URLs below:
ftp://ftp.cs.hacettepe.edu.tr/pub/mirrors/CentOS
http://mirrors.cs.hacettepe.edu.tr/CentOS
Thanks.
--
Ersin Er
Hacettepe University
Deparment of Computer Science & Engineering
That wasn't intentional at all...
Found we had to add the following to your instructions:
rm /pub/centos/2.1
mv /pub/caos/centos-2 /pub/centos/2.1
-----Original Message-----
From: centos-mirror-bounces(a)centos.org
[mailto:centos-mirror-bounces@centos.org] On Behalf Of Lance Davis
Sent: Wednesday, March 30, 2005 6:06 PM
To: Mailing list for CentOS mirrors.
Subject: RE: [CentOS-mirror] Mirror Changes - Important
On Wed, 30 Mar 2005, Bob Pierce wrote:
> Our new mirror locations are as follows:
>
> http://centos.westmancom.com/
> ftp://centos.westmancom.com/
>
> We won't be mirroring caos for now.
>
> Let me know if there's any questions about our setup.
Thanbks - you dont seem to have 2.1 - is that deliberate ?? or again
something wrong at our end ??
Regards
Lance
>
> Good day,
> Bob Pierce
>
> -----Original Message-----
> From: centos-mirror-bounces(a)centos.org
> [mailto:centos-mirror-bounces@centos.org] On Behalf Of Lance Davis
> Sent: Wednesday, March 30, 2005 2:42 PM
> To: centos-mirror(a)centos.org
> Cc: caos-mirror(a)caosity.org
> Subject: [CentOS-mirror] Mirror Changes - Important
>
>
>
> Due to the split of mirrors with cAos , it will be necessary for
> mirrors
>
> to make some changes to the way that they mirror the CentOS tree, as
> moving forward it will no longer be a part of the caosity tree.
>
> Firstly mirrors need to decide whether they are mirroring CentOS or
> cAos
>
> or both. They are distinct operating systems, CentOS is a rebuild of
> Enterprise Linux , whereas cAos is an rpm based distribution in its
> own right.
>
> For more information see www.centos.org or caos.caosity.org
>
> At present both trees are mirrored with a single rsync of
> mirror.caosity.org::cAos - moving forward two rsyncs will be needed :-
>
> mirror.caosity.org::caosity that will get the caos tree
>
> and
>
> msync.centos.org::CentOS that will get the CentOS tree
>
> Please note that at present CentOS will be listed and stored within
> the cAos tree, this should not be the case in the future - CentOS
> should never be stored or listed as a part of cAos or caosity.
>
> Mirror Changes
> --------------
>
> In order to achieve the changes required with minimum download
> bandwidth
>
> the following steps should be carried out. (Note that individual
> circumstances may vary - if in doubt do nothing and ask) .
>
> 1. Stop cron based rsync job from syncing
>
> 2. Move the CentOS tree to its new location, which should be at the
> root
>
> of the publically served tree.
>
> This can either be achieved with 'mv' or if you want a 2nd chance
> at it
> 'cp -al' which will create a hardlinked copy of the tree (as long
> as it
> is on the same partition)
>
> eg with directory structure /pub
> /pub/caos
> /pub/caos/centos
>
> cp -al /pub/caos/centos /pub/
> or
> mv /pub/caos/centos /pub
>
> to end up with /pub/
> /pub/caos
> /pub/centos
> (and /pub/caos/centos/ if using cp -al)
>
> 3. Create a new rsync cron job to sync the CentOS tree (if required) .
> This should be something like :-
>
> rsync -aqzH --delete msync.centos.org::CentOS /pub/
>
> *** note the change to msync.centos.org *** mirror.centos.org is
> deprecated for rsync use - to allow us to use different servers for
> yum
> mirrors.
>
> please use rsync -anvzH --delete msync.centos.org::CentOS /pub/
> first to test that the command will do the right thing ('n' is dry
> run
> and will just show what wil be transferred - which in theory should
> be very
> little - if it says 40 GB + then the command is wrong !!)
>
> Note that due to the way that rsync works any updates will only be
> written to this new tree and not the hardlinked tree left behind if
> using cp -al
>
> above ( that can be deleted once you are happy with the new location
> working).
>
> 4. Create a new rsync cron job to sync the cAos tree (if required).
> This
>
> should be something like :-
>
> rsync -aqzH --delete mirror.caosity.org::caosity /pub/
>
> *** note the change to ::caosity - ::cAos will still sync both
trees
> for mirrors that havent restructured yet.
> ***
>
> This will also delete the CentOS tree left underneath the caos tree
> above.
>
> You should now have both trees in the correct places.
>
> 5. Please email the list to say that you have restructured your mirror
> and what the new urls will be for public use. We will update the
> databases to reflect these new locations.
>
> 6. It is not necessary to mirror all of centos if you do not wish to -
> eg you can choose whether to carry 2.1 , 3.3, 3.4, 4.0 - but please
> note in
>
> the email any trees that you will not be carrying and we will note
> that in the database.
>
> 7. In the very near future we will be restricting access to
> msync.centos.org to publically listed mirrors only - we have to
> establiush a way for new mirrors to sync first though.
>
> 8. We will be tracking which mirrors have/havent restructured and will
> contact individual mirrors accordingly.
>
> There is now an irc channel - #centos-mirror on irc.freenode.net
> where mirroring discussions may be held.
>
> Lance
>
>
--
uklinux.net -
The ISP of choice for the discerning Linux user.
_______________________________________________
CentOS-mirror mailing list
CentOS-mirror(a)centos.org
http://lists.centos.org/mailman/listinfo/centos-mirror
Our new mirror locations are as follows:
http://centos.westmancom.com/ftp://centos.westmancom.com/
We won't be mirroring caos for now.
Let me know if there's any questions about our setup.
Good day,
Bob Pierce
-----Original Message-----
From: centos-mirror-bounces(a)centos.org
[mailto:centos-mirror-bounces@centos.org] On Behalf Of Lance Davis
Sent: Wednesday, March 30, 2005 2:42 PM
To: centos-mirror(a)centos.org
Cc: caos-mirror(a)caosity.org
Subject: [CentOS-mirror] Mirror Changes - Important
Due to the split of mirrors with cAos , it will be necessary for mirrors
to make some changes to the way that they mirror the CentOS tree, as
moving forward it will no longer be a part of the caosity tree.
Firstly mirrors need to decide whether they are mirroring CentOS or cAos
or both. They are distinct operating systems, CentOS is a rebuild of
Enterprise Linux , whereas cAos is an rpm based distribution in its own
right.
For more information see www.centos.org or caos.caosity.org
At present both trees are mirrored with a single rsync of
mirror.caosity.org::cAos - moving forward two rsyncs will be needed :-
mirror.caosity.org::caosity that will get the caos tree
and
msync.centos.org::CentOS that will get the CentOS tree
Please note that at present CentOS will be listed and stored within the
cAos tree, this should not be the case in the future - CentOS should
never
be stored or listed as a part of cAos or caosity.
Mirror Changes
--------------
In order to achieve the changes required with minimum download bandwidth
the following steps should be carried out. (Note that individual
circumstances may vary - if in doubt do nothing and ask) .
1. Stop cron based rsync job from syncing
2. Move the CentOS tree to its new location, which should be at the root
of the publically served tree.
This can either be achieved with 'mv' or if you want a 2nd chance at
it
'cp -al' which will create a hardlinked copy of the tree (as long as
it
is on the same partition)
eg with directory structure /pub
/pub/caos
/pub/caos/centos
cp -al /pub/caos/centos /pub/
or
mv /pub/caos/centos /pub
to end up with /pub/
/pub/caos
/pub/centos
(and /pub/caos/centos/ if using cp -al)
3. Create a new rsync cron job to sync the CentOS tree (if required) .
This should be something like :-
rsync -aqzH --delete msync.centos.org::CentOS /pub/
*** note the change to msync.centos.org *** mirror.centos.org is
deprecated for rsync use - to allow us to use different servers for
yum
mirrors.
please use rsync -anvzH --delete msync.centos.org::CentOS /pub/
first to test that the command will do the right thing ('n' is dry
run
and will just show what wil be transferred - which in theory should
be very
little - if it says 40 GB + then the command is wrong !!)
Note that due to the way that rsync works any updates will only be
written
to this new tree and not the hardlinked tree left behind if using cp -al
above ( that can be deleted once you are happy with the new location
working).
4. Create a new rsync cron job to sync the cAos tree (if required). This
should be something like :-
rsync -aqzH --delete mirror.caosity.org::caosity /pub/
*** note the change to ::caosity - ::cAos will still sync both trees
for mirrors that havent restructured yet.
***
This will also delete the CentOS tree left underneath the caos tree
above.
You should now have both trees in the correct places.
5. Please email the list to say that you have restructured your mirror
and
what the new urls will be for public use. We will update the databases
to
reflect these new locations.
6. It is not necessary to mirror all of centos if you do not wish to -
eg
you can choose whether to carry 2.1 , 3.3, 3.4, 4.0 - but please note in
the email any trees that you will not be carrying and we will note that
in
the database.
7. In the very near future we will be restricting access to
msync.centos.org to publically listed mirrors only - we have to
establiush
a way for new mirrors to sync first though.
8. We will be tracking which mirrors have/havent restructured and will
contact individual mirrors accordingly.
There is now an irc channel - #centos-mirror
on irc.freenode.net where mirroring discussions may be held.
Lance
--
uklinux.net -
The ISP of choice for the discerning Linux user.
_______________________________________________
CentOS-mirror mailing list
CentOS-mirror(a)centos.org
http://lists.centos.org/mailman/listinfo/centos-mirror
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Our mirror URL (both HTTP and FTP) are listed incorrectly on the mirror
list (http://www.centos.org/modules/tinycontent/index.php?id=13)
They should be:
http://mirrors.jtlnet.com/centos/ (HTTP)
ftp://mirrors.jtlnet.com/centos/ (FTP)
Looks like a simple data entry issue :) If someone could correct them
when they get a chance, it would be appreciated.
Also, I'm not sure if it should be noted here or elsewhere, but I've
moved our mirror over to using the newer rsync URLs.
- --
Adam C. Greenfield (adam(a)jtl.net)
Senior Systems Engineer
JTL Networks Inc. (614) 453-1020
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.5 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
iD8DBQFCSuuaPFtTBnBd3G4RAjOEAKCd65LeAfgQSuBNM1/6Lr6TExK1iwCfapVu
zbIGF+1jk5uVgjU4WT8diDU=
=1YwO
-----END PGP SIGNATURE-----