[CentOS-mirror] Set up New Mirror

Nick Olsen Nick at 141networks.com
Tue Feb 1 14:32:12 EST 2011


oops Didn't reply onlist

Jeffery,
This is the script I use to rsync using lock files. Including DVD's
I just make a file in root called centos.sh paste the code in.
You'll need to do a chmod +x centos.sh to make it execute.
You'll have to modify the script to put the data where you need it to 
be. Once that is done you can run the script, Or use cron to run it 
every few hours or so.
If you want DVD's you must sync from another mirror instead of msync. We 
sync with Cogent, As we are directly peered with them and get good 
transfer rates.
As for no username and password on FTP, I don't have an answer for you, 
Cpanel isn't quite my cup of tea.

Below is the exact script used for http://mirror.flhsi.com/centos

#!/bin/bash
NAME='centos'
LOCKFILE='/tmp/centos.lock'
RSYNC='rsync://mirror.cogentco.com/CentOS/'

######### Commands Start Here.
if [ -f $LOCKFILE ]
         then echo "Lock file exisis" && exit 1
         else echo "Making Lock File" && date > $LOCKFILE
fi

rsync -vaHh --stats --progress --numeric-ids --delete --delete-after 
--delay-updates $RSYNC /home/mirror/public_html/$NAME

/bin/rm -rf $LOCKFILE


On 2/1/2011 2:14 PM, Jeffrey Palladino wrote:
> Nick
> I am not sure how to set up the rsync or the lock files.
> I was wondering if you can give me direction on that I looked all over 
> and I did see some ways of doing it.
> But I want to set up rsync for all the versions. Most of the tutorials 
> are to set up for just let say version 5.
> Also not sure how to set up the lock files.
> I am running centos on this box with cpanel.
> I was wondering if you can send me the commands to get this all set up 
> right.
> As for cron that is working it is adding files to the mirror. But very 
> slow.
> I want to get this done and list it in the mirror list.
> Also the ftp cpanel wont let me set up the ftp without a user and 
> password. Is there a way around that.
> I want to have all centos versions with the dvd versions as well.
> mirror again is:
> http://mirror.bluethundercomputers.net/centos
>
> Thank you for your time.
> Jeffrey Palladino
> http://bluethundercomputers.net
>
> ----- Original Message ----- From: <centos-mirror-request at centos.org>
> To: <centos-mirror at centos.org>
> Sent: Tuesday, February 01, 2011 10:00 AM
> Subject: CentOS-mirror Digest, Vol 72, Issue 1
>
>
>> Send CentOS-mirror mailing list submissions to
>> centos-mirror at centos.org
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>> http://lists.centos.org/mailman/listinfo/centos-mirror
>> or, via email, send a message with subject or body 'help' to
>> centos-mirror-request at centos.org
>>
>> You can reach the person managing the list at
>> centos-mirror-owner at centos.org
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of CentOS-mirror digest..."
>>
>>
>> Today's Topics:
>>
>>   1. Re: Request For Mirroring (Ray Morris)
>>   2. Set up New Mirror (support at bluethundercomputers.net)
>>   3. Re: Set up New Mirror (Nick Olsen)
>>   4. Re: New CentOS mirror in Pakistan (Ralph Angenendt)
>>   5. Re: New Mirror, Williston, VT, USA (Ralph Angenendt)
>>   6. Re: centos.dataplus.az mirror has been deleted (Ralph Angenendt)
>>   7. Re: New Mirror HTTP/FTP/RSYNC://centos.mirrors.atwab.net
>>      (Ralph Angenendt)
>>   8. Re: R (mirror at communilink.net)
>>   9. Re: centos.dataplus.az mirror has been deleted
>>      (mirror at communilink.net)
>>
>>
>> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Mon, 31 Jan 2011 11:46:27 -0600
>> From: Ray Morris <support at bettercgi.com>
>> Subject: Re: [CentOS-mirror] Request For Mirroring
>> To: centos-mirror at centos.org
>> Message-ID: <20110131114627.1edd320d at bettercgi.com>
>> Content-Type: text/plain; charset=US-ASCII
>>
>> Ralph Angenendt ralph.angenendt at gmail.com wrote:
>>> >       Embargoed Destinations
>>> >
>>> >       Fedora's software and/or technical data may NOT be
>>> >       exported/reexported, either directly or indirectly, to the
>>> > following U.S. embargoed or restricted destinations:
>>> >
>>> >       Cuba, Iran, Iraq, North Korea, Sudan or Syria.
>>
>>> Isn't that against the GPL?
>>
>>> Any Lawyers on here?
>>
>>  It does not, but it could have been worded better, and in fact I
>> believe the wording was updated.  Also, the wording essentially has
>> no real effect.  First, that section applies only to the Fedora system
>> as a whole. Paragraph 1 of the Fedora license states that each piece
>> may be distributed under the GPL or other applicable license. So each
>> package is still GPL, just the ISOs, basically, are export restricted,
>> according to the Fedora license.
>>
>>  In section 5 of GPL v3 you'll find:
>>
>> Inclusion of a covered work in an aggregate does not cause this
>> License to apply to the other parts of the aggregate.
>>
>>  Under section 5, Fedora could use any license they wish for the
>> aggregate (ISO) without violating the GPL.  For that reason, it
>> doesn't violate the GPL, since the GPL says they can license the
>> ISO any way they wish, so long as each package is GPL.
>>
>>   As far as the actual effect, recall that the GPL, like any
>> license, is only the AUTHOR giving you THEIR permission to do
>> certain things.  That doesn't imply that the GOVERNMENT also gives
>> THEIR permission.  So while the GPL license may not restrict export,
>> US law may in some cases.  Neither Fedora nor anyone else can give
>> you permission to violate the law, so those export restrictions are
>> in place no matter what Fedora says.
>>
>>   In reality, if you violate the law and the license by exporting
>> an ISO, Fedora isn't going to come after you.  They are just covering
>> their butts legally by not being clear that they are not giving you
>> permission to violate the law.  US law says that they can't indirectly
>> export it, by giving it to you and telling you that you can export it.
>> It may have been better to word it as a warning rather than a
>> restriction, simply warning the user that exporting certain packages
>> may be illegal.
>>
>>  In any event, paragraph 1 of the Fedora license does all that's
>> necesary under the GPL when it grants you a GPL license, using
>> these words:
>>
>> This agreement does not limit User's rights under, or grant
>> User rights that supersede, the license terms of any particular
>> component.
>> -- 
>> Ray Morris
>> support at bettercgi.com
>>
>> Strongbox - The next generation in site security:
>> http://www.bettercgi.com/strongbox/
>>
>> Throttlebox - Intelligent Bandwidth Control
>> http://www.bettercgi.com/throttlebox/
>>
>> Strongbox / Throttlebox affiliate program:
>> http://www.bettercgi.com/affiliates/user/register.php
>>
>>
>>
>>
>>
>>
>> ------------------------------
>>
>> Message: 2
>> Date: Mon, 31 Jan 2011 14:18:13 -0700
>> From: support at bluethundercomputers.net
>> Subject: [CentOS-mirror] Set up New Mirror
>> To: centos-mirror at centos.org
>> Message-ID:
>> <32c80f2671b1183f81de1c26999ee9de.squirrel at bluethundercomputers.net>
>> Content-Type: text/plain;charset=iso-8859-1
>>
>> To whom it may concern:
>> I set up a mirror for centos but I am not sure if I did it right.
>> the address is http://mirror.bluethundercomputers.net/centos
>>
>> I set up cron to update every 4 hours dont know if this is to much or 
>> not.
>> Or should I set it to every 6 hours instead??
>> The cron I set is: rsync -aqzH --delete us-msync.centos.org::CentOS
>> /home/bluethun/public_html/mirror/centos
>>
>> I did put the files in there but some of them are empty along with it 
>> only
>> going up to centos 3.
>> Is this all I had to do and the system will update over time??
>> Did I miss a step??
>>
>> Any help you can give I would be greatful.
>> Also how do I set it up to be ftp and rsyc??
>> I want it to be listed in the mirror list thanks again.
>> Jeffrey Palladino
>> http://bluethundercomputers.net
>>
>>
>>
>> ------------------------------
>>
>> Message: 3
>> Date: Mon, 31 Jan 2011 16:27:13 -0500
>> From: Nick Olsen <Nick at 141networks.com>
>> Subject: Re: [CentOS-mirror] Set up New Mirror
>> To: "Mailing list for CentOS mirrors." <centos-mirror at centos.org>
>> Message-ID: <4D472931.7020304 at 141networks.com>
>> Content-Type: text/plain; charset=ISO-8859-1; format=flowed
>>
>> Is the Rsync Completing?
>> It looks like it isn't.
>> run Rsync with a --progress and see what its doing
>>
>> Also, You may want to use lockfiles so that you have a case of rsync
>> running again before the first one is finished.
>>
>> On 1/31/2011 4:18 PM, support at bluethundercomputers.net wrote:
>>> To whom it may concern:
>>> I set up a mirror for centos but I am not sure if I did it right.
>>> the address is http://mirror.bluethundercomputers.net/centos
>>>
>>> I set up cron to update every 4 hours dont know if this is to much 
>>> or not.
>>> Or should I set it to every 6 hours instead??
>>> The cron I set is: rsync -aqzH --delete us-msync.centos.org::CentOS
>>> /home/bluethun/public_html/mirror/centos
>>>
>>> I did put the files in there but some of them are empty along with 
>>> it only
>>> going up to centos 3.
>>> Is this all I had to do and the system will update over time??
>>> Did I miss a step??
>>>
>>> Any help you can give I would be greatful.
>>> Also how do I set it up to be ftp and rsyc??
>>> I want it to be listed in the mirror list thanks again.
>>> Jeffrey Palladino
>>> http://bluethundercomputers.net
>>>
>>> _______________________________________________
>>> CentOS-mirror mailing list
>>> CentOS-mirror at centos.org
>>> http://lists.centos.org/mailman/listinfo/centos-mirror
>>
>>
>>
>> ------------------------------
>>
>> Message: 4
>> Date: Mon, 31 Jan 2011 23:24:07 +0100
>> From: Ralph Angenendt <ralph.angenendt at gmail.com>
>> Subject: Re: [CentOS-mirror] New CentOS mirror in Pakistan
>> To: centos-mirror at centos.org
>> Message-ID: <4D473687.6030200 at googlemail.com>
>> Content-Type: text/plain; charset=ISO-8859-1
>>
>> Am 30.01.11 00:30, schrieb LUMS Mirror Team:
>>> Hello,
>>>
>>> We have created a new CentOS mirror in Pakistan using the instructions
>>> at http://www.centos.org/modules/tinycontent/index.php?id=22.
>>
>> Okay, just added your mirror - it should show up in a few hours.
>>
>> Regards and thanks for your support,
>>
>> Ralph
>>
>>
>> ------------------------------
>>
>> Message: 5
>> Date: Mon, 31 Jan 2011 23:25:08 +0100
>> From: Ralph Angenendt <ralph.angenendt at gmail.com>
>> Subject: Re: [CentOS-mirror] New Mirror, Williston, VT, USA
>> To: centos-mirror at centos.org
>> Message-ID: <4D4736C4.7030603 at googlemail.com>
>> Content-Type: text/plain; charset=ISO-8859-1
>>
>> Am 31.01.11 01:26, schrieb David Storandt:
>>> Um, oops. Fat fingered the template I was using.
>>>
>>> It should be: HTTP: http://mirror.teljet.net/centos
>>>
>>> -D
>>>
>>>
>>> Am 26.01.11 18:08, schrieb David Storandt:
>>>> I'd like to add our new mirror to the list...
>>>>
>>>> http://mirror.teljet.net
>>>> Available over both IPv4 and IPv6.
>>>>
>>>> Contact: TelJet Support <support at teljet.net>
>>
>> Do you have any sponsoring organization? Any URL you want to be 
>> linked to?
>>
>> Regards,
>>
>> Ralph
>>
>>
>> ------------------------------
>>
>> Message: 6
>> Date: Mon, 31 Jan 2011 23:27:08 +0100
>> From: Ralph Angenendt <ralph.angenendt at gmail.com>
>> Subject: Re: [CentOS-mirror] centos.dataplus.az mirror has been
>> deleted
>> To: centos-mirror at centos.org
>> Message-ID: <4D47373C.50804 at googlemail.com>
>> Content-Type: text/plain; charset=UTF-8
>>
>> Am 31.01.11 09:37, schrieb mirror at communilink.net:
>>> Dear team,
>>>
>>> Here is CommuniLink Internet Limited <http://www.communilink.net/> and
>>> we updated the mirror http and ftp link.
>>> Please also update the mirror list, thanks.
>>>
>>> http://centos.communilink.net <http://centos.communilink.net/>
>>> ftp://centos.communilink.net/centos
>>> Server <ftp://centos.communilink.net/centosServer> IP: 203.124.11.85
>>
>> Okay, as all of that information has been deleted (dataplus.az that is):
>> You are in Azerbeidjan too?
>>
>>> And we also want to ask how to get the *Direct DVD Downloads* for 
>>> mirror
>>> as well?
>>
>> Same answer as for anyone at the moment: Our mirrors need restructuring.
>>
>> Ralph
>>
>>
>> ------------------------------
>>
>> Message: 7
>> Date: Mon, 31 Jan 2011 23:28:11 +0100
>> From: Ralph Angenendt <ralph.angenendt at gmail.com>
>> Subject: Re: [CentOS-mirror] New Mirror
>> HTTP/FTP/RSYNC://centos.mirrors.atwab.net
>> To: centos-mirror at centos.org
>> Message-ID: <4D47377B.1050905 at googlemail.com>
>> Content-Type: text/plain; charset=UTF-8
>>
>> Am 31.01.11 10:10, schrieb avallee at atwab.net:
>>> Hi CentOS Community,
>>>
>>> We have a mirror located in Hamilton, Ontario,  Canada.
>>
>> Atwab is the sponsoring organization and we should link to
>> http://www.atwab.net/?
>>
>> Regards,
>>
>> Ralph
>>
>>
>> ------------------------------
>>
>> Message: 8
>> Date: Tue, 01 Feb 2011 09:23:19 +0800
>> From: mirror at communilink.net
>> Subject: Re: [CentOS-mirror] R
>> To: 'Ralph Angenendt' <ralph.angenendt at gmail.com>,
>> centos-mirror at centos.org
>> Message-ID:
>> <467d1c90cc1da32f72c2934fab711bf3436dd701 at weboffice.com.hk>
>> Content-Type: text/plain; charset="utf-8"
>>
>> null
>> -------------------------
>> Email sent using Atmail - Email, Groupware and Calendaring done right.
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL: 
>> http://lists.centos.org/pipermail/centos-mirror/attachments/20110201/e8a07ec7/attachment-0001.html
>>
>> ------------------------------
>>
>> Message: 9
>> Date: Tue, 1 Feb 2011 09:35:21 +0800
>> From: mirror at communilink.net
>> Subject: Re: [CentOS-mirror] centos.dataplus.az mirror has been
>> deleted
>> To: <centos-mirror at centos.org>, "Ralph Angenendt"
>> <ralph.angenendt at gmail.com>
>> Message-ID: <2430.1296524121 at communilink.net>
>> Content-Type: text/plain; charset="utf-8"
>>
>>  Dear team,
>>
>> Sorry we reply on the wrong thread. We are from Hong Kong. We
>> reconfig our server and the links are changed.
>>
>>  Here is CommuniLink Internet Limited  [1] and
>>  we updated the mirror http and ftp link.
>>  Please also update the mirror list, thanks.
>>
>>  http://centos.communilink.net [2]
>>  ftp://centos.communilink.net/centos [4]
>>  Server  [5] IP: 203.124.11.85
>>
>> Any further enquiry, please feel free to contact us.
>>
>> Best Regards,
>> For and on Behalf of CommuniLink
>>
>> On 11/02/01 06:27 Tue , "Ralph Angenendt" ralph.angenendt at gmail.com
>> sent:
>>  Am 31.01.11 09:37, schrieb mirror at communilink.net:
>> > Dear team,
>> >
>> > Here is CommuniLink Internet Limited  [6] and
>> > we updated the mirror http and ftp link.
>> > Please also update the mirror list, thanks.
>> >
>> > http://centos.communilink.net [7]
>> > ftp://centos.communilink.net/centos [9]
>> > Server  [10] IP: 203.124.11.85
>>
>> Okay, as all of that information has been deleted (dataplus.az that
>> is):
>> You are in Azerbeidjan too?
>>
>> > And we also want to ask how to get the *Direct DVD Downloads* for
>> mirror
>> > as well?
>>
>> Same answer as for anyone at the moment: Our mirrors need
>> restructuring.
>>
>> Ralph
>> _______________________________________________
>> CentOS-mirror mailing list
>> CentOS-mirror at centos.org
>> http://lists.centos.org/mailman/listinfo/centos-mirror [11]
>>
>>
>>
>> Links:
>> ------
>> [1]
>> http://weboffice.com.hk/webmail/parse.php?redirect=http%3A%2F%2Fwww.communilink.net%2F%26gt%3B 
>>
>> [2]
>> http://weboffice.com.hk/webmail/parse.php?redirect=http%3A%2F%2Fcentos.communilink.net 
>>
>> [3]
>> http://weboffice.com.hk/webmail/parse.php?redirect=http%3A%2F%2Fcentos.communilink.net 
>>
>> [4]
>> http://weboffice.com.hk/webmail/parse.php?redirect=ftp%3A%2F%2Fcentos.communilink.net%2Fcentos 
>>
>> [5]
>> http://weboffice.com.hk/webmail/parse.php?redirect=ftp%3A%2F%2Fcentos.communilink.net%2FcentosServer%26gt%3B 
>>
>> [6]
>> http://weboffice.com.hk/webmail/parse.php?redirect=http%3A%2F%2Fwww.communilink.net%2F%26gt%3B 
>>
>> [7]
>> http://weboffice.com.hk/webmail/parse.php?redirect=http%3A%2F%2Fcentos.communilink.net 
>>
>> [8]
>> http://weboffice.com.hk/webmail/parse.php?redirect=http%3A%2F%2Fcentos.communilink.net 
>>
>> [9]
>> http://weboffice.com.hk/webmail/parse.php?redirect=ftp%3A%2F%2Fcentos.communilink.net%2Fcentos 
>>
>> [10]
>> http://weboffice.com.hk/webmail/parse.php?redirect=ftp%3A%2F%2Fcentos.communilink.net%2FcentosServer%26gt%3B 
>>
>> [11]
>> http://weboffice.com.hk/parse.php?redirect=http%3A%2F%2Flists.centos.org%2Fmailman%2Flistinfo%2Fcentos-mirror 
>>
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL: 
>> http://lists.centos.org/pipermail/centos-mirror/attachments/20110201/b69d1b3f/attachment-0001.html
>>
>> ------------------------------
>>
>> _______________________________________________
>> CentOS-mirror mailing list
>> CentOS-mirror at centos.org
>> http://lists.centos.org/mailman/listinfo/centos-mirror
>>
>>
>> End of CentOS-mirror Digest, Vol 72, Issue 1
>> ******************************************** 
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.centos.org/pipermail/centos-mirror/attachments/20110201/e3722163/attachment.html 


More information about the CentOS-mirror mailing list