[CentOS-mirror] 5.6 is coming closer

Paul Stewart pstewart at nexicomgroup.net
Thu Apr 7 11:16:18 EDT 2011


Why are you listed under Canada when your server is in the USA?

  1 dis1-rtr-tu-ge0-0.nexicom.net (76.75.85.129) 0 msec 0 msec 0 msec
  2 dis2-rtr-mb-ge9-7.nexicom.net (76.75.85.33) 0 msec 4 msec 0 msec
  3 ge5-1-9-4.core1.toronto1.nexicom.net (98.124.0.226) 12 msec 8 msec
12 msec
  4 gige-g2-20.core1.tor1.he.net (209.51.163.145) [AS 6939] 12 msec 12
msec 12 msec
  5 10gigabitethernet1-2.core1.nyc5.he.net (72.52.92.165) [AS 6939] 24
msec 28 msec 24 msec
  6 bluehost.tienyc.telxgroup.net (206.126.115.34) [AS 25973] 92 msec 92
msec 92 msec
  7 tg2-5.ar01.prov.bluehost.com (69.195.64.41) [AS 11798] 92 msec 92
msec 92 msec
  8 mirror.roelf.org (69.195.90.115) [AS 11798] 92 msec 92 msec 92 msec


-----Original Message-----
From: centos-mirror-bounces at centos.org
[mailto:centos-mirror-bounces at centos.org] On Behalf Of Roelf Wichertjes
Sent: Thursday, April 07, 2011 11:14 AM
To: Mailing list for CentOS mirrors.
Subject: Re: [CentOS-mirror] 5.6 is coming closer

By the way, can someone add a function to the mirror-status so you can
let it sort sites on other things then country?


--------------------
Roelf Software
software.roelf.org
www.roelf.org
--------------------

Op 7 apr. 2011 om 17:11 heeft Roelf Wichertjes <info at roelf.org> het
volgende geschreven:

> Also i found out that i made a error in the cron settings, instead of
it syncing once every 12 houres, it synced every 12 DAYS, i fixed it,
hopefully fixing the low ranking
> 
> 
> --------------------
> Roelf Software
> software.roelf.org
> www.roelf.org
> --------------------
> 
> Op 7 apr. 2011 om 17:03 heeft Roelf Wichertjes <info at roelf.org> het
volgende geschreven:
> 
>> Oh, by the way:
>> What's "mirror age, daily stats" at the mirror list?
>> I'm increasing the sync rate to once an hour.
>> 
>> 
>> --------------------
>> Roelf Software
>> software.roelf.org
>> www.roelf.org
>> --------------------
>> 
>> Op 7 apr. 2011 om 16:58 heeft Roelf Wichertjes <info at roelf.org> het
volgende geschreven:
>> 
>>> I've got the bandwith and speed for it,
>>> I once pulled all 7 install iso's (at the same time) from a high
ranked mirror, it took me 16 min.
>>> Then did the same but now used my mirror, it took me 15 min.
>>> My bandwith is enough.
>>> Ps. I know what a busy server is.
>>> I get a bonus from my host if i have a lot of traffic.
>>> I forgot the tier of the site and i removed the --delete flag.
>>> (my mail software is broken and the webmail i'm using can't handle
the e-mail format of the list-admin, so i can't read the mail in which
he told me the tier).
>>> 
>>> I'm ready for it!
>>> 
>>> 
>>> --------------------
>>> Roelf Software
>>> software.roelf.org
>>> www.roelf.org
>>> --------------------
>>> 
>>> Op 6 apr. 2011 om 20:42 heeft "Paul Stewart"
<pstewart at nexicomgroup.net> het volgende geschreven:
>>> 
>>>> I'm curious as to what a busy mirror is...
>>>> 
>>>> We are currently delivering about 60GB a day of CentOS files...
does
>>>> that put us at the bottom or near the top? ;)
>>>> 
>>>> Paul
>>>> 
>>>> 
>>>> 
>>>> -----Original Message-----
>>>> From: centos-mirror-bounces at centos.org
>>>> [mailto:centos-mirror-bounces at centos.org] On Behalf Of J.H.
>>>> Sent: Wednesday, April 06, 2011 1:37 PM
>>>> To: Mailing list for CentOS mirrors.
>>>> Subject: Re: [CentOS-mirror] 5.6 is coming closer
>>>> 
>>>> On 04/05/2011 01:52 PM, Karanbir Singh wrote:
>>>>> On 04/05/2011 12:30 PM, Roelf Wichertjes wrote:
>>>>>> 
>>>>>> Maybe a idea,
>>>>>> Why not choose the least busy ones,
>>>>>> Say there are 100 mirrors, 5 are busy and 5 almost unused
>>>>>> Isn't it a better idea to let the 5 busy and the 5 unbusy pull
from
>>>> centos.org
>>>>>> And have the other 90 pull from the 5 unbusy?
>>>>>> That should even the load better.
>>>>>>> On 04/05/2011 10:20 AM, Prof. P. Sriram wrote:
>>>>>>>> Maybe it's been discussed before, but would it not be
worthwhile to
>>>> do a
>>>>>>>> DNS based thing for this? We create a temporary rsync source
domain
>>>>>>> 
>>>>>>> Thats quite a lot of work, I'm more keen on having ACL's in
place
>>>> that
>>>>>>> only allow some specific mirrors ( maybe the 100 busiest ones )
to
>>>> pull
>>>>>>> from centos.org; and have everyone else pull from them.
>>>>> 
>>>>> 
>>>>> from 'busy' -i meant more like kernel.org / heanet.ie or
>>>> mirrorservice.org
>>>>> 
>>>>> - KB
>>>> 
>>>> Tiering the mirror distribution is pretty common, and honestly
makes
>>>> things a *LOT* easier for everyone.  I agree with the sentiments
already
>>>> stated, automation is what makes this all doable.  Removing things
like
>>>> --delete from your mirrors, is just a PITA.  Yes accidental
upstream
>>>> removals will happen, but if the mirror infrastructure is
structured
>>>> well it will propagate out and the fix will propagate out quickly.
>>>> 
>>>> The way I've normally seen it is a small number (say 10) mirrors
are
>>>> allowed to pull form the master machines, and servers are then
>>>> encouraged / forced to pull from those tier 1 mirrors.  This means
the
>>>> tier 1's can pull more often from the upstream, and everyone else
can
>>>> make better use of the 1 & 10 gbps (and associated big hardware)
links
>>>> some of the bigger mirrors have.  Personally I think it's
worthwhile,
>>>> and it's not too hard to implement.
>>>> 
>>>> Keep in mind that the 'busier' servers (kernel.org at least) are in
a
>>>> better position (hardware / bandwidth) to support a greater number
of
>>>> people pulling from them.  I would guess many of those "unused"
mirrors
>>>> may not be able to support the deluge you could potentially be
pointing
>>>> at them, this isn't universal but it's something to be aware of.
>>>> 
>>>> - John 'Warthog9' Hawley
>>>> _______________________________________________
>>>> CentOS-mirror mailing list
>>>> CentOS-mirror at centos.org
>>>> http://lists.centos.org/mailman/listinfo/centos-mirror
>>>> _______________________________________________
>>>> CentOS-mirror mailing list
>>>> CentOS-mirror at centos.org
>>>> http://lists.centos.org/mailman/listinfo/centos-mirror
>>> _______________________________________________
>>> CentOS-mirror mailing list
>>> CentOS-mirror at centos.org
>>> http://lists.centos.org/mailman/listinfo/centos-mirror
>> _______________________________________________
>> CentOS-mirror mailing list
>> CentOS-mirror at centos.org
>> http://lists.centos.org/mailman/listinfo/centos-mirror
> _______________________________________________
> CentOS-mirror mailing list
> CentOS-mirror at centos.org
> http://lists.centos.org/mailman/listinfo/centos-mirror
_______________________________________________
CentOS-mirror mailing list
CentOS-mirror at centos.org
http://lists.centos.org/mailman/listinfo/centos-mirror


More information about the CentOS-mirror mailing list