Hello All

I support Randy M, my mirror is mirrors.bd-servers.net has multiple address, that's not the issue, issue is the machine itself update any rpm via yum, it always choose .au mirrors!

Other box in same subnet, also choose most of the time .au mirror. So I have to change the yum.conf of all CentOS box to use mirrors.bd-servers.net. More funny thing is from mirror access log, I found most of request is coming from India, Pakistan, Nepal etc. Few Bangladeshi IP also shows up, but it is too low in numbers. I think the problem is on fastmirror plugin.

From my country we have 3 gateway One is Seabone, Italy (EU), Other

is Singapore where few high speed mirror running, those mirrors are connected with Singapore National IX and the 3rd and most traffic pass through Tata Communication, India.

I asked few friend of India to check the mirror, result: most of time about 4 out of 5 found mirrors.bd-servers.net as their list.

We might have to do something about this issue.

Regards Ahamed Bauani

On Sat, Sep 25, 2010 at 8:01 AM, Randy McAnally rsm@fast-serv.com wrote:

Here's another that popped up after a 'yum clean all':

styx.biochem.wfubmc.edu @50kb.sec

The funny thing is we have local public mirrors in both our datacenters yet these 5-50kb/sec mirrors always win for some reason :)

-- Randy M. www.FastServ.com

---------- Original Message ----------- From: "Randy McAnally" rsm@fast-serv.com To: centos-mirror@centos.org Sent: Fri, 24 Sep 2010 21:58:59 -0400 Subject: [CentOS-mirror] Terrible .edu mirror performance

...

Anyone else seeing dismal speeds from multiple .edu mirrors?  Over the past few days?  Several .edu mirrors over the past week have been running at 3kB/sec - 50kB/sec forcing me to have to clean my yum cache just to get through the update process.  Latest .edu offender at 3kB/sec is mirror.vcu.edu.  Even yum thinks it's a fast mirror for some reason.

I know it's great that schools are pitching in, but c-mon we need some kind of performance monitor for the Tier1 mirrors...not just up or down tests.

-- Randy M. www.FastServ.com

---

CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror

------- End of Original Message -------

---

CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror

Hi Karanbir Singh

Thanks for your reply with details info. Just one more thing, the Mirror Machine Itself choosing mirror in other country, when default configuration is used.

Regards Ahamed Bauani http://www.buanai.org

On Sat, Sep 25, 2010 at 4:33 PM, Karanbir Singh mail-lists@karan.org wrote:

On 09/25/2010 03:45 AM, Bangladeshi CentOS Mirror Maintainer [BD-SERVERS.NET] wrote:

...

Hello All

I support Randy M, my mirror is mirrors.bd-servers.net has multiple address, that's not the issue, issue is the machine itself update any rpm via yum, it always choose .au mirrors!

Other box in same subnet, also choose most  of the time .au mirror. So I have to change the yum.conf of all CentOS box to use mirrors.bd-servers.net. More funny thing is from mirror access log, I found most of request is coming from India, Pakistan, Nepal etc. Few Bangladeshi IP also shows up, but it is too low in numbers. I think the problem is on fastmirror plugin.

the fastestmirror code is very simple, take a look and see what you might think is causing the issue.

...

...

From my country we have 3 gateway   One is Seabone, Italy (EU), Other

is Singapore where few high speed mirror running, those mirrors are connected with Singapore National IX and the 3rd and most traffic pass through Tata Communication, India.

I asked few friend of India to check the mirror, result: most of time about 4 out of 5 found mirrors.bd-servers.net as their list.

Thats expected, the mirrorlist will use geo-neighbour in the hostlist to workout places 'geographically close' to the yum client pulling.

...

We might have to do something about this issue.

Like what ?

• KB

---

CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror

RE: edu bandwidth:

I run centos.eecs.wsu.edu, and I do watch the university's bandwidth. I know that these days most universities have huge pipes, and we're actually in the "smaller" catagory, as we only have an OC-12 (622Mbps), although local management is working to upgrade this.

That said, my mirror will max out well before our bandwidth. My mirror is also a Ubuntu mirror, and when 10.04 was released, the entire university's bandwidth went up by a third, and that was me serving. I was pushing about 40Mbps out of my box, and that limit was hardware related (like many mirror servers, this hardware is second rate).

If you're looking for an awesome mirror, check out mirror.its.uidaho.edu These guys have a very solid server, and gobs of bandwidth (more than WSU), and fewer users. Local cablemodem users (there's no direct peering) reguarly report 20Mbps transfer rates -- the cablemodem cap's.

So, if you test to uidaho and still have poor performance, there's probably some trauma happening on the internet. I know our performance on campus to off campus was pretty bad a few days ago, and apparently that was traced to a backbone provider's misconfigured router that caused good portions of the US backbones to get bogged down.

So, my suggestion: try mirror.its.uidaho.edu; if it still is poor performance (as well as several other .edu), then its probably a larger-scale Internet problem, not an .edu problem...give it a few days and it should iron out.

--Jim

On Sat, Sep 25, 2010 at 1:27 PM, Tru Huynh tru@centos.org wrote:

On Sat, Sep 25, 2010 at 08:45:00AM +0600, Bangladeshi CentOS Mirror Maintainer [BD-SERVERS.NET] wrote:

...

Hello All

I support Randy M, my mirror is mirrors.bd-servers.net has multiple address, that's not the issue, issue is the machine itself update any rpm via yum, it always choose .au mirrors!

[tru@woodstock ~]$ geoiplookup BD-SERVERS.NET GeoIP Country Edition: CA, Canada GeoIP City Edition, Rev 1: CA, BC, Kelowna, v1y9x1, 49.900002, -119.483299, 0, 0 [tru@woodstock ~]$ host BD-SERVERS.NET BD-SERVERS.NET has address 69.10.136.107 BD-SERVERS.NET mail is handled by 0 BD-SERVERS.NET. [tru@woodstock ~]$ host  bauani.org bauani.org has address 69.10.136.107 bauani.org has IPv6 address 2001:470:9f54::3 bauani.org mail is handled by 0 mail.bauani.org.

Maybe our geoip db is out of date...

...

Other box in same subnet, also choose most  of the time .au mirror. So I have to change the yum.conf of all CentOS box to use mirrors.bd-servers.net. More funny thing is from mirror access log, I found most of request is coming from India, Pakistan, Nepal etc. Few Bangladeshi IP also shows up, but it is too low in numbers. I think the problem is on fastmirror plugin.

[tru@woodstock ~]$ host mirrors.bd-servers.net mirrors.bd-servers.net has address 175.158.99.139 mirrors.bd-servers.net has address 180.211.221.26 mirrors.bd-servers.net has address 175.158.99.141 mirrors.bd-servers.net has address 175.158.99.140 mirrors.bd-servers.net has IPv6 address 2403:1200::2 [tru@woodstock ~]$ geoiplookup mirrors.bd-servers.net GeoIP Country Edition: BD, Bangladesh [tru@woodstock ~]$ geoiplookup 175.158.99.139 GeoIP Country Edition: BD, Bangladesh [tru@woodstock ~]$ geoiplookup 180.211.221.26 GeoIP Country Edition: BD, Bangladesh [tru@woodstock ~]$ geoiplookup 175.158.99.141 GeoIP Country Edition: BD, Bangladesh [tru@woodstock ~]$ geoiplookup 175.158.99.140 GeoIP Country Edition: BD, Bangladesh [tru@woodstock ~]$

Tru

Tru Huynh (mirrors, CentOS-3 i386/x86_64 Package Maintenance) http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xBEFA581B

---

CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror

-----Original Message-----

Yours is .EDU mirror number 3 with performance issues: 11-20kB/sec on verizon fios as I type this.

Interesting, I have an average download speed of 3.84 MB/s from http://centos.eecs.wsu.edu for a random iso (CentOS-5.5-i386-LiveCD-Release2.iso). Are you using RSYNC/HTTP/FTP? Maybe it is something between you and these mirrors that is causing the issue.

After discussion with another .EDU maintainer, the dismal speeds were do to hard core bandwidth capping on their web server (mod_bandwidth).

Having a bandwidth cap per client is reasonable, preventing your customers from accessing content because two public clients on GigE are taking all of the bandwidth is not. To me the question isn't how fast a single client can download, but how many clients can be supported at X bandwidth per connection.

My suggestion is that anyone running a bandwidth limiter of any sort, or with limited connectivity (<1Gbps upstream these days is limited) should be placed on Tier2 status.

While we don't use a .EDU domain for our mirroring (many do not, like osuosl.org) we are still an education entity, and many these days have larger pipes. Feel free to test against http://mirror.nwresd.org/pub/centos/ but you will find some limits depending on what protocol and how many clients are connected.

-Jonathan

On Sat, Sep 25, 2010 at 11:15 AM, John R. Dennison jrd@gerdesas.com wrote:

On Fri, Sep 24, 2010 at 09:58:59PM -0400, Randy McAnally wrote:

...

Anyone else seeing dismal speeds from multiple .edu mirrors? Over the

past

...

few days? Several .edu mirrors over the past week have been running at 3kB/sec - 50kB/sec forcing me to have to clean my yum cache just to get through the update process. Latest .edu offender at 3kB/sec is mirror.vcu.edu. Even yum thinks it's a fast mirror for some reason.

    vcu.edu has been attrocious for quite some time now; in fact
   I've had it blocked from various colo'd boxes since at least
   August 1st.



                                                   John

This is just a kindergarten-educated guess for my region and totally uninformed and un-educated ones for the neighboring countries. Don't go to the bank with this information.

For Malaysia, for most of its popular ISPs, the peering is fastest through Singapore, Australia and USA-West Coast. Frequently, speeds from these mirrors are the fastest. Yet, Malaysian client-updates are going to a local mirror first (which is very congested), Indonesia next (which is mind-boggling) then Singapore (which should be second-tier) and Australia beign at the bottom.

Local mirrors here frequently received update requests from clients originating from countries whose ISP peering are somewhat less nominal - Philippines, Vietnam, Cambodia, Thailand, Indonesia and sometimes Bangladesh. Examining the mirrorlist.centos.org shows local mirrors here are being listed in those countries' list at somewhat higher priority compared to those known to be better peered.

I'd say we need to examine the local peering and advise the mirror-administrators, them whom manage mirrorlist.centos.org to change the order of preference for neighbouring countries mirrors-list.

Check it out - http://mirrorlist.centos.org/?release=5&arch=x86_64&repo=os&cc=<your country code eg. my>

Regards