guys, i have the yum plugin -> fastest mirror . But not even once i have seen it selecting repos which are near my region such as japan or australia ( where i get the best speeds). Something is wrong.
It seems stuck with these 3 sites ;
Determining fastest mirrors * ftp-stud.fht-esslingen.de : 0.309373 secs * apt.sw.be : 0.483867 secs * fr2.rpmfind.net : 0.503842 secs
i have tried yum clean all , yum clean metadata....
----- Original Message ----
From: Linux Advocate linuxhousedn@yahoo.com To: CentOS mailing list centos@centos.org Sent: Saturday, August 22, 2009 8:56:37 PM Subject: [CentOS] fasttest mirror -doesnt seem to pick sites near my region
guys, i have the yum plugin -> fastest mirror . But not even once i have seen it selecting repos which are near my region such as japan or australia ( where i get the best speeds). Something is wrong.
It seems stuck with these 3 sites ;
Determining fastest mirrors
- ftp-stud.fht-esslingen.de : 0.309373 secs
- apt.sw.be : 0.483867 secs
- fr2.rpmfind.net : 0.503842 secs
On 22/08/2009, at 10:37 PM, Linux Advocate wrote:
i have tried yum clean all , yum clean metadata....
----- Original Message ----
From: Linux Advocate linuxhousedn@yahoo.com To: CentOS mailing list centos@centos.org Sent: Saturday, August 22, 2009 8:56:37 PM Subject: [CentOS] fasttest mirror -doesnt seem to pick sites near my region
guys, i have the yum plugin -> fastest mirror . But not even once i have seen it selecting repos which are near my region such as japan or australia ( where i get the best speeds). Something is wrong.
It seems stuck with these 3 sites ;
Determining fastest mirrors
- ftp-stud.fht-esslingen.de : 0.309373 secs
- apt.sw.be : 0.483867 secs
- fr2.rpmfind.net : 0.503842 secs
Hi Linux Advocate,
I have found this a problem for the Australian servers I manage as well. I suggest you manually test the speed of some local mirrors then manually specify a mirror rather than relying on the fastest mirror plugin.
If your ISP mirrors content locally then that'd be the logical mirror to use.
Good luck, Oliver
CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Hi Linux Advocate,
I have found this a problem for the Australian servers I manage as well. I suggest you manually test the speed of some local mirrors then manually specify a mirror rather than relying on the fastest mirror plugin.
If your ISP mirrors content locally then that'd be the logical mirror to use.
my repos are configured to use mirrorlist. how do i add mirrors manually?
On 22/08/2009, at 11:02 PM, Linux Advocate wrote:
Hi Linux Advocate,
I have found this a problem for the Australian servers I manage as well. I suggest you manually test the speed of some local mirrors then manually specify a mirror rather than relying on the fastest mirror plugin.
If your ISP mirrors content locally then that'd be the logical mirror to use.
my repos are configured to use mirrorlist. how do i add mirrors manually?
If you take a look in /etc/yum.repos.d/ you will see a number of files. There should be example baseurl lines in the repo files which will be commented out by default. Here's an example of how I use this to manually use my local ISPs mirror for the base repo:
[base] name=CentOS-$releasever - Base #mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&rep... baseurl=ftp://mirror.internode.on.net/pub/centos/$releasever/os/$basearch/ gpgcheck=1 gpgkey=ftp://mirror.internode.on.net/pub/centos/RPM-GPG-KEY-CentOS-5
Regards, Oliver
CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
If you take a look in /etc/yum.repos.d/ you will see a number of files. There should be example baseurl lines in the repo files which will be commented out by default. Here's an example of how I use this to manually use my local ISPs mirror for the base repo:
[base] name=CentOS-$releasever - Base #mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&rep... baseurl=ftp://mirror.internode.on.net/pub/centos/$releasever/os/$basearch/ gpgcheck=1 gpgkey=ftp://mirror.internode.on.net/pub/centos/RPM-GPG-KEY-CentOS-5
Regards, Oliver
I have done this;
-disabled the fastestmirror plugin ( frm the conf file by setting enabled=0 ) -modified CentOS-Base.repo
[base-1] name=CentOS-5 - Base #mirrorlist=http://mirrorlist.centos.org/?release=5&arch=i386&repo=os baseurl=http://ftp.riken.jp/Linux/centos/$releasever/os/$basearch/ exclude=postfix* perl-MIME-Base64 perl-DBI priority=1 enabled=1
what about the rpmforge repos?
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&rep...
baseurl=ftp://mirror.internode.on.net/pub/centos/$releasever/os/$basearch/ gpgcheck=1 gpgkey=ftp://mirror.internode.on.net/pub/centos/RPM-GPG-KEY-CentOS-5
Regards, Oliver
I have done this;
-disabled the fastestmirror plugin ( frm the conf file by setting enabled=0 ) -modified CentOS-Base.repo
[base-1] name=CentOS-5 - Base #mirrorlist=http://mirrorlist.centos.org/?release=5&arch=i386&repo=os baseurl=http://ftp.riken.jp/Linux/centos/$releasever/os/$basearch/ exclude=postfix* perl-MIME-Base64 perl-DBI priority=1 enabled=1
what about the rpmforge repos?
Will this link do?
http://ftp.riken.jp/Linux/dag/redhat/el5/en/i386/rpmforge/RPMS/
my repos are configured to use mirrorlist. how do i add mirrors manually?
If you take a look in /etc/yum.repos.d/ you will see a number of files. There should be example baseurl lines in the repo files which will be commented out by default. Here's an example of how I use this to manually use my local ISPs mirror for the base repo:
[base] name=CentOS-$releasever - Base #mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&rep... baseurl=ftp://mirror.internode.on.net/pub/centos/$releasever/os/$basearch/ gpgcheck=1 gpgkey=ftp://mirror.internode.on.net/pub/centos/RPM-GPG-KEY-CentOS-5
Regards, Oliver
oliver what kind of speeds do u get? what line do u have? i have a 1.0 mbps adsl
On 24/08/2009, at 7:06 PM, Linux Advocate wrote:
my repos are configured to use mirrorlist. how do i add mirrors manually?
If you take a look in /etc/yum.repos.d/ you will see a number of files. There should be example baseurl lines in the repo files which will be commented out by default. Here's an example of how I use this to manually use my local ISPs mirror for the base repo:
[base] name=CentOS-$releasever - Base #mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&rep... baseurl=ftp://mirror.internode.on.net/pub/centos/$releasever/os/$basearch/ gpgcheck=1 gpgkey=ftp://mirror.internode.on.net/pub/centos/RPM-GPG-KEY-CentOS-5
Regards, Oliver
oliver what kind of speeds do u get? what line do u have? i have a 1.0 mbps adsl
I get 10Mbits from my own ISP's mirror, and I'd probably get the same from any other official Australian mirror sites. I have ADSL2+. If I tried any mirror sites outside of Australia it would probably be noticeably slower. If you're in SE Asia I'd imagine any mirror site in Singapore or Korea or Japan should be quite fast. Those countries seem to be the main "hubs" for traffic in that region.
Regards, Oliver
CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&rep...
baseurl=ftp://mirror.internode.on.net/pub/centos/$releasever/os/$basearch/ gpgcheck=1 gpgkey=ftp://mirror.internode.on.net/pub/centos/RPM-GPG-KEY-CentOS-5
Regards, Oliver
oliver what kind of speeds do u get? what line do u have? i have a 1.0 mbps adsl
I get 10Mbits from my own ISP's mirror, and I'd probably get the same from any other official Australian mirror sites. I have ADSL2+. If I tried any mirror sites outside of Australia it would probably be noticeably slower. If you're in SE Asia I'd imagine any mirror site in Singapore or Korea or Japan should be quite fast. Those countries seem to be the main "hubs" for traffic in that region.
what site do u use for rpmforge?
Hi!
On 08/22/2009 01:56 PM, Linux Advocate wrote:
guys, i have the yum plugin -> fastest mirror . But not even once i have seen it selecting repos which are near my region such as japan or australia ( where i get the best speeds). Something is wrong.
There are a few different things that are at play here. Firstly, the mirrorlist will do a geoip lookup and give you what should be the 'best list' for you, so its possible the ip you are connecting from isnt being recognised as being in Japan. from the list you posted, it clearly looks like its passing you European mirrors. So that would be the first place to test.
Could you open an issue report at bugs.centos.org against the 'Mirror' project, with what ip / subnet you are connecting from ?
It seems stuck with these 3 sites ;
Determining fastest mirrors
- ftp-stud.fht-esslingen.de : 0.309373 secs
- apt.sw.be : 0.483867 secs
- fr2.rpmfind.net : 0.503842 secs
So, there are a few options you have here - you can either just replace the mirrorlist with the baseurl= line in /etc/yum.repos.d/ - however, I would strongly encourage you to NOT do that. You are much better off resolving the issue at hand. If you look at /etc/yum/pluginconf.d/fastestmirror.conf you will see the default settings, which should be something like this :
[main] enabled=1 verbose=0 socket_timeout=3 hostfilepath=/var/cache/yum/timedhosts.txt maxhostfileage=10 maxthreads=15
in order to refresh the cash, 'yum clean all' should remove /var/cache/yum/timedhosts.txt ; however if thats failing, another issue report on bugs.centos.org! also try to remove it manually - its possible some acl layer is getting in the way.
Finally, the mashostfileage ( in days )[1] - you can consider reducing that to '1'. During the first few days ( < 5 ) from the time a new release goes out ( like 4.8 ), mirror performance can vary by large factors on a daily basis. It might be a good idea to reduce that on your machine anyway, and see if that builds your confidence in the way this works.
Hope this helps.
[2] its not hard reducing the resolution of mashostfileage, I plan on investigating what the implications around it might be.
fwiw, it appears "linux advocate" is sending his email from a Malaysia IP per the email headres...
$ whois 60.50.xxx.yyy [Querying whois.apnic.net] [whois.apnic.net] % [whois.apnic.net node-2] % Whois data copyright terms http://www.apnic.net/db/dbcopyright.html
inetnum: 60.48.0.0 - 60.54.255.255 netname: XDSLSTREAMYX descr: Telekom Malaysia Berhad descr: Network Strategy descr: Wisma Telekom descr: Jalan Pantai Baru descr: 50672 Kuala Lumpur country: MY
.....
A couple different geo-ip databases I queried on the web (geoiptool.com maxmind.com) concurred
John R Pierce wrote:
fwiw, it appears "linux advocate" is sending his email from a Malaysia IP per the email headres...
$ whois 60.50.xxx.yyy [Querying whois.apnic.net] [whois.apnic.net] % [whois.apnic.net node-2] % Whois data copyright terms http://www.apnic.net/db/dbcopyright.html
inetnum: 60.48.0.0 - 60.54.255.255 netname: XDSLSTREAMYX descr: Telekom Malaysia Berhad descr: Network Strategy descr: Wisma Telekom descr: Jalan Pantai Baru descr: 50672 Kuala Lumpur country: MY
For the record on this one, it seems that our version of the geoip database does not do a proper lookup for IP addresses in the 60.50.50.50 (as an example IP of that range).
What I get is unknown (with our current version). When unknown, it passes a list of high bandwidth machines.
I will get and build a newer version of the GeoIP database and see if I can get a better result.
Thanks, Johnny Hughes
Johnny Hughes wrote:
What I get is unknown (with our current version). When unknown, it passes a list of high bandwidth machines.
I will get and build a newer version of the GeoIP database and see if I can get a better result.
I reported a problem like this much earlier.
I am in Hong Kong. Mirror selects .TW sites for me. BUT, although .TW is close the actual data transfer between there and here is very slow. I learned almost 20 years ago not to do transfers from there.
I excluded all .TW sites in the .CONF file. This wasn't working so good. I noticed that almost all of the sites listed were .EDU.TW so I changed my exclusion to just the .EDU.TW sites. I now live with this exclusion.
Mel
tech wrote:
Johnny Hughes wrote:
What I get is unknown (with our current version). When unknown, it passes a list of high bandwidth machines.
I will get and build a newer version of the GeoIP database and see if I can get a better result.
I reported a problem like this much earlier.
I am in Hong Kong. Mirror selects .TW sites for me. BUT, although .TW is close the actual data transfer between there and here is very slow. I learned almost 20 years ago not to do transfers from there.
I excluded all .TW sites in the .CONF file. This wasn't working so good. I noticed that almost all of the sites listed were .EDU.TW so I changed my exclusion to just the .EDU.TW sites. I now live with this exclusion.
OK, the original problem is fixed in that we now have a better database.
WRT what is considered fast for a given country, I will publish what we currently use, and have the community tell us if it is working or not. I will do this on another thread.
One thing to consider is countries where we actually have mirrors as well. It will all be in the new thread.
Thanks, Johnny Hughes
John R Pierce wrote:
fwiw, it appears "linux advocate" is sending his email from a Malaysia IP per the email headres...
$ whois 60.50.xxx.yyy [Querying whois.apnic.net] [whois.apnic.net] % [whois.apnic.net node-2] % Whois data copyright terms http://www.apnic.net/db/dbcopyright.html
inetnum: 60.48.0.0 - 60.54.255.255 netname: XDSLSTREAMYX descr: Telekom Malaysia Berhad descr: Network Strategy descr: Wisma Telekom descr: Jalan Pantai Baru descr: 50672 Kuala Lumpur country: MY
For the record on this one, it seems that our version of the geoip database does not do a proper lookup for IP addresses in the 60.50.50.50 (as an example IP of that range).
What I get is unknown (with our current version). When unknown, it passes a list of high bandwidth machines.
I will get and build a newer version of the GeoIP database and see if I can get a better result.
johny, are u the maintainer for the geo-ip database?
Linux Advocate wrote:
John R Pierce wrote:
fwiw, it appears "linux advocate" is sending his email from a Malaysia IP per the email headres...
$ whois 60.50.xxx.yyy [Querying whois.apnic.net] [whois.apnic.net] % [whois.apnic.net node-2] % Whois data copyright terms http://www.apnic.net/db/dbcopyright.html
inetnum: 60.48.0.0 - 60.54.255.255 netname: XDSLSTREAMYX descr: Telekom Malaysia Berhad descr: Network Strategy descr: Wisma Telekom descr: Jalan Pantai Baru descr: 50672 Kuala Lumpur country: MY
For the record on this one, it seems that our version of the geoip database does not do a proper lookup for IP addresses in the 60.50.50.50 (as an example IP of that range).
What I get is unknown (with our current version). When unknown, it passes a list of high bandwidth machines.
I will get and build a newer version of the GeoIP database and see if I can get a better result.
johny, are u the maintainer for the geo-ip database?
I maintain the RPM that is used as part of CentOS Extras and that we use on the CentOS servers in question.
I did some major work on the app that CentOS uses for mirrorlists and isolists over the weekend. Especially in the AP region, as we have picked up some mirrors there recently.
Here is a thread that shows the relationship logic of the app:
http://lists.centos.org/pipermail/centos/2009-August/081033.html
If people who think the lists need to change will tell me the good and bad servers for their country, I can change the logic.
Thanks, Johnny Hughes
I maintain the RPM that is used as part of CentOS Extras and that we use on the CentOS servers in question.
I did some major work on the app that CentOS uses for mirrorlists and isolists over the weekend. Especially in the AP region, as we have picked up some mirrors there recently.
Here is a thread that shows the relationship logic of the app:
http://lists.centos.org/pipermail/centos/2009-August/081033.html
If people who think the lists need to change will tell me the good and bad servers for their country, I can change the logic.
Thanks, Johnny Hughes
johny, thanx for the link.
i think 'my' should point to jp, cn, tw, au,sg. the setup u have there is .... ;)
Linux Advocate wrote:
johny, thanx for the link.
i think 'my' should point to jp, cn, tw, au,sg. the setup u have there is .... ;)
do all ISP's in .MY use the same peering/trunking or do different providers have different sorts of international backbone connections?
my region
Linux Advocate wrote:
johny, thanx for the link.
i think 'my' should point to jp, cn, tw, au,sg. the setup u have there is ....
;)
do all ISP's in .MY use the same peering/trunking or do different providers have different sorts of international backbone connections?
different. we have routes to sg, tw (jp, cn) and then one to au.
inetnum: 60.48.0.0 - 60.54.255.255 netname: XDSLSTREAMYX descr: Telekom Malaysia Berhad descr: Network Strategy descr: Wisma Telekom descr: Jalan Pantai Baru descr: 50672 Kuala Lumpur country: MY
.....
A couple different geo-ip databases I queried on the web (geoiptool.com maxmind.com) concurred
yes. so normally i choose mirrors frm taiwan, japan, australia... always got the best speeds frm them.
-
John R Pierce -
Johnny Hughes -
Karanbir Singh -
Linux Advocate -
Oliver Ransom -
tech