[CentOS-mirror] Is my mirror ok?

Tue Apr 20 14:00:40 UTC 2021
Fabian Arrotin <arrfab at centos.org>

On 20/04/2021 11:13, Fabian Arrotin wrote:
> On 19/04/2021 16:37, "Sergio E. López" via CentOS-mirror wrote:
>> Hi there! 
>> I have a mirror (https://mirrors.upr.edu <https://mirrors.upr.edu>) that
>> serve CentOS and others repositories like EPEL, UBUNTU and REMI. While
>> doing updates to my servers I notices that none of my servers are using
>> my CentOS mirror, but for EPEL and REMI repositories’ works fine.
>>
>> # yum clean all; yum update
>> Loaded plugins: fastestmirror
>> Cleaning repos: base epel extras mariadb remi-php74 remi-safe updates
>> Cleaning up list of fastest mirrors
>> Other repos take up 11 M of disk space (use --verbose for details)
>> Loaded plugins: fastestmirror
>> Determining fastest mirrors
>> epel/x86_64/metalink                                                    
>>               |  15 kB  00:00:00     
>>  * base: mirror.centos.iad1.serverforge.org
>> <http://mirror.centos.iad1.serverforge.org>
>>  * epel: mirrors.upr.edu <http://mirrors.upr.edu>
>>  * extras: centos.mirrors.tds.net <http://centos.mirrors.tds.net>
>>  * remi-php74: mirrors.upr.edu <http://mirrors.upr.edu>
>>  * remi-safe: mirrors.upr.edu <http://mirrors.upr.edu>
>>  * updates: ftp.usf.edu <http://ftp.usf.edu>
>>
>> I check if is out of sync in https://mirror-status.centos.org/#pr
>> <https://mirror-status.centos.org/#pr> but is looks OK. I check the logs
>> file web and I notice very low activity to CentOS repository. I also
>> try some «curl» test on my servers, and I never get my server:
>>
>> Normal Curl
>> # curl 'http://mirrorlist.centos.org/?repo=os&arch=x86_64&release=7
>> <http://mirrorlist.centos.org/?repo=os&arch=x86_64&release=7>'
>> http://mirror.centos.iad1.serverforge.org/7.9.2009/os/x86_64/
>> <http://mirror.centos.iad1.serverforge.org/7.9.2009/os/x86_64/>
>> http://mirror.grid.uchicago.edu/pub/linux/centos/7.9.2009/os/x86_64/
>> http://mirror.cybersecurity.nmt.edu/centos/7.9.2009/os/x86_64/
>> http://mirrors.seas.harvard.edu/centos/7.9.2009/os/x86_64/
>> http://repos.eggycrew.com/centos/7.9.2009/os/x86_64/
>> http://ftp.ussg.iu.edu/linux/centos/7.9.2009/os/x86_64/
>> http://mirror.vtti.vt.edu/centos/7.9.2009/os/x86_64/
>> http://mirrors.cat.pdx.edu/centos/7.9.2009/os/x86_64/
>> http://mirrors.mit.edu/centos/7.9.2009/os/x86_64/
>> http://repo1.dal.innoscale.net/centos/7.9.2009/os/x86_64/
>> <http://repo1.dal.innoscale.net/centos/7.9.2009/os/x86_64/>
>>
>>
>> Forcing PR
>> # curl
>> 'http://mirrorlist.centos.org/?repo=os&arch=x86_64&release=7&cc=pr
>> <http://mirrorlist.centos.org/?repo=os&arch=x86_64&release=7&cc=pr>'
>> http://mirror.centos.iad1.serverforge.org/7.9.2009/os/x86_64/
>> <http://mirror.centos.iad1.serverforge.org/7.9.2009/os/x86_64/>
>> http://mirror.grid.uchicago.edu/pub/linux/centos/7.9.2009/os/x86_64/
>> http://mirror.cybersecurity.nmt.edu/centos/7.9.2009/os/x86_64/
>> http://mirrors.seas.harvard.edu/centos/7.9.2009/os/x86_64/
>> http://repos.eggycrew.com/centos/7.9.2009/os/x86_64/
>> http://ftp.ussg.iu.edu/linux/centos/7.9.2009/os/x86_64/
>> http://mirror.vtti.vt.edu/centos/7.9.2009/os/x86_64/
>> http://mirrors.cat.pdx.edu/centos/7.9.2009/os/x86_64/
>> http://mirrors.mit.edu/centos/7.9.2009/os/x86_64/
>> http://repo1.dal.innoscale.net/centos/7.9.2009/os/x86_64/
>>
>>
>> Testing other country (EC):
>> # curl
>> 'http://mirrorlist.centos.org/?repo=os&arch=x86_64&release=7&cc=ec
>> <http://mirrorlist.centos.org/?repo=os&arch=x86_64&release=7&cc=ec>'
>> http://mirror.uta.edu.ec/centos/7.9.2009/os/x86_64/
>> <http://mirror.uta.edu.ec/centos/7.9.2009/os/x86_64/>
>> http://mirror.epn.edu.ec/centos/7.9.2009/os/x86_64/
>> http://mirror.cedia.org.ec/centos/7.9.2009/os/x86_64/
>> http://mirror.ueb.edu.ec/centos/7.9.2009/os/x86_64/
>> http://centos.brisanet.com.br/7.9.2009/os/x86_64/
>> http://centos.mirror.letscloud.io/7.9.2009/os/x86_64/
>> http://mirror.facom.ufms.br/centos/7.9.2009/os/x86_64/
>> http://mirror.ci.ifes.edu.br/centos/7.9.2009/os/x86_64/
>> http://mirror.ufam.edu.br/centos/7.9.2009/os/x86_64/
>> http://centos.ufes.br/7.9.2009/os/x86_64/
>>
>> There's something that I'm missing? Any Idea?
>>
>> Regards.
>> Sergio E. López
>>
>>
> 
> 
> Hi Sergio,
> 
> Thanks for the report, and I think that in fact mirrorlist would just be
> missing a map for nearby country for Puerto Rico .
> I have just created https://pagure.io/centos-infra/issue/298 ticket and
> assigned it to me to investigate and I'll report here when it will be fixed.
> 
> It seems that there is probably just something missing for the
> map/geoiplookup and so it defaults back to US mirrors instead of picking
> yours (which, as you said, is up2date and so should be used in mirrorlist)
> 
> Kind Regards,
> 
> 

Just had a look at crawler logs and the issue is :

500 Can't connect to mirrors.upr.edu:80 (timeout)
ipv4 http://mirrors.upr.edu/centos/ going in timeout mirrors

Can't reach your mirror from mirror crawler, reason why it puts it in
error state and isn't able to validate repositories and why it's absent
from the generated mirrorlists

Maybe we can take that on a thread not on this list if you want to know
the hops where it doesn't seem to work, so that you can ask your ISP
about routing issue ?

-- 
Fabian Arrotin
The CentOS Project | https://www.centos.org
gpg key: 17F3B7A1 | twitter: @arrfab