Hi Fabian Is your crawler looking for robots.txt? I just added robots.txt to make sure Crawler is able to read now. This is only server in Canada, we can spare for now. Although in coming months, there is a possibility of upgrading it to 1Gbit/s. Please let me know. Thanks Alex ________________________________ From: CentOS-mirror <centos-mirror-bounces at centos.org> on behalf of Fabian Arrotin <arrfab at centos.org> Sent: Tuesday, October 27, 2020 3:26 AM To: centos-mirror at centos.org <centos-mirror at centos.org> Subject: Re: [CentOS-mirror] Create public mirrors for CentOS On 26/10/2020 08:41, alex leeper wrote: > HTTP: http://centos-mirror.usessionbuddy.com/ <https://centos-mirror.usessionbuddy.com/> > HTTPS: https://centos-mirror.usessionbuddy.com/ > > Sync schedule: Every 4 hrs > Bandwidth: 100 Mbit/s > Location: Canada, Ontario, Toronto > Sponsor: Googu Corporation > Sponsor URL: https://www.usessionbuddy.com > IPv4 address to authorize: 198.27.64.8 > IPv6 address to authorize: NA > Email contact: alexleeper at outlook.com > Mirroring AltArch: no > > Thanks > Alex > Hi Alex, Thanks for your proposal but our crawler seems to have issue reaching that site to validate it. And also, as we have well-connected (Gbit or faster) nodes in Canada, I was wondering about the 100Mbit/s limit on your vhost. What do you think ? -- Fabian Arrotin The CentOS Project | https://www.centos.org gpg key: 17F3B7A1 | twitter: @arrfab -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.centos.org/pipermail/centos-mirror/attachments/20201027/bcaadd0b/attachment-0005.html>