mirror

mirror@lists.centos.org

4577 discussions

Re: [CentOS-mirror] Abusive repodata downloads
by Carsten Otto 03 Apr '24

03 Apr '24

On Wed, Apr 03, 2024 at 02:14:07PM -0400, Stephen John Smoogen wrote: > My expectation is that traffic is going to be higher in the next 6 months > as various systems are getting moved from CentOS 7 to some newer release. > This upgrade process will require a system to be first updated to the > latest '7' and many have had updates turned off for years.. then there will > be a download and update to EL8 or EL9 depending on what they are doing > which will also create a spike in traffic. Even better, that sounds like useful traffic and I have around 15 GBit/sec to spare for that :) -- Dr. Carsten Otto http://verify.rwth-aachen.de/otto/

1 0

Re: [CentOS-mirror] Abusive repodata downloads
by Carsten Otto 03 Apr '24

03 Apr '24

On Wed, Apr 03, 2024 at 12:54:10PM -0500, Dennis Gilmore wrote: > An exception to this would be people building containers. > Theytypically remove the metadata at the end of each build. So do not > have it cached. However, the described behaviour would seem to be > more widespread than some people building containers, which may > indicate some other reason that a group of people are repeatedly > grabbing the same data. It would be interesting to know if they are > only getting repodata or also downloading rpms and other things. Interesting thought! I just grepped for a few of the "abusive" hosts. These hosts are downloading packages, including some "basic" ones like perl, curl, python setuptools. I'll relax the fail2ban rules a bit and see how things evolve over time. Maybe everyone needs to rebuild everything once now, which obviously causes a bit of traffic. -- Dr. Carsten Otto http://verify.rwth-aachen.de/otto/

1 0

Re: [CentOS-mirror] Abusive repodata downloads
by Carsten Otto 03 Apr '24

03 Apr '24

On Tue, Apr 02, 2024 at 05:08:33PM -0700, Kevin Fenzi wrote: > In general clients should pull the repomd.xml file and check if it's > changed, if not, use their cached versions. Does this also apply to this file? /fedora-epel/7/x86_64/repodata/f25bccaa54b08e731162aec431dd82887a5ed1abce8eb6f892ad41454f07e1f3-primary.sqlite.bz2 I have five hosts which each downloaded 4 GByte of this file in the span of 24 hours. The delay between two downloads varies, from a few seconds to a few minutes. -- Dr. Carsten Otto http://verify.rwth-aachen.de/otto/

3 6

Re: [CentOS-mirror] Abusive repodata downloads
by Carsten Otto 03 Apr '24

03 Apr '24

Hi Kevin, On Tue, Apr 02, 2024 at 05:08:33PM -0700, Kevin Fenzi wrote: > How are you determining this? From IP address? Yes. > Those could be a large number of different machines behind a nat proxy > no? Possibly. > Recent versions of fedora do not even download the filelists unless a > user requests/looks up something that needs it. For normal install or > updates, it shouldn't be pulled. Can you tell what OS/versions this is > happening with? Great! No, I just see basic file download information. Blocking those who do it much too often shouldn't be a concern then. > In general clients should pull the repomd.xml file and check if it's > changed, if not, use their cached versions. That's not what I see for quite a lot of peers. > This should normally already be the case, so I wonder what is happening > here, could be a bug in some version/os or otherwise something > unexpected. That's my guess too. Bye Carsten -- Dr. Carsten Otto http://verify.rwth-aachen.de/otto/

2 1

Abusive repodata downloads
by Carsten Otto 02 Apr '24

02 Apr '24

Hi, I'm one of the admins of ftp.halifax.rwth-aachen.de, which offers fedora and fedora-epel among other distributions and projects. I've recently noticed that many Fedora users (including EPEL, CentOS, and BlackArch) frequently re-download "repodata" files that haven't been updated since the previous request. As some of those files are rather large ("filelists") and others are hit extremely often, I added fail2ban rules to deny users access to our service for some time. Please adjust your software so that file mirrors like ours are not (ab)used like this. Files that haven't been changed usually shouldn't be downloaded. Thanks Carsten -- Dr. Carsten Otto http://verify.rwth-aachen.de/otto/

2 1

Problem mirror list from Azerbaijan
by support＠yer.az 05 Mar '24

05 Mar '24

Hi, Dear Mirror team, I hope this e-mail finds you well. Azerbaijan is not in your mirror list for more than 128 days. Can you help us with this? It is very important for our country now. Looking forward to hearing from you soon. Our IP address is: 62.212.239.34 (mirror.yer.az) Best Regards, Yer XSP team.

1 0

Mirror removal: centos.mirror.server24.net
by Thomas Moroder (INCUBATEC GmbH - Srl) 05 Mar '24

05 Mar '24

Dear CentOS Project, due to a change in internal policy we are asking to withdraw centos.mirror.server24.net from your mirror list. Sincerely, Thomas Moroder INCUBATEC Srl, V.Scurciàstr. 36, 39046 Ortisei (BZ), Italy VAT-ID: IT02283140214 | REA: BZ - 168204 | c.c. 10.000 EUR President: Thomas Moroder | LEI: 81560022273FE4C8B730 Voice: +39.0471796829 Fax: +39.0471797949 IMPRINT: https://www.incubatec.com/imprint/ PRIVACY: https://www.incubatec.com/privacy-policy/

2 1

Mirror Removal: centos.ufms.br
by Brivaldo Junior 24 Feb '24

24 Feb '24

Unfortunately, after an outage, our server broke and we are not able to fix it soon. So, we are asking to withdraw centos.ufms.br from your mirror list. Thank you, Prof. Brivaldo

3 2

Mirror Removal
by Thomas Currie 08 Feb '24

08 Feb '24

Please remove mirror.pulsant.com from the mirror list. Due to internal infrastructure changes Thomas Currie Senior Infrastructure Engineer (Platforms) [Pulsant]<https://www.pulsant.com/?source=email> D: +441313145090 M: 447826923039 T: 0345 119 9900 Pulsant - Sirius House, Flassches Yard, Edinburgh, EH12 9LB. [Facebook]<https://www.facebook.com/Pulsant/> [Twitter]<http://twitter.com/PulsantUK> [LinkedIn]<http://www.linkedin.com/company/2515168> Please note that Pulsant may monitor email traffic data and also the content of email for the purposes of security and staff training. Email confidentiality notice This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the sender. Any offers or quotation of service are subject to formal specification. Errors and omissions excepted. Please note that any views or opinions presented in this email are solely those of the author and do not necessarily represent those of Pulsant Limited or any companies within the wider group. Finally, the recipient should check this email and any attachments for the presence of viruses. Pulsant Limited accept no liability for any damage caused by any virus transmitted by this email. Pulsant is a limited company registered in England and Wales. Registered number: 03625971. Registered office: BlueSquare House, Priors Way, Maidenhead, Berkshire, SL6 2HP.

3 2

Change url
by dmitry＠shishkin.email 30 Dec '23

30 Dec '23

Hi! URL changed from mirror.surf to repository.su. A new path to the mirror: HTTP — http://repository.su/centos RSYNC — rsync://repository.su/centos HTTPS — https://repository.su/centos HTTP — http://repository.su/centos-altarch RSYNC — rsync://repository.su/centos-altarch HTTPS — https://repository.su/centos-altarch

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

mirror