Hey Everyone,
I'm a newbie to the list, not sure if this topic has been covered before but was about to establish a CentOS mirror to support what has helped me out tremendously in the last few months.
On Average, how much does a standard mirror pull per month in transfer?
Any help would be appreciated!
Thanks.
Lee Clements Network Architect ServerGurus Direct: 312.376.8872 Main: 312.376.8870 Fax: 312.205.0153 lee@servergurus.commailto:lee@servergurus.com www.ServerGurus.comhttp://www.servergurus.com/
[cid:image001.jpg@01C9287E.91095CB0]
DISCLAIMER: This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.
On Tue, 7 Oct 2008, Lee Clements wrote:
Hey Everyone,
I'm a newbie to the list, not sure if this topic has been covered before but was about to establish a CentOS mirror to support what has helped me out tremendously in the last few months.
On Average, how much does a standard mirror pull per month in transfer?
Lee,
mirror.chpc.utah.edu pushes 150-200 gigabytes every day (that includes all traffic, and I also have the DVD images pushing my numbers up).
DR
Lee,
We have a smaller mirror that includes versions 4 & 5 and ISO DVD's. Our Centos mirror (mirror.astate.edu) will typically transfer 20-30G a day. Our average flow during peak time is about 3-5Mb. We have seen it peak an average of 10-15M before.
--Todd
Lee Clements wrote: : Hey Everyone, : : I'm a newbie to the list, not sure if this topic has been covered before but was about to establish a CentOS mirror to support what has helped me out tremendously in the last few months. : : On Average, how much does a standard mirror pull per month in transfer? : ftp.fi.muni.cz/ftp.linux.cz sends out 75-80 GB/week of CentOS data.
-Y.
Our mirror servers does about 45mbit/s (95%) (about 9TB of traffic a month)
However it also mirror's debian/fedora/gentoo/suse/ubuntu
Regard,
Jeffrey
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Lee Clements Sent: dinsdag 7 oktober 2008 20:14 To: centos-mirror@centos.org Subject: [CentOS-mirror] Average Monthly Transfer used?
Hey Everyone,
I'm a newbie to the list, not sure if this topic has been covered before but was about to establish a CentOS mirror to support what has helped me out tremendously in the last few months.
On Average, how much does a standard mirror pull per month in transfer?
Any help would be appreciated!
Thanks.
Lee Clements
Network Architect
ServerGurus
Direct: 312.376.8872
Main: 312.376.8870
Fax: 312.205.0153
lee@servergurus.com
www.ServerGurus.com http://www.servergurus.com/
sgsiglogo
DISCLAIMER: This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.
On 7/10/08 19:14, Lee Clements wrote:
On Average, how much does a standard mirror pull per month in transfer?
My UK mirror (full mirror without DVD ISOs) is serving between 700 and 900 GB per month. I've some stats at
http://centos.zanker.org/vnstat/
Regards,
Mike
We are (for some silly reason) listed very low on the mirrors list. We are also listed as not having the ISOs, but we do. I am rsyncing from another mirror that has the ISOs. Anyway, we are putting about 20GB/day. We serve about 9TB/day for all things we mirror, so Cent is not a huge hit to us. I would presume that if the CentOS team put us further up the list and updated to show that we do have the ISOs, that number would increase drastically.
Monthly usage then would be about 600GB for CentOS. roughly.
________________________________
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Lee Clements Sent: Tuesday, October 07, 2008 2:14 PM To: centos-mirror@centos.org Subject: [CentOS-mirror] Average Monthly Transfer used?
Hey Everyone,
I'm a newbie to the list, not sure if this topic has been covered before but was about to establish a CentOS mirror to support what has helped me out tremendously in the last few months.
On Average, how much does a standard mirror pull per month in transfer?
Any help would be appreciated!
Thanks.
Lee Clements
Network Architect
ServerGurus
Direct: 312.376.8872
Main: 312.376.8870
Fax: 312.205.0153
lee@servergurus.com
www.ServerGurus.com http://www.servergurus.com/
DISCLAIMER: This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.
The list of active mirrors on CentOS's site. If yum is randomizing, great. But If I am a person wanting to experiment, I would go look first at the mirrors list, find a relatively close location that has the distribution method of choice, and go from there. Yum updates do not pull ISO images. My comment was merely we do X amount of traffic today, and if we were more prominently displayed we would probably do Y amount. I was not then, nor am I now, attempting to be confrontational or upset. Just trying to further my explination of why my CentOS traffic is low in comparison to everything else I serve.
-----Original Message----- From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Ralph Angenendt Sent: Wednesday, October 08, 2008 7:25 AM To: centos-mirror@centos.org Subject: Re: [CentOS-mirror] Average Monthly Transfer used?
Mullaley, Patrick S (Pat) wrote:
We are (for some silly reason) listed very low on the mirrors list.
Which "mirrors list"? Because the one you get via yum (mirrorlist entry) has a randum succession of mirrors (and changes every hour or so).
Ralph
Hi,
Mine does around 10Mbit/sec 95th% - it's only doing 4 & 5 though with no ISO's.
Regards,
Alex Smith
Lee Clements wrote:
Hey Everyone,
I’m a newbie to the list, not sure if this topic has been covered before but was about to establish a CentOS mirror to support what has helped me out tremendously in the last few months.
On Average, how much does a standard mirror pull per month in transfer?
Any help would be appreciated!
Thanks.
Lee Clements
Network Architect
ServerGurus
Direct: 312.376.8872
Main: 312.376.8870
Fax: 312.205.0153
lee@servergurus.com mailto:lee@servergurus.com
_www.ServerGurus.com http://www.servergurus.com/___
sgsiglogo
*DISCLAIMER:* This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Hi Lee
There seem to be many people on the list who are eager to show off that they have "multiple mirrors" or have "multiple-gigabit" connections and other superlatives. Nevertheless they do contribute and deserve merit for the donation of something what at the end of the day rather turns out to be based on a 99$ unlimited "shared" bandwith rented server offering. And those are normally the same ones who ask in their second post to the list to be added to the ACL to mirror DVDs directly from the master servers as if binary data coming from one of the existing ones who made it in time to that ACL had less value.
What really counts for the project is a meshed content delivery network with fast connections and I personally find as much as possible peered local traffic instead of commercial transit traffic, however the peering situation is not a technical but only a commercial inconvenience. The "yum-fastesmirror" plugin now shipping as default has made the situation more sane because local mirrors are now preferred while before, data traffic was carried around the world by the questionable logic the CentOS team matches server and host IP through DNS.
What is strongly disliked are mirrors shaping the total bandwith on the port to a ridiculous amount of say 2-5 Mbit. This results in slow performance for the leechers from that server since the mirror accepts all request but delivers equally slow to all of them. Unfortunately yum only picks the next mirror on failure but doesn't failover in case of slow performance and cannot suck from multiple sources as bittorrent can. It is better not to have a mirror than having an extremely slow one. If you are not a carrier and you don't have to manage bandwith but purchase data volumes from someone who does, it's perfectly acceptable to allow downloads at wirespeed "as long as offer lasts" and completely stop the mirror when your volume is reached since other mirrors will take over the job thanks to the failover mechanism in yum. It's not a website where people look at and where your reputation suffers if it's down. Don't be shy about denying download requests at will, smarty yum, sitting on millions of machines to get fresh content for its host will pick the next mirror without complaint.
To make it short, if you want to contribute and you are serious about it, budget for a certain throughput not less than 10 Mbit and not more than some 30 Mbit and be creative by having Apache denying requests if the bandwith suddenly outreaches your budget.
My MRTGs are not public as of yet but realistic volumes for CentOS ONLY can be seen here:
http://mirror.silyus.net/ (German mirror, with DVD iso)
http://swissmirror.silyus.net/ (Swiss mirror, without DVD iso)
Expect volumes to double or triple for a couple days when a new release (5.1->5.2) comes out.
Regards, Florian
Von: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] Im Auftrag von Lee Clements Gesendet: Dienstag, 7. Oktober 2008 20:14 An: centos-mirror@centos.org Betreff: [CentOS-mirror] Average Monthly Transfer used?
Hey Everyone,
I'm a newbie to the list, not sure if this topic has been covered before but was about to establish a CentOS mirror to support what has helped me out tremendously in the last few months.
On Average, how much does a standard mirror pull per month in transfer?
Any help would be appreciated!
Thanks.
Lee Clements
Network Architect
ServerGurus
Direct: 312.376.8872
Main: 312.376.8870
Fax: 312.205.0153
lee@servergurus.com
www.ServerGurus.com http://www.servergurus.com/
sgsiglogo
DISCLAIMER: This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.