[CentOS-mirror] Bandwidth questions
pstewart at nexicomgroup.net
Tue Mar 22 12:42:12 EDT 2011
We only serve via HTTP today - but we run mod_security in order to keep a grasp on traffic levels. CentOS in particular we don't have any limits on as it never gets higher than what we are prepared for, but we mirror *many* other things and there's a few we have to keep an eye on (such as Mozilla mirror) especially during release days.
From: centos-mirror-bounces at centos.org [mailto:centos-mirror-bounces at centos.org] On Behalf Of Jim Kusznir
Sent: Tuesday, March 22, 2011 12:24 PM
To: Mailing list for CentOS mirrors.
Subject: Re: [CentOS-mirror] Bandwidth questions
Unfortunately, I don't run the upstream router. And I just got shut
down by central IT...Apparently I was overloading their traffic shaper
and impeding performance campus-wide.
So I need to come up with a rate limiting method that runs on my
mirror server. I know linux has QoS and other traffic shaping
systems, I just haven't found a very clear guide to using them, and I
was hoping for someone using traffic shaping on linux with mirror
servers to supply some suggested settings.
On Tue, Mar 22, 2011 at 9:13 AM, Nick Olsen <Nick at 141networks.com> wrote:
> I would limit it on the upstream router. We just give ours a 100mb/s
> port and call it a day. But I think rate limiting upstream would work
> the best if you need it to run speeds other then just standard eth
> speeds (10/100/1000).
> On 3/22/2011 12:11 PM, Jim Kusznir wrote:
>> So do users have a suggestion on how to throttle / rate limit their
>> mirror server? Mine sits on a gig-e connection, and I just got a call
>> from campus IT questioning the amount of bandwidth I'm using...Right
>> now, I'm running it "fully open", but I may have to restrict that, at
>> least during certain hours. I run http, ftp, and rsync on my server.
>> On Fri, Mar 18, 2011 at 9:35 AM, Nick Olsen<Nick at 141networks.com> wrote:
>>> Ours is quite bursty, Sits around only 5-30mb/s normally. But will
>>> sometimes hammer the 100Mb/s ethernet port its on for 20minutes to an hour.
>>> On 3/18/2011 12:33 PM, James A. Peltier wrote:
>>>> ----- Original Message -----
>>>> | I'm setting up a public mirror (ftp only so far) on one of our servers
>>>> | and was wondering what kind of bandwidth usage to plan for. We have
>>>> | about 100M overall at this site, but I want to make sure that I can
>>>> | limit the rate appropriately. I had planned on doing this using the
>>>> | ftp
>>>> | server's configuration (vsftpd).
>>>> | Anyone have any notes on a good ballpark figure for maximum number of
>>>> | connections and maximum bandwidth per connection? Any horror stories,
>>>> | grim warnings or sage advice appreciated.
>>>> I was averaging about 50-100MBps when I initially deployed. When the mirror was in full swing I was saturating my Gigabit switches. It's now been throttled to 20MBps during peak hours if you aren't on CA*Net or Canarie and if you are 50MBps during peak hours.
>>> CentOS-mirror mailing list
>>> CentOS-mirror at centos.org
>> CentOS-mirror mailing list
>> CentOS-mirror at centos.org
> CentOS-mirror mailing list
> CentOS-mirror at centos.org
CentOS-mirror mailing list
CentOS-mirror at centos.org
More information about the CentOS-mirror