Just curious to hear what you might be using to track the usage on your mirror? It's been a long time since we looked at it and mostly we run webalizer. I can't say that I am completely happy with it though.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.commailto:johnstong@westmancom.com P think green; don't print this email.
I've got a complicated setup as it applies to all 100ish physical and virtual servers on my network (as well as around 1000 customer and Point-of-Presence devices across our own fixed-point wireless network).
The actual server is part of our virtual infrastructure, which with a proper VMware license is managed through a vCenter server has a database that keeps stats for months (CPU, Memory, Network, Disk IO, etc). The IP address for that particular server is also queued to 100mbit/100mbit in its gateway router (a Mikrotik Routerboard), and I monitor (using both Opsview and Mikrotik's The Dude) and graph (using Cacti) SNMP statistics for that queue as well as the VLAN the traffic comes in on. I also have a centralized syslog server using ELSA (Enterprise Log Search and Archive) that all logs get dumped to which also produces reports and graphs and is fully searchable.
Hope that helps.
Cheers,
Daniel Pawliw, B.Sc. (Network Administration) Netflash Internet Solutionshttp://www.netflash.ca/ Tel: (519) 741-8167 ext. 265 Fax:(519) 893-7979 Daniel.Pawliw@netflash.net
P Please consider the environment before printing this e-mail.
This Email is confidential, and may contain legally privileged information. If you are not the intended recipient it may be unlawful for you to read, copy, distribute, disclose, or otherwise make use of the information enclosed. If you have received this Email in error please contact us immediately.
Continuum Online Services Ltd. O/A Netflash Internet Solutions will accept no liability for the mistransmission, interference, or interception of any Email and you are reminded that Email is not a secure method of communication.
While all efforts are made to ensure that all downloaded and uploaded Emails are virus free, Continuum Online Services Ltd. will not accept liability for viruses or computer problems which may occur as a result of this Email and/or any attachments.
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Graham Johnston Sent: Thursday, January 17, 2013 9:35 AM To: 'centos-mirror@centos.org' Subject: [CentOS-mirror] Mirror Stats
Just curious to hear what you might be using to track the usage on your mirror? It's been a long time since we looked at it and mostly we run webalizer. I can't say that I am completely happy with it though.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.commailto:johnstong@westmancom.com P think green; don't print this email.
It's close, but what I was really after was deeper than just interface counters, as I like you have those. I am really looking for how and if people analyze who accesses their mirror and what gets downloaded, Apache log analysis for instance.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.commailto:johnstong@westmancom.com P think green; don't print this email.
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Daniel Pawliw Sent: Friday, January 18, 2013 2:02 PM To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] Mirror Stats
I've got a complicated setup as it applies to all 100ish physical and virtual servers on my network (as well as around 1000 customer and Point-of-Presence devices across our own fixed-point wireless network).
The actual server is part of our virtual infrastructure, which with a proper VMware license is managed through a vCenter server has a database that keeps stats for months (CPU, Memory, Network, Disk IO, etc). The IP address for that particular server is also queued to 100mbit/100mbit in its gateway router (a Mikrotik Routerboard), and I monitor (using both Opsview and Mikrotik's The Dude) and graph (using Cacti) SNMP statistics for that queue as well as the VLAN the traffic comes in on. I also have a centralized syslog server using ELSA (Enterprise Log Search and Archive) that all logs get dumped to which also produces reports and graphs and is fully searchable.
Hope that helps.
Cheers,
Daniel Pawliw, B.Sc. (Network Administration) Netflash Internet Solutionshttp://www.netflash.ca/ Tel: (519) 741-8167 ext. 265 Fax:(519) 893-7979 Daniel.Pawliw@netflash.net
P Please consider the environment before printing this e-mail.
This Email is confidential, and may contain legally privileged information. If you are not the intended recipient it may be unlawful for you to read, copy, distribute, disclose, or otherwise make use of the information enclosed. If you have received this Email in error please contact us immediately.
Continuum Online Services Ltd. O/A Netflash Internet Solutions will accept no liability for the mistransmission, interference, or interception of any Email and you are reminded that Email is not a secure method of communication.
While all efforts are made to ensure that all downloaded and uploaded Emails are virus free, Continuum Online Services Ltd. will not accept liability for viruses or computer problems which may occur as a result of this Email and/or any attachments.
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Graham Johnston Sent: Thursday, January 17, 2013 9:35 AM To: 'centos-mirror@centos.org' Subject: [CentOS-mirror] Mirror Stats
Just curious to hear what you might be using to track the usage on your mirror? It's been a long time since we looked at it and mostly we run webalizer. I can't say that I am completely happy with it though.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.commailto:johnstong@westmancom.com P think green; don't print this email.
The unsubscribe option does not appear I work as I unsubscribed from all lists over a week ago and yet I am still receiving emails 13 of which in the last hour alone.
Please make sure I will not receive any more emails.
Thanks
Sent from my iPhone
On Jan 18, 2013, at 12:04, Graham Johnston johnstong@westmancom.com wrote:
It’s close, but what I was really after was deeper than just interface counters, as I like you have those. I am really looking for how and if people analyze who accesses their mirror and what gets downloaded, Apache log analysis for instance.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.com P think green; don't print this email.
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Daniel Pawliw Sent: Friday, January 18, 2013 2:02 PM To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] Mirror Stats
I’ve got a complicated setup as it applies to all 100ish physical and virtual servers on my network (as well as around 1000 customer and Point-of-Presence devices across our own fixed-point wireless network).
The actual server is part of our virtual infrastructure, which with a proper VMware license is managed through a vCenter server has a database that keeps stats for months (CPU, Memory, Network, Disk IO, etc). The IP address for that particular server is also queued to 100mbit/100mbit in its gateway router (a Mikrotik Routerboard), and I monitor (using both Opsview and Mikrotik’s The Dude) and graph (using Cacti) SNMP statistics for that queue as well as the VLAN the traffic comes in on. I also have a centralized syslog server using ELSA (Enterprise Log Search and Archive) that all logs get dumped to which also produces reports and graphs and is fully searchable.
Hope that helps.
Cheers,
Daniel Pawliw, B.Sc. (Network Administration) Netflash Internet Solutions Tel: (519) 741-8167 ext. 265 Fax:(519) 893-7979 Daniel.Pawliw@netflash.net
P Please consider the environment before printing this e-mail.
This Email is confidential, and may contain legally privileged information. If you are not the intended recipient it may be unlawful for you to read, copy, distribute, disclose, or otherwise make use of the information enclosed. If you have received this Email in error please contact us immediately.
Continuum Online Services Ltd. O/A Netflash Internet Solutions will accept no liability for the mistransmission, interference, or interception of any Email and you are reminded that Email is not a secure method of communication.
While all efforts are made to ensure that all downloaded and uploaded Emails are virus free, Continuum Online Services Ltd. will not accept liability for viruses or computer problems which may occur as a result of this Email and/or any attachments.
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Graham Johnston Sent: Thursday, January 17, 2013 9:35 AM To: 'centos-mirror@centos.org' Subject: [CentOS-mirror] Mirror Stats
Just curious to hear what you might be using to track the usage on your mirror? It’s been a long time since we looked at it and mostly we run webalizer. I can’t say that I am completely happy with it though.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.com P think green; don't print this email.
CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
We have it all send to a syslog server, but at the moment we don't have any statistics (ie awstats or the like) in place. I'm not overly concerned for that at the moment, but it might get implemented when fail2ban gets put in place (it's one of the last servers slated to get it installed at the moment though).
Daniel Pawliw, B.Sc. (Network Administration) Netflash Internet Solutionshttp://www.netflash.ca/ Tel: (519) 741-8167 ext. 265 Fax:(519) 893-7979 Daniel.Pawliw@netflash.net
P Please consider the environment before printing this e-mail.
This Email is confidential, and may contain legally privileged information. If you are not the intended recipient it may be unlawful for you to read, copy, distribute, disclose, or otherwise make use of the information enclosed. If you have received this Email in error please contact us immediately.
Continuum Online Services Ltd. O/A Netflash Internet Solutions will accept no liability for the mistransmission, interference, or interception of any Email and you are reminded that Email is not a secure method of communication.
While all efforts are made to ensure that all downloaded and uploaded Emails are virus free, Continuum Online Services Ltd. will not accept liability for viruses or computer problems which may occur as a result of this Email and/or any attachments.
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Graham Johnston Sent: Friday, January 18, 2013 3:05 PM To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] Mirror Stats
It's close, but what I was really after was deeper than just interface counters, as I like you have those. I am really looking for how and if people analyze who accesses their mirror and what gets downloaded, Apache log analysis for instance.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.commailto:johnstong@westmancom.com P think green; don't print this email.
From: centos-mirror-bounces@centos.orgmailto:centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Daniel Pawliw Sent: Friday, January 18, 2013 2:02 PM To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] Mirror Stats
I've got a complicated setup as it applies to all 100ish physical and virtual servers on my network (as well as around 1000 customer and Point-of-Presence devices across our own fixed-point wireless network).
The actual server is part of our virtual infrastructure, which with a proper VMware license is managed through a vCenter server has a database that keeps stats for months (CPU, Memory, Network, Disk IO, etc). The IP address for that particular server is also queued to 100mbit/100mbit in its gateway router (a Mikrotik Routerboard), and I monitor (using both Opsview and Mikrotik's The Dude) and graph (using Cacti) SNMP statistics for that queue as well as the VLAN the traffic comes in on. I also have a centralized syslog server using ELSA (Enterprise Log Search and Archive) that all logs get dumped to which also produces reports and graphs and is fully searchable.
Hope that helps.
Cheers,
Daniel Pawliw, B.Sc. (Network Administration) Netflash Internet Solutionshttp://www.netflash.ca/ Tel: (519) 741-8167 ext. 265 Fax:(519) 893-7979 Daniel.Pawliw@netflash.netmailto:Daniel.Pawliw@netflash.net
P Please consider the environment before printing this e-mail.
This Email is confidential, and may contain legally privileged information. If you are not the intended recipient it may be unlawful for you to read, copy, distribute, disclose, or otherwise make use of the information enclosed. If you have received this Email in error please contact us immediately.
Continuum Online Services Ltd. O/A Netflash Internet Solutions will accept no liability for the mistransmission, interference, or interception of any Email and you are reminded that Email is not a secure method of communication.
While all efforts are made to ensure that all downloaded and uploaded Emails are virus free, Continuum Online Services Ltd. will not accept liability for viruses or computer problems which may occur as a result of this Email and/or any attachments.
From: centos-mirror-bounces@centos.orgmailto:centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Graham Johnston Sent: Thursday, January 17, 2013 9:35 AM To: 'centos-mirror@centos.org' Subject: [CentOS-mirror] Mirror Stats
Just curious to hear what you might be using to track the usage on your mirror? It's been a long time since we looked at it and mostly we run webalizer. I can't say that I am completely happy with it though.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.commailto:johnstong@westmancom.com P think green; don't print this email.
Awstats for mirror reporting (we mirror debian, fedora, centos etc). Cacti pulling network stats from our LTM's for full bandwidth reporting like so;
[http://www.spr.id.au/screens/2013-01-18_16-36-04.png]
Does the job quite well.
- Seamus
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Graham Johnston Sent: Friday, 18 January 2013 1:35 AM To: 'centos-mirror@centos.org' Subject: [CentOS-mirror] Mirror Stats
Just curious to hear what you might be using to track the usage on your mirror? It's been a long time since we looked at it and mostly we run webalizer. I can't say that I am completely happy with it though.
Graham Johnston Network Planner Westman Communications Group 204.717.2829 johnstong@westmancom.commailto:johnstong@westmancom.com P think green; don't print this email.
-
Chris Banks -
Daniel Pawliw -
Graham Johnston -
Seamus Ryan