I've been setting up a mirror and I would like to know if anybody has any good ideas on how to stress test it without being live?
I'd like to be able to simulate a lot of requests from either one or multiple IPs (I know I'd have to run it on more than one system)
Please let me know as I'm not sure if it's working correctly as of yet!
--
Kate Gerry
OC3 Networks & Web Solutions
530 W 6th Street #901
Los Angeles, CA 90014
kate@oc3networks.com
Hi,
how about a lot of clients and rsync, wget and ftp requests? That would stress the mirror afaik.
Regards Jan
From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of Kate Gerry Sent: Saturday, February 07, 2009 11:28 AM To: CentOS-mirror@centos.org Subject: [CentOS-mirror] Good stress tester...
I've been setting up a mirror and I would like to know if anybody has any good ideas on how to stress test it without being live?
I'd like to be able to simulate a lot of requests from either one or multiple IPs (I know I'd have to run it on more than one system)
Please let me know as I'm not sure if it's working correctly as of yet!
-- Kate Gerry OC3 Networks & Web Solutions 530 W 6th Street #901 Los Angeles, CA 90014 kate@oc3networks.com
On Sat, 7 Feb 2009, Kate Gerry wrote:
I've been setting up a mirror and I would like to know if anybody has any good ideas on how to stress test it without being live?
I'd like to be able to simulate a lot of requests from either one or multiple IPs (I know I'd have to run it on more than one system)
Please let me know as I'm not sure if it's working correctly as of yet!
IMO, real world traffic for static files (ie, normal mirror servers) are unlikely to stress mirrors much. The bottleneck is likely to be available bandwidth, I/O, or possibly RAM/available threads/file descriptors to serve requests.
Unless you're just trying to see at what the limit really is at which your server will fail...
The reason I ask is I'm unsure if the machine is having issues and I'd like to see if it's a machine issue or what.
Also, I sure hope there aren't any issues... It's a RAID5 on a gigabit uplink.
-- Kate Gerry OC3 Networks & Web Solutions 530 W 6th Street #901 Los Angeles, CA 90014 kate@oc3networks.com
-----Original Message----- From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of mirror-maintainer@mirror.averse.net Sent: Saturday, February 07, 2009 15:19 To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] Good stress tester...
On Sat, 7 Feb 2009, Kate Gerry wrote:
I've been setting up a mirror and I would like to know if anybody has any good ideas on how to stress test it without being live?
I'd like to be able to simulate a lot of requests from either one or multiple IPs (I know I'd have to run it on more than one system)
Please let me know as I'm not sure if it's working correctly as of
yet!
IMO, real world traffic for static files (ie, normal mirror servers) are
unlikely to stress mirrors much. The bottleneck is likely to be available bandwidth, I/O, or possibly RAM/available threads/file descriptors to serve requests.
Unless you're just trying to see at what the limit really is at which your server will fail... _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
On 02/08/2009 03:40 AM, Kate Gerry wrote:
The reason I ask is I'm unsure if the machine is having issues and I'd like to see if it's a machine issue or what.
Before we put machines in production we stress them for some time (from a couple of hours to a day) with this tool: http://weather.ou.edu/~apw/projects/stress/
It doesn't do network, but it's a good test for the rest.
Also, I sure hope there aren't any issues... It's a RAID5 on a gigabit uplink.
-- Kate Gerry OC3 Networks& Web Solutions 530 W 6th Street #901 Los Angeles, CA 90014 kate@oc3networks.com
-----Original Message----- From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of mirror-maintainer@mirror.averse.net Sent: Saturday, February 07, 2009 15:19 To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] Good stress tester...
On Sat, 7 Feb 2009, Kate Gerry wrote:
I've been setting up a mirror and I would like to know if anybody has any good ideas on how to stress test it without being live?
I'd like to be able to simulate a lot of requests from either one or multiple IPs (I know I'd have to run it on more than one system)
Please let me know as I'm not sure if it's working correctly as of
yet!
IMO, real world traffic for static files (ie, normal mirror servers) are
unlikely to stress mirrors much. The bottleneck is likely to be available bandwidth, I/O, or possibly RAM/available threads/file descriptors to serve requests.
Unless you're just trying to see at what the limit really is at which your server will fail... _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Hi there,
what makes you believe the machine is having issues when it has not been made public and served any load yet?
There is two software suites I know of to do automated stress test on applications or websites as in your scenario
http://www-01.ibm.com/software/awdtools/tester/robot/index.html http://www.automatedqa.com/products/testcomplete/
But before you invest in such a license and especially time in learning how to use the software, you are probably better off reading logs pointing to a hardware failure or just doing away with the machine. A mirror is an ideal environment to "just see when it fails" and have some network load normal websites don't see. It won't hurt anybody, the built in failover in yum will just pick another mirror if the mirror machine goes down or stops serving requests due to overload.
Sorry for being nearly cynical, but your e-mail address points to a network company and I suppose there is some people who back up the offerings with actual know-how do diagnose issues once they happen. You needn't worry about the design of the mirror as it has been a proven concept working well for many of us. Be confident, roll it out and let it happen, whatever it be.
Florian
----- Original Message ----- From: "Kate Gerry" kate@oc3networks.com To: "Mailing list for CentOS mirrors." centos-mirror@centos.org Sent: Sunday, February 08, 2009 4:40 AM Subject: Re: [CentOS-mirror] Good stress tester...
The reason I ask is I'm unsure if the machine is having issues and I'd like to see if it's a machine issue or what.
Also, I sure hope there aren't any issues... It's a RAID5 on a gigabit uplink.
-- Kate Gerry OC3 Networks & Web Solutions 530 W 6th Street #901 Los Angeles, CA 90014 kate@oc3networks.com
-----Original Message----- From: centos-mirror-bounces@centos.org [mailto:centos-mirror-bounces@centos.org] On Behalf Of mirror-maintainer@mirror.averse.net Sent: Saturday, February 07, 2009 15:19 To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] Good stress tester...
On Sat, 7 Feb 2009, Kate Gerry wrote:
I've been setting up a mirror and I would like to know if anybody has any good ideas on how to stress test it without being live?
I'd like to be able to simulate a lot of requests from either one or multiple IPs (I know I'd have to run it on more than one system)
Please let me know as I'm not sure if it's working correctly as of
yet!
IMO, real world traffic for static files (ie, normal mirror servers) are
unlikely to stress mirrors much. The bottleneck is likely to be available bandwidth, I/O, or possibly RAM/available threads/file descriptors to serve requests.
Unless you're just trying to see at what the limit really is at which your server will fail... _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror _______________________________________________ CentOS-mirror mailing list CentOS-mirror@centos.org http://lists.centos.org/mailman/listinfo/centos-mirror
Hi,
-----Original Message----- From: centos-mirror-bounces@centos.org [mailto:centos-mirror- bounces@centos.org] On Behalf Of Kate Gerry Sent: Sunday, February 08, 2009 4:41 AM To: Mailing list for CentOS mirrors. Subject: Re: [CentOS-mirror] Good stress tester...
The reason I ask is I'm unsure if the machine is having issues and I'd like to see if it's a machine issue or what.
Also, I sure hope there aren't any issues... It's a RAID5 on a gigabit uplink.
I assume there would be just one point: Too much traffic for the interface so the download for everyone would slow down. But that's no hw failure or whatever you're expecting.
Just release the mirror to public and check it periodically with mrtg or collectd and check the logfiles for errors. That's all. No need to worry.
Regards Jan
Silly enough, the reason why I ask is because I'm not 100% on my RAID + RAID controller. I want to ensure that it's stable and not dropping out/etc. And usually, a real 'stress' will show you. While the redundancy of the yum setup is fine... I'd rather not have the attitude of "If it fails it's not a big deal", I want to feel that if I set it up, I don't need to worry about whether it's still up and working at its peak every 5 minutes.
Server info:
FreeBSD 7.1 i386 Dell 2950 /w 4-bay slot raid Xeon 3.0Ghz (Dual Core + HT) 2GB DDR2 Broadcom NetXtreme II BCM5708 1000Base-T attached to Cisco SRW2024 /w fiber uplink 1x 146GB SAS Drive (OS) (I wanted to do a RAID1 on this but since I grabbed a chassis with only 4 ports instead of 6, I was limited) 3x 1TB SATA2 Drives (RAID5 /w repos on it)
I just thought I'd set this up 'for the lulz' and so far it's worked okay. However, I haven't been sure if there have been problems on the server-side, network-side, or just inside my head. There aren't any errors listed in any logs... But logs aren't always everything.
-- Kate Gerry OC3 Networks & Web Solutions 530 W 6th Street #901 Los Angeles, CA 90014 kate@oc3networks.com
Kate Gerry wrote:
I’ve been setting up a mirror and I would like to know if anybody has any good ideas on how to stress test it without being live?
I’d like to be able to simulate a lot of requests from either one or multiple IPs (I know I’d have to run it on more than one system)
Please let me know as I’m not sure if it’s working correctly as of yet!
We also wanted to stress test our new server before going live. To get the load we wrote two small perl programs, one for the server and one for the clients.
The server part generated files with different sizes. The file sizes where picked to look like dvd/cd-iso:s(4.5GB, 700MB), ordinary packages (1-150MB) and small files (1-100k). The program also generated a list containing url:s to the files (both ftp and http). To avoid just getting files from cache we generated a file set with the total size four times the size of ram (in our case 256GB).
At the clients we had another perl program that fetched the list containing the url:s, started a given number of downloads threads, picked a file randomly from the list and and downloaded the file to /dev/null. This way we tested the configuration of httpd, ftpd and the os i one test. At the most we had 12 clients running a total of 7000 simultaneous downloads.
This really helped us to detect bottlenecks and find other problems in the configuration.
regards, Tobias Lundquist