On Thu, Oct 21, 2010 at 3:29 AM, Karanbir Singh mail-lists@karan.orgwrote:
On 10/21/2010 12:01 AM, Grant McWilliams wrote:
So what we're on the verge of doing here is creating a test set... I'd love to see a shell script that ran a bunch of tests, gathered data about the system and then created an archive that would then be uploaded to a website which created graphs. Dreaming maybe but it would be consistent. So what goes in our testset?
I am trying to create just that - a kickstart that will build a machine as a Xen dom0, build 4 domU's, fire up puppet inside the domU's do the testing and scp results into a central git repo. Then something similar for KVM.
will get the basic framework online today.
- KB
Do you suppose you could get it to use Phoronix Test Suite so we can start to have measurable stats? We could do the same thing for any VM software - even the ones that don't allow publishing stats in the EULA...
I'm also wondering if we should do the whole test suite or a subset. Here is the list of tests..
aio-stress apache battery-power-usage blogbench bork build-apache build-imagemagick build-linux-kernel build-mplayer build-mysql build-php bullet bwfirt byte c-ray cachebench compilebench compliance-acpi compliance-sensors compress-7zip compress-gzip compress-lzma compress-pbzip2 crafty dbench dcraw doom3 encode-ape encode-flac encode-mp3 encode-ogg encode-wavpack espeak et etqw-demo-iqc etqw-demo etqw ffmpeg fhourstones fio fs-mark gcrypt geekbench gluxmark gmpbench gnupg graphics-magick gtkperf hdparm-read himeno hmmer idle-power-usage idle iozone j2dbench java-scimark2 jgfxbat john-the-ripper juliagpu jxrendermark lightsmark mafft mandelbulbgpu mandelgpu mencoder minion mrbayes n-queens nero2d network-loopback nexuiz-iqc nexuiz npb openarena openssl opstone-svd opstone-svsp opstone-vsp padman pgbench phpbench postmark povray prey pybench pyopencl qgears2 quake4 ramspeed render-bench scimark2 smallpt-gpu smallpt smokin-guns specviewperf10 specviewperf9 sqlite stream stresscpu2 sudokut sunflow supertuxkart systester tachyon tiobench tremulous trislam tscp ttsiod-renderer unigine-heaven unigine-sanctuary unigine-tropics unpack-linux urbanterror ut2004-demo vdrift-fps-monitor vdrift video-cpu-usage video-extensions warsow wine-cloth wine-domino wine-fire2 wine-hdr wine-metaballs wine-vf2 wine-water x11perf x264 xplane9-iqc xplane9 yafray
Grant McWilliams
.