[CentOS] Best mkfs.ext2 performance options on RAID5 in CentOS 4.2
Bryan J. Smith
thebs413 at earthlink.net
Tue Nov 1 16:31:45 UTC 2005
Aleksandar Milivojevic <alex at milivojevic.org> wrote:
> Correct me if I'm wrong, but you got 233MB/s for reads (the
> block read test).
Oh, good catch! I didn't even see that when responding (I
assumed he could interpret the bonnie benchmark). And if I
see that correctly, that was with a 12GiB file (on a system
that had 6GiB RAM).
> Assuming your disks can do 50MB/s sustained transfer rate
> each, you are preatty darn close to the theoretical maximum
> of (6 - 1) * 50MB/s = 250MB/s for 6 disk RAID5.
On reads, yes. 3Ware is clearly leveraging the ASIC's
non-blocking I/O for reads from RAID-5, which basically act
> RAID5 as such is bad choice for file systems that will have
> more than about 30% of writes (out of total I/O).
He still should be seeing at least 100MBps for RAID-5 writes
on a 3Ware Escalade 9500S with 6-discs (180MBps is about the
maximum for RAID-5 writes on the 9500S' ASIC with DRAM). The
ASIC is fairly good at sequential writes to RAID-5, and there
is enough DRAM to buffer all but the heaviest of random I/O.
Still, the new 9550SX series has a PowerPC. AMCC's influence
is clearly being pressed on their 3Ware acquisition, as they
are _the_ company for the IBM embedded PowerPC 400 line now.
The 9550SX is supposed to be cable of 380MBps for RAID-5
writes -- double the 9500S best benchmarks.
> If most of the I/O will be writes, and you care about
> performance, you should use RAID-10.
Yep, mega-dittos on that point.
> Remember, writes to Dumb, not-optimized RAID5
> implementation is slower than writing to a single
> disk. This is generic RAID wisdom, nothing to do with
> any particular implementation. In the worst case scenario,
> the write operation on 6-disk RAID5 volume involves
> reading a data block from 5 drives, calculating XOR,
> and writing back one block of data and one block of
> checksum. Whichever way you do it, it ain't gonna be
Still, he shouldn't be seeing less than 100MBps writes on the
3Ware Escalade 9500S series with its on-board ASIC and DRAM
At least the reads are very accurate for his configuration.
I'm curious how he is striping though? It might have been
better to do a 12-disc RAID-5 and get close to 400MBps reads.
Or if performance was more important than efficiency, making
one 6-disc volume RAID-10 would give close to 300MBps reads,
150MBps writes -- maybe higher.
Bryan J. Smith | Sent from Yahoo Mail
mailto:b.j.smith at ieee.org | (please excuse any
http://thebs413.blogspot.com/ | missing headers)
More information about the CentOS