Just wondering if you had the chance of testing the network speed with iperf from host to host yet? This is like the first thing to do while doing a full debug upside-down. No matter what disks you have but note that each and one of them has a maximum IOps limit which sometimes you can hit in a way. as already suggested by others in the past you can use a binary search dividing the issue one part at a time network.. disk.. controller.. driver.. software(since the software is proven to work).
Eliezer
On 06/12/2014 11:40 PM, Aronesty, Erik wrote:
I suspect I'm having performance issues because of network speeds.
/Supposedly/ I have 10gbit connections on all my NAS devices, however, it seems to me that the fastest I can write is 1Gbit. When I'm copying very large files, etc, I see 'D' as the cp waits to I/O, but when I go the gluster servers, I don't see glusterfsd waiting (D) to write to the bricks themselves. I have 4 nodes, each with 10Gbit connection, each has 2 Areca RAID controllers with 12 disk raid5, and the 2 controllers stripped into 1 large volume. Pretty sure there's plenty of i/o left on the bricks themselves.
Is it possible that "one big file" isn't the right test… should I try 20 big files, and see how saturated my network can get?
Erik Aronesty Senior Bioinformatics Architect
*EA | Quintiles **/Genomic Services/**//*
4820 Emperor Boulevard
Durham, NC 27703 USA
Office: + 919.287.4011 erik.aronesty@quintiles.com mailto:kmichailo@expressionanalysis.com
www.quintiles.com http://www.quintiles.com/ www.expressionanalysis.com http://www.expressionanalysis.com/ cid:image001.jpg@01CDEF4B.84C3E9F0 https://www.twitter.com/simulxcid:image002.jpg@01CDEF4B.84C3E9F0 http://www.facebook.com/aronestycid:image003.jpg@01CDEF4B.84C3E9F0 http://www.linkedin.com/in/earonesty
Gluster-users mailing list Gluster-users@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-users