<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
-------- Original Message --------<br>
Subject: Re: [CentOS] disk I/O problems and Solutions<br>
From: Alan McKay <a class="moz-txt-link-rfc2396E" href="mailto:alan.mckay@gmail.com"><alan.mckay@gmail.com></a><br>
To: CentOS mailing list <a class="moz-txt-link-rfc2396E" href="mailto:centos@centos.org"><centos@centos.org></a><br>
Date: Friday, October 09, 2009 12:55:35 PM<br>
<blockquote
cite="mid:844129e80910091055l74061e2pa491619801f2c681@mail.gmail.com"
type="cite">
<blockquote type="cite">
<pre wrap="">Since you stated that your system is only having trouble at writes,
doing batch inserts, I would look at how you are doing these batch
inserts and see if you can optimize this by using techniques to delay
key writes or adjust locking mechanisms on the insert. Some databases
have special insert from file or bulk insert operations that are much
faster than running many single row inserts - be sure you are taking
advantage of these methods.
</pre>
</blockquote>
<pre wrap=""><!---->
Yeah, our DB geeks have already said a few weeks ago that they think
we are doing these bulk updates in a pretty inefficient manner, so
that's something else we plan to optimize.
</pre>
</blockquote>
I meant to include some annecdotal advice in my last post... In my
experience, most of our DB servers rarely access the disk. Though we do
configure our db servers for RAID10 now (previously RAID5). RAM is
cheap and you should always have plenty of it.<br>
<br>
Given your setup, I would be surprised if you would get more than a
100% improvement from transitioning to RAID10 using your current
hardware. However, I wouldn't be surprised if you could get a 1,000% to
10,000% improvement through software optimization. This includes proper
db software config, db schema, queries, and how you process/prepare
data to go in/out of your db.<br>
<br>
Keep in mind that if you are disk limited now and top shows no other
signs of stress, then you are likely to continue to be disk limited -
though you may notice shorter periods of impact.<br>
<br>
<br>
</body>
</html>