[CentOS] lots of disk activity keep process from responding

Mon Jun 20 15:23:21 UTC 2011
m.roth at 5-cent.us <m.roth at 5-cent.us>

Jerry Geis wrote:
> hi all
>
> I have something like 3000 log files in a directory (from data
> collection).
> At 4am in the morning cron runs a script of mine that essentiallly trims
> all files in that directory back to a certain size.
> Basically does a "tail -c XXXX filename > tmp_filename"
>
> I have noticed that only around the 4am-4:15 time frame when the trim is
> happening does my
> other process log connection attempts but my process (forking and
> opening databases) is not responding in time to give data back
> to the connecting process. Not critically important as it just tries
> again and all ok...
<snip>
Are you trimming the logfiles sequentially, or in parallel? And unless the
files are many megs each, 3k files isn't a huge number these days, so I'd
wonder what else is running around then.

        mark