On 6/20/2011 10:31 AM, Kai Schaetzl wrote:
Jerry Geis wrote on Mon, 20 Jun 2011 11:05:34 -0400:
The trimmming of the log files is just so they they dont take a bunch of space on the HD.
use logrotate and zip them.
Not sure how that helps with the issue of queuing up a whole lot of disk activity at once with a lot of locking operations (directory and free space updates). Can you split the files into some reasonable number of subdirectories and process one subdirectory at a time with a few seconds between to let the disk queue flush?
-- Les Mikesell lesmikesell@gmail.com