[CentOS] Deleting Large Files

[Ross Walker]

On Mar 2, 2009, at 11:05 AM, Ross Walker <rswwalker at gmail.com> wrote:

> On Mar 2, 2009, at 7:06 AM, "Joseph L. Casale" <JCasale at activenetwerx.com 
> > wrote:
>
>>> Have you tried to delete locally, instead of over NFS?
>>
>> As I said, the deletes are done locally via ssh.
>>
>>> Have you tried the "unlink" command instead of "rm" ?
>>
>> Nope, but I will now!
>
> If it's not too late you could try XFS as I believe it is efficient  
> in handling large files.
>
> Or you could try a different journal option to your ext3 fs.

Try the data=writeback option which emulates the way XFS handles log  
operations. With UPS and/or battery backed caching controller the risk  
should be minimum.

That will help, but ext3 is not good at handling large files at all,  
so if you can switch to XFS that will make a bigger improvement. Make  
sure XFS journal is set to max size and noatime and nodiratime are set  
to make regular/small file operations perform decently.

-Ross