[CentOS] GFS and Small Files

Les Mikesell lesmikesell at gmail.com
Wed Apr 29 20:52:02 UTC 2009


Filipe Brandenburger wrote:
> 
> In general, having directories with a huge number of files tends to be
> a bad idea, you will most likely have performance bottlenecks with
> specific filesystems or tools. If possible, try to change the
> application to create two or three levels of directories using a hash
> on the filename and then creating directories with a small number of
> files on each of them.

This is particularly true of directories with a lot of activity. 
Whenever an open for writing happens, the directory has to be searched 
to see if the file already exists, and if it doesn't it must be created 
- and the search/create must be atomic so the directory must be locked 
while it completes.

-- 
   Les Mikesell
    lesmikesell at gmail.com





More information about the CentOS mailing list