[CentOS] XFS on a 25 TB device

Wed Sep 29 15:53:10 UTC 2010
James A. Peltier <jpeltier at sfu.ca>

----- Original Message -----
| On Wednesday 29 September 2010, Boris Epstein wrote:
| > Hello all,
| >
| > I have just configured a 64-bit CentOS 5.5 machine to support an XFS
| > filesystem as specified in the subject line. The filesystem will be
| > used to
| > store an extremely large number of files (in the tens of millions).
| > Due to
| > its extremely large size, would there be any non-standard XFS
| > build/configuration options I should consider?
| 
| I have created and tested filesystems larger than 25T using xfs on
| CentOS-5
| (64-bit). I did not use any non-standard options. Do not attempt this
| on a
| 32-bit box.
| 
| However, given the size of the device I assume that this is a raid of
| some
| sort. You'll want to make sure to run mkfs.xfs with the proper stripe
| parameters to get the alignment right. Also, you may want to make sure
| your
| LVM or partition table is properly aligned.
| 
| Even with the above done right you may get worse performance than
| expected
| since "lots of small files" typically reads like "terrible
| performance".
| 
| Finally I'd suggest you fill the filesystem and read it back
| (verifying what
| you wrote). This is, imho, a reasonable level of paranoia.
| 
| /Peter
| 
| > Thanks.
| >
| > Boris.
| 
| _______________________________________________
| CentOS mailing list
| CentOS at centos.org
| http://lists.centos.org/mailman/listinfo/centos

On my 30+TB file systems all I've done is mkfs.xfs with stripe and width parameters and they are very speedy.  I've not done anything on the LVM side and see no performance issues, but perhaps I need to investigate that some more. :\

--
James A. Peltier
Systems Analyst (FASNet), VIVARIUM Technical Director
Simon Fraser University - Burnaby Campus
Phone   : 778-782-6573
Fax     : 778-782-3045
E-Mail  : jpeltier at sfu.ca
Website : http://www.fas.sfu.ca | http://vivarium.cs.sfu.ca
MSN     : subatomic_spam at hotmail.com

Does your OS has a man 8 lart?
http://www.xinu.nl/unix/humour/asr-manpages/lart.html