Each node is also an nfs server (centos 4.7) One nfs server per user. I think it is still nfsv3, I will consider upgrading to v4. On Fri, Feb 27, 2009 at 1:47 AM, Rainer Duffner <rainer at ultra-secure.de>wrote: > > Am 27.02.2009 um 01:44 schrieb Joe Barjo: > > > I'd also like to test gfs for a 30 nodes cluster with sge. > > Tasks are often quite short, files are also quite small. Job rate > > can be quite high (can reach 10 to 20/second) > > We actualy use NFS under centos4.7 and experience coherency problems. > > I tested AFS, lustre, glusterFS. All showed too much overhead with > > small files, and less performance than nfs. > > > > The coherency problem seems related to the ext3 timestamp resolution > > (1 second), and the poor NFS cache system. It is not coherent even > > with the noac (no attribute cache option) > > > > First GFS test on 6 nodes (with gnbd) were ok, but there had been > > unexplained kernel panics (even when not working) that prevented > > further tests. > > > > I will try to upgrade the cluster to a more recent distribution and > > test GFS on 30 nodes. > > > > > What's your NFS-server, BTW? > > > > Rainer > _______________________________________________ > CentOS mailing list > CentOS at centos.org > http://lists.centos.org/mailman/listinfo/centos > -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.centos.org/pipermail/centos/attachments/20090227/36a41b1c/attachment-0005.html>