[CentOS] Is GFS for HPC?

[Joe Barjo]

Each node is also an nfs server (centos 4.7)
One nfs server per user.
I think it is still nfsv3, I will consider upgrading to v4.


On Fri, Feb 27, 2009 at 1:47 AM, Rainer Duffner <rainer at ultra-secure.de>wrote:

>
> Am 27.02.2009 um 01:44 schrieb Joe Barjo:
>
> > I'd also like to test gfs for a 30 nodes cluster with sge.
> > Tasks are often quite short, files are also quite small. Job rate
> > can be quite high (can reach 10 to 20/second)
> > We actualy use NFS under centos4.7 and experience coherency problems.
> > I tested AFS, lustre, glusterFS. All showed too much overhead with
> > small files, and less performance than nfs.
> >
> > The coherency problem seems related to the ext3 timestamp resolution
> > (1 second), and the poor NFS cache system. It is not coherent even
> > with the noac (no attribute cache option)
> >
> > First GFS test on 6 nodes (with gnbd) were ok, but there had been
> > unexplained kernel panics (even when not working) that prevented
> > further tests.
> >
> > I will try to upgrade the cluster to a more recent distribution and
> > test GFS on 30 nodes.
> >
>
>
> What's your NFS-server, BTW?
>
>
>
> Rainer
> _______________________________________________
> CentOS mailing list
> CentOS at centos.org
> http://lists.centos.org/mailman/listinfo/centos
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.centos.org/pipermail/centos/attachments/20090227/36a41b1c/attachment.html>