Greetings-
Is it possible to mount multiple block devices (or network devices over NFS/CIFS) such that the contents of the mounts appear in one location? For example, lets say I have these shares available:
\server1\volume1\ \server1\volume2\ \server1\volume3\
All three contain a directory called data, with different subdirectories. Typically, these would be mounted like so:
mount \server1\volume1\ /mnt/s1v1 mount \server1\volume2\ /mnt/s1v2 mount \server1\volume3\ /mnt/s1v3
And, each would have a corresponding 'data' dir at those mounts:
/mnt/s1v1/data /mnt/s1v2/data /mnt/s1v3/data
However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir?
The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem.
Does any of this make sense? Is it possible with CentOS (pref. 6) ?
--Tim
Vreme: 11/15/2011 05:44 PM, Tim Nelson piše:
However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir?
The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem.
Does any of this make sense? Is it possible with CentOS (pref. 6) ?
If nothing else, you could create ans script that would create symlinks from all files in those directories into single one. I use that technique to create combined repository directory for mrepo.
----- Original Message -----
Vreme: 11/15/2011 05:44 PM, Tim Nelson piše:
However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir?
The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem.
Does any of this make sense? Is it possible with CentOS (pref. 6) ?
If nothing else, you could create ans script that would create symlinks from all files in those directories into single one. I use that technique to create combined repository directory for mrepo.
I'm already doing this. It "works", but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically.
--Tim
On Tue, 15 Nov 2011, Tim Nelson wrote:
I'm already doing this. It "works", but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically.
Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach.
Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers?
jh
----- Original Message -----
On Tue, 15 Nov 2011, Tim Nelson wrote:
I'm already doing this. It "works", but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically.
Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach.
A small loss of performance would be acceptable.
Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers?
Yes, multiple exports on multiple servers. The data is read by a legacy application that does not have a concept of 'multiple data locations' in which to read data from. :-/
--Tim
On Tue, 15 Nov 2011, Tim Nelson wrote:
----- Original Message -----
On Tue, 15 Nov 2011, Tim Nelson wrote:
I'm already doing this. It "works", but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically.
Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach.
A small loss of performance would be acceptable.
Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers?
Yes, multiple exports on multiple servers. The data is read by a legacy application that does not have a concept of 'multiple data locations' in which to read data from. :-/
Anything of interest here?
http://en.wikipedia.org/wiki/UnionFS
jh
----- Original Message -----
Anything of interest here?
YES, very interesting. This looks "on paper" at least to be what I'm looking for.
Thanks for the pointer!
--Tim
Vreme: 11/15/2011 06:39 PM, John Hodrien piše:
On Tue, 15 Nov 2011, Tim Nelson wrote:
----- Original Message -----
On Tue, 15 Nov 2011, Tim Nelson wrote:
I'm already doing this. It "works", but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically.
Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach.
A small loss of performance would be acceptable.
Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers?
Yes, multiple exports on multiple servers. The data is read by a legacy application that does not have a concept of 'multiple data locations' in which to read data from. :-/
Anything of interest here?
http://en.wikipedia.org/wiki/UnionFS
jh _______________________________________________ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Yup, that should be it.
Available Packages funionfs.x86_64 0.4.3-6.el6 epel fuse-unionfs.x86_64 0.23-1.el6.rf repoforge
Repoforge built variant seams better, but do not hold me for it.
On 11/15/2011 01:05 PM, Ljubomir Ljubojevic wrote:
Vreme: 11/15/2011 06:39 PM, John Hodrien piše:
On Tue, 15 Nov 2011, Tim Nelson wrote:
----- Original Message -----
On Tue, 15 Nov 2011, Tim Nelson wrote:
I'm already doing this. It "works", but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically.
Presumably it's be easy enough to knock up with fuse, but there'd be a small performance hit compared to the symlink approach.
A small loss of performance would be acceptable.
Why are you wanting to do this out of interest? Are you merging filesystems from multiple servers?
Yes, multiple exports on multiple servers. The data is read by a legacy application that does not have a concept of 'multiple data locations' in which to read data from. :-/
Anything of interest here?
http://en.wikipedia.org/wiki/UnionFS
jh _______________________________________________ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Yup, that should be it.
Available Packages funionfs.x86_64 0.4.3-6.el6 epel fuse-unionfs.x86_64 0.23-1.el6.rf repoforge
Repoforge built variant seams better, but do not hold me for it.
how about mhddfs?
$ yum search unionFS funionfs-debuginfo.x86_64 : Debug information for package funionfs funionfs.x86_64 : Union filesystem in userspace mhddfs.x86_64 : Fuse-based file system for unifying several mount points into : one
on 11/15/2011 9:22 AM Tim Nelson spake the following:
----- Original Message -----
Vreme: 11/15/2011 05:44 PM, Tim Nelson piše:
However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir?
The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem.
Does any of this make sense? Is it possible with CentOS (pref. 6) ?
If nothing else, you could create ans script that would create symlinks from all files in those directories into single one. I use that technique to create combined repository directory for mrepo.
I'm already doing this. It "works", but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically.
In Microsoft terms that sounds like Distributed file system. I think you can do that under samba...
On Tue, 15 Nov 2011, Scott Silva wrote:
In Microsoft terms that sounds like Distributed file system. I think you can do that under samba...
Is that the same? I thought DFS was just about effectively having cross server symlinks so that one folder could be on one server and another on another transparently, but I didn't know it could effectively merge multiple folders into one.
jh
on 11/15/2011 10:48 AM John Hodrien spake the following:
On Tue, 15 Nov 2011, Scott Silva wrote:
In Microsoft terms that sounds like Distributed file system. I think you can do that under samba...
Is that the same? I thought DFS was just about effectively having cross server symlinks so that one folder could be on one server and another on another transparently, but I didn't know it could effectively merge multiple folders into one.
jh
I suppose it would have to be more like disparate subfolders shared under one root...
Scott Silva wrote:
on 11/15/2011 9:22 AM Tim Nelson spake the following:
----- Original Message -----
Vreme: 11/15/2011 05:44 PM, Tim Nelson piše:
However, it is possible to mount all of the shares to one location, such that there is one 'data' dir, with the combined contents of each of the three shares? So, all shares are mounted at /mnt/s1, and the contents of the multiple data dirs appears in one single data dir?
The only time I've seen such functionality is within the XBMC media center application. It allows you to mount multiple network shares, but shows them all in one location as a sort of 'overlay' view. Duplicate directories are shown have their contents merged, but remain intact on the actual shares/filesystem.
Does any of this make sense? Is it possible with CentOS (pref. 6) ?
If nothing else, you could create ans script that would create symlinks from all files in those directories into single one. I use that technique to create combined repository directory for mrepo.
I'm already doing this. It "works", but is quite messy. I had hoped there would be an actual filesystem merging function that would do this automagically.
In Microsoft terms that sounds like Distributed file system. I think you can do that under samba...
I hadn't been following this thread - been busy - but have you looked into glusterfs?
mark
Vreme: 11/15/2011 11:04 PM, m.roth@5-cent.us piše:
I hadn't been following this thread - been busy - but have you looked into glusterfs?
Fedora 16 uses HekaFS, "a cloud-ready version of GlusterFS".
-
John Hodrien -
Ljubomir Ljubojevic -
m.roth＠5-cent.us -
Roger K. Wells -
Scott Silva -
Tim Nelson