My non-tape solution of choice is definitely rsync => box with ZFS, snapshot however often you'd like. => forever incrementals.
For more redundancy and performance, add more ZFS boxes, do replication between them.
Not sure whether ZFS now makes this OT - if so, sorry for not putting "OT:" in the subject.
Anyway, I have a ZFS storage unit here and this is my first exposure to it so I don't really know about any of this ZFS magic that I often hear about. I'm sure I could google and find some reading on the matter but am wondering if anyone has some recommended reading that is concise and to the point, and will give me a good intro.
On Thu, Dec 8, 2011 at 1:31 PM, Alan McKay alan.mckay@gmail.com wrote:
My non-tape solution of choice is definitely rsync => box with ZFS, snapshot however often you'd like. => forever incrementals.
For more redundancy and performance, add more ZFS boxes, do replication between them.
Not sure whether ZFS now makes this OT - if so, sorry for not putting "OT:" in the subject.
Anyway, I have a ZFS storage unit here and this is my first exposure to it so I don't really know about any of this ZFS magic that I often hear about. I'm sure I could google and find some reading on the matter but am wondering if anyone has some recommended reading that is concise and to the point, and will give me a good intro.
ZFS gives you several options missing in linux filesystems. The ones likely to be important for the filesystems holding backup archives are: compression block-level de-dup snapshots incremental snapshot send/receive easy-to-expand combined volume/raid management
Backuppc does compression and de-dups at the file level with hardlinks so you get some of the missing features anyway, but it's not quite the same.
Vreme: 12/08/2011 08:31 PM, Alan McKay piše:
My non-tape solution of choice is definitely rsync => box with ZFS, snapshot however often you'd like. => forever incrementals.
For more redundancy and performance, add more ZFS boxes, do replication between them.
Not sure whether ZFS now makes this OT - if so, sorry for not putting "OT:" in the subject.
Anyway, I have a ZFS storage unit here and this is my first exposure to it so I don't really know about any of this ZFS magic that I often hear about. I'm sure I could google and find some reading on the matter but am wondering if anyone has some recommended reading that is concise and to the point, and will give me a good intro.
I read this when got interested: http://www.funtoo.org/wiki/ZFS_Fun http://hub.opensolaris.org/bin/download/Community+Group+zfs/docs/zfslast.pdf http://hub.opensolaris.org/bin/view/Community+Group+zfs/docs
On Thu, Dec 8, 2011 at 9:24 PM, Ljubomir Ljubojevic office@plnet.rs wrote:
Vreme: 12/08/2011 08:31 PM, Alan McKay piše:
[...]
wondering if anyone has some recommended reading that is concise and to the point, and will give me a good intro.
I read this when got interested: http://www.funtoo.org/wiki/ZFS_Fun http://hub.opensolaris.org/bin/download/Community+Group+zfs/docs/zfslast.pdf http://hub.opensolaris.org/bin/view/Community+Group+zfs/docs
http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide http://blogs.oracle.com/brendan/entry/test http://blogs.oracle.com/roch/entry/when_to_and_not_to http://blogs.everycity.co.uk/alasdair/2010/07/using-mbuffer-to-speed-up-slow... http://blogs.oracle.com/realneel/entry/mysql_innodb_zfs_best_practices
Vreme: 12/09/2011 03:02 AM, Mikael Fridh piše:
On Thu, Dec 8, 2011 at 9:24 PM, Ljubomir Ljubojevicoffice@plnet.rs wrote:
Vreme: 12/08/2011 08:31 PM, Alan McKay piše:
[...]
wondering if anyone has some recommended reading that is concise and to the point, and will give me a good intro.
I read this when got interested: http://www.funtoo.org/wiki/ZFS_Fun http://hub.opensolaris.org/bin/download/Community+Group+zfs/docs/zfslast.pdf http://hub.opensolaris.org/bin/view/Community+Group+zfs/docs
http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide http://blogs.oracle.com/brendan/entry/test http://blogs.oracle.com/roch/entry/when_to_and_not_to http://blogs.everycity.co.uk/alasdair/2010/07/using-mbuffer-to-speed-up-slow... http://blogs.oracle.com/realneel/entry/mysql_innodb_zfs_best_practices
Thanks for the links. Brendan's test is excellent presentation.
All I would ask now is that someone comment on ZFS implementation on Linux/CentOS.
On Dec 9, 2011, at 7:08 AM, Ljubomir Ljubojevic office@plnet.rs wrote:
Vreme: 12/09/2011 03:02 AM, Mikael Fridh piše:
On Thu, Dec 8, 2011 at 9:24 PM, Ljubomir Ljubojevicoffice@plnet.rs wrote:
Vreme: 12/08/2011 08:31 PM, Alan McKay piše:
[...]
wondering if anyone has some recommended reading that is concise and to the point, and will give me a good intro.
I read this when got interested: http://www.funtoo.org/wiki/ZFS_Fun http://hub.opensolaris.org/bin/download/Community+Group+zfs/docs/zfslast.pdf http://hub.opensolaris.org/bin/view/Community+Group+zfs/docs
http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide http://blogs.oracle.com/brendan/entry/test http://blogs.oracle.com/roch/entry/when_to_and_not_to http://blogs.everycity.co.uk/alasdair/2010/07/using-mbuffer-to-speed-up-slow... http://blogs.oracle.com/realneel/entry/mysql_innodb_zfs_best_practices
Thanks for the links. Brendan's test is excellent presentation.
All I would ask now is that someone comment on ZFS implementation on Linux/CentOS.
Fuse-ZFS still is at the enthusiast level.
I don't know about the other "straight" ports, last I heard they were having issues making the VFS layer map properly so it's fully compatible with the user-land utilities.
-Ross
On Fri, Dec 9, 2011 at 8:11 AM, Ross Walker rswwalker@gmail.com wrote:
All I would ask now is that someone comment on ZFS implementation on Linux/CentOS.
Fuse-ZFS still is at the enthusiast level.
I don't know about the other "straight" ports, last I heard they were having issues making the VFS layer map properly so it's fully compatible with the user-land utilities.
I thought the real issue is that the GPL-licensed kernel restricts inclusion of code under less-restricted licenses.
Vreme: 12/09/2011 05:09 PM, Les Mikesell piše:
On Fri, Dec 9, 2011 at 8:11 AM, Ross Walkerrswwalker@gmail.com wrote:
All I would ask now is that someone comment on ZFS implementation on Linux/CentOS.
Fuse-ZFS still is at the enthusiast level.
I don't know about the other "straight" ports, last I heard they were having issues making the VFS layer map properly so it's fully compatible with the user-land utilities.
I thought the real issue is that the GPL-licensed kernel restricts inclusion of code under less-restricted licenses.
http://zfsonlinux.org/faq.html#WhatAboutTheLicensingIssue
And maybe FYI, but they do not have mountable filesystem in stable release: http://zfsonlinux.org/spl-building-rpm.html http://zfsonlinux.org
On Dec 9, 2011, at 11:09 AM, Les Mikesell lesmikesell@gmail.com wrote:
On Fri, Dec 9, 2011 at 8:11 AM, Ross Walker rswwalker@gmail.com wrote:
All I would ask now is that someone comment on ZFS implementation on Linux/CentOS.
Fuse-ZFS still is at the enthusiast level.
I don't know about the other "straight" ports, last I heard they were having issues making the VFS layer map properly so it's fully compatible with the user-land utilities.
I thought the real issue is that the GPL-licensed kernel restricts inclusion of code under less-restricted licenses.
Restricted from distributing with GPL kernel, but definitely OK as a add-on third party loadable module. Just load it from a separate repo and nothing is violated.
-Ross
-
Alan McKay -
Les Mikesell -
Ljubomir Ljubojevic -
Mikael Fridh -
Ross Walker