The better option for ZFS would be to get a SSD and move the dedupe table onto that drive instead of having it in RAM, because it can become massive. Thank you, Ryan Palamara ZAIS Group, LLC 2 Bridge Avenue, Suite 322 Red Bank, New Jersey 07701 Phone: (732) 450-7444 Ryan.palamara at zaisgroup.com -----Original Message----- From: centos-bounces at centos.org [mailto:centos-bounces at centos.org] On Behalf Of Dean Jones Sent: Monday, August 27, 2012 11:45 AM To: CentOS mailing list Subject: Re: [CentOS] Deduplication data for CentOS? Deduplication with ZFS takes a lot of RAM. I would not yet trust any of the linux zfs projects for data that I wanted to keep long term. On Mon, Aug 27, 2012 at 8:26 AM, Les Mikesell <lesmikesell at gmail.com> wrote: > On Mon, Aug 27, 2012 at 9:23 AM, John R Pierce <pierce at hogranch.com> wrote: >> On 08/27/12 4:55 AM, Rainer Traut wrote: >>> is there any working solution for deduplication of data for centos? >>> We are trying to find a solution for our backup server which runs a bash >>> script invoking xdelta(3). But having this functionality in fs is much >>> more friendly... >> >> BackupPC does exactly this. its not a generalized solution to >> deduplication of a file system, instead, its a backup system, designed >> to backup multiple targets, that implements deduplication on the backup >> tree it maintains. > > Not _exactly_, but maybe close enough and it is very easy to install > and try. Backuppc will use rsync for transfers and thus only uses > bandwidth for the differences, but it uses hardlinks to files to dedup > the storage. It will find and link duplicate content even from > different sources, but the complete file must be identical. It does > not store deltas, so large files that change even slightly between > backups end up stored as complete copies (with optional compression). > > -- > Les Mikesell > lesmikesell at gmail.com > _______________________________________________ > CentOS mailing list > CentOS at centos.org > http://lists.centos.org/mailman/listinfo/centos _______________________________________________ CentOS mailing list CentOS at centos.org http://lists.centos.org/mailman/listinfo/centos ________________________________ This e-mail message is intended only for the named recipient(s) above. It may contain confidential information. If you are not the intended recipient you are hereby notified that any dissemination, distribution or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the message and any attachment(s) from your system. Thank you. This is not an offer (or solicitation of an offer) to buy/sell the securities/instruments mentioned or an official confirmation. This is not research and is not from ZAIS Group but it may refer to a research analyst/research report. Unless indicated, these views are the author's and may differ from those of ZAIS Group research or others in the Firm. We do not represent this is accurate or complete and we may not update this. Past performance is not indicative of future returns. IRS CIRCULAR 230 NOTICE:. To comply with requirements imposed by the IRS, we inform you that any U.S. federal tax advice contained herein (including any attachments), unless specifically stated otherwise, is not intended or written to be used, and cannot be used, for the purpose of (i) avoiding penalties under the Internal Revenue Code or (ii) promoting, marketing or recommending any transaction or matter addressed herein to another party. Each taxpayer should seek advice based on the taxpayer's particular circumstances from an independent tax advisor. "ZAIS", "ZAIS Group" and "ZAIS Solutions" are trademarks of ZAIS Group, LLC.