We have about 5 servers spread out throughout the country: 2 Centos 4.4, 1 Red Hat and 2 windows machines- looking for some good ideas for a back-up solution. Our servers hold a lot of data, but only a small portion of it is crucial on any given day. That crucial portion is always changing (for example, this week the crucial files all relate to November- current and previous projects, and the next project in early December). What we need to have is a backup solution that would allow us to roll back to any given day (about four weeks of daily history). Bare-metal backups are a must.
Our ideal solution would be to find someone who could design and implement a system for us. All ideas and suggestions are welcome.
On Wed, Nov 22, 2006 at 11:26:22AM -0800, System Admin wrote:
We have about 5 servers spread out throughout the country: 2 Centos 4.4, 1 Red Hat and 2 windows machines- looking for some good ideas for a back-up solution. Our servers hold a lot of data, but only a small portion of it is crucial on any given day. That crucial portion is always changing (for example, this week the crucial files all relate to November- current and previous projects, and the next project in early December). What we need to have is a backup solution that would allow us to roll back to any given day (about four weeks of daily history). Bare-metal backups are a must.
Our ideal solution would be to find someone who could design and implement a system for us. All ideas and suggestions are welcome.
What is the size of the dataset? What is the size of the daily change? What is the size and throughput restrictions of respective internet connectivity? Is there (and how big is the) budget? Are the machines under the control of local administrators, or are they hands-off remote hosted? Are there any restrictions (say, inability to hire or use Canadian based services) that might be relevant?
System Admin wrote:
We have about 5 servers spread out throughout the country: 2 Centos 4.4, 1 Red Hat and 2 windows machines- looking for some good ideas for a back-up solution. Our servers hold a lot of data, but only a small portion of it is crucial on any given day. That crucial portion is always changing (for example, this week the crucial files all relate to November- current and previous projects, and the next project in early December). What we need to have is a backup solution that would allow us to roll back to any given day (about four weeks of daily history). Bare-metal backups are a must.
Our ideal solution would be to find someone who could design and implement a system for us. All ideas and suggestions are welcome.
CentOS mailing list
Hi!
Have a look at: http://www.mikerubel.org/computers/rsync_snapshots/
I use this kind of setup for my clients, works like a charm. I made my own scripts and we can hold easily last 30 days in rolling scheme. It works over SSH and support compression of the stream. RSync is very efficient. For Winblows, check:
http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view...
Hope this helps!
Guy Boisvert IngTegration inc.
The only fully bare-metal ready backup solution I know of for CentOS is mondorescue. IME, it's the bare-metal recovery that is going to be the hardest requirement for you to meet (at least for free-as-in-beer software), the rest can be done by many different pieces of available software: backuppc, bacula, rdiff-snapshot, dervish etc.
Cian
http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view...
I would add DeltaCopy: http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp
On Wed, 2006-11-22 at 11:26 -0800, System Admin wrote:
We have about 5 servers spread out throughout the country: 2 Centos 4.4, 1 Red Hat and 2 windows machines- looking for some good ideas for a back-up solution. Our servers hold a lot of data, but only a small portion of it is crucial on any given day. That crucial portion is always changing (for example, this week the crucial files all relate to November- current and previous projects, and the next project in early December). What we need to have is a backup solution that would allow us to roll back to any given day (about four weeks of daily history). Bare-metal backups are a must.
Our ideal solution would be to find someone who could design and implement a system for us. All ideas and suggestions are welcome.
CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
if you seem to be that involved w/centos through-out your system, why wouldn't you consider Centos paid support? those guys are good!
On 23/11/06, System Admin administrator@insurancejournal.com wrote:
We have about 5 servers spread out throughout the country: 2 Centos 4.4, 1 Red Hat and 2 windows machines- looking for some good ideas for a back-up solution. Our servers hold a lot of data, but only a small portion of it is crucial on any given day. That crucial portion is always changing (for example, this week the crucial files all relate to November- current and previous projects, and the next project in early December). What we need to have is a backup solution that would allow us to roll back to any given day (about four weeks of daily history). Bare-metal backups are a must.
Our ideal solution would be to find someone who could design and implement a system for us. All ideas and suggestions are welcome.
Your best bet would be rsync on day one. Copy over the day one data to another set called day two. Then rsync day two. Copy over to the set day three and then rsync day three and so on...
Since rsync does differential transfer it would be fast and easy to implement and to run from either the client server or backup server.
Plus since rsync works on top of ssh you can do key-only authentication so that other logins are thwarted.
On Thu, 23 Nov 2006, Sudev Barar wrote:
On 23/11/06, System Admin administrator@insurancejournal.com wrote:
We have about 5 servers spread out throughout the country: 2 Centos 4.4, 1 Red Hat and 2 windows machines- looking for some good ideas for a back-up solution. Our servers hold a lot of data, but only a small portion of it is crucial on any given day. That crucial portion is always changing (for example, this week the crucial files all relate to November- current and previous projects, and the next project in early December). What we need to have is a backup solution that would allow us to roll back to any given day (about four weeks of daily history). Bare-metal backups are a must.
Our ideal solution would be to find someone who could design and implement a system for us. All ideas and suggestions are welcome.
Your best bet would be rsync on day one. Copy over the day one data to another set called day two. Then rsync day two. Copy over to the set day three and then rsync day three and so on...
Since rsync does differential transfer it would be fast and easy to implement and to run from either the client server or backup server.
Plus since rsync works on top of ssh you can do key-only authentication so that other logins are thwarted.
http://www.nongnu.org/rdiff-backup/
Regards,
I'm using rdiff-backup's cousin : duplicity : http://duplicity.nongnu.org/ Although much less mature, it has incredible features for remote gpg encrypted incremental backups. I'm using it on my production server to backup through untrusted ftp. I keep one week of automatic daily encrypted, compressed, incremental backup.
Tom Diehl a écrit :
http://www.nongnu.org/rdiff-backup/
Regards,
-
Cian Cullinan -
David Mackintosh -
Guy Boisvert -
Jordi Espasa Clofent -
rado -
sophana -
Sudev Barar -
System Admin -
Tom Diehl