Hi All,
Need some information on getting the right storage array to buy for my cluster configuration can anyone help me with this
my Setup so far
2 Athlon 2800 Sempron System 1 Wti Network power switch 1 24 Port 10/100 Cat5 switch 2 Adaptec 39160 scsi host adapter pci cards installed in the systems.
I need to know what is the best storage solution with this configuration
Thanks
Sherwyn Greene Planner / I.T. Technician Project Controls Dept. Kentz-OJ's E&I Services J.V. +1 (868) 648-0876
On Tue, 2006-10-17 at 09:14 -0400, Sherwyn Greene wrote:
Hi All,
Need some information on getting the right storage array to buy
for my cluster configuration can anyone help me with this
my Setup so far
2 Athlon 2800 Sempron System 1 Wti Network power switch 1 24 Port 10/100 Cat5 switch 2 Adaptec 39160 scsi host adapter pci cards installed in the systems.
I need to know what is the best storage solution with this configuration
It depends of what you want to do ... which kind of cluster do you want to implement ? a linux-ha type cluster based on heartbeat ? Do you need a shared storage ? in that case a san in fiber-channel or iscsi should work. Some scsi adapters are able also to handle shared scsi bus. If you don't really need a shared storage, you can just replicate data with drbd ...
Yes, I would like to have a shared storage setup, the question is can I do it from the scsi cards I have & if so what other equipment I need to have this setup.
Thanks
Sherwyn Greene Planner / I.T. Technician Project Controls Dept. Kentz-OJ's E&I Services J.V. +1 (868) 648-0876
-----Original Message----- From: centos-bounces@centos.org [mailto:centos-bounces@centos.org] On Behalf Of Fabian Arrotin Sent: Tuesday, October 17, 2006 1:34 PM To: CentOS mailing list Subject: Re: [CentOS] Cluster Help
On Tue, 2006-10-17 at 09:14 -0400, Sherwyn Greene wrote:
Hi All,
Need some information on getting the right storage array to buy
for my cluster configuration can anyone help me with this
my Setup so far
2 Athlon 2800 Sempron System 1 Wti Network power switch 1 24 Port 10/100 Cat5 switch 2 Adaptec 39160 scsi host adapter pci cards installed in the systems.
I need to know what is the best storage solution with this configuration
It depends of what you want to do ... which kind of cluster do you want to implement ? a linux-ha type cluster based on heartbeat ? Do you need a shared storage ? in that case a san in fiber-channel or iscsi should work. Some scsi adapters are able also to handle shared scsi bus. If you don't really need a shared storage, you can just replicate data with drbd ...
-- Fabian Arrotin fabian.arrotin@arrfab.net
On 10/17/06, Sherwyn Greene wrote:
Yes, I would like to have a shared storage setup, the question is can I do it from the scsi cards I have & if so what other equipment I need to have this setup.
This is actually a fairly complicated question-- more than a mere CentOS mailing list can likely answer to the level of detail you're going to need. If you have not set up shared storage before, you may want to find a local consultant to help out.
With that said, yes, you can use your existing SCSI cards provided you find the right kind of storage and your SCSI cards are "differential" SCSI (e.g. low-voltage differential). There are tons of vendors, large and small, that would be eager to take your money and sell you a disk array that would work. I would suggest the following requirements to jump-start your search: + dual SCSI channels from each host compatible with your existing cards - so if one card dies you can keep working + RAID-5 in hardware + battery-backed cache on the RAID controller - so you can survive a power loss with minimal data lost - you probably want a battery that will last at least 7 days, perhaps longer + hot-swap disks + 24x7 support including on-site hardware replacement - if you can get by with less, you probably don't need a cluster... + [optional] automatic hot spare disks (these take over for a failed disk until you get it replaced) - the need for these depends on how quickly you're likely to replace a dead disk as well as how many disks you have total
EMC and HP/Compaq both make excellent, if expensive, storage. This might be a good place to start your vendor search since this will set an upper limit on how much it's likely to cost.
Again-- seek competent local help. I don't think you can learn enough about what to do from this mailing list. ;-)
-- Steve
Thanks for the info
Sherwyn Greene Planner / I.T. Technician Project Controls Dept. Kentz-OJ's E&I Services J.V. +1 (868) 648-0876
-----Original Message----- From: centos-bounces@centos.org [mailto:centos-bounces@centos.org] On Behalf Of Steve Bonds Sent: Tuesday, October 17, 2006 1:56 PM To: centos@centos.org Subject: Re: [CentOS] Cluster Help
On 10/17/06, Sherwyn Greene wrote:
Yes, I would like to have a shared storage setup, the question is can I do it from the scsi cards I have & if so what other equipment I need to have this setup.
This is actually a fairly complicated question-- more than a mere CentOS mailing list can likely answer to the level of detail you're going to need. If you have not set up shared storage before, you may want to find a local consultant to help out.
With that said, yes, you can use your existing SCSI cards provided you find the right kind of storage and your SCSI cards are "differential" SCSI (e.g. low-voltage differential). There are tons of vendors, large and small, that would be eager to take your money and sell you a disk array that would work. I would suggest the following requirements to jump-start your search: + dual SCSI channels from each host compatible with your existing cards - so if one card dies you can keep working + RAID-5 in hardware + battery-backed cache on the RAID controller - so you can survive a power loss with minimal data lost - you probably want a battery that will last at least 7 days, perhaps longer + hot-swap disks + 24x7 support including on-site hardware replacement - if you can get by with less, you probably don't need a cluster... + [optional] automatic hot spare disks (these take over for a failed disk until you get it replaced) - the need for these depends on how quickly you're likely to replace a dead disk as well as how many disks you have total
EMC and HP/Compaq both make excellent, if expensive, storage. This might be a good place to start your vendor search since this will set an upper limit on how much it's likely to cost.
Again-- seek competent local help. I don't think you can learn enough about what to do from this mailing list. ;-)
-- Steve _______________________________________________ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
We are using a 3.0 Terabyte Iscsi-enabled SAN device made by Promise... Works really well on Centos. For what people go through with HP and other vendors, this was very much worth it, very little hassle and no vendor lock-in.
We connect our servers to GB switches, GB Nics, Cat 6 cable (very important about Cat6 and Iscsi) and they talk to the promiseraid over Iscsi and are mounted to it in filesystem. The promiseraid itself just sits on the rack plugged into a GB switch itself, everyone's happy.
A great reliable affordable simple way to add storage in a clustered environ, in this case out clustered app is of the Javagroups/Tomcat/Apache ilk, along with quite a bit of Mysql. We backup our mysql boxes to the Iscsi device quite well, some of which are 100+GB tables.
So you need a GB switch and some cat6 going on and you are very much OK then if you get an Iscsi solution.
-krb
On Tue, 2006-10-17 at 09:14 -0400, Sherwyn Greene wrote:
Hi All,
Need some information on getting the right storage array to buy
for my cluster configuration can anyone help me with this
my Setup so far
2 Athlon 2800 Sempron System 1 Wti Network power switch 1 24 Port 10/100 Cat5 switch 2 Adaptec 39160 scsi host adapter pci cards installed in the systems.
I need to know what is the best storage solution with this configuration
It depends of what you want to do ... which kind of cluster do you want to implement ? a linux-ha type cluster based on heartbeat ? Do you need a shared storage ? in that case a san in fiber-channel or iscsi should work. Some scsi adapters are able also to handle shared scsi bus. If you don't really need a shared storage, you can just replicate data with drbd ...
-- Fabian Arrotin fabian.arrotin@arrfab.net _______________________________________________ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
On Tue, 2006-10-17 at 14:56 -0700, karl@klxsystems.net wrote:
, along with quite a bit of Mysql. We backup our mysql boxes to the Iscsi device quite well, some of which are 100+GB tables.
Can I just ask how many million rows are in 1 table to reach 100+GB tables?