I have LSI Logic MegaRAID 8480 Storage controller
I am having trouble reconfigure one of the hardware raid devices
It is configured with 4 hardware raid logical volumes on
/dev/sda /dev/sdb /dev/sdc /dev/sdd.
I am in the middle of rebuilding the system, and at this point I am only using one of the volumes, /dev/sda
/dev/sda, /dev/sdb, and /dev/sdd are all 2 drive raid1 mirrors I will be using the hardware raid logical volumes /dev/sdb and /dev/sdd with their current configurations
I doubt that the hardware raid device on /dev/hda is causing any problems
/dev/sda has two partitiions /dev/sda1 is a 100 MB ext3 partition mounted on /boot /dev/sda2 is a 20 GB lvm logical volume in a 67 GB volume group with an ext3 partition mounted on / the rest of the volume group is empty.
I don't like the /dev/sdc is configued. It's configured as a 4 drive raid6. It will be used for database journal, nearly all sequential writes. I would rather use raid10
There are 3 ways to configure the hardware raid.
The is something called WebBIOS which is sort of like a web browser that you access from the BIOS. This is ruled out since we will need to maintain the raid configuration with shutting down the operating system, or applications.
There is a MegaCLI command line interface that runs under the operating system. Normally I prefer command line tools. But this software is big, and complex. All I have been able to find is a reference manual, that has lots of typos and is not very well organized for me to learn what I need to know. I have not been able to find a tutorial for this software. It will take more time than I have at the moment to figure out this tool.
Finally there is the MegaRAID Storage Manager a GUI tool that runs under the OS. I'm running v2.77-00
So the first thing I need to do is delete the unwanted raid6 logical volume.
When I try to delete it, it refuses and says:
This is an OS drive. The virtual drive cannot be deleted.
Any ideas on how to get past this problem with the MegaRAID Storage Manager,
or pointers the better documentation, and maybe even a tutorial for the MegaCLI interface.
-- Drew Einhorn
From: drew einhorn drew.einhorn@gmail.com
When I try to delete it, it refuses and says: This is an OS drive. The virtual drive cannot be deleted. Any ideas on how to get past this problem with the MegaRAID Storage Manager, or pointers the better documentation, and maybe even a tutorial for the MegaCLI interface.
Hum, is it unmounted? If it was, maybe try to remove any partitions on it...
JD
On Mon, Mar 9, 2009 at 10:38 AM, John Doe jdmls@yahoo.com wrote:
From: drew einhorn drew.einhorn@gmail.com
When I try to delete it, it refuses and says: This is an OS drive. The virtual drive cannot be deleted. Any ideas on how to get past this problem with the MegaRAID Storage Manager, or pointers the better documentation, and maybe even a tutorial for the MegaCLI interface.
Hum, is it unmounted?
No, the only mounted stuff is on /dev/sda
If it was, maybe try to remove any partitions on it...
That's it! It won't delete a raid logical volume if it sees a partition on it, even if it is not mounted. Once I cleared the partition table. The it let me delete the, logical volume.
Thanks,
There is a MegaCLI command line interface that runs under the operating system. Normally I prefer command line tools. But this software is big, and complex. All I have been able to find is a reference manual, that has lots of typos and is not very well organized for me to learn what I need to know. I have not been able to find a tutorial for this software. It will take more time than I have at the moment to figure out this tool.
Huh? It's one tiny binary, and the syntax is trivial? You are looking at something else... Its own help is decent and it installs via rpm on RHEL.
Finally there is the MegaRAID Storage Manager a GUI tool that runs under the OS. I'm running v2.77-00
Now that's a big steaming pile of dung :) I can't make any sense of that darn at the best of times :)
What you need is the mr_sas_sw_ug.pdf from lsi's site.
Display the VD's/LD's:
Table 3.35 Display Virtual Disk Information Convention CmdTool -LDInfo -Lx|-L0,1,2|-Lall -aN|-a0,1,2|-aALL Description Displays information about the virtual disk(s) on the selected adapter(s). This information includes the name, RAID level, RAID level qualifier, size in megabytes, state, stripe size, number of drives, span depth, cache policy, access policy, and ongoing activity progress, if any, including initialization, background initialization, consistency check, and reconstruction.
Pick the one you want, then delete:
Table 3.33 Delete Specified Virtual Disks Convention CmdTool -CfgLDDel -Lx|-L0,1,2|-Lall -aN|-a0,1,2|-aALL Description Deletes the specified virtual disk(s) on the selected adapter(s). You can delete one virtual disk, multiple virtual disks, or all the selected virtual disks on selected adapter(s).
HTH, jlc
On Mon, Mar 9, 2009 at 11:14 AM, Joseph L. Casale JCasale@activenetwerx.com wrote:
There is a MegaCLI command line interface that runs under the operating system. Normally I prefer command line tools. But this software is big, and complex. All I have been able to find is a reference manual, that has lots of typos and is not very well organized for me to learn what I need to know. I have not been able to find a tutorial for this software. It will take more time than I have at the moment to figure out this tool.
Huh? It's one tiny binary, and the syntax is trivial? You are looking at something else... Its own help is decent and it installs via rpm on RHEL.
What you need is the mr_sas_sw_ug.pdf from lsi's site.
The manual IS sloppy. missing - characters in the syntax
Tryijng to figure out -Val syntax
megacli AdpPRSetDelay -Val -aN|-a0,1,2|-aALL
+ /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0 Invalid input at or near token -AdpPRSetDelay
Tried sticking a - in front of the zero. Doesn't make much sense, tried it anyway, didn't help.
This cheat sheet for another vintage of the controller rebadged by Dell, seems to be exactly what I need.
http://tools.rapidsoft.de/perc/perc-cheat-sheet.html
Looks like I can get most of what I need, without any stinking -Val
That will do for now.
The manual IS sloppy. missing - characters in the syntax
Tryijng to figure out -Val syntax
megacli AdpPRSetDelay -Val -aN|-a0,1,2|-aALL
- /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0
Invalid input at or near token -AdpPRSetDelay
Tried sticking a - in front of the zero. Doesn't make much sense, tried it anyway, didn't help.
Seriously, I get that you are frustrated, been there myself.
I don't have any of our LSI's actually running at the moment, but it makes sense to me if the Patrol Read is disabled, you get an error configuring it. Just a guess...
What does a -AdpPR -Info -a0 yield?
jlc
On Tue, Mar 10, 2009 at 1:52 PM, Joseph L. Casale JCasale@activenetwerx.com wrote:
The manual IS sloppy. missing - characters in the syntax
Tryijng to figure out -Val syntax
megacli AdpPRSetDelay -Val -aN|-a0,1,2|-aALL
- /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0
Invalid input at or near token -AdpPRSetDelay
Tried sticking a - in front of the zero. Doesn't make much sense, tried it anyway, didn't help.
Seriously, I get that you are frustrated, been there myself.
I don't have any of our LSI's actually running at the moment, but it makes sense to me if the Patrol Read is disabled, you get an error configuring it. Just a guess...
What does a -AdpPR -Info -a0 yield?
+ /home/drew/bin/MegaCli -AdpPR -Info -a0 ^M Adapter 0: Patrol Read Information:
Patrol Read Mode: Auto Patrol Read Execution Delay: 168 hours Number of iterations completed: 43 Current State: Stopped
It's already 168 hours, lets try a command setting it to 168 hours
+ /home/drew/bin/MegaCli -AdpPRSetDelay 168 -a0 ^MInvalid input at or near token -AdpPRSetDelay
Doesn't like the syntax
+ /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0 ^MInvalid input at or near token -AdpPRSetDelay
Lets try setting it to 0, Doesn't like that either.
/home/drew/bin/MegaCli -AdpPRSetDelay 168 -a0 ^MInvalid input at or near token -AdpPRSetDelay
Doesn't like the syntax
- /home/drew/bin/MegaCli -AdpPRSetDelay 0 -a0
^MInvalid input at or near token -AdpPRSetDelay
Lets try setting it to 0, Doesn't like that either.
I wish I had one of my cards running, but just looking at the syntax, from my experience running this app, I would say you need to do: # MegaCli -AdpPRSetDelay -Val33 -a0 if you wanted 33 hours :) What are you trying to change it to anyway? Is the value sane?
jlc
On Tue, Mar 10, 2009 at 4:18 PM, Joseph L. Casale JCasale@activenetwerx.com wrote:
I wish I had one of my cards running, but just looking at the syntax, from my experience running this app, I would say you need to do: # MegaCli -AdpPRSetDelay -Val33 -a0 if you wanted 33 hours :) What are you trying to change it to anyway? Is the value sane?
+ /home/drew/bin/MegaCli -AdpPRSetDelay -Val168 -a0 ^MInvalid input at or near token -AdpPRSetDelay
Hmm. It didn't like that either!
I'm just trying to figure out the command syntax. And writing some utility scripts.
-AdpPRSetDelay -Val is just the first command in the manual that sets a value, and there is neither a specification of the syntax for -Val, nor an example command using -Val
Will probably leave the -AdpPRSetDelay at 168 But I still need the syntax for setting -Val in other commands.
I bet you didn't learn the syntax from the manual. I'll bet you inherited some scripts from someone else, and learned by tweaking working scripts.
On Tue, Mar 10, 2009 at 6:18 PM, Joseph L. Casale JCasale@activenetwerx.com wrote:
I bet you didn't learn the syntax from the manual. I'll bet you inherited some scripts from someone else, and learned by tweaking working scripts.
Uhm, I learned from the manual. I am tempted to fire one up and just figure it out...
Next I'm trying to setup a raid-10 logical volume.
Got the two mirrors built. Now I need to stripe them
Here's an excerpt from -LDPDInfo I just added a little white space it makes the output much more readable. And I deleted the stuff about other Logical Drives
+ /home/drew/bin/MegaCli -LDPDInfo -a0
Adapter #0
Number of Virtual Disks: 5 . . .
Virtual Disk: 3 (Target Id: 2) Name: RAID Level: Primary-1, Secondary-0, RAID Level Qualifier-0 Size:285148MB State: Optimal Stripe Size: 128kB Number Of Drives:2 Span Depth:1 Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Access Policy: Read/Write Disk Cache Policy: Disk's Default Encryption Type: None Number of Spans: 1 Span: 0 - Number of PDs: 2
PD: 0 Information Enclosure Device ID: 11 Slot Number: 3 Device Id: 5 Sequence Number: 12 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 286102MB [0x22ecb25c Sectors] Non Coerced Size: 285590MB [0x22dcb25c Sectors] Coerced Size: 285148MB [0x22cee000 Sectors] Firmware state: Online SAS Address(0): 0x5000c500072b15a1 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: IBM-ESXSST3300655SS BA263LM2M7RN1026BA26 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Foreign State: None Media Type: Hard Disk Device
PD: 1 Information Enclosure Device ID: 11 Slot Number: 4 Device Id: 6 Sequence Number: 12 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 286102MB [0x22ecb25c Sectors] Non Coerced Size: 285590MB [0x22dcb25c Sectors] Coerced Size: 285148MB [0x22cee000 Sectors] Firmware state: Online SAS Address(0): 0x5000c500072b14c1 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: IBM-ESXSST3300655SS BA263LM2QDNP1026BA26 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Foreign State: None Media Type: Hard Disk Device
Virtual Disk: 4 (Target Id: 4) Name: RAID Level: Primary-1, Secondary-0, RAID Level Qualifier-0 Size:285148MB State: Optimal Stripe Size: 128kB Number Of Drives:2 Span Depth:1 Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Access Policy: Read/Write Disk Cache Policy: Disk's Default Encryption Type: None Number of Spans: 1 Span: 0 - Number of PDs: 2
PD: 0 Information Enclosure Device ID: 11 Slot Number: 5 Device Id: 7 Sequence Number: 10 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 286102MB [0x22ecb25c Sectors] Non Coerced Size: 285590MB [0x22dcb25c Sectors] Coerced Size: 285148MB [0x22cee000 Sectors] Firmware state: Online SAS Address(0): 0x5000c500072b2081 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: IBM-ESXSST3300655SS BA263LM2TCW71026BA26 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Foreign State: None Media Type: Hard Disk Device
PD: 1 Information Enclosure Device ID: 11 Slot Number: 6 Device Id: 8 Sequence Number: 10 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 286102MB [0x22ecb25c Sectors] Non Coerced Size: 285590MB [0x22dcb25c Sectors] Coerced Size: 285148MB [0x22cee000 Sectors] Firmware state: Online SAS Address(0): 0x5000c500072b1ed5 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: IBM-ESXSST3300655SS BA263LM2RPS41026BA26 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Foreign State: None Media Type: Hard Disk Device
+ /home/drew/bin/MegaCli -CfgSpanAdd -R10 -Array0[11:3,11:4] -Array1[11:5,11:6] -a0
Drives are not consistent with Disk Group.
Doesn't look like it liked the way I specified the mirrors!
MegaCli –CfgSpanAdd -aN|-a0,1,2|-aALL -R10|-R50|R60 – Array0[E0:S0,E1:S1,...] –Array1[E0:S0,E1:S1,...] [...] [WT | WB] [NORA | RA | ADRA] [Direct | Cached] [CachedBadBBU|NoCachedBadBBU] [- szXXXXXXXX [-szYYYYYYYY [... ]]] [-strpszM] [–afterLdX] -aN
Hmm. The -aN|-a0,1,2|-aALL part looks completely bogus
The Arrays look right to me. Will set some different polices, etc after I get this part working!
-- Drew Einhorn
Drives are not consistent with Disk Group.
Doesn't look like it liked the way I specified the mirrors!
I really can't remember, but for some reason I think in the GUI you span then mirror, but in the cli you do it one pass. Dump the two ld's and try that command over.
I really can't remember, it's been several months since I set an array up and the only machines running LSI's at the moment are esxi boxes so I can't execute the cli anymore.
jlc
Joseph L. Casale wrote:
Drives are not consistent with Disk Group.
Doesn't look like it liked the way I specified the mirrors!
I really can't remember, but for some reason I think in the GUI you span then mirror, but in the cli you do it one pass. Dump the two ld's and try that command over.
indeed, most of the hardware raid controllers I've used of late, you just pick 4 or more drives and build a 'raid-1' and it automatically does the mirror/stripe thing for you.
- /home/drew/bin/MegaCli -AdpPRSetDelay 168 -a0
^MInvalid input at or near token -AdpPRSetDelay
Doesn't like the syntax
Looks like the manual is outdated, you should have ran a -h :)
Turns out this is the correct syntax:
MegaCli -AdpPR -Dsbl|EnblAuto|EnblMan|Start|Stop|Info|{SetDelay Val} -aN|-a0,1,2|-aALL
MegaCli -AdpPR -SetDelay X -a0 where X is between 0 and 65535...
jlc
On Wed, Mar 11, 2009 at 8:26 AM, Joseph L. Casale JCasale@activenetwerx.com wrote:
- /home/drew/bin/MegaCli -AdpPRSetDelay 168 -a0
^MInvalid input at or near token -AdpPRSetDelay
Doesn't like the syntax
Looks like the manual is outdated, you should have ran a -h :)
Hmm.
I've seen a bunch of bad syntax in the manual. Can't trust the manual.
Haven't looked at the -h Will probably have better luck there.
Turns out this is the correct syntax:
MegaCli -AdpPR -Dsbl|EnblAuto|EnblMan|Start|Stop|Info|{SetDelay Val} -aN|-a0,1,2|-aALL
MegaCli -AdpPR -SetDelay X -a0 where X is between 0 and 65535...
jlc _______________________________________________ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
-
drew einhorn -
John Doe -
John R Pierce -
Joseph L. Casale