I'm trying to figure out why 2 machines have a "hard I/O lock" on the HDD when running EL6.
I have 4 identical machines, all were stable with EL5. 2 work great with EL6, 2 do not. I've checked momtherboard BIOS versions and settings, SAS controller BIOS versions and settings, they are the same between the working and non- working systems.
When booting a non-working system, it boots straight up to the boot prompt (runlevel 3) without issue, and everything works fine. When the machine sits idle for a period of time (ranging from 15 minutes or so and up) the HDD becomes unreadable/unwritable and the system is useless for any purpose and must be hard restarted with a full power cycle - it won't even shut down.
Since nothing is logged, I've had precious little information to diagnose with. After several attempts to find out what's going on, I find the following emitted to the screen:
mpt2sas0: diag reset: FAILED mpt2sas0: diag reset: FAILED mpt2sas0: diag reset: FAILED end_request: I/O error, dev sda, sector 226972349 Buffer I/O error, device sda5, logical block 2719747 sd 0:0:0:0rejecting I/O to offline device sd 0:0:0:0rejecting I/O to offline device sd 0:0:0:0rejecting I/O to offline device
This is NOT due to a faulty HDD: I've tried new hard disks, SATA/SAS, I've swapped hard disks with an identical working unit and verified that the working unit remains working and the failing unit continues to fail. I've reformatted and re-installed EL6 numerous times with consistent results.
Googling this error returned very little useful information: where should I go now? Below, please find outputs of dmesg and lspci. I've compared outputs of dmesg between working and nonworking systems, the output of anything with "mpt" at the beginning is identical except for different IRQ ports.
Dump of dmesg: Initializing cgroup subsys cpuset Initializing cgroup subsys cpu Linux version 2.6.32-71.29.1.el6.x86_64 (mockbuild@c6b5.bsys.dev.centos.org) (gcc version 4.4.4 20100726 (Red Hat 4.4.4-13) (GCC) ) #1 SMP Mon Jun 27 19:49:27 BST 2011 Command line: ro root=UUID=3653eebb-f6b7-4e90-8365-26f4eccaa960 rd_NO_LUKS rd_NO_LVM rd_NO_MD rd_NO_DM LANG=en_US.UTF-8 SYSFONT=latarcyrheb-sun16 KEYBOARDTYPE=pc KEYTABLE=us crashkernel=auto rhgb quiet acpi=off KERNEL supported cpus: Intel GenuineIntel AMD AuthenticAMD Centaur CentaurHauls BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009dc00 (usable) BIOS-e820: 000000000009dc00 - 00000000000a0000 (reserved) BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 00000000bf7d0000 (usable) BIOS-e820: 00000000bf7d0000 - 00000000bf7e0000 (reserved) BIOS-e820: 00000000bf7ed000 - 00000000c0000000 (reserved) BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) BIOS-e820: 00000000fed20000 - 00000000fed40000 (reserved) BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) BIOS-e820: 0000000100000000 - 0000000440000000 (usable) DMI present. AMI BIOS detected: BIOS may corrupt low RAM, working around it. e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved) e820 update range: 0000000000000000 - 0000000000001000 (usable) ==> (reserved) e820 remove range: 00000000000a0000 - 0000000000100000 (usable) last_pfn = 0x440000 max_arch_pfn = 0x400000000 MTRR default type: uncachable MTRR fixed ranges enabled: 00000-9FFFF write-back A0000-BFFFF uncachable C0000-CFFFF write-protect D0000-DFFFF uncachable E0000-E3FFF write-protect E4000-E7FFF write-through E8000-EBFFF write-protect EC000-EFFFF write-through F0000-FFFFF write-protect MTRR variable ranges enabled: 0 base 000000000 mask C00000000 write-back 1 base 400000000 mask FC0000000 write-back 2 base 0C0000000 mask FC0000000 uncachable 3 disabled 4 disabled 5 disabled 6 disabled 7 disabled x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 original variable MTRRs reg 0, base: 0GB, range: 16GB, type WB reg 1, base: 16GB, range: 1GB, type WB reg 2, base: 3GB, range: 1GB, type UC total RAM covered: 16384M Found optimal setting for mtrr clean up gran_size: 64K chunk_size: 64K num_reg: 5 lose cover RAM: 0G New variable MTRRs reg 0, base: 0GB, range: 2GB, type WB reg 1, base: 2GB, range: 1GB, type WB reg 2, base: 4GB, range: 4GB, type WB reg 3, base: 8GB, range: 8GB, type WB reg 4, base: 16GB, range: 1GB, type WB e820 update range: 00000000c0000000 - 0000000100000000 (usable) ==> (reserved) last_pfn = 0xbf7d0 max_arch_pfn = 0x400000000 initial memory mapped : 0 - 20000000 init_memory_mapping: 0000000000000000-00000000bf7d0000 0000000000 - 00bf600000 page 2M 00bf600000 - 00bf7d0000 page 4k kernel direct mapping tables up to bf7d0000 @ 10000-15000 init_memory_mapping: 0000000100000000-0000000440000000 0100000000 - 0440000000 page 2M kernel direct mapping tables up to 440000000 @ 13000-25000 RAMDISK: 37515000 - 37fefb62 No NUMA configuration found Faking a node at 0000000000000000-0000000440000000 Bootmem setup node 0 0000000000000000-0000000440000000 NODE_DATA [0000000000020000 - 0000000000053fff] bootmap [0000000000100000 - 0000000000187fff] pages 88 (8 early reservations) ==> bootmem [0000000000 - 0440000000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000] #2 [0001000000 - 0001ca0ff8] TEXT DATA BSS ==> [0001000000 - 0001ca0ff8] #3 [0037515000 - 0037fefb62] RAMDISK ==> [0037515000 - 0037fefb62] #4 [000009dc00 - 0000100000] BIOS reserved ==> [000009dc00 - 0000100000] #5 [0001ca1000 - 0001ca121b] BRK ==> [0001ca1000 - 0001ca121b] #6 [0000010000 - 0000013000] PGTABLE ==> [0000010000 - 0000013000] #7 [0000013000 - 0000020000] PGTABLE ==> [0000013000 - 0000020000] found SMP MP-table at [ffff8800000ff780] ff780 Reserving 129MB of memory at 32MB for crashkernel (System RAM: 17408MB) [ffffea0000000000-ffffea000edfffff] PMD -> [ffff880028600000-ffff8800365fffff] on node 0 Zone PFN ranges: DMA 0x00000010 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal 0x00100000 -> 0x00440000 Movable zone start PFN for each node early_node_map[3] active PFN ranges 0: 0x00000010 -> 0x0000009d 0: 0x00000100 -> 0x000bf7d0 0: 0x00100000 -> 0x00440000 On node 0 totalpages: 4192093 DMA zone: 56 pages used for memmap DMA zone: 117 pages reserved DMA zone: 3808 pages, LIFO batch:0 DMA32 zone: 14280 pages used for memmap DMA32 zone: 765960 pages, LIFO batch:31 Normal zone: 46592 pages used for memmap Normal zone: 3361280 pages, LIFO batch:31 SFI: Simple Firmware Interface v0.7 http://simplefirmware.org Intel MultiProcessor Specification v1.4 MPTABLE: OEM ID: INTEL MPTABLE: Product ID: FOXHOLLOW MPTABLE: APIC at: 0xFEE00000 Processor #0 (Bootup-CPU) Processor #2 Processor #4 Processor #6 I/O APIC #1 Version 32 at 0xFEC00000. Processors: 4 SMP: Allowing 4 CPUs, 0 hotplug CPUs nr_irqs_gsi: 24 PM: Registered nosave memory: 000000000009d000 - 000000000009e000 PM: Registered nosave memory: 000000000009e000 - 00000000000a0000 PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000 PM: Registered nosave memory: 00000000000e0000 - 0000000000100000 PM: Registered nosave memory: 00000000bf7d0000 - 00000000bf7e0000 PM: Registered nosave memory: 00000000bf7e0000 - 00000000bf7ed000 PM: Registered nosave memory: 00000000bf7ed000 - 00000000c0000000 PM: Registered nosave memory: 00000000c0000000 - 00000000e0000000 PM: Registered nosave memory: 00000000e0000000 - 00000000f0000000 PM: Registered nosave memory: 00000000f0000000 - 00000000fed20000 PM: Registered nosave memory: 00000000fed20000 - 00000000fed40000 PM: Registered nosave memory: 00000000fed40000 - 00000000fee00000 PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000 PM: Registered nosave memory: 00000000fee01000 - 0000000100000000 Allocating PCI resources starting at c0000000 (gap: c0000000:20000000) Booting paravirtualized kernel on bare hardware NR_CPUS:4096 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 PERCPU: Embedded 31 pages/cpu @ffff880028200000 s95064 r8192 d23720 u524288 pcpu-alloc: s95064 r8192 d23720 u524288 alloc=1*2097152 pcpu-alloc: [0] 0 1 2 3 Built 1 zonelists in Zone order, mobility grouping on. Total pages: 4131048 Policy zone: Normal Kernel command line: ro root=UUID=3653eebb-f6b7-4e90-8365-26f4eccaa960 rd_NO_LUKS rd_NO_LVM rd_NO_MD rd_NO_DM LANG=en_US.UTF-8 SYSFONT=latarcyrheb- sun16 KEYBOARDTYPE=pc KEYTABLE=us crashkernel=129M@0M rhgb quiet acpi=off PID hash table entries: 4096 (order: 3, 32768 bytes) Checking aperture... No AGP bridge found AMD-Vi disabled by default: pass amd_iommu=on to enable PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000 software IO TLB at phys 0x20000000 - 0x24000000 Memory: 16315744k/17825792k available (4939k kernel code, 1057420k absent, 452628k reserved, 3931k data, 1220k init) Hierarchical RCU implementation. NR_IRQS:33024 nr_irqs:440 Console: colour VGA+ 80x25 console [tty0] enabled allocated 167772160 bytes of page_cgroup please try 'cgroup_disable=memory' option if you don't want memory cgroups Fast TSC calibration using PIT Detected 2666.323 MHz processor. Calibrating delay loop (skipped), value calculated using timer frequency.. 5332.64 BogoMIPS (lpj=2666323) pid_max: default: 32768 minimum: 301 Security Framework initialized SELinux: Initializing. SELinux: Starting in permissive mode Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes) Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes) Mount-cache hash table entries: 256 Initializing cgroup subsys ns Initializing cgroup subsys cpuacct Initializing cgroup subsys memory Initializing cgroup subsys devices Initializing cgroup subsys freezer Initializing cgroup subsys net_cls Initializing cgroup subsys blkio CPU: Physical Processor ID: 0 CPU: Processor Core ID: 0 mce: CPU supports 9 MCE banks CPU0: Thermal monitoring enabled (TM1) using mwait in idle threads. Performance Events: PEBS fmt1+, Nehalem events, Intel PMU driver. ... version: 3 ... bit width: 48 ... generic registers: 4 ... value mask: 0000ffffffffffff ... max period: 000000007fffffff ... fixed-purpose events: 3 ... event mask: 000000070000000f ftrace: converting mcount calls to 0f 1f 44 00 00 ftrace: allocating 20293 entries in 80 pages Setting APIC routing to flat ExtINT not setup in hardware but reported by MP table alloc irq_desc for 16 on node 0 alloc kstat_irqs on node 0 alloc irq_desc for 17 on node 0 alloc kstat_irqs on node 0 alloc irq_desc for 18 on node 0 alloc kstat_irqs on node 0 alloc irq_desc for 19 on node 0 alloc kstat_irqs on node 0 alloc irq_desc for 21 on node 0 alloc kstat_irqs on node 0 alloc irq_desc for 23 on node 0 alloc kstat_irqs on node 0 ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0 CPU0: Intel(R) Xeon(R) CPU X3450 @ 2.67GHz stepping 05 Booting Node 0, Processors #1 #2 #3 Ok. Brought up 4 CPUs Total of 4 processors activated (21328.27 BogoMIPS). Testing NMI watchdog ... OK. sizeof(vma)=200 bytes sizeof(page)=56 bytes sizeof(inode)=592 bytes sizeof(dentry)=192 bytes sizeof(ext3inode)=800 bytes sizeof(buffer_head)=104 bytes sizeof(skbuff)=232 bytes sizeof(task_struct)=2600 bytes devtmpfs: initialized regulator: core version 0.5 NET: Registered protocol family 16 PCI: Using configuration type 1 for base access bio: create slab <bio-0> at 0 ACPI: Interpreter disabled. vgaarb: loaded SCSI subsystem initialized libata version 3.00 loaded. usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb PCI: Probing PCI hardware PCI: Probing PCI hardware (bus 00) pci 0000:00:03.0: PME# supported from D0 D3hot D3cold pci 0000:00:03.0: PME# disabled pci 0000:00:05.0: PME# supported from D0 D3hot D3cold pci 0000:00:05.0: PME# disabled pci 0000:00:1a.0: reg 10 32bit mmio: [0xfb3fc000-0xfb3fc3ff] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold pci 0000:00:1a.0: PME# disabled pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold pci 0000:00:1c.0: PME# disabled pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold pci 0000:00:1c.4: PME# disabled pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold pci 0000:00:1c.5: PME# disabled pci 0000:00:1d.0: reg 10 32bit mmio: [0xfb3fa000-0xfb3fa3ff] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold pci 0000:00:1d.0: PME# disabled pci 0000:00:1f.2: reg 10 io port: [0xbc00-0xbc07] pci 0000:00:1f.2: reg 14 io port: [0xb880-0xb883] pci 0000:00:1f.2: reg 18 io port: [0xb800-0xb807] pci 0000:00:1f.2: reg 1c io port: [0xb480-0xb483] pci 0000:00:1f.2: reg 20 io port: [0xb400-0xb40f] pci 0000:00:1f.2: reg 24 io port: [0xb080-0xb08f] pci 0000:00:1f.3: reg 10 64bit mmio: [0xfb3f8000-0xfb3f80ff] pci 0000:00:1f.3: reg 20 io port: [0x400-0x41f] pci 0000:00:1f.5: reg 10 io port: [0xac00-0xac07] pci 0000:00:1f.5: reg 14 io port: [0xa880-0xa883] pci 0000:00:1f.5: reg 18 io port: [0xa800-0xa807] pci 0000:00:1f.5: reg 1c io port: [0xa480-0xa483] pci 0000:00:1f.5: reg 20 io port: [0xa400-0xa40f] pci 0000:00:1f.5: reg 24 io port: [0xa080-0xa08f] pci 0000:02:00.0: reg 10 io port: [0xc000-0xc0ff] pci 0000:02:00.0: reg 14 64bit mmio: [0xfb43c000-0xfb43ffff] pci 0000:02:00.0: reg 1c 64bit mmio: [0xfb440000-0xfb47ffff] pci 0000:02:00.0: reg 30 32bit mmio pref: [0xfb480000-0xfb4fffff] pci 0000:02:00.0: supports D1 D2 pci 0000:00:05.0: bridge io port: [0xc000-0xcfff] pci 0000:00:05.0: bridge 32bit mmio: [0xfb400000-0xfb4fffff] pci 0000:04:00.0: reg 10 32bit mmio: [0xfb5e0000-0xfb5fffff] pci 0000:04:00.0: reg 18 io port: [0xdc00-0xdc1f] pci 0000:04:00.0: reg 1c 32bit mmio: [0xfb5dc000-0xfb5dffff] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold pci 0000:04:00.0: PME# disabled pci 0000:00:1c.4: bridge io port: [0xd000-0xdfff] pci 0000:00:1c.4: bridge 32bit mmio: [0xfb500000-0xfb5fffff] pci 0000:05:00.0: reg 10 32bit mmio: [0xfb6e0000-0xfb6fffff] pci 0000:05:00.0: reg 18 io port: [0xec00-0xec1f] pci 0000:05:00.0: reg 1c 32bit mmio: [0xfb6dc000-0xfb6dffff] pci 0000:05:00.0: PME# supported from D0 D3hot D3cold pci 0000:05:00.0: PME# disabled pci 0000:00:1c.5: bridge io port: [0xe000-0xefff] pci 0000:00:1c.5: bridge 32bit mmio: [0xfb600000-0xfb6fffff] pci 0000:06:03.0: reg 10 32bit mmio pref: [0xfa000000-0xfaffffff] pci 0000:06:03.0: reg 14 32bit mmio: [0xfb7fc000-0xfb7fffff] pci 0000:06:03.0: reg 18 32bit mmio: [0xfb800000-0xfbffffff] pci 0000:00:1e.0: transparent bridge pci 0000:00:1e.0: bridge 32bit mmio: [0xfb700000-0xfbffffff] pci 0000:00:1e.0: bridge 64bit mmio pref: [0xfa000000-0xfaffffff] vgaarb: device added: PCI:0000:06:03.0,decodes=io+mem,owns=io+mem,locks=none pci 0000:00:1f.0: PIIX/ICH IRQ router [8086:3b14] PCI: old code would have set cacheline size to 32 bytes, but clflush_size = 64 PCI: pci_cache_line_size set to 64 bytes NetLabel: Initializing NetLabel: domain hash size = 128 NetLabel: protocols = UNLABELED CIPSOv4 NetLabel: unlabeled traffic allowed by default Switching to clocksource tsc pnp: PnP ACPI: disabled pci 0000:00:03.0: PCI bridge to [bus 01-01] pci 0000:00:03.0: PCI bridge, secondary bus 0000:01 pci 0000:00:03.0: bridge window [io disabled] pci 0000:00:03.0: bridge window [mem disabled] pci 0000:00:03.0: bridge window [mem pref disabled] pci 0000:00:05.0: PCI bridge to [bus 02-02] pci 0000:00:05.0: PCI bridge, secondary bus 0000:02 pci 0000:00:05.0: bridge window [0xc000-0xcfff] pci 0000:00:05.0: bridge window [0xfb400000-0xfb4fffff] pci 0000:00:05.0: bridge window [mem pref disabled] pci 0000:00:1c.0: PCI bridge to [bus 03-03] pci 0000:00:1c.0: PCI bridge, secondary bus 0000:03 pci 0000:00:1c.0: bridge window [0x1000-0x1fff] pci 0000:00:1c.0: bridge window [0xc0000000-0xc01fffff] pci 0000:00:1c.0: bridge window [0xc0200000-0xc03fffff] pci 0000:00:1c.4: PCI bridge to [bus 04-04] pci 0000:00:1c.4: PCI bridge, secondary bus 0000:04 pci 0000:00:1c.4: bridge window [0xd000-0xdfff] pci 0000:00:1c.4: bridge window [0xfb500000-0xfb5fffff] pci 0000:00:1c.4: bridge window [0xc0400000-0xc05fffff] pci 0000:00:1c.5: PCI bridge to [bus 05-05] pci 0000:00:1c.5: PCI bridge, secondary bus 0000:05 pci 0000:00:1c.5: bridge window [0xe000-0xefff] pci 0000:00:1c.5: bridge window [0xfb600000-0xfb6fffff] pci 0000:00:1c.5: bridge window [0xc0600000-0xc07fffff] pci 0000:00:1e.0: PCI bridge to [bus 06-06] pci 0000:00:1e.0: PCI bridge, secondary bus 0000:06 pci 0000:00:1e.0: bridge window [io disabled] pci 0000:00:1e.0: bridge window [0xfb700000-0xfbffffff] pci 0000:00:1e.0: bridge window [0xfa000000-0xfaffffff] pci 0000:00:03.0: PCI->APIC IRQ transform: INT A -> IRQ 16 pci 0000:00:03.0: setting latency timer to 64 pci 0000:00:05.0: PCI->APIC IRQ transform: INT A -> IRQ 16 pci 0000:00:05.0: setting latency timer to 64 pci 0000:00:1c.0: enabling device (0104 -> 0107) pci 0000:00:1c.0: PCI->APIC IRQ transform: INT A -> IRQ 17 pci 0000:00:1c.0: setting latency timer to 64 pci 0000:00:1c.4: PCI->APIC IRQ transform: INT A -> IRQ 17 pci 0000:00:1c.4: setting latency timer to 64 pci 0000:00:1c.5: PCI->APIC IRQ transform: INT B -> IRQ 16 pci 0000:00:1c.5: setting latency timer to 64 pci 0000:00:1e.0: setting latency timer to 64 pci_bus 0000:00: resource 0 io: [0x00-0xffff] pci_bus 0000:00: resource 1 mem: [0x000000-0xffffffffffffffff] pci_bus 0000:02: resource 0 io: [0xc000-0xcfff] pci_bus 0000:02: resource 1 mem: [0xfb400000-0xfb4fffff] pci_bus 0000:03: resource 0 io: [0x1000-0x1fff] pci_bus 0000:03: resource 1 mem: [0xc0000000-0xc01fffff] pci_bus 0000:03: resource 2 pref mem [0xc0200000-0xc03fffff] pci_bus 0000:04: resource 0 io: [0xd000-0xdfff] pci_bus 0000:04: resource 1 mem: [0xfb500000-0xfb5fffff] pci_bus 0000:04: resource 2 pref mem [0xc0400000-0xc05fffff] pci_bus 0000:05: resource 0 io: [0xe000-0xefff] pci_bus 0000:05: resource 1 mem: [0xfb600000-0xfb6fffff] pci_bus 0000:05: resource 2 pref mem [0xc0600000-0xc07fffff] pci_bus 0000:06: resource 1 mem: [0xfb700000-0xfbffffff] pci_bus 0000:06: resource 2 pref mem [0xfa000000-0xfaffffff] pci_bus 0000:06: resource 3 io: [0x00-0xffff] pci_bus 0000:06: resource 4 mem: [0x000000-0xffffffffffffffff] NET: Registered protocol family 2 IP route cache hash table entries: 524288 (order: 10, 4194304 bytes) TCP established hash table entries: 524288 (order: 11, 8388608 bytes) TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) TCP: Hash tables configured (established 524288 bind 65536) TCP reno registered NET: Registered protocol family 1 pci 0000:06:03.0: Boot video device Trying to unpack rootfs image as initramfs... Freeing initrd memory: 11114k freed platform rtc_cmos: registered platform RTC device (no PNP device found) audit: initializing netlink socket (disabled) type=2000 audit(1317063573.647:1): initialized HugeTLB registered 2 MB page size, pre-allocated 0 pages VFS: Disk quotas dquot_6.5.2 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) msgmni has been set to 31888 SELinux: Registering netfilter hooks alg: No test for stdrng (krng) ksign: Installing public key data Loading keyring - Added public key 965331713A640F69 - User ID: CentOS (Kernel Module GPG key) Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252) io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered io scheduler cfq registered (default) alloc irq_desc for 24 on node -1 alloc kstat_irqs on node -1 pcieport 0000:00:03.0: irq 24 for MSI/MSI-X pcieport 0000:00:03.0: setting latency timer to 64 alloc irq_desc for 25 on node -1 alloc kstat_irqs on node -1 pcieport 0000:00:05.0: irq 25 for MSI/MSI-X pcieport 0000:00:05.0: setting latency timer to 64 alloc irq_desc for 26 on node -1 alloc kstat_irqs on node -1 pcieport 0000:00:1c.0: irq 26 for MSI/MSI-X pcieport 0000:00:1c.0: setting latency timer to 64 alloc irq_desc for 27 on node -1 alloc kstat_irqs on node -1 pcieport 0000:00:1c.4: irq 27 for MSI/MSI-X pcieport 0000:00:1c.4: setting latency timer to 64 alloc irq_desc for 28 on node -1 alloc kstat_irqs on node -1 pcieport 0000:00:1c.5: irq 28 for MSI/MSI-X pcieport 0000:00:1c.5: setting latency timer to 64 pci_hotplug: PCI Hot Plug PCI Core version: 0.5 pciehp: PCI Express Hot Plug Controller Driver version: 0.4 acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 pci-stub: invalid id string "" Non-volatile memory driver v1.3 Linux agpgart interface v0.103 crash memory driver: version 1.0 Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A serial8250: ttyS2 at I/O 0x3e8 (irq = 5) is a 16550A brd: module loaded loop: module loaded input: Macintosh mouse button emulation as /devices/virtual/input/input0 Fixed MDIO Bus: probed ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver ehci_hcd 0000:00:1a.0: PCI->APIC IRQ transform: INT A -> IRQ 21 ehci_hcd 0000:00:1a.0: setting latency timer to 64 ehci_hcd 0000:00:1a.0: EHCI Host Controller ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1 ehci_hcd 0000:00:1a.0: debug port 2 ehci_hcd 0000:00:1a.0: cache line size of 64 is not supported ehci_hcd 0000:00:1a.0: irq 21, io mem 0xfb3fc000 ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00 usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 usb usb1: Product: EHCI Host Controller usb usb1: Manufacturer: Linux 2.6.32-71.29.1.el6.x86_64 ehci_hcd usb usb1: SerialNumber: 0000:00:1a.0 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 2 ports detected ehci_hcd 0000:00:1d.0: PCI->APIC IRQ transform: INT A -> IRQ 23 ehci_hcd 0000:00:1d.0: setting latency timer to 64 ehci_hcd 0000:00:1d.0: EHCI Host Controller ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 ehci_hcd 0000:00:1d.0: debug port 2 ehci_hcd 0000:00:1d.0: cache line size of 64 is not supported ehci_hcd 0000:00:1d.0: irq 23, io mem 0xfb3fa000 ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00 usb usb2: New USB device found, idVendor=1d6b, idProduct=0002 usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 usb usb2: Product: EHCI Host Controller usb usb2: Manufacturer: Linux 2.6.32-71.29.1.el6.x86_64 ehci_hcd usb usb2: SerialNumber: 0000:00:1d.0 usb usb2: configuration #1 chosen from 1 choice hub 2-0:1.0: USB hub found hub 2-0:1.0: 2 ports detected ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver uhci_hcd: USB Universal Host Controller Interface driver PNP: No PS/2 controller found. Probing ports directly. serio: i8042 KBD port at 0x60,0x64 irq 1 serio: i8042 AUX port at 0x60,0x64 irq 12 mice: PS/2 mouse device common for all mice rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0 rtc0: alarms up to one day, 114 bytes nvram cpuidle: using governor ladder cpuidle: using governor menu usbcore: registered new interface driver hiddev usbcore: registered new interface driver usbhid usbhid: v2.6:USB HID core driver TCP cubic registered Initializing XFRM netlink socket NET: Registered protocol family 17 registered taskstats version 1 rtc_cmos rtc_cmos: setting system clock to 2011-09-26 18:59:34 UTC (1317063574) Initalizing network drop monitor service Freeing unused kernel memory: 1220k freed Write protecting the kernel read-only data: 7184k dracut: dracut-004-33.2.el6_0 device-mapper: uevent: version 1.0.3 device-mapper: ioctl: 4.17.0-ioctl (2010-03-05) initialised: dm- devel@redhat.com udev: starting version 147 dracut: Starting plymouth daemon mpt2sas version 05.100.00.02 loaded scsi0 : Fusion MPT SAS Host mpt2sas 0000:02:00.0: PCI->APIC IRQ transform: INT A -> IRQ 16 mpt2sas 0000:02:00.0: setting latency timer to 64 mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (16328080 kB) alloc irq_desc for 29 on node -1 alloc kstat_irqs on node -1 mpt2sas 0000:02:00.0: irq 29 for MSI/MSI-X mpt2sas0: PCI-MSI-X enabled: IRQ 29 mpt2sas0: iomem(0x00000000fb43c000), mapped(0xffffc900025c8000), size(16384) mpt2sas0: ioport(0x000000000000c000), size(256) mpt2sas0: sending diag reset !! usb 1-1: new high speed USB device using ehci_hcd and address 2 usb 1-1: New USB device found, idVendor=8087, idProduct=0020 usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 usb 1-1: configuration #1 chosen from 1 choice hub 1-1:1.0: USB hub found hub 1-1:1.0: 6 ports detected usb 2-1: new high speed USB device using ehci_hcd and address 2 usb 2-1: New USB device found, idVendor=8087, idProduct=0020 usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 usb 2-1: configuration #1 chosen from 1 choice hub 2-1:1.0: USB hub found hub 2-1:1.0: 6 ports detected usb 1-1.2: new full speed USB device using ehci_hcd and address 3 usb 1-1.2: New USB device found, idVendor=0557, idProduct=2221 usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0 usb 1-1.2: Product: Hermon USB hidmouse Device usb 1-1.2: Manufacturer: Winbond Electronics Corp usb 1-1.2: configuration #1 chosen from 1 choice input: Winbond Electronics Corp Hermon USB hidmouse Device as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.2/1-1.2:1.0/input/input1 generic-usb 0003:0557:2221.0001: input,hidraw0: USB HID v1.00 Mouse [Winbond Electronics Corp Hermon USB hidmouse Device] on usb-0000:00:1a.0-1.2/input0 input: Winbond Electronics Corp Hermon USB hidmouse Device as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.2/1-1.2:1.1/input/input2 generic-usb 0003:0557:2221.0002: input,hidraw1: USB HID v1.00 Keyboard [Winbond Electronics Corp Hermon USB hidmouse Device] on usb-0000:00:1a.0-1.2/input1 usb 1-1.3: new high speed USB device using ehci_hcd and address 4 usb 1-1.3: New USB device found, idVendor=05e3, idProduct=0719 usb 1-1.3: New USB device strings: Mfr=0, Product=1, SerialNumber=2 usb 1-1.3: Product: USB Storage usb 1-1.3: SerialNumber: 000000000033 usb 1-1.3: configuration #1 chosen from 1 choice usb 2-1.2: new low speed USB device using ehci_hcd and address 3 usb 2-1.2: New USB device found, idVendor=046d, idProduct=c31c usb 2-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0 usb 2-1.2: Product: USB Keyboard usb 2-1.2: Manufacturer: Logitech usb 2-1.2: configuration #1 chosen from 1 choice input: Logitech USB Keyboard as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.2/2-1.2:1.0/input/input3 generic-usb 0003:046D:C31C.0003: input,hidraw2: USB HID v1.10 Keyboard [Logitech USB Keyboard] on usb-0000:00:1d.0-1.2/input0 input: Logitech USB Keyboard as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.2/2-1.2:1.1/input/input4 generic-usb 0003:046D:C31C.0004: input,hidraw3: USB HID v1.10 Device [Logitech USB Keyboard] on usb-0000:00:1d.0-1.2/input1 usb 2-1.3: new high speed USB device using ehci_hcd and address 4 mpt2sas0: diag reset: SUCCESS usb 2-1.3: New USB device found, idVendor=0930, idProduct=653d usb 2-1.3: New USB device strings: Mfr=0, Product=2, SerialNumber=3 usb 2-1.3: Product: USB Flash Memory usb 2-1.3: SerialNumber: 0EF0F56022A2B8C4 usb 2-1.3: configuration #1 chosen from 1 choice mpt2sas0: Allocated physical memory: size(839 kB) mpt2sas0: Current Controller Queue Depth(339), Max Controller Queue Depth(2799) mpt2sas0: Scatter Gather Elements per IO(128) mpt2sas0: LSISAS2008: FWVersion(04.00.00.00), ChipRevision(0x02), BiosVersion(07.03.00.00) mpt2sas0: Protocol=(Initiator,Target), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ) mpt2sas0: sending port enable !! mpt2sas0: host_add: handle(0x0001), sas_addr(0x50030480004a14c0), phys(8) mpt2sas0: port enable: SUCCESS scsi 0:0:0:0: Direct-Access SEAGATE ST3300657SS 0006 PQ: 0 ANSI: 5 scsi 0:0:0:0: SSP: handle(0x0009), sas_addr(0x5000c50023bdb4b9), device_name(0x00c50050b8b4bd23) scsi 0:0:0:0: SSP: enclosure_logical_id(0x50030480004a14c0), slot(0) scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1) ata_piix 0000:00:1f.2: version 2.13 ata_piix 0000:00:1f.2: PCI->APIC IRQ transform: INT B -> IRQ 19 ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ] ata_piix 0000:00:1f.2: setting latency timer to 64 scsi1 : ata_piix scsi2 : ata_piix ata1: SATA max UDMA/133 cmd 0xbc00 ctl 0xb880 bmdma 0xb400 irq 19 ata2: SATA max UDMA/133 cmd 0xb800 ctl 0xb480 bmdma 0xb408 irq 19 ata_piix 0000:00:1f.5: PCI->APIC IRQ transform: INT B -> IRQ 19 ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ] ata_piix 0000:00:1f.5: setting latency timer to 64 scsi3 : ata_piix scsi4 : ata_piix ata3: SATA max UDMA/133 cmd 0xac00 ctl 0xa880 bmdma 0xa400 irq 19 ata4: SATA max UDMA/133 cmd 0xa800 ctl 0xa480 bmdma 0xa408 irq 19 ata4: SATA link down (SStatus 0 SControl 300) ata3: SATA link down (SStatus 0 SControl 300) ata2.00: SATA link down (SStatus 0 SControl 300) ata2.01: SATA link down (SStatus 0 SControl 300) ata1.00: SATA link down (SStatus 0 SControl 300) ata1.01: SATA link down (SStatus 0 SControl 300) Initializing USB Mass Storage driver... scsi5 : SCSI emulation for USB Mass Storage devices usb-storage: device found at 4 usb-storage: waiting for device to settle before scanning scsi6 : SCSI emulation for USB Mass Storage devices usb-storage: device found at 4 usb-storage: waiting for device to settle before scanning usbcore: registered new interface driver usb-storage USB Mass Storage support registered. sd 0:0:0:0: [sda] 585937500 512-byte logical blocks: (300 GB/279 GiB) sd 0:0:0:0: [sda] Write Protect is off sd 0:0:0:0: [sda] Mode Sense: bb 00 10 08 sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA sda: sda1 sda2 sda3 sda4 < sda5 sda6 sda7 > sd 0:0:0:0: [sda] Attached SCSI disk EXT3-fs: INFO: recovery required on readonly filesystem. EXT3-fs: write access will be enabled during recovery. kjournald starting. Commit interval 5 seconds EXT3-fs: recovery complete. EXT3-fs: mounted filesystem with ordered data mode. dracut: Mounted root filesystem /dev/sda3 dracut: Loading SELinux policy type=1404 audit(1317063586.147:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295 SELinux: 2048 avtab hash slots, 200977 rules. SELinux: 2048 avtab hash slots, 200977 rules. SELinux: 9 users, 13 roles, 3327 types, 173 bools, 1 sens, 1024 cats SELinux: 77 classes, 200977 rules SELinux: Completing initialization. SELinux: Setting up existing superblocks. SELinux: initialized (dev sda3, type ext3), uses xattr SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts SELinux: initialized (dev mqueue, type mqueue), uses transition SIDs SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses transition SIDs SELinux: initialized (dev devpts, type devpts), uses transition SIDs SELinux: initialized (dev inotifyfs, type inotifyfs), uses genfs_contexts SELinux: initialized (dev anon_inodefs, type anon_inodefs), uses genfs_contexts SELinux: initialized (dev pipefs, type pipefs), uses task SIDs SELinux: initialized (dev debugfs, type debugfs), uses genfs_contexts SELinux: initialized (dev sockfs, type sockfs), uses task SIDs SELinux: initialized (dev devtmpfs, type devtmpfs), uses transition SIDs SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs SELinux: initialized (dev proc, type proc), uses genfs_contexts SELinux: initialized (dev bdev, type bdev), uses genfs_contexts SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts type=1403 audit(1317063586.463:3): policy loaded auid=4294967295 ses=4294967295 dracut: dracut: Switching root udev: starting version 147 sd 0:0:0:0: Attached scsi generic sg0 type 0 e1000e: Intel(R) PRO/1000 Network Driver - 1.5.1-NAPI e1000e: Copyright(c) 1999 - 2011 Intel Corporation. e1000e 0000:04:00.0: Disabling ASPM L0s e1000e 0000:04:00.0: PCI->APIC IRQ transform: INT A -> IRQ 16 e1000e 0000:04:00.0: setting latency timer to 64 alloc irq_desc for 30 on node -1 alloc kstat_irqs on node -1 e1000e 0000:04:00.0: irq 30 for MSI/MSI-X alloc irq_desc for 31 on node -1 alloc kstat_irqs on node -1 e1000e 0000:04:00.0: irq 31 for MSI/MSI-X e1000e 0000:04:00.0: eth0: (PCI Express:2.5GT/s:Width x1) 00:25:90:00:64:b0 e1000e 0000:04:00.0: eth0: Intel(R) PRO/1000 Network Connection e1000e 0000:04:00.0: eth0: MAC: 4, PHY: 8, PBA No: 0101FF-0FF e1000e 0000:05:00.0: Disabling ASPM L0s e1000e 0000:05:00.0: PCI->APIC IRQ transform: INT A -> IRQ 17 e1000e 0000:05:00.0: setting latency timer to 64 alloc irq_desc for 32 on node -1 alloc kstat_irqs on node -1 e1000e 0000:05:00.0: irq 32 for MSI/MSI-X alloc irq_desc for 33 on node -1 alloc kstat_irqs on node -1 e1000e 0000:05:00.0: irq 33 for MSI/MSI-X e1000e 0000:05:00.0: eth1: (PCI Express:2.5GT/s:Width x1) 00:25:90:00:64:b1 e1000e 0000:05:00.0: eth1: Intel(R) PRO/1000 Network Connection e1000e 0000:05:00.0: eth1: MAC: 4, PHY: 8, PBA No: 0101FF-0FF iTCO_vendor_support: vendor-support=0 iTCO_wdt: Intel TCO WatchDog Timer Driver v1.05 iTCO_wdt: Found a 3420 TCO device (Version=2, TCOBASE=0x0860) iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) i801_smbus 0000:00:1f.3: PCI->APIC IRQ transform: INT C -> IRQ 18 usb-storage: device scan complete usb-storage: device scan complete scsi 6:0:0:0: Direct-Access USB Flash Memory 5.00 PQ: 0 ANSI: 0 CCS scsi 5:0:0:0: CD-ROM HL-DT-ST DVDRAM GT20L DQ02 PQ: 0 ANSI: 0 sd 6:0:0:0: Attached scsi generic sg1 type 0 scsi 5:0:0:0: Attached scsi generic sg2 type 5 EXT3 FS on sda3, internal journal kjournald starting. Commit interval 5 seconds EXT3 FS on sda1, internal journal EXT3-fs: mounted filesystem with ordered data mode. SELinux: initialized (dev sda1, type ext3), uses xattr kjournald starting. Commit interval 5 seconds EXT3 FS on sda7, internal journal EXT3-fs: mounted filesystem with ordered data mode. SELinux: initialized (dev sda7, type ext3), uses xattr kjournald starting. Commit interval 5 seconds EXT3 FS on sda2, internal journal EXT3-fs: mounted filesystem with ordered data mode. SELinux: initialized (dev sda2, type ext3), uses xattr kjournald starting. Commit interval 5 seconds EXT3 FS on sda5, internal journal EXT3-fs: mounted filesystem with ordered data mode. SELinux: initialized (dev sda5, type ext3), uses xattr Adding 10241396k swap on /dev/sda6. Priority:-1 extents:1 across:10241396k SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts NET: Registered protocol family 10 lo: Disabled Privacy Extensions sd 6:0:0:0: [sdb] 2013184 512-byte logical blocks: (1.03 GB/983 MiB) sd 6:0:0:0: [sdb] Write Protect is off sd 6:0:0:0: [sdb] Mode Sense: 23 00 00 00 sd 6:0:0:0: [sdb] Assuming drive cache: write through sd 6:0:0:0: [sdb] Assuming drive cache: write through sdb: sdb1 sd 6:0:0:0: [sdb] Assuming drive cache: write through sd 6:0:0:0: [sdb] Attached SCSI removable disk ip6_tables: (C) 2000-2006 Netfilter Core Team sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray Uniform CD-ROM driver Revision: 3.20 sr 5:0:0:0: Attached scsi CD-ROM sr0 nf_conntrack version 0.5.0 (16384 buckets, 65536 max) ip_tables: (C) 2000-2006 Netfilter Core Team ADDRCONF(NETDEV_UP): eth1: link is not ready e1000e: eth1 NIC Link is Up 100 Mbps Full Duplex, Flow Control: Rx/Tx e1000e 0000:05:00.0: eth1: 10/100 speed: disabling TSO ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready eth1: no IPv6 routers present SELinux: initialized (dev sdb1, type vfat), uses genfs_contexts
Output of lspci 00:00.0 Host bridge: Intel Corporation Core Processor DMI (rev 11) 00:03.0 PCI bridge: Intel Corporation Core Processor PCI Express Root Port 1 (rev 11) 00:05.0 PCI bridge: Intel Corporation Core Processor PCI Express Root Port 3 (rev 11) 00:08.0 System peripheral: Intel Corporation Core Processor System Management Registers (rev 11) 00:08.1 System peripheral: Intel Corporation Core Processor Semaphore and Scratchpad Registers (rev 11) 00:08.2 System peripheral: Intel Corporation Core Processor System Control and Status Registers (rev 11) 00:08.3 System peripheral: Intel Corporation Core Processor Miscellaneous Registers (rev 11) 00:10.0 System peripheral: Intel Corporation Core Processor QPI Link (rev 11) 00:10.1 System peripheral: Intel Corporation Core Processor QPI Routing and Protocol Registers (rev 11) 00:1a.0 USB Controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 05) 00:1c.0 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 1 (rev 05) 00:1c.4 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 5 (rev 05) 00:1c.5 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 6 (rev 05) 00:1d.0 USB Controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 05) 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5) 00:1f.0 ISA bridge: Intel Corporation 3400 Series Chipset LPC Interface Controller (rev 05) 00:1f.2 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 4 port SATA IDE Controller (rev 05) 00:1f.3 SMBus: Intel Corporation 5 Series/3400 Series Chipset SMBus Controller (rev 05) 00:1f.5 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 2 port SATA IDE Controller (rev 05) 02:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 02) 04:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 05:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 06:03.0 VGA compatible controller: Matrox Graphics, Inc. MGA G200eW WPCM450 (rev 0a)