This happened a few times now, I (soft) reboot and do the fsck thing and all is fine until it happens again.
Any ideas?
[root@test-dhcp ~]# yum remove bluez-libs bluez-utils Loaded plugins: fastestmirror Setting up Remove Process Resolving Dependencies <snip/> Finished Transaction Test Transaction Test Succeeded Running Transaction Erasing : bluez-utils 1/3 Erasing : bluez-libs 2/3 Traceback (most recent call last): File "/usr/lib/python2.4/site-packages/yum/rpmtrans.py", line 376, in callback self._unInstStop( bytes, total, h ) File "/usr/lib/python2.4/site-packages/yum/rpmtrans.py", line 479, in _unInstStop self.ts_done(h, action) File "/usr/lib/python2.4/site-packages/yum/rpmtrans.py", line 307, in ts_done misc.unlink_f(self.ts_done_fn) File "/usr/lib/python2.4/site-packages/yum/misc.py", line 777, in unlink_f os.unlink(filename) OSError: [Errno 30] Read-only file system: '/var/lib/yum/transaction-done.2010-05-06.15:18.05' error: python callback <bound method RPMTransaction.callback of <yum.rpmtrans.RPMTransaction instance at 0x9fddeac>> failed, aborting! [root@test-dhcp ~]# > /tmp/test -bash: /tmp/test: Read-only file system [root@test-dhcp ~]# mount -n -o remount,rw / mount: block device /dev/VolGroup00/LogVol00 is write-protected, mounting read-only [root@test-dhcp ~]# fdisk -l /dev/sda
Disk /dev/sda: 4105 MB, 4105175040 bytes 255 heads, 63 sectors/track, 499 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 499 3903795 8e Linux LVM [root@test-dhcp ~]# > /boot/foo [root@test-dhcp ~]# rm /boot/foo rm: remove regular empty file `/boot/foo'? y [root@test-dhcp ~]# > /tmp/foo -bash: /tmp/foo: Read-only file system [root@test-dhcp ~]#
Was tailing logs when it happened:
[root@test-dhcp ~]# tail -f /var/log/dmesg /var/log/secure /var/log/messages /var/log/faillog ==> /var/log/dmesg <== md: ... autorun DONE. device-mapper: multipath: version 1.0.5 loaded EXT3 FS on dm-0, internal journal kjournald starting. Commit interval 5 seconds EXT3 FS on sda1, internal journal EXT3-fs: mounted filesystem with ordered data mode. SELinux: initialized (dev sda1, type ext3), uses xattr SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs Adding 917496k swap on /dev/VolGroup00/LogVol01. Priority:-1 extents:1 across:917496k SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
==> /var/log/secure <== May 6 14:51:08 test-dhcp sshd[2237]: Server listening on :: port 22. May 6 14:51:08 test-dhcp sshd[2237]: error: Bind to port 22 on 0.0.0.0 failed: Address already in use. May 6 14:53:07 test-dhcp login: pam_unix(login:session): session opened for user root by (uid=0) May 6 14:53:09 test-dhcp login: ROOT LOGIN ON tty1 May 6 15:04:05 test-dhcp sshd[2258]: Server listening on :: port 22. May 6 15:04:05 test-dhcp sshd[2258]: error: Bind to port 22 on 0.0.0.0 failed: Address already in use. May 6 15:04:28 test-dhcp sshd[2385]: Connection closed by 192.168.4.12 May 6 15:04:39 test-dhcp sshd[2387]: Accepted password for root from 192.168.4.12 port 4794 ssh2 May 6 15:04:40 test-dhcp sshd[2387]: pam_unix(sshd:session): session opened for user root by (uid=0)
==> /var/log/messages <== May 6 15:05:04 test-dhcp kernel: Bluetooth: Core ver 2.10 May 6 15:05:04 test-dhcp kernel: NET: Registered protocol family 31 May 6 15:05:04 test-dhcp kernel: Bluetooth: HCI device and connection manager initialized May 6 15:05:04 test-dhcp kernel: Bluetooth: HCI socket layer initialized May 6 15:05:04 test-dhcp kernel: Bluetooth: L2CAP ver 2.8 May 6 15:05:04 test-dhcp kernel: Bluetooth: L2CAP socket layer initialized May 6 15:05:04 test-dhcp kernel: Bluetooth: RFCOMM socket layer initialized May 6 15:05:04 test-dhcp kernel: Bluetooth: RFCOMM TTY layer initialized May 6 15:05:04 test-dhcp kernel: Bluetooth: RFCOMM ver 1.8 May 6 15:05:05 test-dhcp kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
==> /var/log/faillog <==
==> /var/log/secure <== May 6 15:05:51 test-dhcp sshd[2504]: Accepted password for root from 192.168.4.12 port 4795 ssh2 May 6 15:05:52 test-dhcp sshd[2504]: pam_unix(sshd:session): session opened for user root by (uid=0)
==> /var/log/messages <== May 6 15:06:46 test-dhcp yum: Erased: redhat-lsb May 6 15:07:41 test-dhcp yum: Erased: cups May 6 15:09:23 test-dhcp yum: Erased: avahi-compat-libdns_sd May 6 15:10:29 test-dhcp avahi-daemon[2383]: Got SIGTERM, quitting. May 6 15:10:29 test-dhcp avahi-daemon[2383]: Leaving mDNS multicast group on interface eth0.IPv6 with address fc00::30:18ae:6b84. May 6 15:10:29 test-dhcp avahi-daemon[2383]: Leaving mDNS multicast group on interface eth0.IPv4 with address 192.168.22.23. May 6 15:10:29 test-dhcp yum: Erased: avahi May 6 15:18:06 test-dhcp sdpd[2073]: terminating... May 6 15:18:06 test-dhcp hcid[2069]: Unregister path:/org/bluez May 6 15:18:06 test-dhcp hcid[2069]: Exit May 6 15:18:06 test-dhcp hidd[2210]: Exit May 6 15:18:07 test-dhcp kernel: Bluetooth: BNEP (Ethernet Emulation) ver 1.2 May 6 15:18:07 test-dhcp kernel: Bluetooth: BNEP filters: protocol multicast May 6 15:18:07 test-dhcp yum: Erased: bluez-utils
-- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- - - - Jason Pyeron PD Inc. http://www.pdinc.us - - Principal Consultant 10 West 24th Street #100 - - +1 (443) 269-1555 x333 Baltimore, Maryland 21218 - - - -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- This message is copyright PD Inc, subject to license 20080407P00.
Jason Pyeron wrote:
[root@test-dhcp ~]# tail -f /var/log/dmesg /var/log/secure /var/log/messages /var/log/faillog
...
note that /var/log/dmesg is just a snapshot of the output of the program dmesg taken after boot time. the dmesg command dumps the current kernel message buffer, but I don't believe it has a live 'follow' mode.
that said, most stuff written to the kernel message buffer gets processed by syslog and put in /var/log/messages
-----Original Message----- From: John R Pierce Sent: Thursday, May 06, 2010 22:35 Subject: Re: [CentOS] USB key installed OS;file system goes read-only randomly...
From dmesg:
<snip/> EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506003 Aborting journal on device dm-0. ext3_abort called. EXT3-fs error (device dm-0): ext3_journal_start_sb: Detected aborted journal Remounting filesystem read-only <snip/>
The full log is below
Jason Pyeron wrote:
[root@test-dhcp ~]# tail -f /var/log/dmesg /var/log/secure /var/log/messages /var/log/faillog
...
note that /var/log/dmesg is just a snapshot of the output of the program dmesg taken after boot time. the dmesg command dumps the current kernel message buffer, but I don't believe it has a live 'follow' mode.
that said, most stuff written to the kernel message buffer gets processed by syslog and put in /var/log/messages
[1]+ Stopped tail -f /var/log/dmesg /var/log/secure /var/log/messages /var/log/faillog [root@test-dhcp ~]# dmesg Linux version 2.6.18-164.el5 (mockbuild@builder16.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Thu Sep 3 03:33:56 EDT 2009 BIOS-provided physical RAM map: BIOS-e820: 0000000000010000 - 000000000009f800 (usable) BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved) BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 000000001bee0000 (usable) BIOS-e820: 000000001bee0000 - 000000001bee3000 (ACPI NVS) BIOS-e820: 000000001bee3000 - 000000001bef0000 (ACPI data) BIOS-e820: 000000001bef0000 - 000000001bf00000 (reserved) BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved) BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) BIOS-e820: 00000000ffff0000 - 0000000100000000 (reserved) 0MB HIGHMEM available. 446MB LOWMEM available. found SMP MP-table at 000f3e80 Memory for crash kernel (0x0 to 0x0) notwithin permissible range disabling kdump Using x86 segment limits to approximate NX protection On node 0 totalpages: 114400 DMA zone: 4096 pages, LIFO batch:0 Normal zone: 110304 pages, LIFO batch:31 DMI 2.3 present. Using APIC driver default ACPI: RSDP (v000 CX700 ) @ 0x000f7f70 ACPI: RSDT (v001 CX700 AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x1bee3040 ACPI: FADT (v001 CX700 AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x1bee30c0 ACPI: _HPT (v001 CX700 AWRDACPI 0x42302e31 AWRD 0x00000098) @ 0x1bee9480 ACPI: _WDT (v001 CX700 AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x1bee9500 ACPI: MCFG (v001 CX700 AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x1bee95c0 ACPI: MADT (v001 CX700 AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0x1bee93c0 ACPI: DSDT (v001 CX700 AWRDACPI 0x00001000 MSFT 0x03000000) @ 0x00000000 ACPI: PM-Timer IO Port: 0x408 ACPI: Local APIC address 0xfee00000 ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) Processor #0 6:13 APIC version 20 ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 2, version 3, address 0xfec00000, GSI 0-23 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) ACPI: IRQ0 used by override. ACPI: IRQ2 used by override. ACPI: IRQ9 used by override. Enabling APIC mode: Flat. Using 1 I/O APICs Using ACPI (MADT) for SMP configuration information Allocating PCI resources starting at 20000000 (gap: 1bf00000:c4100000) Detected 1199.604 MHz processor. Built 1 zonelists. Total pages: 114400 Kernel command line: ro root=/dev/VolGroup00/LogVol00 mapped APIC to ffffd000 (fee00000) mapped IOAPIC to ffffc000 (fec00000) Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Initializing CPU#0 CPU 0 irqstacks, hard=c0761000 soft=c0741000 PID hash table entries: 2048 (order: 11, 8192 bytes) Console: colour VGA+ 80x25 Dentry cache hash table entries: 65536 (order: 6, 262144 bytes) Inode-cache hash table entries: 32768 (order: 5, 131072 bytes) Memory: 445780k/457600k available (2154k kernel code, 11276k reserved, 899k data, 232k init, 0k highmem) Checking if this processor honours the WP bit even in supervisor mode... Ok. Calibrating delay loop (skipped), value calculated using timer frequency.. 2399.20 BogoMIPS (lpj=1199604) Security Framework v1.0.0 initialized SELinux: Initializing. SELinux: Starting in permissive mode selinux_register_security: Registering secondary module capability Capability LSM initialized as secondary Mount-cache hash table entries: 512 CPU: After generic identify, caps: a7c9baff 00100000 00000000 00000000 00004181 00000000 00000000 CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) CPU: L2 Cache: 128K (64 bytes/line) CPU: After all inits, caps: 27c9b2ff 00100000 00000000 00000000 00004181 0000ffcc 00000000 Checking 'hlt' instruction... OK. SMP alternatives: switching to UP code Freeing SMP alternatives: 14k freed ACPI: Core revision 20060707 CPU0: Centaur VIA Eden Processor 1200MHz stepping 00 Total of 1 processors activated (2399.20 BogoMIPS). ENABLING IO-APIC IRQs ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1 Brought up 1 CPUs sizeof(vma)=84 bytes sizeof(page)=32 bytes sizeof(inode)=340 bytes sizeof(dentry)=136 bytes sizeof(ext3inode)=492 bytes sizeof(buffer_head)=52 bytes sizeof(skbuff)=176 bytes checking if image is initramfs... it is Freeing initrd memory: 3113k freed NET: Registered protocol family 16 ACPI: bus type pci registered PCI: Using MMCONFIG Setting up standard PCI resources ACPI: Interpreter enabled ACPI: Using IOAPIC for interrupt routing ACPI: No dock devices found. ACPI: PCI Root Bridge [PCI0] (0000:00) PCI: Transparent bridge - 0000:00:13.1 ACPI: PCI Interrupt Routing Table [_SB_.PCI0._PRT] ACPI: PCI Interrupt Routing Table [_SB_.PCI0.P2PB._PRT] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 6 7 10 *11 12) ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 6 7 *10 11 12) ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 6 7 10 *11 12) ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 6 7 10 11 12) *5 ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 6 7 10 11 12) *0, disabled. ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 6 7 10 11 12) *0, disabled. ACPI: PCI Interrupt Link [LNK0] (IRQs 3 4 6 7 10 11 12) *0, disabled. ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 6 7 10 11 12) *0, disabled. ACPI: PCI Root Bridge [PCI1] (0000:80) ACPI: PCI Interrupt Routing Table [_SB_.PCI1._PRT] Linux Plug and Play Support v0.97 (c) Adam Belay pnp: PnP ACPI init pnp: PnP ACPI: found 15 devices usbcore: registered new driver usbfs usbcore: registered new driver hub PCI: Using ACPI for IRQ routing PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report NetLabel: Initializing NetLabel: domain hash size = 128 NetLabel: protocols = UNLABELED CIPSOv4 NetLabel: unlabeled traffic allowed by default pnp: 00:01: ioport range 0x400-0x47f could not be reserved pnp: 00:01: ioport range 0x500-0x50f has been reserved PCI: Bridge: 0000:00:01.0 IO window: e000-0000 MEM window: dd000000-00000000 PREFETCH window 0x00000000a0000000-0x00000000bfffffff PCI: Bridge: 0000:00:13.1 IO window: d000-0000 MEM window: dfe00000-00000000 PREFETCH window 0x00000000dfd00000-0x00000000dfdfffff PCI: Setting latency timer of device 0000:00:01.0 to 64 PCI: Setting latency timer of device 0000:00:13.1 to 64 NET: Registered protocol family 2 IP route cache hash table entries: 4096 (order: 2, 16384 bytes) TCP established hash table entries: 16384 (order: 5, 131072 bytes) TCP bind hash table entries: 8192 (order: 4, 65536 bytes) TCP: Hash tables configured (established 16384 bind 8192) TCP reno registered apm: BIOS version 1.2 Flags 0x07 (Driver version 1.16ac) apm: overridden by ACPI. audit: initializing netlink socket (disabled) type=2000 audit(1273172528.208:1): initialized Total HugeTLB memory allocated, 0 VFS: Disk quotas dquot_6.5.1 Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) SELinux: Registering netfilter hooks Initializing Cryptographic API alg: No test for crc32c (crc32c-generic) ksign: Installing public key data Loading keyring - Added public key 581431131FF6A527 - User ID: CentOS (Kernel Module GPG key) io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered io scheduler cfq registered (default) Boot video device is 0000:01:00.0 pci_hotplug: PCI Hot Plug PCI Core version: 0.5 ACPI: Fan [FAN] (on) ACPI: CPU0 (power states: C1[C1] C2[C2] C3[C3]) ACPI: Processor [CPU0] (supports 2 throttling states) ACPI: Thermal Zone [THRM] (36 C) Real Time Clock Driver v1.12ac Non-volatile memory driver v1.2 Linux agpgart interface v0.101 (c) Dave Jones Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A 00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A brd: module loaded Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx VP_IDE: IDE controller at PCI slot 0000:00:0f.0 VP_IDE: chipset revision 0 VP_IDE: not 100% native mode: will probe irqs later VP_IDE: Unknown VIA SouthBridge, disabling DMA. VP_IDE: IDE controller at PCI slot 0000:00:0f.0 VP_IDE: chipset revision 0 VP_IDE: not 100% native mode: will probe irqs later VP_IDE: Unknown VIA SouthBridge, disabling DMA. Probing IDE interface ide0... Probing IDE interface ide1... ide-floppy driver 0.99.newide usbcore: registered new driver hiddev usbcore: registered new driver usbhid drivers/usb/input/hid-core.c: v2.6:USB HID core driver PNP: PS/2 Controller [PNP0303:PS2K] at 0x60,0x64 irq 1 PNP: PS/2 controller doesn't have AUX irq; using default 12 serio: i8042 KBD port at 0x60,0x64 irq 1 mice: PS/2 mouse device common for all mice md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27 md: bitmap version 4.39 TCP bic registered Initializing IPsec netlink socket NET: Registered protocol family 1 NET: Registered protocol family 17 Using IPI No-Shortcut mode ACPI: (supports S0 S1 S4 S5) Initalizing network drop monitor service Time: tsc clocksource has been installed. Freeing unused kernel memory: 232k freed Write protecting the kernel read-only data: 404k Time: acpi_pm clocksource has been installed. input: AT Translated Set 2 keyboard as /class/input/input0 ACPI: PCI Interrupt 0000:00:10.4[D] -> GSI 23 (level, low) -> IRQ 169 PCI: VIA IRQ fixup for 0000:00:10.4, from 5 to 9 ehci_hcd 0000:00:10.4: EHCI Host Controller ehci_hcd 0000:00:10.4: new USB bus registered, assigned bus number 1 ehci_hcd 0000:00:10.4: debug port 1 ehci_hcd 0000:00:10.4: irq 169, io mem 0xdffff000 ehci_hcd 0000:00:10.4: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 6 ports detected ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI) USB Universal Host Controller Interface driver v3.0 ACPI: PCI Interrupt 0000:00:10.0[A] -> GSI 20 (level, low) -> IRQ 177 PCI: VIA IRQ fixup for 0000:00:10.0, from 11 to 1 uhci_hcd 0000:00:10.0: UHCI Host Controller uhci_hcd 0000:00:10.0: new USB bus registered, assigned bus number 2 uhci_hcd 0000:00:10.0: irq 177, io base 0x0000fe00 usb usb2: configuration #1 chosen from 1 choice hub 2-0:1.0: USB hub found hub 2-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:10.1[B] -> GSI 22 (level, low) -> IRQ 185 PCI: VIA IRQ fixup for 0000:00:10.1, from 10 to 9 uhci_hcd 0000:00:10.1: UHCI Host Controller uhci_hcd 0000:00:10.1: new USB bus registered, assigned bus number 3 uhci_hcd 0000:00:10.1: irq 185, io base 0x0000fd00 usb usb3: configuration #1 chosen from 1 choice hub 3-0:1.0: USB hub found hub 3-0:1.0: 2 ports detected usb 1-2: new high speed USB device using ehci_hcd and address 2 ACPI: PCI Interrupt 0000:00:10.2[C] -> GSI 21 (level, low) -> IRQ 193 PCI: VIA IRQ fixup for 0000:00:10.2, from 11 to 1 uhci_hcd 0000:00:10.2: UHCI Host Controller uhci_hcd 0000:00:10.2: new USB bus registered, assigned bus number 4 uhci_hcd 0000:00:10.2: irq 193, io base 0x0000fc00 usb usb4: configuration #1 chosen from 1 choice hub 4-0:1.0: USB hub found hub 4-0:1.0: 2 ports detected usb 1-2: configuration #1 chosen from 1 choice SCSI subsystem initialized Initializing USB Mass Storage driver... scsi0 : SCSI emulation for USB Mass Storage devices usb-storage: device found at 2 usb-storage: waiting for device to settle before scanning usbcore: registered new driver usb-storage USB Mass Storage support registered. Vendor: HP Model: v125w Rev: 0119 Type: Direct-Access ANSI SCSI revision: 02 SCSI device sda: 8017920 512-byte hdwr sectors (4105 MB) sda: Write Protect is off sda: Mode Sense: 23 00 00 00 sda: assuming drive cache: write through SCSI device sda: 8017920 512-byte hdwr sectors (4105 MB) sda: Write Protect is off sda: Mode Sense: 23 00 00 00 sda: assuming drive cache: write through sda: sda1 sda2 sd 0:0:0:0: Attached scsi removable disk sda usb-storage: device scan complete device-mapper: uevent: version 1.0.3 device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@redhat.com device-mapper: dm-raid45: initialized v0.2594l kjournald starting. Commit interval 5 seconds EXT3-fs: mounted filesystem with ordered data mode. type=1404 audit(1273172560.075:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295 security: 3 users, 6 roles, 1871 types, 242 bools, 1 sens, 1024 cats security: 61 classes, 69981 rules SELinux: Completing initialization. SELinux: Setting up existing superblocks. SELinux: initialized (dev dm-0, type ext3), uses xattr SELinux: initialized (dev usbfs, type usbfs), uses genfs_contexts SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs SELinux: initialized (dev debugfs, type debugfs), uses genfs_contexts SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts SELinux: initialized (dev mqueue, type mqueue), uses transition SIDs SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses genfs_contexts SELinux: initialized (dev devpts, type devpts), uses transition SIDs SELinux: initialized (dev eventpollfs, type eventpollfs), uses task SIDs SELinux: initialized (dev inotifyfs, type inotifyfs), uses genfs_contexts SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs SELinux: initialized (dev futexfs, type futexfs), uses genfs_contexts SELinux: initialized (dev anon_inodefs, type anon_inodefs), uses genfs_contexts SELinux: initialized (dev pipefs, type pipefs), uses task SIDs SELinux: initialized (dev sockfs, type sockfs), uses task SIDs SELinux: initialized (dev cpuset, type cpuset), uses genfs_contexts SELinux: initialized (dev proc, type proc), uses genfs_contexts SELinux: initialized (dev bdev, type bdev), uses genfs_contexts SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts type=1403 audit(1273172561.092:3): policy loaded auid=4294967295 ses=4294967295 VIA Networking Velocity Family Gigabit Ethernet Adapter Driver Ver. 1.13 Copyright (c) 2002, 2003 VIA Networking Technologies, Inc. Copyright (c) 2004 Red Hat Inc. ACPI: PCI Interrupt 0000:02:05.0[A] -> GSI 18 (level, low) -> IRQ 201 eth0: VIA Networking Velocity Family Gigabit Ethernet Adapter eth0: Ethernet Address: 00:30:18:AE:6B:84 input: PC Speaker as /class/input/input1 sd 0:0:0:0: Attached scsi generic sg0 type 0 ACPI: PCI Interrupt 0000:80:01.0[A] -> GSI 17 (level, low) -> IRQ 209 PCI: Setting latency timer of device 0000:80:01.0 to 64 floppy0: no floppy controllers found lp: driver loaded but no devices found ACPI: Power Button (FF) [PWRF] ACPI: Power Button (CM) [PWRB] md: Autodetecting RAID arrays. md: autorun ... md: ... autorun DONE. device-mapper: multipath: version 1.0.5 loaded EXT3 FS on dm-0, internal journal kjournald starting. Commit interval 5 seconds EXT3 FS on sda1, internal journal EXT3-fs: mounted filesystem with ordered data mode. SELinux: initialized (dev sda1, type ext3), uses xattr SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs Adding 917496k swap on /dev/VolGroup00/LogVol01. Priority:-1 extents:1 across:917496k SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts NET: Registered protocol family 10 lo: Disabled Privacy Extensions IPv6 over IPv4 tunneling driver ip6_tables: (C) 2000-2006 Netfilter Core Team ip_tables: (C) 2000-2006 Netfilter Core Team Netfilter messages via NETLINK v0.30. ip_conntrack version 2.4 (3575 buckets, 28600 max) - 228 bytes per conntrack process `sysctl' is using deprecated sysctl (syscall) net.ipv6.neigh.lo.base_reachable_time; Use net.ipv6.neigh.lo.base_reachable_time_ms instead. Velocity is AUTO mode ADDRCONF(NETDEV_UP): eth0: link is not ready eth0: Link autonegation speed 1000M bps full duplex ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready SELinux: initialized (dev rpc_pipefs, type rpc_pipefs), uses genfs_contexts Bluetooth: Core ver 2.10 NET: Registered protocol family 31 Bluetooth: HCI device and connection manager initialized Bluetooth: HCI socket layer initialized Bluetooth: L2CAP ver 2.8 Bluetooth: L2CAP socket layer initialized Bluetooth: RFCOMM socket layer initialized Bluetooth: RFCOMM TTY layer initialized Bluetooth: RFCOMM ver 1.8 eth0: no IPv6 routers present Bluetooth: HIDP (Human Interface Emulation) ver 1.1 SELinux: initialized (dev autofs, type autofs), uses genfs_contexts SELinux: initialized (dev autofs, type autofs), uses genfs_contexts SELinux: initialized (dev autofs, type autofs), uses genfs_contexts Bluetooth: BNEP (Ethernet Emulation) ver 1.2 Bluetooth: BNEP filters: protocol multicast EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506003 Aborting journal on device dm-0. ext3_abort called. EXT3-fs error (device dm-0): ext3_journal_start_sb: Detected aborted journal Remounting filesystem read-only EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506004 EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506005 EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506006 EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506007 EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506008 EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506009 EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506010 EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506011 EXT3-fs error (device dm-0) in ext3_reserve_inode_write: Journal has aborted EXT3-fs error (device dm-0) in ext3_truncate: Journal has aborted EXT3-fs error (device dm-0) in ext3_reserve_inode_write: Journal has aborted EXT3-fs error (device dm-0) in ext3_orphan_del: Journal has aborted EXT3-fs error (device dm-0) in ext3_reserve_inode_write: Journal has aborted __journal_remove_journal_head: freeing b_committed_data ext3_abort called. EXT3-fs error (device dm-0): ext3_remount: Abort forced by user ext3_abort called. EXT3-fs error (device dm-0): ext3_remount: Abort forced by user ext3_abort called. EXT3-fs error (device dm-0): ext3_remount: Abort forced by user ext3_abort called. EXT3-fs error (device dm-0): ext3_remount: Abort forced by user audit(1273176061.441:21): audit_pid=0 old=1891 by auid=4294967295 subj=system_u:system_r:auditd_t:s0 type=1103 audit(1273176061.464:22): user pid=2757 uid=0 auid=4294967295 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: setcred acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' type=1006 audit(1273176061.465:23): login pid=2757 uid=0 old auid=4294967295 new auid=0 old ses=4294967295 new ses=3 type=1105 audit(1273176061.480:24): user pid=2757 uid=0 auid=0 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: session open acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' type=1104 audit(1273176061.563:25): user pid=2757 uid=0 auid=0 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: setcred acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' type=1106 audit(1273176061.565:26): user pid=2757 uid=0 auid=0 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: session close acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' type=1101 audit(1273179661.659:27): user pid=2859 uid=0 auid=4294967295 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: accounting acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' type=1103 audit(1273179661.664:28): user pid=2859 uid=0 auid=4294967295 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: setcred acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' type=1006 audit(1273179661.666:29): login pid=2859 uid=0 old auid=4294967295 new auid=0 old ses=4294967295 new ses=4 type=1105 audit(1273179661.671:30): user pid=2859 uid=0 auid=0 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: session open acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' type=1104 audit(1273179661.709:31): user pid=2859 uid=0 auid=0 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: setcred acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' type=1106 audit(1273179661.710:32): user pid=2859 uid=0 auid=0 subj=system_u:system_r:crond_t:s0-s0:c0.c1023 msg='PAM: session close acct="root" : exe="/usr/sbin/crond" (hostname=?, addr=?, terminal=cron res=success)' [root@test-dhcp ~]#
-- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- - - - Jason Pyeron PD Inc. http://www.pdinc.us - - Principal Consultant 10 West 24th Street #100 - - +1 (443) 269-1555 x333 Baltimore, Maryland 21218 - - - -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- This message is copyright PD Inc, subject to license 20080407P00.
(2010/05/07 11:49), Jason Pyeron wrote:
<snip/> EXT3-fs error (device dm-0): ext3_free_blocks_sb: bit already cleared for block 506003
Some bit errors occurred on your usb stick!
Memory: 445780k/457600k available (2154k kernel code, 11276k reserved, 899k
data, 232k init, 0k highmem)
Adding 917496k swap on /dev/VolGroup00/LogVol01. Priority:-1 extents:1
you have swap file on ssd, and small memory. If you know ssd writing algorithm, swap write is losing your usb-stick life.
Buy new memory stick and more memory! and See the following know how running Linux on SSD. (see noswap, no /tmp, no /var/log, noatime topics) http://tombuntu.com/index.php/2008/09/04/four-tweaks-for-using-linux-with-so... more Linux on SSD know how on web.
-Tsuyoshi
Jason Pyeron wrote:
This happened a few times now, I (soft) reboot and do the fsck thing and all is fine until it happens again.
A) your USB key is flakey
B) your systems USB ports are flakey
C) the cabling between the mainboard and the USB port is flakey.
I've run into C) quite a lot, where front panel USB ports don't work reliably at USB2.0 speeds when doing large and/or complex operations. I suspect the internal wiring is inadequate for the task.
-----Original Message----- From: John R Pierce Sent: Thursday, May 06, 2010 22:54 Subject: Re: [CentOS] USB key installed OS;file system goes read-only randomly...
Jason Pyeron wrote:
This happened a few times now, I (soft) reboot and do the
fsck thing
and all is fine until it happens again.
A) your USB key is flakey
New HP v125w 4GB.
B) your systems USB ports are flakey
Will search for a BIOS image upgrade.
C) the cabling between the mainboard and the USB port is flakey.
Plugged directly into the MB port.
I've run into C) quite a lot, where front panel USB ports don't work reliably at USB2.0 speeds when doing large and/or complex operations. I suspect the internal wiring is inadequate for the task.
Ug.
Btw. https://bugzilla.redhat.com/show_bug.cgi?id=494927
-- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- - - - Jason Pyeron PD Inc. http://www.pdinc.us - - Principal Consultant 10 West 24th Street #100 - - +1 (443) 269-1555 x333 Baltimore, Maryland 21218 - - - -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- This message is copyright PD Inc, subject to license 20080407P00.
On 05/06/2010 08:33 PM, Jason Pyeron wrote:
The original reporter (me) and at least one other reporter tracked those problems down to bad RAID controllers.
IIRC, another reporter got similar problems when the FS became 100% full.
-
Gordon Messmer -
Jason Pyeron -
John R Pierce -
Tsuyoshi Nagata