On Tue, Dec 8, 2015 at 4:17 PM, President president@caldwellglobal.com wrote:
Not sure if this actually made it to the list the first time.
Here is the SERIAL output (bottom of message after your questions). Googling the error indicates it's something people ran into a few years back but was supposedly fixed. Any ideas?
I can verify that if I REMOVE the second CPU, it boots into Xen kernel no problem. The CPU itself doesn't matter, as I can swap either CPU into the first slot, and it boots. Only if there is a second CPU does it fail.
Great, thanks for the report. This looks like a bug in upstream Xen -- would you mind re-posting this (with the serial output) on the xen-users mailing list? That will get more eyeballs on the problem.
-George
-----Original message----- From: George Dunlap dunlapg@umich.edu Sent: Monday 30th November 2015 6:00 To: Discussion about the virtualization on CentOS centos-virt@centos.org Subject: Re: [CentOS-virt] new install of Xen 4.6 hangs on Loading initial ramdisk
On Fri, Nov 27, 2015 at 11:18 PM, Craig Thompson president@caldwellglobal.com wrote:
First post to this list. I would appreciate some help on this issue.
As background, I installed CentOS 7 on a Dell server, and then ran the following commands:
yum update http://buildlogs.centos.org/centos/7/virt/x86_64/xen/centos-release-xen-7-11... yum --enablerepo=centos-virt-xen-testing update yum --enablerepo=centos-virt-xen-testing install xen
Doing that, I was able to successfully install Xen, create a virtual machine with its own HVM setup, logical volume, etc. and boot it just fine.
I then tried to do the same on an IBM x3550 server I’m trying to install with CentOS 7. The CentOS 7 install went just fine. I can boot into the standard kernel and have a working machine. But after running the commands above to install the Xen hypervisor, the machine hangs on boot for a few moments after displaying the lines below and then reboots in a loop over and over and over:
Loading Xen 4.6.0-2.el7 … Loading Linux 3.18.21-16.el7.x86_64 … Loading initial ramdisk …
It never gets beyond that. If I choose the stock kernel (no Xen) from the Grub menu, it will continue to boot into that just fine.
My grub.cfg file has these entries of note:
multiboot /xen-4.6.0-2.el7.gz placeholder dom0_mem=1024M,max:1024M cpuinfo com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all ${xen_rm_opts} echo 'Loading Linux 3.18.21-16.el7.x86_64 ...' module /vmlinuz-3.18.21-16.el7.x86_64 placeholder root=UUID=9dc18146-f9b3-41cc-ba9c-7314689abcde ro crashkernel=auto debug irqpoll ipv6.disable=1 console=hvc0 earlyprintk=xen nomodeset echo 'Loading initial ramdisk ...' module --nounzip /initramfs-3.18.21-16.el7.x86_64.img
What I have tried:
- adding debug into the vmlinuz line
- disabling ipv6 in that line
- adding root=UUID=9dc18146-f9b3-41cc-ba9c-7314689abcde to the last line
AFTER /initramfs ….
Nothing so far has made any difference. Obviously the process works, as it works for me just fine on the Dell server.
Underlying this machine is a SATA RAID 1 PCI card with two SSD drives attached in a RAID 1 mirror. Not that that should matter, but I’m including it for reference. As noted previously, it boots into the stock kernel just fine.
Any help would be appreciated.
Thanks for the testing and the report.
Have you tried booting the Xen4CentOS kernel (Linux-3.18.21-16) by itself (i.e., not under Xen)?
Also, is there any chance you could get the output of a serial console? That's pretty critical for debugging this sort of thing. CentOS-virt mailing list
### No such file or directory opening port (XEN) Bad console= option 'tty' Xen 4.6.0-2.el7 (XEN) Xen version 4.6.0-2.el7 (mockbuild@centos.org) (gcc (GCC) 4.8.3 20140911 (Red Hat 4.8.3-9)) debug=n Tue Nov 3 17:23:39 UTC 2015 (XEN) Latest ChangeSet: Mon Oct 19 12:05:21 2015 +0100 git:36b6fe9-dirty (XEN) Bootloader: GRUB 2.02~beta2 (XEN) Command line: placeholder dom0_mem=1024M,max:1024M cpuinfo com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) VBE/DDC methods: V2; EDID transfer time: 2 seconds (XEN) Disc information: (XEN) Found 1 MBR signatures (XEN) Found 1 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009c800 (usable) (XEN) 000000000009c800 - 00000000000a0000 (reserved) (XEN) 00000000000e0000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000bffcba40 (usable) (XEN) 00000000bffcba40 - 00000000bffcee00 (ACPI data) (XEN) 00000000bffcee00 - 00000000c0000000 (reserved) (XEN) 00000000fec00000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 00000001fee00000 (usable) (XEN) 00000001fee00000 - 00000001fef00000 (reserved) (XEN) 00000001fef00000 - 00000002fee00000 (usable) (XEN) 00000002fee00000 - 00000002fef00000 (reserved) (XEN) 00000002fef00000 - 00000003fee00000 (usable) (XEN) 00000003fee00000 - 00000003fef00000 (reserved) (XEN) 00000003fef00000 - 0000000840000000 (usable) (XEN) ACPI: RSDP 000FDFD0, 0024 (r2 IBM ) (XEN) ACPI: XSDT BFFCED00, 004C (r1 IBM SERDEFNT 1000 IBM 45444F43) (XEN) ACPI: FACP BFFCEC40, 0084 (r2 IBM SERDEFNT 1000 IBM 45444F43) (XEN) ACPI: DSDT BFFCBA40, 246C (r2 IBM SERDEFNT 1000 INTL 20041203) (XEN) ACPI: FACS BFFCE980, 0040 (XEN) ACPI: APIC BFFCEB80, 0084 (r1 IBM SERDEFNT 1000 IBM 45444F43) (XEN) ACPI: SRAT BFFCEA40, 00E8 (r1 IBM SERDEFNT 1000 IBM 45444F43) (XEN) ACPI: HPET BFFCEA00, 0038 (r1 IBM SERDEFNT 1000 IBM 45444F43) (XEN) ACPI: MCFG BFFCE9C0, 003C (r1 IBM SERDEFNT 1000 IBM 45444F43) (XEN) System RAM: 32764MB (33550748kB) (XEN) SRAT: PXM 0 -> APIC 0 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 1 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 6 -> Node 0 (XEN) SRAT: PXM 0 -> APIC 7 -> Node 0 (XEN) SRAT: Node 0 PXM 0 0-c0000000 (XEN) SRAT: Node 0 PXM 0 100000000-840000000 (XEN) SRAT: Node 0 PXM 0 840000000-1000000000 (hotplug) (XEN) NUMA: Allocated memnodemap from 83d5cd000 - 83d5ce000 (XEN) NUMA: Using 18 for the hash shift. (XEN) Domain heap initialised (XEN) found SMP MP-table at 0009c940 (XEN) DMI 2.4 present. (XEN) Using APIC driver default (XEN) ACPI: PM-Timer IO Port: 0x588 (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:584,1:0], pm1x_evt[1:580,1:0] (XEN) ACPI: wakeup_vec[bffce98c], vec_size[20] (XEN) ACPI: Local APIC address 0xfee00000 (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) (XEN) Processor #0 6:15 APIC version 20 (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) (XEN) Processor #1 6:15 APIC version 20 (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x06] enabled) (XEN) Processor #6 6:15 APIC version 20 (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled) (XEN) Processor #7 6:15 APIC version 20 (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] dfl dfl lint[0x1]) (XEN) ACPI: IOAPIC (id[0x0e] address[0xfec00000] gsi_base[0]) (XEN) IOAPIC[0]: apic_id 14, version 32, address 0xfec00000, GSI 0-23 (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) (XEN) ACPI: IRQ0 used by override. (XEN) ACPI: IRQ2 used by override. (XEN) ACPI: IRQ9 used by override. (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000 (XEN) ERST table was not found (XEN) Using ACPI (MADT) for SMP configuration information (XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs) (XEN) IRQ limits: 24 GSI, 760 MSI/MSI-X (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 4096K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 0 (XEN) CMCI: CPU0 has no CMCI support (XEN) CPU0: Thermal monitoring enabled (TM2) (XEN) Intel machine check reporting enabled (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Initializing CPU#0 (XEN) Detected 2000.117 MHz processor. (XEN) Initing memory sharing. (XEN) alt table ffff82d0802b8b50 -> ffff82d0802b9f24 (XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - 14 (XEN) PCI: Not using MCFG for segment 0000 bus 00-14 (XEN) I/O virtualisation disabled (XEN) CPU0: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1 (XEN) Platform timer is 14.318MHz HPET (XEN) Allocated console ring of 32 KiB. (XEN) mwait-idle: does not run on family 6 model 15 (XEN) VMX: Supported advanced features: (XEN) - APIC TPR shadow (XEN) - MSR direct-access bitmap (XEN) HVM: ASIDs disabled. (XEN) HVM: VMX enabled (XEN) HVM: Hardware Assisted Paging (HAP) not detected (XEN) HVM: PVH mode not supported on this platform (XEN) CPU 0 APIC 0 -> Node 0 (XEN) CPU 1 APIC 1 -> Node 0 (XEN) Booting processor 1/1 eip 8c000 (XEN) Initializing CPU#1 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 4096K (XEN) CPU: Physical Processor ID: 0 (XEN) CPU: Processor Core ID: 1 (XEN) CMCI: CPU1 has no CMCI support (XEN) CPU1: Thermal monitoring enabled (TM2) (XEN) CPU1: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) CPU 2 APIC 6 -> Node 0 (XEN) Booting processor 2/6 eip 8c000 (XEN) Initializing CPU#2 (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K (XEN) CPU: L2 cache: 4096K (XEN) CPU: Physical Processor ID: 3 (XEN) CPU: Processor Core ID: 0 (XEN) CMCI: CPU2 has no CMCI support (XEN) CPU2: Thermal monitoring enabled (TM2) (XEN) CPU2: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) ----[ Xen-4.6.0-2.el7 x86_64 debug=n Not tainted ]---- (XEN) CPU: 2 (XEN) RIP: e008:[<ffff82d080181ba9>] set_cpu_sibling_map+0x39/0x340 (XEN) RFLAGS: 0000000000010006 CONTEXT: hypervisor (XEN) rax: 0000000000000020 rbx: 0000000000000200 rcx: 00000037bd295580 (XEN) rdx: 0000000000000003 rsi: 0000000000000000 rdi: 0000000000000002 (XEN) rbp: 00000000000000c8 rsp: ffff83083d597e90 r8: 00000037bd295580 (XEN) r9: 00000037bd295580 r10: 0000000000000007 r11: 0000000000000001 (XEN) r12: 0000000000000002 r13: 0000000000000002 r14: 0000000000000000 (XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000000026e0 (XEN) cr3: 00000000bfc70000 cr2: 0000000000000020 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff83083d597e90: (XEN) ffff82d0802f4380 0000000000000012 0000000000000000 00000100801ad1e1 (XEN) ffff82d0802f4380 0000000000000000 00000000000000c8 0000000000000002 (XEN) 0000000000000002 0000000000000000 0000000000000000 ffff82d08018206c (XEN) 0000000000000000 0000000000000001 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000 (XEN) 0000000000000000 0000000000000000 0000000000000002 ffff8300bfd0b000 (XEN) 00000037bd295580 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d080181ba9>] set_cpu_sibling_map+0x39/0x340 (XEN) [<ffff82d08018206c>] start_secondary+0x1bc/0x260 (XEN) (XEN) Pagetable walk from 0000000000000020: (XEN) L4[0x000] = 000000083d5c1063 ffffffffffffffff (XEN) L3[0x000] = 000000083d5c0063 ffffffffffffffff (XEN) L2[0x000] = 000000083d5bf063 ffffffffffffffff (XEN) L1[0x000] = 0000000000000000 ffffffffffffffff (XEN) (XEN) **************************************** (XEN) Panic on CPU 2: (XEN) FATAL PAGE FAULT (XEN) [error_code=0002] (XEN) Faulting linear address: 0000000000000020 (XEN) **************************************** (XEN) (XEN) Reboot in five seconds... (XEN) Resetting with ACPI MEMORY or I/O RESET_REG.
CentOS-virt mailing list CentOS-virt@centos.org https://lists.centos.org/mailman/listinfo/centos-virt