<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"><html>
<head>
<meta name="Generator" content="Zarafa WebApp v7.2.1-51838">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<title>[CentOS-virt] new install of Xen 4.6 hangs on Loading initial ramdisk</title>
</head>
<body>
<p style="padding: 0; margin: 0;"><span id="_mce_caret"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;">Not sure if this actually made it to the list the first time. <br></span></span></p><p style="padding: 0; margin: 0;"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;"><br data-mce-bogus="1"></span></p><p style="padding: 0; margin: 0;"><span id="_mce_caret"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;">Here is the SERIAL output (bottom of message after your questions). Googling the error indicates it's something people ran into a few years back but was supposedly fixed. Any ideas?<br></span></span></p><p style="padding: 0; margin: 0;"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;"><br></span></p><p style="padding: 0; margin: 0;"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;">I can verify that if I REMOVE the second CPU, it boots into Xen kernel no problem. The CPU itself doesn't matter, as I can swap either CPU into the first slot, and it boots. Only if there is a second CPU does it fail.<br data-mce-bogus="1"></span></p><p style="padding: 0; margin: 0;"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;"><br></span></p><blockquote style="border-left: 2px solid rgb(50, 95, 186); padding-left: 5px; margin: 0px 5px 1em;"><span style="font-family:tahoma,arial,helvetica,sans-serif; font-size: 10pt;">-----Original message-----<br><span><strong>From:</strong> George Dunlap <dunlapg@umich.edu></span><br><span><strong>Sent:</strong> Monday 30th November 2015 6:00</span><br><span><strong>To:</strong> Discussion about the virtualization on CentOS <centos-virt@centos.org></span><br><span><strong>Subject:</strong> Re: [CentOS-virt] new install of Xen 4.6 hangs on Loading initial ramdisk</span><br><br></span><div dir="ltr"><br><div class="gmail_extra"><br><div style="null" class="gmail_quote">On Fri, Nov 27, 2015 at 11:18 PM, Craig Thompson <span dir="ltr"><<a href="mailto:president@caldwellglobal.com" title="This external link will open in a new window" target="_blank">president@caldwellglobal.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div>First post to this list. I would appreciate some help on this issue.</div><div><br></div><div>As background, I installed CentOS 7 on a Dell server, and then ran the following commands:</div><div><br></div><div><div style="margin:0px;font-size:13px;font-family:Monaco;background-color:rgb(255,253,195)"><span style="color:#c1351e">yum</span> update <a href="http://buildlogs.centos.org/centos/7/virt/x86_64/xen/centos-release-xen-7-11.el7.x86_64.rpm" title="This external link will open in a new window" target="_blank">http://buildlogs.centos.org/centos/7/virt/x86_64/xen/centos-release-xen-7-11.el7.x86_64.rpm</a><br data-mce-bogus="1"></div><div style="margin:0px;font-size:13px;font-family:Monaco;background-color:rgb(255,253,195)"><span style="color:#c1351e">yum</span> --enablerepo=centos-virt-xen-testing update</div><div style="margin:0px;font-size:13px;font-family:Monaco;background-color:rgb(255,253,195)"><span style="color:#c1351e">yum</span> --enablerepo=centos-virt-xen-testing install xen</div></div><div><br></div><div>Doing that, I was able to successfully install Xen, create a virtual machine with its own HVM setup, logical volume, etc. and boot it just fine.</div><div><br></div><div>I then tried to do the same on an IBM x3550 server I’m trying to install with CentOS 7. The CentOS 7 install went just fine. I can boot into the standard kernel and have a working machine. But after running the commands above to install the Xen hypervisor, the machine hangs on boot for a few moments after displaying the lines below and then reboots in a loop over and over and over:</div><div><br></div><div>Loading Xen 4.6.0-2.el7 …</div><div>Loading Linux 3.18.21-16.el7.x86_64 …</div><div>Loading initial ramdisk …</div><div><br></div><div>It never gets beyond that. If I choose the stock kernel (no Xen) from the Grub menu, it will continue to boot into that just fine.</div><div><br></div><div>My grub.cfg file has these entries of note:</div><div><br></div><div><div style="margin:0px;font-size:13px;font-family:Monaco;background-color:rgb(255,253,195)"> multiboot<span style="white-space:pre-wrap"> </span>/xen-4.6.0-2.el7.gz placeholder dom0_mem=1024M,max:1024M cpuinfo com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all ${xen_rm_opts}</div><div style="margin:0px;font-size:13px;font-family:Monaco;background-color:rgb(255,253,195)"> echo 'Loading Linux 3.18.21-16.el7.x86_64 ...'</div><div style="margin:0px;font-size:13px;font-family:Monaco;background-color:rgb(255,253,195)"> module /vmlinuz-3.18.21-16.el7.x86_64 placeholder root=UUID=9dc18146-f9b3-41cc-ba9c-7314689abcde ro crashkernel=auto debug irqpoll ipv6.disable=1 console=hvc0 earlyprintk=xen nomodeset</div><div style="margin:0px;font-size:13px;font-family:Monaco;background-color:rgb(255,253,195)"> echo 'Loading initial ramdisk ...'</div><div style="margin:0px;font-size:13px;font-family:Monaco;background-color:rgb(255,253,195)"> module --nounzip /initramfs-3.18.21-16.el7.x86_64.img</div></div><div><br></div><div><br></div><div>What I have tried:</div><div><br></div><div>1) adding debug into the vmlinuz line</div><div>2) disabling ipv6 in that line</div><div>3) adding root=<span style="background-color:rgb(255,253,195);font-family:Monaco;font-size:13px">UUID=9dc18146-f9b3-41cc-ba9c-7314689abcde</span> to the last line AFTER /initramfs ….</div><div><br></div><div>Nothing so far has made any difference. Obviously the process works, as it works for me just fine on the Dell server.</div><div><br></div><div>Underlying this machine is a SATA RAID 1 PCI card with two SSD drives attached in a RAID 1 mirror. Not that that should matter, but I’m including it for reference. As noted previously, it boots into the stock kernel just fine.</div><div><br></div><div>Any help would be appreciated.</div></div></blockquote><div><br></div><div>Thanks for the testing and the report.<br><br></div><div>Have you tried booting the Xen4CentOS kernel (Linux-3.18.21-16) by itself (i.e., not under Xen)?<br><br></div><div>Also, is there any chance you could get the output of a serial console? That's pretty critical for debugging this sort of thing.<br></div>
CentOS-virt mailing list<br></div></div></div></blockquote><p style="padding: 0; margin: 0;"><span id="_mce_caret"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;"><br></span></span></p><p style="padding: 0; margin: 0;"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;"><span style="overflow:hidden;line-height:0px" id="mce_0_start">### No such file or directory opening port<br>(XEN) Bad console= option 'tty'<br> Xen 4.6.0-2.el7<br>(XEN) Xen version 4.6.0-2.el7 (mockbuild@centos.org) (gcc (GCC) 4.8.3 20140911 (Red Hat 4.8.3-9)) debug=n Tue Nov 3 17:23:39 UTC 2015<br>(XEN) Latest ChangeSet: Mon Oct 19 12:05:21 2015 +0100 git:36b6fe9-dirty<br>(XEN) Bootloader: GRUB 2.02~beta2<br>(XEN) Command line: placeholder dom0_mem=1024M,max:1024M cpuinfo com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all<br>(XEN) Video information:<br>(XEN) VGA is text mode 80x25, font 8x16<br>(XEN) VBE/DDC methods: V2; EDID transfer time: 2 seconds<br>(XEN) Disc information:<br>(XEN) Found 1 MBR signatures<br>(XEN) Found 1 EDD information structures<br>(XEN) Xen-e820 RAM map:<br>(XEN) 0000000000000000 - 000000000009c800 (usable)<br>(XEN) 000000000009c800 - 00000000000a0000 (reserved)<br>(XEN) 00000000000e0000 - 0000000000100000 (reserved)<br>(XEN) 0000000000100000 - 00000000bffcba40 (usable)<br>(XEN) 00000000bffcba40 - 00000000bffcee00 (ACPI data)<br>(XEN) 00000000bffcee00 - 00000000c0000000 (reserved)<br>(XEN) 00000000fec00000 - 0000000100000000 (reserved)<br>(XEN) 0000000100000000 - 00000001fee00000 (usable)<br>(XEN) 00000001fee00000 - 00000001fef00000 (reserved)<br>(XEN) 00000001fef00000 - 00000002fee00000 (usable)<br>(XEN) 00000002fee00000 - 00000002fef00000 (reserved)<br>(XEN) 00000002fef00000 - 00000003fee00000 (usable)<br>(XEN) 00000003fee00000 - 00000003fef00000 (reserved)<br>(XEN) 00000003fef00000 - 0000000840000000 (usable)<br>(XEN) ACPI: RSDP 000FDFD0, 0024 (r2 IBM )<br>(XEN) ACPI: XSDT BFFCED00, 004C (r1 IBM SERDEFNT 1000 IBM 45444F43)<br>(XEN) ACPI: FACP BFFCEC40, 0084 (r2 IBM SERDEFNT 1000 IBM 45444F43)<br>(XEN) ACPI: DSDT BFFCBA40, 246C (r2 IBM SERDEFNT 1000 INTL 20041203)<br>(XEN) ACPI: FACS BFFCE980, 0040<br>(XEN) ACPI: APIC BFFCEB80, 0084 (r1 IBM SERDEFNT 1000 IBM 45444F43)<br>(XEN) ACPI: SRAT BFFCEA40, 00E8 (r1 IBM SERDEFNT 1000 IBM 45444F43)<br>(XEN) ACPI: HPET BFFCEA00, 0038 (r1 IBM SERDEFNT 1000 IBM 45444F43)<br>(XEN) ACPI: MCFG BFFCE9C0, 003C (r1 IBM SERDEFNT 1000 IBM 45444F43)<br>(XEN) System RAM: 32764MB (33550748kB)<br>(XEN) SRAT: PXM 0 -> APIC 0 -> Node 0<br>(XEN) SRAT: PXM 0 -> APIC 1 -> Node 0<br>(XEN) SRAT: PXM 0 -> APIC 6 -> Node 0<br>(XEN) SRAT: PXM 0 -> APIC 7 -> Node 0<br>(XEN) SRAT: Node 0 PXM 0 0-c0000000<br>(XEN) SRAT: Node 0 PXM 0 100000000-840000000<br>(XEN) SRAT: Node 0 PXM 0 840000000-1000000000 (hotplug)<br>(XEN) NUMA: Allocated memnodemap from 83d5cd000 - 83d5ce000<br>(XEN) NUMA: Using 18 for the hash shift.<br>(XEN) Domain heap initialised<br>(XEN) found SMP MP-table at 0009c940<br>(XEN) DMI 2.4 present.<br>(XEN) Using APIC driver default<br>(XEN) ACPI: PM-Timer IO Port: 0x588<br>(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:584,1:0], pm1x_evt[1:580,1:0]<br>(XEN) ACPI: wakeup_vec[bffce98c], vec_size[20]<br>(XEN) ACPI: Local APIC address 0xfee00000<br>(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)<br>(XEN) Processor #0 6:15 APIC version 20<br>(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)<br>(XEN) Processor #1 6:15 APIC version 20<br>(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x06] enabled)<br>(XEN) Processor #6 6:15 APIC version 20<br>(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled)<br>(XEN) Processor #7 6:15 APIC version 20<br>(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1])<br>(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1])<br>(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0x1])<br>(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] dfl dfl lint[0x1])<br>(XEN) ACPI: IOAPIC (id[0x0e] address[0xfec00000] gsi_base[0])<br>(XEN) IOAPIC[0]: apic_id 14, version 32, address 0xfec00000, GSI 0-23<br>(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)<br>(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)<br>(XEN) ACPI: IRQ0 used by override.<br>(XEN) ACPI: IRQ2 used by override.<br>(XEN) ACPI: IRQ9 used by override.<br>(XEN) Enabling APIC mode: Flat. Using 1 I/O APICs<br>(XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000<br>(XEN) ERST table was not found<br>(XEN) Using ACPI (MADT) for SMP configuration information<br>(XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs)<br>(XEN) IRQ limits: 24 GSI, 760 MSI/MSI-X<br>(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K<br>(XEN) CPU: L2 cache: 4096K<br>(XEN) CPU: Physical Processor ID: 0<br>(XEN) CPU: Processor Core ID: 0<br>(XEN) CMCI: CPU0 has no CMCI support<br>(XEN) CPU0: Thermal monitoring enabled (TM2)<br>(XEN) Intel machine check reporting enabled<br>(XEN) Using scheduler: SMP Credit Scheduler (credit)<br>(XEN) Initializing CPU#0<br>(XEN) Detected 2000.117 MHz processor.<br>(XEN) Initing memory sharing.<br>(XEN) alt table ffff82d0802b8b50 -> ffff82d0802b9f24<br>(XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - 14<br>(XEN) PCI: Not using MCFG for segment 0000 bus 00-14<br>(XEN) I/O virtualisation disabled<br>(XEN) CPU0: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06<br>(XEN) ENABLING IO-APIC IRQs<br>(XEN) -> Using new ACK method<br>(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1<br>(XEN) Platform timer is 14.318MHz HPET<br>(XEN) Allocated console ring of 32 KiB.<br>(XEN) mwait-idle: does not run on family 6 model 15<br>(XEN) VMX: Supported advanced features:<br>(XEN) - APIC TPR shadow<br>(XEN) - MSR direct-access bitmap<br>(XEN) HVM: ASIDs disabled.<br>(XEN) HVM: VMX enabled<br>(XEN) HVM: Hardware Assisted Paging (HAP) not detected<br>(XEN) HVM: PVH mode not supported on this platform<br>(XEN) CPU 0 APIC 0 -> Node 0<br>(XEN) CPU 1 APIC 1 -> Node 0<br>(XEN) Booting processor 1/1 eip 8c000<br>(XEN) Initializing CPU#1<br>(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K<br>(XEN) CPU: L2 cache: 4096K<br>(XEN) CPU: Physical Processor ID: 0<br>(XEN) CPU: Processor Core ID: 1<br>(XEN) CMCI: CPU1 has no CMCI support<br>(XEN) CPU1: Thermal monitoring enabled (TM2)<br>(XEN) CPU1: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06<br>(XEN) CPU 2 APIC 6 -> Node 0<br>(XEN) Booting processor 2/6 eip 8c000<br>(XEN) Initializing CPU#2<br>(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K<br>(XEN) CPU: L2 cache: 4096K<br>(XEN) CPU: Physical Processor ID: 3<br>(XEN) CPU: Processor Core ID: 0<br>(XEN) CMCI: CPU2 has no CMCI support<br>(XEN) CPU2: Thermal monitoring enabled (TM2)<br>(XEN) CPU2: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06<br>(XEN) ----[ Xen-4.6.0-2.el7 x86_64 debug=n Not tainted ]----<br>(XEN) CPU: 2<br>(XEN) RIP: e008:[<ffff82d080181ba9>] set_cpu_sibling_map+0x39/0x340<br>(XEN) RFLAGS: 0000000000010006 CONTEXT: hypervisor<br>(XEN) rax: 0000000000000020 rbx: 0000000000000200 rcx: 00000037bd295580<br>(XEN) rdx: 0000000000000003 rsi: 0000000000000000 rdi: 0000000000000002<br>(XEN) rbp: 00000000000000c8 rsp: ffff83083d597e90 r8: 00000037bd295580<br>(XEN) r9: 00000037bd295580 r10: 0000000000000007 r11: 0000000000000001<br>(XEN) r12: 0000000000000002 r13: 0000000000000002 r14: 0000000000000000<br>(XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000000026e0<br>(XEN) cr3: 00000000bfc70000 cr2: 0000000000000020<br>(XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008<br>(XEN) Xen stack trace from rsp=ffff83083d597e90:<br>(XEN) ffff82d0802f4380 0000000000000012 0000000000000000 00000100801ad1e1<br>(XEN) ffff82d0802f4380 0000000000000000 00000000000000c8 0000000000000002<br>(XEN) 0000000000000002 0000000000000000 0000000000000000 ffff82d08018206c<br>(XEN) 0000000000000000 0000000000000001 0000000000000000 0000000000000000<br>(XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000<br>(XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000<br>(XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000<br>(XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000<br>(XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000<br>(XEN) 0000000000000000 0000000000000000 0000000000000000 0000000000000000<br>(XEN) 0000000000000000 0000000000000000 0000000000000002 ffff8300bfd0b000<br>(XEN) 00000037bd295580 0000000000000000<br>(XEN) Xen call trace:<br>(XEN) [<ffff82d080181ba9>] set_cpu_sibling_map+0x39/0x340<br>(XEN) [<ffff82d08018206c>] start_secondary+0x1bc/0x260<br>(XEN)<br>(XEN) Pagetable walk from 0000000000000020:<br>(XEN) L4[0x000] = 000000083d5c1063 ffffffffffffffff<br>(XEN) L3[0x000] = 000000083d5c0063 ffffffffffffffff<br>(XEN) L2[0x000] = 000000083d5bf063 ffffffffffffffff<br>(XEN) L1[0x000] = 0000000000000000 ffffffffffffffff<br>(XEN)<br>(XEN) ****************************************<br>(XEN) Panic on CPU 2:<br>(XEN) FATAL PAGE FAULT<br>(XEN) [error_code=0002]<br>(XEN) Faulting linear address: 0000000000000020<br>(XEN) ****************************************<br>(XEN)<br>(XEN) Reboot in five seconds...<br>(XEN) Resetting with ACPI MEMORY or I/O RESET_REG.</span><br></span></p><p style="padding: 0; margin: 0;"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;"><br></span></p><p style="padding: 0; margin: 0;"><span style="font-size: 10pt; font-family: tahoma,arial,helvetica,sans-serif;"><br></span></p>
</body>
</html>