[CentOS-virt] new install of Xen 4.6 hangs on Loading initial ramdisk

On Tue, Dec 8, 2015 at 4:17 PM, President <president at caldwellglobal.com> wrote:
> Not sure if this actually made it to the list the first time.
>
>
> Here is the SERIAL output (bottom of message after your questions).
> Googling the error indicates it's something people ran into a few years back
> but was supposedly fixed.  Any ideas?
>
>
> I can verify that if I REMOVE the second CPU, it boots into Xen kernel no
> problem.  The CPU itself doesn't matter, as I can swap either CPU into the
> first slot, and it boots.  Only if there is a second CPU does it fail.

Great, thanks for the report.  This looks like a bug in upstream Xen
-- would you mind re-posting this (with the serial output) on the
xen-users mailing list?  That will get more eyeballs on the problem.

 -George

>
>
> -----Original message-----
> From: George Dunlap <dunlapg at umich.edu>
> Sent: Monday 30th November 2015 6:00
> To: Discussion about the virtualization on CentOS <centos-virt at centos.org>
> Subject: Re: [CentOS-virt] new install of Xen 4.6 hangs on Loading initial
> ramdisk
>
>
>
> On Fri, Nov 27, 2015 at 11:18 PM, Craig Thompson
> <president at caldwellglobal.com> wrote:
>>
>> First post to this list.  I would appreciate some help on this issue.
>>
>> As background, I installed CentOS 7 on a Dell server, and then ran the
>> following commands:
>>
>> yum update
>> http://buildlogs.centos.org/centos/7/virt/x86_64/xen/centos-release-xen-7-11.el7.x86_64.rpm
>> yum --enablerepo=centos-virt-xen-testing update
>> yum --enablerepo=centos-virt-xen-testing install xen
>>
>> Doing that, I was able to successfully install Xen, create a virtual
>> machine with its own HVM setup, logical volume, etc. and boot it just fine.
>>
>> I then tried to do the same on an IBM x3550 server I’m trying to install
>> with CentOS 7.  The CentOS 7 install went just fine.  I can boot into the
>> standard kernel and have a working machine.  But after running the commands
>> above to install the Xen hypervisor, the machine hangs on boot for a few
>> moments after displaying the lines below and then reboots in a loop over and
>> over and over:
>>
>> Loading Xen 4.6.0-2.el7 …
>> Loading Linux 3.18.21-16.el7.x86_64 …
>> Loading initial ramdisk …
>>
>> It never gets beyond that.  If I choose the stock kernel (no Xen) from the
>> Grub menu, it will continue to boot into that just fine.
>>
>> My grub.cfg file has these entries of note:
>>
>>  multiboot /xen-4.6.0-2.el7.gz placeholder  dom0_mem=1024M,max:1024M
>> cpuinfo com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all
>> ${xen_rm_opts}
>>         echo    'Loading Linux 3.18.21-16.el7.x86_64 ...'
>>         module  /vmlinuz-3.18.21-16.el7.x86_64 placeholder
>> root=UUID=9dc18146-f9b3-41cc-ba9c-7314689abcde ro crashkernel=auto debug
>> irqpoll ipv6.disable=1 console=hvc0 earlyprintk=xen nomodeset
>>         echo    'Loading initial ramdisk ...'
>>         module  --nounzip   /initramfs-3.18.21-16.el7.x86_64.img
>>
>>
>> What I have tried:
>>
>> 1) adding debug into the vmlinuz line
>> 2) disabling ipv6 in that line
>> 3) adding root=UUID=9dc18146-f9b3-41cc-ba9c-7314689abcde to the last line
>> AFTER /initramfs ….
>>
>> Nothing so far has made any difference.  Obviously the process works, as
>> it works for me just fine on the Dell server.
>>
>> Underlying this machine is a SATA RAID 1 PCI card with two SSD drives
>> attached in a RAID 1 mirror.  Not that that should matter, but I’m including
>> it for reference. As noted previously, it boots into the stock kernel just
>> fine.
>>
>> Any help would be appreciated.
>
>
> Thanks for the testing and the report.
>
> Have you tried booting the Xen4CentOS kernel (Linux-3.18.21-16) by itself
> (i.e., not under Xen)?
>
> Also, is there any chance you could get the output of a serial console?
> That's pretty critical for debugging this sort of thing.
> CentOS-virt mailing list
>
> 
>
> ###  No such file or directory opening port
> (XEN) Bad console= option 'tty'
>  Xen 4.6.0-2.el7
> (XEN) Xen version 4.6.0-2.el7 (mockbuild at centos.org) (gcc (GCC) 4.8.3
> 20140911 (Red Hat 4.8.3-9)) debug=n Tue Nov  3 17:23:39 UTC 2015
> (XEN) Latest ChangeSet: Mon Oct 19 12:05:21 2015 +0100 git:36b6fe9-dirty
> (XEN) Bootloader: GRUB 2.02~beta2
> (XEN) Command line: placeholder dom0_mem=1024M,max:1024M cpuinfo
> com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all
> (XEN) Video information:
> (XEN)  VGA is text mode 80x25, font 8x16
> (XEN)  VBE/DDC methods: V2; EDID transfer time: 2 seconds
> (XEN) Disc information:
> (XEN)  Found 1 MBR signatures
> (XEN)  Found 1 EDD information structures
> (XEN) Xen-e820 RAM map:
> (XEN)  0000000000000000 - 000000000009c800 (usable)
> (XEN)  000000000009c800 - 00000000000a0000 (reserved)
> (XEN)  00000000000e0000 - 0000000000100000 (reserved)
> (XEN)  0000000000100000 - 00000000bffcba40 (usable)
> (XEN)  00000000bffcba40 - 00000000bffcee00 (ACPI data)
> (XEN)  00000000bffcee00 - 00000000c0000000 (reserved)
> (XEN)  00000000fec00000 - 0000000100000000 (reserved)
> (XEN)  0000000100000000 - 00000001fee00000 (usable)
> (XEN)  00000001fee00000 - 00000001fef00000 (reserved)
> (XEN)  00000001fef00000 - 00000002fee00000 (usable)
> (XEN)  00000002fee00000 - 00000002fef00000 (reserved)
> (XEN)  00000002fef00000 - 00000003fee00000 (usable)
> (XEN)  00000003fee00000 - 00000003fef00000 (reserved)
> (XEN)  00000003fef00000 - 0000000840000000 (usable)
> (XEN) ACPI: RSDP 000FDFD0, 0024 (r2 IBM   )
> (XEN) ACPI: XSDT BFFCED00, 004C (r1 IBM    SERDEFNT     1000 IBM  45444F43)
> (XEN) ACPI: FACP BFFCEC40, 0084 (r2 IBM    SERDEFNT     1000 IBM  45444F43)
> (XEN) ACPI: DSDT BFFCBA40, 246C (r2 IBM    SERDEFNT     1000 INTL 20041203)
> (XEN) ACPI: FACS BFFCE980, 0040
> (XEN) ACPI: APIC BFFCEB80, 0084 (r1 IBM    SERDEFNT     1000 IBM  45444F43)
> (XEN) ACPI: SRAT BFFCEA40, 00E8 (r1 IBM    SERDEFNT     1000 IBM  45444F43)
> (XEN) ACPI: HPET BFFCEA00, 0038 (r1 IBM    SERDEFNT     1000 IBM  45444F43)
> (XEN) ACPI: MCFG BFFCE9C0, 003C (r1 IBM    SERDEFNT     1000 IBM  45444F43)
> (XEN) System RAM: 32764MB (33550748kB)
> (XEN) SRAT: PXM 0 -> APIC 0 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 1 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 6 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 7 -> Node 0
> (XEN) SRAT: Node 0 PXM 0 0-c0000000
> (XEN) SRAT: Node 0 PXM 0 100000000-840000000
> (XEN) SRAT: Node 0 PXM 0 840000000-1000000000 (hotplug)
> (XEN) NUMA: Allocated memnodemap from 83d5cd000 - 83d5ce000
> (XEN) NUMA: Using 18 for the hash shift.
> (XEN) Domain heap initialised
> (XEN) found SMP MP-table at 0009c940
> (XEN) DMI 2.4 present.
> (XEN) Using APIC driver default
> (XEN) ACPI: PM-Timer IO Port: 0x588
> (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:584,1:0], pm1x_evt[1:580,1:0]
> (XEN) ACPI:             wakeup_vec[bffce98c], vec_size[20]
> (XEN) ACPI: Local APIC address 0xfee00000
> (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> (XEN) Processor #0 6:15 APIC version 20
> (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> (XEN) Processor #1 6:15 APIC version 20
> (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x06] enabled)
> (XEN) Processor #6 6:15 APIC version 20
> (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled)
> (XEN) Processor #7 6:15 APIC version 20
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] dfl dfl lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] dfl dfl lint[0x1])
> (XEN) ACPI: IOAPIC (id[0x0e] address[0xfec00000] gsi_base[0])
> (XEN) IOAPIC[0]: apic_id 14, version 32, address 0xfec00000, GSI 0-23
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> (XEN) ACPI: IRQ0 used by override.
> (XEN) ACPI: IRQ2 used by override.
> (XEN) ACPI: IRQ9 used by override.
> (XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
> (XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000
> (XEN) ERST table was not found
> (XEN) Using ACPI (MADT) for SMP configuration information
> (XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs)
> (XEN) IRQ limits: 24 GSI, 760 MSI/MSI-X
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 4096K
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: Processor Core ID: 0
> (XEN) CMCI: CPU0 has no CMCI support
> (XEN) CPU0: Thermal monitoring enabled (TM2)
> (XEN) Intel machine check reporting enabled
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Initializing CPU#0
> (XEN) Detected 2000.117 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) alt table ffff82d0802b8b50 -> ffff82d0802b9f24
> (XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - 14
> (XEN) PCI: Not using MCFG for segment 0000 bus 00-14
> (XEN) I/O virtualisation disabled
> (XEN) CPU0: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz stepping 06
> (XEN) ENABLING IO-APIC IRQs
> (XEN)  -> Using new ACK method
> (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
> (XEN) Platform timer is 14.318MHz HPET
> (XEN) Allocated console ring of 32 KiB.
> (XEN) mwait-idle: does not run on family 6 model 15
> (XEN) VMX: Supported advanced features:
> (XEN)  - APIC TPR shadow
> (XEN)  - MSR direct-access bitmap
> (XEN) HVM: ASIDs disabled.
> (XEN) HVM: VMX enabled
> (XEN) HVM: Hardware Assisted Paging (HAP) not detected
> (XEN) HVM: PVH mode not supported on this platform
> (XEN) CPU 0 APIC 0 -> Node 0
> (XEN) CPU 1 APIC 1 -> Node 0
> (XEN) Booting processor 1/1 eip 8c000
> (XEN) Initializing CPU#1
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 4096K
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: Processor Core ID: 1
> (XEN) CMCI: CPU1 has no CMCI support
> (XEN) CPU1: Thermal monitoring enabled (TM2)
> (XEN) CPU1: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz stepping 06
> (XEN) CPU 2 APIC 6 -> Node 0
> (XEN) Booting processor 2/6 eip 8c000
> (XEN) Initializing CPU#2
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 4096K
> (XEN) CPU: Physical Processor ID: 3
> (XEN) CPU: Processor Core ID: 0
> (XEN) CMCI: CPU2 has no CMCI support
> (XEN) CPU2: Thermal monitoring enabled (TM2)
> (XEN) CPU2: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz stepping 06
> (XEN) ----[ Xen-4.6.0-2.el7  x86_64  debug=n  Not tainted ]----
> (XEN) CPU:    2
> (XEN) RIP:    e008:[<ffff82d080181ba9>] set_cpu_sibling_map+0x39/0x340
> (XEN) RFLAGS: 0000000000010006   CONTEXT: hypervisor
> (XEN) rax: 0000000000000020   rbx: 0000000000000200   rcx: 00000037bd295580
> (XEN) rdx: 0000000000000003   rsi: 0000000000000000   rdi: 0000000000000002
> (XEN) rbp: 00000000000000c8   rsp: ffff83083d597e90   r8:  00000037bd295580
> (XEN) r9:  00000037bd295580   r10: 0000000000000007   r11: 0000000000000001
> (XEN) r12: 0000000000000002   r13: 0000000000000002   r14: 0000000000000000
> (XEN) r15: 0000000000000000   cr0: 000000008005003b   cr4: 00000000000026e0
> (XEN) cr3: 00000000bfc70000   cr2: 0000000000000020
> (XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
> (XEN) Xen stack trace from rsp=ffff83083d597e90:
> (XEN)    ffff82d0802f4380 0000000000000012 0000000000000000 00000100801ad1e1
> (XEN)    ffff82d0802f4380 0000000000000000 00000000000000c8 0000000000000002
> (XEN)    0000000000000002 0000000000000000 0000000000000000 ffff82d08018206c
> (XEN)    0000000000000000 0000000000000001 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000002 ffff8300bfd0b000
> (XEN)    00000037bd295580 0000000000000000
> (XEN) Xen call trace:
> (XEN)    [<ffff82d080181ba9>] set_cpu_sibling_map+0x39/0x340
> (XEN)    [<ffff82d08018206c>] start_secondary+0x1bc/0x260
> (XEN)
> (XEN) Pagetable walk from 0000000000000020:
> (XEN)  L4[0x000] = 000000083d5c1063 ffffffffffffffff
> (XEN)  L3[0x000] = 000000083d5c0063 ffffffffffffffff
> (XEN)  L2[0x000] = 000000083d5bf063 ffffffffffffffff
> (XEN)  L1[0x000] = 0000000000000000 ffffffffffffffff
> (XEN)
> (XEN) ****************************************
> (XEN) Panic on CPU 2:
> (XEN) FATAL PAGE FAULT
> (XEN) [error_code=0002]
> (XEN) Faulting linear address: 0000000000000020
> (XEN) ****************************************
> (XEN)
> (XEN) Reboot in five seconds...
> (XEN) Resetting with ACPI MEMORY or I/O RESET_REG.
>
>
>
>
> _______________________________________________
> CentOS-virt mailing list
> CentOS-virt at centos.org
> https://lists.centos.org/mailman/listinfo/centos-virt
>