[CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode

Fri Jan 5 21:12:46 UTC 2018
Ricardo J. Barberis <ricardo at palmtx.com.ar>

Forgot to post my domU config (xm/xend format):

import os, re
arch = os.uname()[4]
if re.search('64', arch):
    arch_libdir = 'lib64'
else:
    arch_libdir = 'lib'

name = 'domU'
bootloader = '/usr/bin/pygrub'
extra = '(hd0,0)/grub/menu.lst'
maxmem = 4096
memory = 1024
vcpus=2

vif = [ 'mac=00:16:3E:AA:BB:CC, bridge=brXXX, vifname=domU.0', 'mac=AA:00:00:AA:BB:CC, bridge=brYYY, vifname=domU.1' ]
disk = [ 'tap2:aio:/dev/VolGroup/Volume,xvda,w', 'tap2:aio:/dev/VolGroup/Volume-b,xvdb,w' ]

on_poweroff = 'destroy'
on_reboot   = 'destroy'
on_crash    = 'preserve'

device_model = '/usr/' + arch_libdir + '/xen/bin/qemu-dm'
boot='cd'
vfb = [ 'type=vnc, vnclisten=0.0.0.0, vncpasswd=RRRRRR, vncdisplay=NN' ]
nographic=0
stdvga=0
serial='pty'
monitor=0
localtime=0
usb=1
usbdevice='tablet'


El Viernes 05/01/2018 a las 18:05, Ricardo J. Barberis escribió:
> A CentOS 6.9 domU with kernel 2.6.32-696.18.7.el6.x86_64 also fails to boot
> on a CentOS 6.9 dom0 with kernel 4.9.63-29.el6.x86_64 and xen
> 4.4.4-34.el6.x86_64
>
> Xen logs lines like these (among others):
>
> /var/log/xen/xend.log:[2018-01-05 17:55:45 2357] WARNING (XendDomainInfo:583) Could not unpause blktap disk: ('unpause', '-p11520', '-m4') failed (5632  )
>
> /var/log/messages:Jan  5 17:55:45 xvm16n00 tapdisk[11520]: tap-err:tapdisk_vbd_resume: resume request for unpaused vbd aio:/dev/VolGroup/Volume
>
>
> Xenctx for vCPU 0 says:
>
> [root at dom0 ~] # /usr/lib64/xen/bin/xenctx -s
> System.map-2.6.32-696.18.7.el6.x86_64 13 0 rip: ffffffff812b7872
> __memcpy_fromio+0x12
> flags: 00001202 i nz
> rsp: ffffffff81a03e00
> rax: 0000000000000000   rcx: 0000000000000004   rdx: 0000000000000010
> rbx: ffffffffff400000   rsi: ffffffffff400000   rdi: ffffffff81a03e68
> rbp: ffffffff81a03e48    r8: 0000000000000000    r9: 0000000000007ff0
> r10: 0000000000000000   r11: 0000000000000000   r12: ffffffff81a03e58
> r13: ffffffffff400000   r14: ffffffffff410000   r15: ffffffff81a03e68
>  cs: e033        ss: e02b        ds: 0000        es: 0000
>  fs: 0000 @ 0000000000000000
>  gs: 0000 @ ffffffff81c25000/0000000000000000
> Code (instr addr ffffffff812b7872)
> 00 00 00 55 48 89 e5 e8 57 e8 29 00 89 d2 48 89 d1 48 c1 e9 02 <f3> a5 f6
> c2 02 74 02 66 a5 f6 c2
>
> Stack:
>  0000000000000004 0000000000000000 0000000000000000 ffffffff812b7872
>  000000010000e030 0000000000010002 ffffffff81a03e48 000000000000e02b
>  ffffffff812b7869 ffffffff81a03eb8 ffffffff81c80153 0000000000000000
>  0000000000000000 ffffffff81a03e98 ffffffff81c872a0 0000000000000000
>
> Call Trace:
>   [<ffffffff812b7872>] __memcpy_fromio+0x12  <--
>   [<ffffffff812b7872>] __memcpy_fromio+0x12
>   [<ffffffff812b7869>] __memcpy_fromio+0x9
>   [<ffffffff81c80153>] dmi_scan_machine+0x139
>   [<ffffffff81c45605>] setup_arch+0x424
>   [<ffffffff8107e0ee>] vprintk_default+0xe
>   [<ffffffff8154b0cd>] printk+0x4f
>   [<ffffffff81c3fdda>] start_kernel+0xdc
>   [<ffffffff81c3f33a>] x86_64_start_reservations+0x125
>   [<ffffffff81c4309c>] xen_start_kernel+0x4fe
>
>
> And my domU has similar boot messages as Sarah Newman's:
>
> (early) Initializing cgroup subsys cpuset
> (early) Initializing cgroup subsys cpu
> (early) Linux version 2.6.32-696.18.7.el6.x86_64 (mockbuild at c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-18) (GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018
> (early) Command line: ro root=/dev/xvda3 rd_NO_LUKS rd_NO_LVM rd_NO_MD SYSFONT=latarcyrheb-sun16 crashkernel=auto LANG=en_US.UTF-8 KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM 
earlyprintk=xen (hd0,0)/grub/menu.lst 
> (early) KERNEL supported cpus:
> (early)   Intel GenuineIntel
> (early)   AMD AuthenticAMD
> (early)   Centaur CentaurHauls
> (early) 1 multicall(s) failed: cpu 0
> (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
> (early) Call Trace:
> (early)  [<ffffffff81004843>] ? xen_mc_flush+0x1c3/0x250
> (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> (early)  [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0
> (early)  [<ffffffff81c5e8ac>] ? early_ioremap_init+0x98/0x133
> (early)  [<ffffffff81c45221>] ? setup_arch+0x40/0xca6
> (early)  [<ffffffff8107e0ee>] ? vprintk_default+0xe/0x10
> (early)  [<ffffffff8154b0cd>] ? printk+0x4f/0x52
> (early)  [<ffffffff81c3fdda>] ? start_kernel+0xdc/0x43b
> (early)  [<ffffffff81c47eb0>] ? reserve_early+0x30/0x39
> (early)  [<ffffffff81c3f33a>] ? x86_64_start_reservations+0x125/0x129
> (early)  [<ffffffff81c4309c>] ? xen_start_kernel+0x4fe/0x505
> (early) ------------[ cut here ]------------
> (early) WARNING: at arch/x86/xen/multicalls.c:182 xen_mc_flush+0x21f/0x250() (Not tainted)
> (early) Modules linked in: 
> (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
> (early) Call Trace:
> (early)  [<ffffffff8107ce81>] ? warn_slowpath_common+0x91/0xe0
> (early)  [<ffffffff8100762f>] ? __raw_callee_save_xen_restore_fl+0x11/0x1e
> (early)  [<ffffffff8107ceea>] ? warn_slowpath_null+0x1a/0x20
> (early)  [<ffffffff8100489f>] ? xen_mc_flush+0x21f/0x250
> (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> (early)  [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0
> (early)  [<ffffffff81c5e8ac>] ? early_ioremap_init+0x98/0x133
> (early)  [<ffffffff81c45221>] ? setup_arch+0x40/0xca6
> (early)  [<ffffffff8107e0ee>] ? vprintk_default+0xe/0x10
> (early)  [<ffffffff8154b0cd>] ? printk+0x4f/0x52
> (early)  [<ffffffff81c3fdda>] ? start_kernel+0xdc/0x43b
> (early)  [<ffffffff81c47eb0>] ? reserve_early+0x30/0x39
> (early)  [<ffffffff81c3f33a>] ? x86_64_start_reservations+0x125/0x129
> (early)  [<ffffffff81c4309c>] ? xen_start_kernel+0x4fe/0x505
> (early) ---[ end trace a7919e7f17c0a725 ]---
> (early) ACPI in unprivileged domain disabled
> (early) released 0 pages of unused memory
> (early) BIOS-provided physical RAM map:
> (early)  Xen: 0000000000000000 - 00000000000a0000 (usable)
> (early)  Xen: 00000000000a0000 - 0000000000100000 (reserved)
> (early)  Xen: 0000000000100000 - 0000000100000000 (usable)
> (early) bootconsole [xenboot0] enabled
>
> El Viernes 05/01/2018 a las 05:39, Sarah Newman escribió:
> > Problems start before any of the kaiser code executes, though it could
> > still be related to CONFIG_KAISER since that has effects beyond kaiser.c.
> >
> > ---
> > (early) Initializing cgroup subsys cpuset
> > (early) Initializing cgroup subsys cpu
> > (early) Linux version 2.6.32-696.18.7.el6.x86_64
> > (mockbuild at c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-18) (GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018 (early) Command line: ro console=hvc0 
rootflags=barrier=0 crashkernel=auto SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us earlyprintk=xen
> > (early) KERNEL supported cpus:
> > (early)   Intel GenuineIntel
> > (early)   AMD AuthenticAMD
> > (early)   Centaur CentaurHauls
> > (early) 1 multicall(s) failed: cpu 0
> > (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
> > (early) Call Trace:
> > (early)  [<ffffffff81004843>] ? xen_mc_flush+0x1c3/0x250
> > (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> > (early)  [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0
> > (early)  [<ffffffff81c5e8ac>] ? early_ioremap_init+0x98/0x133
> > (early)  [<ffffffff81c45221>] ? setup_arch+0x40/0xca6
> > (early)  [<ffffffff8107e0ee>] ? vprintk_default+0xe/0x10
> > (early)  [<ffffffff8154b0cd>] ? printk+0x4f/0x52
> > (early)  [<ffffffff81c3fdda>] ? start_kernel+0xdc/0x43b
> > (early)  [<ffffffff81c47eb0>] ? reserve_early+0x30/0x39
> > (early)  [<ffffffff81c3f33a>] ? x86_64_start_reservations+0x125/0x129
> > (early)  [<ffffffff81c4309c>] ? xen_start_kernel+0x4fe/0x505
> > (early) ------------[ cut here ]------------
> > (early) WARNING: at arch/x86/xen/multicalls.c:182 xen_mc_flush+0x21f/0x250() (Not tainted)
> > (early) Modules linked in: 
> > (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
> > (early) Call Trace:
> > (early)  [<ffffffff8107ce81>] ? warn_slowpath_common+0x91/0xe0
> > (early)  [<ffffffff8100762f>] ? __raw_callee_save_xen_restore_fl+0x11/0x1e (early)  [<ffffffff8107ceea>] ? warn_slowpath_null+0x1a/0x20
> > (early)  [<ffffffff8100489f>] ? xen_mc_flush+0x21f/0x250
> > (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> > (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> > (early)  [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0
> > (early)  [<ffffffff81c5e8ac>] ? early_ioremap_init+0x98/0x133
> > (early)  [<ffffffff81c45221>] ? setup_arch+0x40/0xca6
> > (early)  [<ffffffff8107e0ee>] ? vprintk_default+0xe/0x10
> > (early)  [<ffffffff8154b0cd>] ? printk+0x4f/0x52
> > (early)  [<ffffffff81c3fdda>] ? start_kernel+0xdc/0x43b
> > (early)  [<ffffffff81c47eb0>] ? reserve_early+0x30/0x39
> > (early)  [<ffffffff81c3f33a>] ? x86_64_start_reservations+0x125/0x129
> > (early)  [<ffffffff81c4309c>] ? xen_start_kernel+0x4fe/0x505
> > (early) ---[ end trace a7919e7f17c0a725 ]---
> > (early) ACPI in unprivileged domain disabled
> > (early) released 0 pages of unused memory
> > (early) BIOS-provided physical RAM map:
> > (early)  Xen: 0000000000000000 - 00000000000a0000 (usable)
> > (early)  Xen: 00000000000a0000 - 0000000000100000 (reserved)
> > (early)  Xen: 0000000000100000 - 0000000020000000 (usable)
> > (early) bootconsole [xenboot0] enabled
-- 
Ricardo J. Barberis
Usuario Linux Nº 250625: http://counter.li.org/
Usuario LFS Nº 5121: http://www.linuxfromscratch.org/
Senior SysAdmin / IT Architect - www.DonWeb.com