[CentOS-virt] Centos 6 2.6.32-696.18.7.el6.x86_64 does not boot in Xen PV mode

Fri Jan 5 21:05:14 UTC 2018
Ricardo J. Barberis <ricardo at palmtx.com.ar>

A CentOS 6.9 domU with kernel 2.6.32-696.18.7.el6.x86_64 also fails to boot on
a CentOS 6.9 dom0 with kernel 4.9.63-29.el6.x86_64 and xen 4.4.4-34.el6.x86_64

Xen logs lines like these (among others):

/var/log/xen/xend.log:[2018-01-05 17:55:45 2357] WARNING (XendDomainInfo:583) Could not unpause blktap disk: ('unpause', '-p11520', '-m4') failed (5632  )

/var/log/messages:Jan  5 17:55:45 xvm16n00 tapdisk[11520]: tap-err:tapdisk_vbd_resume: resume request for unpaused vbd aio:/dev/VolGroup/Volume


Xenctx for vCPU 0 says:

[root at dom0 ~] # /usr/lib64/xen/bin/xenctx -s System.map-2.6.32-696.18.7.el6.x86_64 13 0
rip: ffffffff812b7872 __memcpy_fromio+0x12 
flags: 00001202 i nz
rsp: ffffffff81a03e00
rax: 0000000000000000   rcx: 0000000000000004   rdx: 0000000000000010
rbx: ffffffffff400000   rsi: ffffffffff400000   rdi: ffffffff81a03e68
rbp: ffffffff81a03e48    r8: 0000000000000000    r9: 0000000000007ff0
r10: 0000000000000000   r11: 0000000000000000   r12: ffffffff81a03e58
r13: ffffffffff400000   r14: ffffffffff410000   r15: ffffffff81a03e68
 cs: e033        ss: e02b        ds: 0000        es: 0000
 fs: 0000 @ 0000000000000000
 gs: 0000 @ ffffffff81c25000/0000000000000000
Code (instr addr ffffffff812b7872)
00 00 00 55 48 89 e5 e8 57 e8 29 00 89 d2 48 89 d1 48 c1 e9 02 <f3> a5 f6 c2 02 74 02 66 a5 f6 c2 

Stack:
 0000000000000004 0000000000000000 0000000000000000 ffffffff812b7872
 000000010000e030 0000000000010002 ffffffff81a03e48 000000000000e02b
 ffffffff812b7869 ffffffff81a03eb8 ffffffff81c80153 0000000000000000
 0000000000000000 ffffffff81a03e98 ffffffff81c872a0 0000000000000000

Call Trace:
  [<ffffffff812b7872>] __memcpy_fromio+0x12  <--
  [<ffffffff812b7872>] __memcpy_fromio+0x12 
  [<ffffffff812b7869>] __memcpy_fromio+0x9 
  [<ffffffff81c80153>] dmi_scan_machine+0x139 
  [<ffffffff81c45605>] setup_arch+0x424 
  [<ffffffff8107e0ee>] vprintk_default+0xe 
  [<ffffffff8154b0cd>] printk+0x4f 
  [<ffffffff81c3fdda>] start_kernel+0xdc 
  [<ffffffff81c3f33a>] x86_64_start_reservations+0x125 
  [<ffffffff81c4309c>] xen_start_kernel+0x4fe 


And my domU has similar boot messages as Sarah Newman's:

(early) Initializing cgroup subsys cpuset
(early) Initializing cgroup subsys cpu
(early) Linux version 2.6.32-696.18.7.el6.x86_64 (mockbuild at c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-18) (GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018
(early) Command line: ro root=/dev/xvda3 rd_NO_LUKS rd_NO_LVM rd_NO_MD SYSFONT=latarcyrheb-sun16 crashkernel=auto LANG=en_US.UTF-8 KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM 
earlyprintk=xen (hd0,0)/grub/menu.lst
(early) KERNEL supported cpus:
(early)   Intel GenuineIntel
(early)   AMD AuthenticAMD
(early)   Centaur CentaurHauls
(early) 1 multicall(s) failed: cpu 0
(early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
(early) Call Trace:
(early)  [<ffffffff81004843>] ? xen_mc_flush+0x1c3/0x250
(early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
(early)  [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0
(early)  [<ffffffff81c5e8ac>] ? early_ioremap_init+0x98/0x133
(early)  [<ffffffff81c45221>] ? setup_arch+0x40/0xca6
(early)  [<ffffffff8107e0ee>] ? vprintk_default+0xe/0x10
(early)  [<ffffffff8154b0cd>] ? printk+0x4f/0x52
(early)  [<ffffffff81c3fdda>] ? start_kernel+0xdc/0x43b
(early)  [<ffffffff81c47eb0>] ? reserve_early+0x30/0x39
(early)  [<ffffffff81c3f33a>] ? x86_64_start_reservations+0x125/0x129
(early)  [<ffffffff81c4309c>] ? xen_start_kernel+0x4fe/0x505
(early) ------------[ cut here ]------------
(early) WARNING: at arch/x86/xen/multicalls.c:182 xen_mc_flush+0x21f/0x250() (Not tainted)
(early) Modules linked in:
(early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
(early) Call Trace:
(early)  [<ffffffff8107ce81>] ? warn_slowpath_common+0x91/0xe0
(early)  [<ffffffff8100762f>] ? __raw_callee_save_xen_restore_fl+0x11/0x1e
(early)  [<ffffffff8107ceea>] ? warn_slowpath_null+0x1a/0x20
(early)  [<ffffffff8100489f>] ? xen_mc_flush+0x21f/0x250
(early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
(early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
(early)  [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0
(early)  [<ffffffff81c5e8ac>] ? early_ioremap_init+0x98/0x133
(early)  [<ffffffff81c45221>] ? setup_arch+0x40/0xca6
(early)  [<ffffffff8107e0ee>] ? vprintk_default+0xe/0x10
(early)  [<ffffffff8154b0cd>] ? printk+0x4f/0x52
(early)  [<ffffffff81c3fdda>] ? start_kernel+0xdc/0x43b
(early)  [<ffffffff81c47eb0>] ? reserve_early+0x30/0x39
(early)  [<ffffffff81c3f33a>] ? x86_64_start_reservations+0x125/0x129
(early)  [<ffffffff81c4309c>] ? xen_start_kernel+0x4fe/0x505
(early) ---[ end trace a7919e7f17c0a725 ]---
(early) ACPI in unprivileged domain disabled
(early) released 0 pages of unused memory
(early) BIOS-provided physical RAM map:
(early)  Xen: 0000000000000000 - 00000000000a0000 (usable)
(early)  Xen: 00000000000a0000 - 0000000000100000 (reserved)
(early)  Xen: 0000000000100000 - 0000000100000000 (usable)
(early) bootconsole [xenboot0] enabled


El Viernes 05/01/2018 a las 05:39, Sarah Newman escribió:
> Problems start before any of the kaiser code executes, though it could
> still be related to CONFIG_KAISER since that has effects beyond kaiser.c.
>
> ---
> (early) Initializing cgroup subsys cpuset
> (early) Initializing cgroup subsys cpu
> (early) Linux version 2.6.32-696.18.7.el6.x86_64 (mockbuild at c1bl.rdu2.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-18) (GCC) ) #1 SMP Thu Jan 4 17:31:22 UTC 2018
> (early) Command line: ro console=hvc0 rootflags=barrier=0 crashkernel=auto SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us earlyprintk=xen
> (early) KERNEL supported cpus:
> (early)   Intel GenuineIntel
> (early)   AMD AuthenticAMD
> (early)   Centaur CentaurHauls
> (early) 1 multicall(s) failed: cpu 0
> (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
> (early) Call Trace:
> (early)  [<ffffffff81004843>] ? xen_mc_flush+0x1c3/0x250
> (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> (early)  [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0
> (early)  [<ffffffff81c5e8ac>] ? early_ioremap_init+0x98/0x133
> (early)  [<ffffffff81c45221>] ? setup_arch+0x40/0xca6
> (early)  [<ffffffff8107e0ee>] ? vprintk_default+0xe/0x10
> (early)  [<ffffffff8154b0cd>] ? printk+0x4f/0x52
> (early)  [<ffffffff81c3fdda>] ? start_kernel+0xdc/0x43b
> (early)  [<ffffffff81c47eb0>] ? reserve_early+0x30/0x39
> (early)  [<ffffffff81c3f33a>] ? x86_64_start_reservations+0x125/0x129
> (early)  [<ffffffff81c4309c>] ? xen_start_kernel+0x4fe/0x505
> (early) ------------[ cut here ]------------
> (early) WARNING: at arch/x86/xen/multicalls.c:182 xen_mc_flush+0x21f/0x250() (Not tainted)
> (early) Modules linked in: 
> (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1
> (early) Call Trace:
> (early)  [<ffffffff8107ce81>] ? warn_slowpath_common+0x91/0xe0
> (early)  [<ffffffff8100762f>] ? __raw_callee_save_xen_restore_fl+0x11/0x1e
> (early)  [<ffffffff8107ceea>] ? warn_slowpath_null+0x1a/0x20
> (early)  [<ffffffff8100489f>] ? xen_mc_flush+0x21f/0x250
> (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> (early)  [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0
> (early)  [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0
> (early)  [<ffffffff81c5e8ac>] ? early_ioremap_init+0x98/0x133
> (early)  [<ffffffff81c45221>] ? setup_arch+0x40/0xca6
> (early)  [<ffffffff8107e0ee>] ? vprintk_default+0xe/0x10
> (early)  [<ffffffff8154b0cd>] ? printk+0x4f/0x52
> (early)  [<ffffffff81c3fdda>] ? start_kernel+0xdc/0x43b
> (early)  [<ffffffff81c47eb0>] ? reserve_early+0x30/0x39
> (early)  [<ffffffff81c3f33a>] ? x86_64_start_reservations+0x125/0x129
> (early)  [<ffffffff81c4309c>] ? xen_start_kernel+0x4fe/0x505
> (early) ---[ end trace a7919e7f17c0a725 ]---
> (early) ACPI in unprivileged domain disabled
> (early) released 0 pages of unused memory
> (early) BIOS-provided physical RAM map:
> (early)  Xen: 0000000000000000 - 00000000000a0000 (usable)
> (early)  Xen: 00000000000a0000 - 0000000000100000 (reserved)
> (early)  Xen: 0000000000100000 - 0000000020000000 (usable)
> (early) bootconsole [xenboot0] enabled

-- 
Ricardo J. Barberis
Usuario Linux Nº 250625: http://counter.li.org/
Usuario LFS Nº 5121: http://www.linuxfromscratch.org/
Senior SysAdmin / IT Architect - www.DonWeb.com