I thought I'd chime in and say that I'm seeing the same kernel-plus boot failure that Shaun Reitan reported earlier. Is there likely to be another build 3.10 kernel build coming down the pipeline that might fix this issue? Here's the output of my failed PV domU boot:
[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-693.11.6.el7.centos.plus.x86_64 ( builder@kbuilder.dev.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Thu Jan 4 14:27:13 UTC 2018 [ 0.000000] Command line: root=/dev/xvda1 root=/dev/xvda1 [ 0.000000] ACPI in unprivileged domain disabled [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] Xen: [mem 0x0000000000000000-0x000000000009ffff] usable [ 0.000000] Xen: [mem 0x00000000000a0000-0x00000000000fffff] reserved [ 0.000000] Xen: [mem 0x0000000000100000-0x00000000ffffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] DMI not present or invalid. [ 0.000000] e820: last_pfn = 0x100000 max_arch_pfn = 0x400000000 [ 0.000000] RAMDISK: [mem 0x0243e000-0x034befff] [ 0.000000] NUMA turned off [ 0.000000] Faking a node at [mem 0x0000000000000000-0x00000000ffffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0xff802000-0xff828fff] [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009ffff] [ 0.000000] node 0: [mem 0x00100000-0xffffffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0xffffffff] [ 0.000000] SFI: Simple Firmware Interface v0.81 http://simplefirmware.org [ 0.000000] No local APIC present [ 0.000000] APIC: disable apic facility [ 0.000000] APIC: switched to apic NOOP [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff] [ 0.000000] e820: cannot find a gap in the 32bit address range [ 0.000000] e820: PCI devices with unassigned 32bit BARs may break! [ 0.000000] e820: [mem 0x100100000-0x1004fffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on Xen [ 0.000000] Xen version: 4.7.2 (preserve-AD) [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 35 pages/cpu @ffff8800ff200000 s104600 r8192 d30568 u524288 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1032074 [ 0.000000] Policy zone: DMA32 [ 0.000000] Kernel command line: root=/dev/xvda1 root=/dev/xvda1 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 2194120k/4194304k available (6984k kernel code, 388k absent, 116588k reserved, 4581k data, 1800k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] x86/pti: Xen PV detected, disabling PTI protection [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] NR_IRQS:327936 nr_irqs:48 0 [ 0.000000] Console: colour dummy device 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [hvc0] enabled [ 0.000000] allocated 16777216 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] installing Xen timer for CPU 0 [ 0.000000] tsc: Fast TSC calibration failed [ 0.000000] tsc: Unable to calibrate against PIT [ 0.000000] tsc: No reference (HPET/PMTIMER) available [ 0.000000] tsc: Detected 2394.058 MHz processor [ 0.002000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4788.11 BogoMIPS (lpj=2394058) [ 0.002000] pid_max: default: 32768 minimum: 301 [ 0.002000] Security Framework initialized [ 0.002000] SELinux: Initializing. [ 0.002000] Yama: becoming mindful. [ 0.002714] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.004757] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.005495] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.005532] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.006056] Initializing cgroup subsys memory [ 0.006092] Initializing cgroup subsys devices [ 0.006104] Initializing cgroup subsys freezer [ 0.006116] Initializing cgroup subsys net_cls [ 0.006127] Initializing cgroup subsys blkio [ 0.006137] Initializing cgroup subsys perf_event [ 0.006149] Initializing cgroup subsys hugetlb [ 0.006160] Initializing cgroup subsys pids [ 0.006170] Initializing cgroup subsys net_prio [ 0.006302] ENERGY_PERF_BIAS: Set to 'normal', was 'performance' [ 0.006318] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8) [ 0.006331] FEATURE SPEC_CTRL Not Present [ 0.006339] FEATURE IBPB_SUPPORT Not Present [ 0.006351] CPU: Physical Processor ID: 0 [ 0.006362] CPU: Processor Core ID: 0 [ 0.006373] mce: CPU supports 2 MCE banks [ 0.006418] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0 [ 0.006429] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32 [ 0.006439] tlb_flushall_shift: 6 [ 0.060801] ftrace: allocating 26850 entries in 105 pages [ 0.074135] cpu 0 spinlock event irq 17 [ 0.074155] smpboot: Max logical packages: 1 [ 0.074216] Performance Events: unsupported p6 CPU model 45 no PMU driver, software events only. [ 0.076817] NMI watchdog: disabled (cpu0): hardware events not enabled [ 0.076834] NMI watchdog: Shutting down hard lockup detector on all cpus [ 0.076970] installing Xen timer for CPU 1 [ 0.077000] cpu 1 spinlock event irq 24 [ 0.077200] SMP alternatives: switching to SMP code [ 0.002000] [Firmware Bug]: CPU1: APIC id mismatch. Firmware: ffff APIC: 0 [ 0.119896] installing Xen timer for CPU 2 [ 0.119935] cpu 2 spinlock event irq 31 [ 0.002000] [Firmware Bug]: CPU2: APIC id mismatch. Firmware: ffff APIC: 0 [ 0.120440] installing Xen timer for CPU 3 [ 0.120477] cpu 3 spinlock event irq 38 [ 0.002000] [Firmware Bug]: CPU3: APIC id mismatch. Firmware: ffff APIC: 0 [ 0.120937] Brought up 4 CPUs [ 0.145051] node 0 initialised, 470802 pages in 24ms [ 0.146162] devtmpfs: initialized [ 0.152152] EVM: security.selinux [ 0.152168] EVM: security.ima [ 0.152176] EVM: security.capability [ 0.154191] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.154214] pinctrl core: initialized pinctrl subsystem [ 0.154337] xen:grant_table: Grant tables using version 2 layout [ 0.154393] Grant table initialized [ 0.174361] RTC time: 165:165:165, date: 165/165/65 [ 0.174560] NET: Registered protocol family 16 [ 0.175213] random: fast init done [ 0.177033] PCI: setting up Xen PCI frontend stub [ 0.182179] ACPI: Interpreter disabled. [ 0.183029] xen:balloon: Initialising balloon driver [ 0.187043] xen_balloon: Initialising balloon driver [ 0.187130] vgaarb: loaded [ 0.187131] SCSI subsystem initialized [ 0.187244] usbcore: registered new interface driver usbfs [ 0.187291] usbcore: registered new interface driver hub [ 0.188102] usbcore: registered new device driver usb [ 0.188102] dmi: Firmware registration failed. [ 0.188140] PCI: System does not support PCI [ 0.188156] PCI: System does not support PCI [ 0.188156] NetLabel: Initializing [ 0.188156] NetLabel: domain hash size = 128 [ 0.188156] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.188156] NetLabel: unlabeled traffic allowed by default [ 0.188156] amd_nb: Cannot enumerate AMD northbridges [ 0.189005] Switched to clocksource xen [ 0.199769] pnp: PnP ACPI: disabled [ 0.205228] NET: Registered protocol family 2 [ 0.205683] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 0.205963] TCP bind hash table entries: 32768 (order: 7, 524288 bytes) [ 0.206141] TCP: Hash tables configured (established 32768 bind 32768) [ 0.206207] TCP: reno registered [ 0.206240] UDP hash table entries: 2048 (order: 4, 65536 bytes) [ 0.206294] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes) [ 0.206415] NET: Registered protocol family 1 [ 0.206530] Unpacking initramfs... [ 0.586747] Freeing initrd memory: 16900k freed [ 0.592244] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer [ 0.592262] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules [ 0.592269] RAPL PMU: hw unit of domain package 2^-16 Joules [ 0.592275] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 0.592423] platform rtc_cmos: registered platform RTC device (no PNP device found) [ 0.594065] sha1_ssse3: Using AVX optimized SHA-1 implementation [ 0.594310] sha256_ssse3: Using AVX optimized SHA-256 implementation [ 0.595043] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 0.595075] Initialise system trusted keyring [ 0.595117] audit: initializing netlink socket (disabled) [ 0.595156] type=2000 audit(1515443217.801:1): initialized [ 0.620696] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 0.621772] zpool: loaded [ 0.621785] zbud: loaded [ 0.621995] VFS: Disk quotas dquot_6.5.2 [ 0.622063] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.622291] msgmni has been set to 7996 [ 0.622380] Key type big_key registered [ 0.623722] NET: Registered protocol family 38 [ 0.623739] Key type asymmetric registered [ 0.623750] Asymmetric key parser 'x509' registered [ 0.623802] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 0.623881] io scheduler noop registered [ 0.623893] io scheduler deadline registered (default) [ 0.623959] io scheduler cfq registered [ 0.624098] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 0.624115] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 0.624923] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 0.625877] Non-volatile memory driver v1.3 [ 0.625979] Linux agpgart interface v0.103 [ 0.626195] crash memory driver: version 1.1 [ 0.626308] rdac: device handler registered [ 0.626459] hp_sw: device handler registered [ 0.626475] emc: device handler registered [ 0.626486] alua: device handler registered [ 0.626558] libphy: Fixed MDIO Bus: probed [ 0.626669] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 0.626690] ehci-pci: EHCI PCI platform driver [ 0.626714] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 0.626731] ohci-pci: OHCI PCI platform driver [ 0.626753] uhci_hcd: USB Universal Host Controller Interface driver [ 0.626845] usbcore: registered new interface driver usbserial [ 0.626866] usbcore: registered new interface driver usbserial_generic [ 0.626886] usbserial: USB Serial support registered for generic [ 0.626930] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 1.644938] i8042: No controller found [ 1.645173] mousedev: PS/2 mouse device common for all mice [ 1.705613] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0 [ 1.705744] rtc_cmos: probe of rtc_cmos failed with error -38 [ 1.705823] dmi-sysfs: dmi entry is absent. [ 1.705849] hidraw: raw HID events driver (C) Jiri Kosina [ 1.705993] usbcore: registered new interface driver usbhid [ 1.706020] usbhid: USB HID core driver [ 1.706055] drop_monitor: Initializing network drop monitor service [ 1.706132] TCP: cubic registered [ 1.706142] Initializing XFRM netlink socket [ 1.706246] NET: Registered protocol family 10 [ 1.706578] NET: Registered protocol family 17 [ 1.706803] microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x710 [ 1.706837] microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x710 [ 1.706858] microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x710 [ 1.706884] microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x710 [ 1.707034] microcode: Microcode Update Driver: v2.01 < tigran@aivazian.fsnet.co.uk>, Peter Oruba [ 1.707334] Loading compiled-in X.509 certificates [ 1.707368] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' [ 1.707391] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' [ 1.707980] Loaded X.509 cert 'CentOS Linux kernel signing key: 2bade9ee54e382c6692955a95011589b663d6aef' [ 1.708025] registered taskstats version 1 [ 1.710526] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: ffffffff816bc62d [ 1.710526] [ 1.710543] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 3.10.0-693.11.6.el7.centos.plus.x86_64 #1 [ 1.710551] Call Trace: [ 1.710561] [<ffffffff816b6e74>] dump_stack+0x19/0x1b [ 1.710569] [<ffffffff816b0d37>] panic+0xe8/0x20d [ 1.710576] [<ffffffff816bc62d>] ? __schedule+0x95d/0x9b0 [ 1.710584] [<ffffffff810ca4d0>] ? switched_to_idle+0x10/0x10 [ 1.710590] [<ffffffff810891bb>] __stack_chk_fail+0x1b/0x20 [ 1.710596] [<ffffffff816bc62d>] __schedule+0x95d/0x9b0 [ 1.710603] [<ffffffff816c4801>] ? __do_page_fault+0x171/0x450 [ 1.710611] [<ffffffff816c4b15>] ? do_page_fault+0x35/0x90 [ 1.710617] [<ffffffff816c08f8>] ? page_fault+0x28/0x30 [ 1.710623] [<ffffffff816c0dda>] ? error_exit+0x2a/0x60 [ 1.710630] [<ffffffff816c053a>] ? retint_swapgs+0x5/0x6