<div dir="ltr"><div><font face="monospace">Hello,</font></div><div><font face="monospace"><br></font></div><font face="monospace">1. &lt;domain type=&#39;kvm&#39; id=&#39;6&#39;&gt;</font><div><font face="monospace">  &lt;name&gt;baremetalbrbm_1&lt;/name&gt;</font></div><div><font face="monospace">  &lt;uuid&gt;534e9b54-5e4c-4acb-adcf-793f841551a7&lt;/uuid&gt;</font></div><div><font face="monospace">  &lt;memory unit=&#39;KiB&#39;&gt;104857600&lt;/memory&gt;</font></div><div><font face="monospace">  &lt;currentMemory unit=&#39;KiB&#39;&gt;104857600&lt;/currentMemory&gt;</font></div><div><font face="monospace">  &lt;vcpu placement=&#39;static&#39;&gt;36&lt;/vcpu&gt;</font></div><div><font face="monospace">  &lt;resource&gt;</font></div><div><font face="monospace">    &lt;partition&gt;/machine&lt;/partition&gt;</font></div><div><font face="monospace">  &lt;/resource&gt;</font></div><div><font face="monospace">  &lt;os&gt;</font></div><div><font face="monospace">    &lt;type arch=&#39;x86_64&#39; machine=&#39;pc-i440fx-rhel7.0.0&#39;&gt;hvm&lt;/type&gt;</font></div><div><font face="monospace">    &lt;boot dev=&#39;hd&#39;/&gt;</font></div><div><font face="monospace">    &lt;bootmenu enable=&#39;no&#39;/&gt;</font></div><div><font face="monospace">  &lt;/os&gt;</font></div><div><font face="monospace">  &lt;features&gt;</font></div><div><font face="monospace">    &lt;acpi/&gt;</font></div><div><font face="monospace">    &lt;apic/&gt;</font></div><div><font face="monospace">    &lt;pae/&gt;</font></div><div><font face="monospace">  &lt;/features&gt;</font></div><div><font face="monospace">  &lt;cpu mode=&#39;host-passthrough&#39;/&gt;</font></div><div><font face="monospace">  &lt;clock offset=&#39;utc&#39;/&gt;</font></div><div><font face="monospace">  &lt;on_poweroff&gt;destroy&lt;/on_poweroff&gt;</font></div><div><font face="monospace">  &lt;on_reboot&gt;restart&lt;/on_reboot&gt;</font></div><div><font face="monospace">  &lt;on_crash&gt;restart&lt;/on_crash&gt;</font></div><div><font face="monospace">  &lt;devices&gt;</font></div><div><font face="monospace">    &lt;emulator&gt;/usr/libexec/qemu-kvm&lt;/emulator&gt;</font></div><div><font face="monospace">    &lt;disk type=&#39;file&#39; device=&#39;disk&#39;&gt;</font></div><div><font face="monospace">      &lt;driver name=&#39;qemu&#39; type=&#39;qcow2&#39; cache=&#39;unsafe&#39;/&gt;</font></div><div><font face="monospace">      &lt;source file=&#39;/var/lib/libvirt/images/baremetalbrbm_1.qcow2&#39;/&gt;</font></div><div><font face="monospace">      &lt;backingStore/&gt;</font></div><div><font face="monospace">      &lt;target dev=&#39;sda&#39; bus=&#39;sata&#39;/&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;sata0-0-0&#39;/&gt;</font></div><div><font face="monospace">      &lt;address type=&#39;drive&#39; controller=&#39;0&#39; bus=&#39;0&#39; target=&#39;0&#39; unit=&#39;0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/disk&gt;</font></div><div><font face="monospace">    &lt;controller type=&#39;scsi&#39; index=&#39;0&#39; model=&#39;virtio-scsi&#39;&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;scsi0&#39;/&gt;</font></div><div><font face="monospace">      &lt;address type=&#39;pci&#39; domain=&#39;0x0000&#39; bus=&#39;0x00&#39; slot=&#39;0x04&#39; function=&#39;0x0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/controller&gt;</font></div><div><font face="monospace">    &lt;controller type=&#39;usb&#39; index=&#39;0&#39;&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;usb&#39;/&gt;</font></div><div><font face="monospace">      &lt;address type=&#39;pci&#39; domain=&#39;0x0000&#39; bus=&#39;0x00&#39; slot=&#39;0x01&#39; function=&#39;0x2&#39;/&gt;</font></div><div><font face="monospace">    &lt;/controller&gt;</font></div><div><font face="monospace">    &lt;controller type=&#39;pci&#39; index=&#39;0&#39; model=&#39;pci-root&#39;&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;pci.0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/controller&gt;</font></div><div><font face="monospace">    &lt;controller type=&#39;sata&#39; index=&#39;0&#39;&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;sata0&#39;/&gt;</font></div><div><font face="monospace">      &lt;address type=&#39;pci&#39; domain=&#39;0x0000&#39; bus=&#39;0x00&#39; slot=&#39;0x05&#39; function=&#39;0x0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/controller&gt;</font></div><div><font face="monospace">    &lt;interface type=&#39;bridge&#39;&gt;</font></div><div><font face="monospace">      &lt;mac address=&#39;00:f1:15:20:c5:46&#39;/&gt;</font></div><div><font face="monospace">      &lt;source network=&#39;brbm&#39; bridge=&#39;brbm&#39;/&gt;</font></div><div><font face="monospace">      &lt;virtualport type=&#39;openvswitch&#39;&gt;</font></div><div><font face="monospace">        &lt;parameters interfaceid=&#39;654ad04f-fa0a-41dd-9d30-b84e702462fe&#39;/&gt;</font></div><div><font face="monospace">      &lt;/virtualport&gt;</font></div><div><font face="monospace">      &lt;target dev=&#39;vnet5&#39;/&gt;</font></div><div><font face="monospace">      &lt;model type=&#39;virtio&#39;/&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;net0&#39;/&gt;</font></div><div><font face="monospace">      &lt;address type=&#39;pci&#39; domain=&#39;0x0000&#39; bus=&#39;0x00&#39; slot=&#39;0x03&#39; function=&#39;0x0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/interface&gt;</font></div><div><font face="monospace">    &lt;interface type=&#39;bridge&#39;&gt;</font></div><div><font face="monospace">      &lt;mac address=&#39;52:54:00:d3:c9:24&#39;/&gt;</font></div><div><font face="monospace">      &lt;source bridge=&#39;br57&#39;/&gt;</font></div><div><font face="monospace">      &lt;target dev=&#39;vnet6&#39;/&gt;</font></div><div><font face="monospace">      &lt;model type=&#39;rtl8139&#39;/&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;net1&#39;/&gt;</font></div><div><font face="monospace">      &lt;address type=&#39;pci&#39; domain=&#39;0x0000&#39; bus=&#39;0x00&#39; slot=&#39;0x07&#39; function=&#39;0x0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/interface&gt;</font></div><div><font face="monospace">    &lt;serial type=&#39;pty&#39;&gt;</font></div><div><font face="monospace">      &lt;source path=&#39;/dev/pts/3&#39;/&gt;</font></div><div><font face="monospace">      &lt;target port=&#39;0&#39;/&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;serial0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/serial&gt;</font></div><div><font face="monospace">    &lt;console type=&#39;pty&#39; tty=&#39;/dev/pts/3&#39;&gt;</font></div><div><font face="monospace">      &lt;source path=&#39;/dev/pts/3&#39;/&gt;</font></div><div><font face="monospace">      &lt;target type=&#39;serial&#39; port=&#39;0&#39;/&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;serial0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/console&gt;</font></div><div><font face="monospace">    &lt;input type=&#39;mouse&#39; bus=&#39;ps2&#39;/&gt;</font></div><div><font face="monospace">    &lt;input type=&#39;keyboard&#39; bus=&#39;ps2&#39;/&gt;</font></div><div><font face="monospace">    &lt;graphics type=&#39;vnc&#39; port=&#39;5903&#39; autoport=&#39;yes&#39; listen=&#39;127.0.0.1&#39;&gt;</font></div><div><font face="monospace">      &lt;listen type=&#39;address&#39; address=&#39;127.0.0.1&#39;/&gt;</font></div><div><font face="monospace">    &lt;/graphics&gt;</font></div><div><font face="monospace">    &lt;video&gt;</font></div><div><font face="monospace">      &lt;model type=&#39;cirrus&#39; vram=&#39;16384&#39; heads=&#39;1&#39;/&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;video0&#39;/&gt;</font></div><div><font face="monospace">      &lt;address type=&#39;pci&#39; domain=&#39;0x0000&#39; bus=&#39;0x00&#39; slot=&#39;0x02&#39; function=&#39;0x0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/video&gt;</font></div><div><font face="monospace">    &lt;memballoon model=&#39;virtio&#39;&gt;</font></div><div><font face="monospace">      &lt;alias name=&#39;balloon0&#39;/&gt;</font></div><div><font face="monospace">      &lt;address type=&#39;pci&#39; domain=&#39;0x0000&#39; bus=&#39;0x00&#39; slot=&#39;0x06&#39; function=&#39;0x0&#39;/&gt;</font></div><div><font face="monospace">    &lt;/memballoon&gt;</font></div><div><font face="monospace">  &lt;/devices&gt;</font></div><div><font face="monospace">&lt;/domain&gt;</font></div><div><font face="monospace"><br></font></div><font face="monospace">2. </font><div><div><font face="monospace">[root@overcloud-novacompute-0 ~]# lsmod | grep kvm</font></div><div><font face="monospace">kvm_intel             162153  70</font></div><div><font face="monospace">kvm                   525409  1 kvm_intel</font></div><div><font face="monospace"><br></font></div><div><div><font face="monospace">[root@overcloud-novacompute-0 ~]# cat /etc/nova/nova.conf | grep virt_type|grep -v &#39;^#&#39;</font></div><div><font face="monospace">virt_type=kvm</font></div></div><div><font face="monospace"><br></font></div><div><div><font face="monospace">[root@overcloud-novacompute-0 ~]#  cat /etc/nova/nova.conf | grep  cpu_mode|grep -v &#39;^#&#39;</font></div><div><font face="monospace">cpu_mode=host-passthrough</font></div></div><div><br></div><div>Thanks,</div><div>Laurentiu</div><div><br></div><div class="gmail_quote"><div dir="ltr">În dum., 14 aug. 2016 la 21:44, Boris Derzhavets &lt;<a href="mailto:bderzhavets@hotmail.com" target="_blank">bderzhavets@hotmail.com</a>&gt; a scris:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">




<div dir="ltr">
<div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif">
<p><br>
</p>
<br>
<br>
<div style="color:rgb(0,0,0)">
<hr style="display:inline-block;width:98%">
<div dir="ltr"><font style="font-size:11pt" color="#000000" face="Calibri, sans-serif"><b>From:</b> <a href="mailto:centos-virt-bounces@centos.org" target="_blank">centos-virt-bounces@centos.org</a> &lt;<a href="mailto:centos-virt-bounces@centos.org" target="_blank">centos-virt-bounces@centos.org</a>&gt; on behalf of Laurentiu Soica &lt;<a href="mailto:laurentiu@soica.ro" target="_blank">laurentiu@soica.ro</a>&gt;<br>
<b>Sent:</b> Sunday, August 14, 2016 10:17 AM<br>
<b>To:</b> Discussion about the virtualization on CentOS<br>
<b>Subject:</b> Re: [CentOS-virt] Nested KVM issue</font>
<div> </div>
</div>
<div>
<div dir="ltr"></div></div></div></div></div><div dir="ltr"><div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif"><div style="color:rgb(0,0,0)"><div><div dir="ltr">More details on the subject:
<div><br>
</div>
<div>I suppose it is a nested KVM issue because it raised after I enabled the nested KVM feature. Without it, anyway, the second level VMs are unusable in terms of performance.</div>
<div><br>
</div>
<div>I am using CentOS 7 with:</div>
<div><br>
</div>
<div>kernel: 3.10.0-327.22.2.el7.x86_64</div>
<div>qemu-kvm:1.5.3-105.el7_2.4</div>
<div>libvirt:1.2.17-13.el7_2.5</div>
<div><br>
</div>
</div></div></div></div></div><div dir="ltr"><div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif"><div style="color:rgb(0,0,0)"><div><div dir="ltr"><div>on both the baremetal and the compute VM.<br>
<br>
</div></div></div></div></div></div><div dir="ltr"><div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif"><div style="color:rgb(0,0,0)"><div><div dir="ltr"><div><b>Please, post</b><br>
<br>
1) # virsh dumpxml  VM-L1  ( where on L1 level you expect nested KVM to appear)<br>
2) Login into VM-L1 and run :-<br>
    # lsmod | grep kvm<br>
3) I need outputs from VM-L1 ( in case it is Compute Node )<br>
<br>
# cat /etc/nova/nova.conf | grep virt_type<br>
# <span>cat /etc/nova/nova.conf | grep  cpu_mode</span><br>
<br>
Boris.<br>
<br>
<br>
   <br>
<br>
</div></div></div></div></div></div><div dir="ltr"><div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif"><div style="color:rgb(0,0,0)"><div><div dir="ltr">
<div><br>
</div>
<div>The only workaround now is to shutdown the compute VM and start it back from baremetal with virsh start.</div>
<div>A simple restart of the compute node doesn&#39;t help. It looks like the qemu-kvm process corresponding to the compute VM is the problem.</div>
<div><br>
</div>
<div>Laurentiu</div>
</div></div></div></div></div><div dir="ltr"><div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif"><div style="color:rgb(0,0,0)"><div>
<br>
<div class="gmail_quote">
<div dir="ltr">În dum., 14 aug. 2016 la 00:19, Laurentiu Soica &lt;<a href="mailto:laurentiu@soica.ro" target="_blank">laurentiu@soica.ro</a>&gt; a scris:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hello,
<div><br>
</div>
<div>I have an OpenStack setup in virtual environment on CentOS 7.</div>
<div><br>
</div>
<div>The baremetal has <b>nested KVM</b> enabled and 1 compute node as a VM.</div>
<div><br>
</div>
<div>Inside the compute node I have multiple VMs running.</div>
<div><br>
</div>
<div>After about every 3 days the VMs get inaccessible and the compute node reports high CPU usage. The qemu-kvm process for each VM inside the compute node reports full CPU usage.</div>
<div><br>
</div>
<div>Please help me with some hints to debug this issue.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Laurentiu</div>
</div>
</blockquote>
</div>
</div></div></div></div><div dir="ltr"><div style="font-size:12pt;color:#000000;background-color:#ffffff;font-family:Calibri,Arial,Helvetica,sans-serif"><div style="color:rgb(0,0,0)"><div></div>
</div>
</div>
</div>

_______________________________________________<br>
CentOS-virt mailing list<br>
<a href="mailto:CentOS-virt@centos.org" target="_blank">CentOS-virt@centos.org</a><br>
<a href="https://lists.centos.org/mailman/listinfo/centos-virt" rel="noreferrer" target="_blank">https://lists.centos.org/mailman/listinfo/centos-virt</a><br>
</blockquote></div></div></div>