[CentOS] xen - 4 concurrent virtual DomU limitation - how to increae this? (centos 5 x86_64)

Urs Rau urs.rau at uk.om.org
Fri Jun 1 21:01:35 UTC 2007


Johnny,

Johnny Tan wrote:
> Urs Rau wrote:
>> Is there a switch or config setting somewhere that would allow me to
>> start up more than the default 4 xen DomU instances?
>>
>> I am finding that the CentOS 5 (x86_64) installation only allows me to
>> start up 4 virtual machines at a time. (It is definetly not a lack of
>> cpu resources, memory or disk space.)
> 
> According to this page:
> http://www.howtoforge.com/perfect_setup_xen3_debian_p5
> 
> You need to add max_loop=N (where N is the number of virtual machines
> you want x 2) to your module line in grub.conf
> 
> But, oddly, I'm using CentOS-5 x86_64, and I have dom0 plus five virtual
> machines running, and I did not change any setting, config file, and I
> don't have max_loop in my grub.conf -- it's just a default install & setup.
> 
> johnn

Thanks, I tried this, but no change. I think this was/is possibly just
related to the limit of number of loopback interfaces the standard
kernel has. And how to increase this. But for me it has no effect on the
number of DomU I can run. I only manage Dom0 + 4 after that it just
hangs on a xm create and when I hit Ctrl-c it comes back with the error
Error: Device creation failed for domain test5.

If I let it try starting the domain for about 1 - 2 minutes it
eventually returns a:

Error: destroyDevice() takes exactly 3 arguments (2 given)

I am attaching my xend.log file for the failed "xm create test5" DomU


My test1 - test5 config files all look as follows:

> # Automatically generated xen config file
> name = "test1"
> builder = "hvm"
> memory = "512"
> boot = "d"
> disk = [ 'file:/xen_dat/test1/test1.img,hda,w', 'file:/xen_img/knoppix/knoppix.iso,ioemu:hdc:cdrom,r' ]
> vif = [ 'type=ioemu, mac=00:16:3e:6f:3e:0d, bridge=xenbr0', ]
> uuid = "2a4d08bd-e7b7-1010-0656-8eb74b692164"
> device_model = "/usr/lib64/xen/bin/qemu-dm"
> kernel = "/usr/lib/xen/boot/hvmloader"
> vnc=1
> vncunused=1
> apic=1
> acpi=1
> pae=1
> vcpus=2
> serial = "pty" # enable serial console
> on_reboot   = 'restart'
> on_crash    = 'restart'


-- 
Urs Rau						

-------------- next part --------------
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:190) XendDomainInfo.create(['vm', ['name', 'test5'], ['memory', '512'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['vcpus', 2], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]]], ['device', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]], ['device', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]], ['device', ['vkbd']], ['device', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']]]])
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:296) parseConfig: config is ['vm', ['name', 'test5'], ['memory', '512'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['vcpus', 2], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]]], ['device', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]], ['device', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]], ['device', ['vkbd']], ['device', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']]]]
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:397) parseConfig: result is {'shadow_memory': None, 'start_time': None, 'uuid': None, 'on_crash': 'restart', 'on_reboot': 'restart', 'localtime': None, 'image': ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]], 'on_poweroff': None, 'bootloader_args': None, 'cpus': None, 'name': 'test5', 'backend': [], 'vcpus': 2, 'cpu_weight': None, 'features': None, 'vcpu_avail': None, 'memory': 512, 'device': [('vbd', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]), ('vbd', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]), ('vif', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]), ('vkbd', ['vkbd']), ('vfb', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']])], 'bootloader': None, 'cpu': None, 'maxmem': None}
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1264) XendDomainInfo.construct: None
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1296) XendDomainInfo.initDomain: 9 1.0
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: boot, val: d
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: fda, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: fdb, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: soundhw, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: localtime, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: serial, val: pty
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: std-vga, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: isa, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: vcpus, val: 2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: acpi, val: 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: usb, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: usbdevice, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: k, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (balloon:127) Balloon: 543880 KiB free; need 542928; done.
[2007-06-01 21:46:42 xend 2871] INFO (image:136) buildDomain os=hvm dom=9 vcpus=2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:282) dom            = 9
[2007-06-01 21:46:42 xend 2871] DEBUG (image:283) image          = /usr/lib/xen/boot/hvmloader
[2007-06-01 21:46:42 xend 2871] DEBUG (image:284) store_evtchn   = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:285) memsize        = 512
[2007-06-01 21:46:42 xend 2871] DEBUG (image:286) vcpus          = 2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:287) pae            = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:288) acpi           = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:289) apic           = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:435) hvm shutdown watch registered
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'virtual-device': '768', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/9/768'} to /local/domain/9/device/vbd/768.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'domain': 'test5', 'frontend': '/local/domain/9/device/vbd/768', 'dev': 'hda', 'state': '1', 'params': '/xen_dat/test5/test5.img', 'mode': 'w', 'online': '1', 'frontend-id': '9', 'type': 'file'} to /local/domain/0/backend/vbd/9/768.
[2007-06-01 21:46:42 xend 2871] DEBUG (blkif:24) exception looking up device number for hdc: [Errno 2] No such file or directory: '/dev/hdc'
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'virtual-device': '5632', 'device-type': 'cdrom', 'state': '1', 'backend': '/local/domain/0/backend/vbd/9/5632'} to /local/domain/9/device/vbd/5632.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'domain': 'test5', 'frontend': '/local/domain/9/device/vbd/5632', 'dev': 'hdc', 'state': '1', 'params': '/xen_img/knoppix/knoppix.iso', 'mode': 'r', 'online': '1', 'frontend-id': '9', 'type': 'file'} to /local/domain/0/backend/vbd/9/5632.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vif/9/0'} to /local/domain/9/device/vif/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'bridge': 'xenbr0', 'domain': 'test5', 'handle': '0', 'script': '/etc/xen/scripts/vif-bridge', 'state': '1', 'frontend': '/local/domain/9/device/vif/0', 'mac': '00:16:3e:63:71:49', 'online': '1', 'frontend-id': '9', 'type': 'ioemu'} to /local/domain/0/backend/vif/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vkbd/9/0'} to /local/domain/9/device/vkbd/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'frontend-id': '9', 'domain': 'test5', 'frontend': '/local/domain/9/device/vkbd/0', 'state': '1', 'online': '1'} to /local/domain/0/backend/vkbd/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/9/0'} to /local/domain/9/device/vfb/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'vncunused': '1', 'domain': 'test5', 'frontend': '/local/domain/9/device/vfb/0', 'xauthority': '/root/.Xauthority', 'state': '1', 'online': '1', 'frontend-id': '9', 'type': 'vnc'} to /local/domain/0/backend/vfb/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (vfbif:92) No VNC passwd configured for vfb access
[2007-06-01 21:46:42 xend 2871] INFO (image:418) spawning device models: /usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '9', '-m', '512', '-boot', 'd', '-serial', 'pty', '-vcpus', '2', '-acpi', '-domain-name', 'test5', '-net', 'nic,vlan=1,macaddr=00:16:3e:31:10:c3,model=rtl8139', '-net', 'tap,vlan=1,bridge=xenbr0', '-vncunused', '-vnclisten', '127.0.0.1']
[2007-06-01 21:46:42 xend 2871] INFO (image:420) device model pid: 14751
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:715) Storing VM details: {'shadow_memory': '5', 'uuid': 'bc3b1112-6dd5-befc-8c33-b7e29f7e191c', 'on_reboot': 'restart', 'start_time': '1180730802.57', 'on_poweroff': 'destroy', 'name': 'test5', 'xend/restart_count': '0', 'vcpus': '2', 'vcpu_avail': '3', 'memory': '512', 'on_crash': 'restart', 'image': "(hvm (kernel /usr/lib/xen/boot/hvmloader) (device_model /usr/lib64/xen/bin/qemu-dm) (pae 1) (vcpus 2) (boot d) (serial pty) (vnc 1) (vncunused 1) (xauthority /root/.Xauthority) (acpi 1) (apic 1) (vncpasswd 'None'))", 'maxmem': '512'}
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:750) Storing domain details: {'console/port': '2', 'name': 'test5', 'console/limit': '1048576', 'vm': '/vm/bc3b1112-6dd5-befc-8c33-b7e29f7e191c', 'domid': '9', 'cpu/0/availability': 'online', 'memory/target': '524288', 'store/ring-ref': '1527046', 'cpu/1/availability': 'online', 'store/port': '1'}
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices vif.
[2007-06-01 21:46:42 xend 2871] DEBUG (image:458) hvm_shutdown fired, shutdown reason=None
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:940) XendDomainInfo.handleShutdownWatch
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:149) Waiting for 0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vif/9/0/hotplug-status.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vif/9/0/hotplug-status.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:485) hotplugStatusCallback 1.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices usb.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices vbd.
[2007-06-01 21:46:43 xend 2871] DEBUG (DevController:149) Waiting for 768.
[2007-06-01 21:46:43 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vbd/9/768/hotplug-status.
[2007-06-01 21:48:17 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vbd/9/768/hotplug-status.
[2007-06-01 21:48:17 xend 2871] DEBUG (DevController:485) hotplugStatusCallback 2.
[2007-06-01 21:48:17 xend 2871] ERROR (xmlrpclib2:184) destroyDevice() takes exactly 3 arguments (2 given)
Traceback (most recent call last):
  File "/usr/lib64/python2.4/site-packages/xen/util/xmlrpclib2.py", line 162, in _marshaled_dispatch
    response = self._dispatch(method, params)
  File "/usr/lib64/python2.4/SimpleXMLRPCServer.py", line 406, in _dispatch
    return func(*params)
  File "<string>", line 1, in <lambda>
  File "/usr/lib64/python2.4/site-packages/xen/xend/server/XMLRPCServer.py", line 38, in dispatch
    return getattr(info, fn)(*args)
  File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", line 1610, in waitForDevices
    self.waitForDevices_(c)
  File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", line 1101, in waitForDevices_
    return self.getDeviceController(deviceClass).waitForDevices()
  File "/usr/lib64/python2.4/site-packages/xen/xend/server/DevController.py", line 145, in waitForDevices
    return map(self.waitForDevice, self.deviceIDs())
  File "/usr/lib64/python2.4/site-packages/xen/xend/server/DevController.py", line 160, in waitForDevice
    self.destroyDevice(devid)
TypeError: destroyDevice() takes exactly 3 arguments (2 given)
[2007-06-01 21:48:17 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1463) XendDomainInfo.destroy: domid=9
[2007-06-01 21:48:17 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1471) XendDomainInfo.destroyDomain(9)
[2007-06-01 21:48:17 xend 2871] DEBUG (image:447) hvm shutdown watch unregistered


More information about the CentOS mailing list