1 Jun
2007
1 Jun
'07
9:01 p.m.
Johnny,
Johnny Tan wrote:
Urs Rau wrote:
Is there a switch or config setting somewhere that would allow me to start up more than the default 4 xen DomU instances?
I am finding that the CentOS 5 (x86_64) installation only allows me to start up 4 virtual machines at a time. (It is definetly not a lack of cpu resources, memory or disk space.)
According to this page: http://www.howtoforge.com/perfect_setup_xen3_debian_p5
You need to add max_loop=N (where N is the number of virtual machines you want x 2) to your module line in grub.conf
But, oddly, I'm using CentOS-5 x86_64, and I have dom0 plus five virtual machines running, and I did not change any setting, config file, and I don't have max_loop in my grub.conf -- it's just a default install & setup.
johnn
Thanks, I tried this, but no change. I think this was/is possibly just related to the limit of number of loopback interfaces the standard kernel has. And how to increase this. But for me it has no effect on the number of DomU I can run. I only manage Dom0 + 4 after that it just hangs on a xm create and when I hit Ctrl-c it comes back with the error Error: Device creation failed for domain test5.
If I let it try starting the domain for about 1 - 2 minutes it eventually returns a:
Error: destroyDevice() takes exactly 3 arguments (2 given)
I am attaching my xend.log file for the failed "xm create test5" DomU
My test1 - test5 config files all look as follows:
# Automatically generated xen config file name = "test1" builder = "hvm" memory = "512" boot = "d" disk = [ 'file:/xen_dat/test1/test1.img,hda,w', 'file:/xen_img/knoppix/knoppix.iso,ioemu:hdc:cdrom,r' ] vif = [ 'type=ioemu, mac=00:16:3e:6f:3e:0d, bridge=xenbr0', ] uuid = "2a4d08bd-e7b7-1010-0656-8eb74b692164" device_model = "/usr/lib64/xen/bin/qemu-dm" kernel = "/usr/lib/xen/boot/hvmloader" vnc=1 vncunused=1 apic=1 acpi=1 pae=1 vcpus=2 serial = "pty" # enable serial console on_reboot = 'restart' on_crash = 'restart'
--
Urs Rau
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:190) XendDomainInfo.create(['vm', ['name', 'test5'], ['memory', '512'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['vcpus', 2], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]]], ['device', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]], ['device', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]], ['device', ['vkbd']], ['device', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']]]])
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:296) parseConfig: config is ['vm', ['name', 'test5'], ['memory', '512'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['vcpus', 2], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]]], ['device', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]], ['device', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]], ['device', ['vkbd']], ['device', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']]]]
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:397) parseConfig: result is {'shadow_memory': None, 'start_time': None, 'uuid': None, 'on_crash': 'restart', 'on_reboot': 'restart', 'localtime': None, 'image': ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]], 'on_poweroff': None, 'bootloader_args': None, 'cpus': None, 'name': 'test5', 'backend': [], 'vcpus': 2, 'cpu_weight': None, 'features': None, 'vcpu_avail': None, 'memory': 512, 'device': [('vbd', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]), ('vbd', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]), ('vif', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]), ('vkbd', ['vkbd']), ('vfb', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']])], 'bootloader': None, 'cpu': None, 'maxmem': None}
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1264) XendDomainInfo.construct: None
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1296) XendDomainInfo.initDomain: 9 1.0
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: boot, val: d
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: fda, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: fdb, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: soundhw, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: localtime, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: serial, val: pty
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: std-vga, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: isa, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: vcpus, val: 2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: acpi, val: 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: usb, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: usbdevice, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: k, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (balloon:127) Balloon: 543880 KiB free; need 542928; done.
[2007-06-01 21:46:42 xend 2871] INFO (image:136) buildDomain os=hvm dom=9 vcpus=2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:282) dom = 9
[2007-06-01 21:46:42 xend 2871] DEBUG (image:283) image = /usr/lib/xen/boot/hvmloader
[2007-06-01 21:46:42 xend 2871] DEBUG (image:284) store_evtchn = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:285) memsize = 512
[2007-06-01 21:46:42 xend 2871] DEBUG (image:286) vcpus = 2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:287) pae = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:288) acpi = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:289) apic = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:435) hvm shutdown watch registered
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'virtual-device': '768', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/9/768'} to /local/domain/9/device/vbd/768.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'domain': 'test5', 'frontend': '/local/domain/9/device/vbd/768', 'dev': 'hda', 'state': '1', 'params': '/xen_dat/test5/test5.img', 'mode': 'w', 'online': '1', 'frontend-id': '9', 'type': 'file'} to /local/domain/0/backend/vbd/9/768.
[2007-06-01 21:46:42 xend 2871] DEBUG (blkif:24) exception looking up device number for hdc: [Errno 2] No such file or directory: '/dev/hdc'
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'virtual-device': '5632', 'device-type': 'cdrom', 'state': '1', 'backend': '/local/domain/0/backend/vbd/9/5632'} to /local/domain/9/device/vbd/5632.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'domain': 'test5', 'frontend': '/local/domain/9/device/vbd/5632', 'dev': 'hdc', 'state': '1', 'params': '/xen_img/knoppix/knoppix.iso', 'mode': 'r', 'online': '1', 'frontend-id': '9', 'type': 'file'} to /local/domain/0/backend/vbd/9/5632.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vif/9/0'} to /local/domain/9/device/vif/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'bridge': 'xenbr0', 'domain': 'test5', 'handle': '0', 'script': '/etc/xen/scripts/vif-bridge', 'state': '1', 'frontend': '/local/domain/9/device/vif/0', 'mac': '00:16:3e:63:71:49', 'online': '1', 'frontend-id': '9', 'type': 'ioemu'} to /local/domain/0/backend/vif/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vkbd/9/0'} to /local/domain/9/device/vkbd/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'frontend-id': '9', 'domain': 'test5', 'frontend': '/local/domain/9/device/vkbd/0', 'state': '1', 'online': '1'} to /local/domain/0/backend/vkbd/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/9/0'} to /local/domain/9/device/vfb/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'vncunused': '1', 'domain': 'test5', 'frontend': '/local/domain/9/device/vfb/0', 'xauthority': '/root/.Xauthority', 'state': '1', 'online': '1', 'frontend-id': '9', 'type': 'vnc'} to /local/domain/0/backend/vfb/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (vfbif:92) No VNC passwd configured for vfb access
[2007-06-01 21:46:42 xend 2871] INFO (image:418) spawning device models: /usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '9', '-m', '512', '-boot', 'd', '-serial', 'pty', '-vcpus', '2', '-acpi', '-domain-name', 'test5', '-net', 'nic,vlan=1,macaddr=00:16:3e:31:10:c3,model=rtl8139', '-net', 'tap,vlan=1,bridge=xenbr0', '-vncunused', '-vnclisten', '127.0.0.1']
[2007-06-01 21:46:42 xend 2871] INFO (image:420) device model pid: 14751
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:715) Storing VM details: {'shadow_memory': '5', 'uuid': 'bc3b1112-6dd5-befc-8c33-b7e29f7e191c', 'on_reboot': 'restart', 'start_time': '1180730802.57', 'on_poweroff': 'destroy', 'name': 'test5', 'xend/restart_count': '0', 'vcpus': '2', 'vcpu_avail': '3', 'memory': '512', 'on_crash': 'restart', 'image': "(hvm (kernel /usr/lib/xen/boot/hvmloader) (device_model /usr/lib64/xen/bin/qemu-dm) (pae 1) (vcpus 2) (boot d) (serial pty) (vnc 1) (vncunused 1) (xauthority /root/.Xauthority) (acpi 1) (apic 1) (vncpasswd 'None'))", 'maxmem': '512'}
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:750) Storing domain details: {'console/port': '2', 'name': 'test5', 'console/limit': '1048576', 'vm': '/vm/bc3b1112-6dd5-befc-8c33-b7e29f7e191c', 'domid': '9', 'cpu/0/availability': 'online', 'memory/target': '524288', 'store/ring-ref': '1527046', 'cpu/1/availability': 'online', 'store/port': '1'}
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices vif.
[2007-06-01 21:46:42 xend 2871] DEBUG (image:458) hvm_shutdown fired, shutdown reason=None
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:940) XendDomainInfo.handleShutdownWatch
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:149) Waiting for 0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vif/9/0/hotplug-status.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vif/9/0/hotplug-status.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:485) hotplugStatusCallback 1.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices usb.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices vbd.
[2007-06-01 21:46:43 xend 2871] DEBUG (DevController:149) Waiting for 768.
[2007-06-01 21:46:43 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vbd/9/768/hotplug-status.
[2007-06-01 21:48:17 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vbd/9/768/hotplug-status.
[2007-06-01 21:48:17 xend 2871] DEBUG (DevController:485) hotplugStatusCallback 2.
[2007-06-01 21:48:17 xend 2871] ERROR (xmlrpclib2:184) destroyDevice() takes exactly 3 arguments (2 given)
Traceback (most recent call last):
File "/usr/lib64/python2.4/site-packages/xen/util/xmlrpclib2.py", line 162, in _marshaled_dispatch
response = self._dispatch(method, params)
File "/usr/lib64/python2.4/SimpleXMLRPCServer.py", line 406, in _dispatch
return func(*params)
File "<string>", line 1, in <lambda>
File "/usr/lib64/python2.4/site-packages/xen/xend/server/XMLRPCServer.py", line 38, in dispatch
return getattr(info, fn)(*args)
File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", line 1610, in waitForDevices
self.waitForDevices_(c)
File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", line 1101, in waitForDevices_
return self.getDeviceController(deviceClass).waitForDevices()
File "/usr/lib64/python2.4/site-packages/xen/xend/server/DevController.py", line 145, in waitForDevices
return map(self.waitForDevice, self.deviceIDs())
File "/usr/lib64/python2.4/site-packages/xen/xend/server/DevController.py", line 160, in waitForDevice
self.destroyDevice(devid)
TypeError: destroyDevice() takes exactly 3 arguments (2 given)
[2007-06-01 21:48:17 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1463) XendDomainInfo.destroy: domid=9
[2007-06-01 21:48:17 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1471) XendDomainInfo.destroyDomain(9)
[2007-06-01 21:48:17 xend 2871] DEBUG (image:447) hvm shutdown watch unregistered