Johnny,
Johnny Tan wrote:
Urs Rau wrote:
Is there a switch or config setting somewhere that would allow me to
start up more than the default 4 xen DomU instances?
I am finding that the CentOS 5 (x86_64) installation only allows me to
start up 4 virtual machines at a time. (It is definetly not a lack of
cpu resources, memory or disk space.)
According to this page:
http://www.howtoforge.com/perfect_setup_xen3_debian_p5
You need to add max_loop=N (where N is the number of virtual machines
you want x 2) to your module line in grub.conf
But, oddly, I'm using CentOS-5 x86_64, and I have dom0 plus five virtual
machines running, and I did not change any setting, config file, and I
don't have max_loop in my grub.conf -- it's just a default install & setup.
johnn
Thanks, I tried this, but no change. I think this was/is possibly just
related to the limit of number of loopback interfaces the standard
kernel has. And how to increase this. But for me it has no effect on the
number of DomU I can run. I only manage Dom0 + 4 after that it just
hangs on a xm create and when I hit Ctrl-c it comes back with the error
Error: Device creation failed for domain test5.
If I let it try starting the domain for about 1 - 2 minutes it
eventually returns a:
Error: destroyDevice() takes exactly 3 arguments (2 given)
I am attaching my xend.log file for the failed "xm create test5" DomU
My test1 - test5 config files all look as follows:
# Automatically generated xen config file
name = "test1"
builder = "hvm"
memory = "512"
boot = "d"
disk = [ 'file:/xen_dat/test1/test1.img,hda,w', 'file:/xen_img/knoppix/knoppix.iso,ioemu:hdc:cdrom,r' ]
vif = [ 'type=ioemu, mac=00:16:3e:6f:3e:0d, bridge=xenbr0', ]
uuid = "2a4d08bd-e7b7-1010-0656-8eb74b692164"
device_model = "/usr/lib64/xen/bin/qemu-dm"
kernel = "/usr/lib/xen/boot/hvmloader"
vnc=1
vncunused=1
apic=1
acpi=1
pae=1
vcpus=2
serial = "pty" # enable serial console
on_reboot = 'restart'
on_crash = 'restart'
--
Urs Rau
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:190) XendDomainInfo.create(['vm', ['name', 'test5'], ['memory', '512'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['vcpus', 2], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]]], ['device', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]], ['device', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]], ['device', ['vkbd']], ['device', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']]]])
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:296) parseConfig: config is ['vm', ['name', 'test5'], ['memory', '512'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['vcpus', 2], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]]], ['device', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]], ['device', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]], ['device', ['vkbd']], ['device', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']]]]
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:397) parseConfig: result is {'shadow_memory': None, 'start_time': None, 'uuid': None, 'on_crash': 'restart', 'on_reboot': 'restart', 'localtime': None, 'image': ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'd'], ['serial', 'pty'], ['vnc', 1], ['vncunused', 1], ['xauthority', '/root/.Xauthority'], ['acpi', 1], ['apic', 1], ['vncpasswd', None]], 'on_poweroff': None, 'bootloader_args': None, 'cpus': None, 'name': 'test5', 'backend': [], 'vcpus': 2, 'cpu_weight': None, 'features': None, 'vcpu_avail': None, 'memory': 512, 'device': [('vbd', ['vbd', ['uname', 'file:/xen_dat/test5/test5.img'], ['dev', 'hda'], ['mode', 'w']]), ('vbd', ['vbd', ['uname', 'file:/xen_img/knoppix/knoppix.iso'], ['dev', 'ioemu:hdc:cdrom'], ['mode', 'r']]), ('vif', ['vif', ['bridge', 'xenbr0'], ['type', 'ioemu']]), ('vkbd', ['vkbd']), ('vfb', ['vfb', ['vncunused', '1'], ['type', 'vnc'], ['xauthority', '/root/.Xauthority']])], 'bootloader': None, 'cpu': None, 'maxmem': None}
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1264) XendDomainInfo.construct: None
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1296) XendDomainInfo.initDomain: 9 1.0
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: boot, val: d
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: fda, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: fdb, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: soundhw, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: localtime, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: serial, val: pty
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: std-vga, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: isa, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: vcpus, val: 2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: acpi, val: 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: usb, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: usbdevice, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (image:329) args: k, val: None
[2007-06-01 21:46:42 xend 2871] DEBUG (balloon:127) Balloon: 543880 KiB free; need 542928; done.
[2007-06-01 21:46:42 xend 2871] INFO (image:136) buildDomain os=hvm dom=9 vcpus=2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:282) dom = 9
[2007-06-01 21:46:42 xend 2871] DEBUG (image:283) image = /usr/lib/xen/boot/hvmloader
[2007-06-01 21:46:42 xend 2871] DEBUG (image:284) store_evtchn = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:285) memsize = 512
[2007-06-01 21:46:42 xend 2871] DEBUG (image:286) vcpus = 2
[2007-06-01 21:46:42 xend 2871] DEBUG (image:287) pae = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:288) acpi = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:289) apic = 1
[2007-06-01 21:46:42 xend 2871] DEBUG (image:435) hvm shutdown watch registered
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'virtual-device': '768', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/9/768'} to /local/domain/9/device/vbd/768.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'domain': 'test5', 'frontend': '/local/domain/9/device/vbd/768', 'dev': 'hda', 'state': '1', 'params': '/xen_dat/test5/test5.img', 'mode': 'w', 'online': '1', 'frontend-id': '9', 'type': 'file'} to /local/domain/0/backend/vbd/9/768.
[2007-06-01 21:46:42 xend 2871] DEBUG (blkif:24) exception looking up device number for hdc: [Errno 2] No such file or directory: '/dev/hdc'
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'virtual-device': '5632', 'device-type': 'cdrom', 'state': '1', 'backend': '/local/domain/0/backend/vbd/9/5632'} to /local/domain/9/device/vbd/5632.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'domain': 'test5', 'frontend': '/local/domain/9/device/vbd/5632', 'dev': 'hdc', 'state': '1', 'params': '/xen_img/knoppix/knoppix.iso', 'mode': 'r', 'online': '1', 'frontend-id': '9', 'type': 'file'} to /local/domain/0/backend/vbd/9/5632.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vif/9/0'} to /local/domain/9/device/vif/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'bridge': 'xenbr0', 'domain': 'test5', 'handle': '0', 'script': '/etc/xen/scripts/vif-bridge', 'state': '1', 'frontend': '/local/domain/9/device/vif/0', 'mac': '00:16:3e:63:71:49', 'online': '1', 'frontend-id': '9', 'type': 'ioemu'} to /local/domain/0/backend/vif/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vkbd/9/0'} to /local/domain/9/device/vkbd/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'frontend-id': '9', 'domain': 'test5', 'frontend': '/local/domain/9/device/vkbd/0', 'state': '1', 'online': '1'} to /local/domain/0/backend/vkbd/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/9/0'} to /local/domain/9/device/vfb/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:112) DevController: writing {'vncunused': '1', 'domain': 'test5', 'frontend': '/local/domain/9/device/vfb/0', 'xauthority': '/root/.Xauthority', 'state': '1', 'online': '1', 'frontend-id': '9', 'type': 'vnc'} to /local/domain/0/backend/vfb/9/0.
[2007-06-01 21:46:42 xend 2871] DEBUG (vfbif:92) No VNC passwd configured for vfb access
[2007-06-01 21:46:42 xend 2871] INFO (image:418) spawning device models: /usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '9', '-m', '512', '-boot', 'd', '-serial', 'pty', '-vcpus', '2', '-acpi', '-domain-name', 'test5', '-net', 'nic,vlan=1,macaddr=00:16:3e:31:10:c3,model=rtl8139', '-net', 'tap,vlan=1,bridge=xenbr0', '-vncunused', '-vnclisten', '127.0.0.1']
[2007-06-01 21:46:42 xend 2871] INFO (image:420) device model pid: 14751
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:715) Storing VM details: {'shadow_memory': '5', 'uuid': 'bc3b1112-6dd5-befc-8c33-b7e29f7e191c', 'on_reboot': 'restart', 'start_time': '1180730802.57', 'on_poweroff': 'destroy', 'name': 'test5', 'xend/restart_count': '0', 'vcpus': '2', 'vcpu_avail': '3', 'memory': '512', 'on_crash': 'restart', 'image': "(hvm (kernel /usr/lib/xen/boot/hvmloader) (device_model /usr/lib64/xen/bin/qemu-dm) (pae 1) (vcpus 2) (boot d) (serial pty) (vnc 1) (vncunused 1) (xauthority /root/.Xauthority) (acpi 1) (apic 1) (vncpasswd 'None'))", 'maxmem': '512'}
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:750) Storing domain details: {'console/port': '2', 'name': 'test5', 'console/limit': '1048576', 'vm': '/vm/bc3b1112-6dd5-befc-8c33-b7e29f7e191c', 'domid': '9', 'cpu/0/availability': 'online', 'memory/target': '524288', 'store/ring-ref': '1527046', 'cpu/1/availability': 'online', 'store/port': '1'}
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices vif.
[2007-06-01 21:46:42 xend 2871] DEBUG (image:458) hvm_shutdown fired, shutdown reason=None
[2007-06-01 21:46:42 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:940) XendDomainInfo.handleShutdownWatch
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:149) Waiting for 0.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vif/9/0/hotplug-status.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vif/9/0/hotplug-status.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:485) hotplugStatusCallback 1.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices usb.
[2007-06-01 21:46:42 xend 2871] DEBUG (DevController:143) Waiting for devices vbd.
[2007-06-01 21:46:43 xend 2871] DEBUG (DevController:149) Waiting for 768.
[2007-06-01 21:46:43 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vbd/9/768/hotplug-status.
[2007-06-01 21:48:17 xend 2871] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vbd/9/768/hotplug-status.
[2007-06-01 21:48:17 xend 2871] DEBUG (DevController:485) hotplugStatusCallback 2.
[2007-06-01 21:48:17 xend 2871] ERROR (xmlrpclib2:184) destroyDevice() takes exactly 3 arguments (2 given)
Traceback (most recent call last):
File "/usr/lib64/python2.4/site-packages/xen/util/xmlrpclib2.py", line 162, in _marshaled_dispatch
response = self._dispatch(method, params)
File "/usr/lib64/python2.4/SimpleXMLRPCServer.py", line 406, in _dispatch
return func(*params)
File "<string>", line 1, in <lambda>
File "/usr/lib64/python2.4/site-packages/xen/xend/server/XMLRPCServer.py", line 38, in dispatch
return getattr(info, fn)(*args)
File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", line 1610, in waitForDevices
self.waitForDevices_(c)
File "/usr/lib64/python2.4/site-packages/xen/xend/XendDomainInfo.py", line 1101, in waitForDevices_
return self.getDeviceController(deviceClass).waitForDevices()
File "/usr/lib64/python2.4/site-packages/xen/xend/server/DevController.py", line 145, in waitForDevices
return map(self.waitForDevice, self.deviceIDs())
File "/usr/lib64/python2.4/site-packages/xen/xend/server/DevController.py", line 160, in waitForDevice
self.destroyDevice(devid)
TypeError: destroyDevice() takes exactly 3 arguments (2 given)
[2007-06-01 21:48:17 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1463) XendDomainInfo.destroy: domid=9
[2007-06-01 21:48:17 xend.XendDomainInfo 2871] DEBUG (XendDomainInfo:1471) XendDomainInfo.destroyDomain(9)
[2007-06-01 21:48:17 xend 2871] DEBUG (image:447) hvm shutdown watch unregistered
Johnny Tan
Steven Haigh
Urs Rau