virt August 2008

virt@lists.centos.org

38 participants
28 discussions

relocation, migration
by Paras pradhan 02 Sep '08

02 Sep '08

Hi, I am running a cluster having 2 nodes using red hat cluster suite. node 1 has a para virtualized guest(centOS) running under Xen. My question is when node1 is rebooted, guest is automatically relocated to node 2 . Instead of relocation, is migration possible in this case which can result in Zero down time? Thanks in adv Paras.

3 3

xen+drbd Question
by Alexandre Biancalana 27 Aug '08

27 Aug '08

Hi list, I installed two new servers to be our virtualization HA. This servers have CentOS 5.2, Xen 3.0.3, Drbd 8.2.6. The setup is ok, lvm drbd resources sincronizing, Guest VM running without any problem. My only doubt is that I can only use drbd resources inside guest vms when I specify the disk resource in vms config like this: disk = ['phy:/dev/VolGroup00/vappprtem01,hda,w' ] if I specify de disk like: disk = [drbd:vappprtem01,hda,w' ] The Guest VM found the disk but this appear with zero size. As far what I read the second way is the correct to live migration work without any race condiction... This link say that centos has a problem with block-drbd script provided by drbd, is anybody aware of that ? http://lists.xensource.com/archives/html/xen-users/2008-08/msg00176.html Any hints ? Best Regards,

5 13

Re: [CentOS-virt] Shared Storage Options
by Brett Worth 27 Aug '08

27 Aug '08

Jerry Ablan wrote: > Has anyone played with OCFS2? > > http://oss.oracle.com/projects/ocfs2/ Thanks for suggesting this. I've done a fresh install of CentOS 5.2 and put OCFS2 on top. Its really easy to use and install and the the performance looks really good. I'm going to be using OCFS2 for a few more applications from now on. Meanwhile... Once I ran up Xen on these machines I was able to use file based storage allocation to the VMs and have it running with reasonable performance. My original problem is still there however. I've tested the flock functionality of OCFS2 and it works but Xen it seems doesn't do locking even on a shared filesystem. It is possible that Xen is trying to do some other sort of file locking but unfortunately OCFS2 only supports flock. I could write some scripts to replace xm which could check for the existence of a lock file before attempting to start a VM but that seems a bit clunky. Is there a proper way to do this? Regards Brett > -----Original Message----- > From: centos-virt-bounces(a)centos.org [mailto:centos-virt-bounces@centos.org] > On Behalf Of Brett Worth > Sent: Thursday, August 21, 2008 6:22 AM > To: Discussion about the virtualization on CentOS > Subject: [CentOS-virt] Shared Storage Options > > Hello all. > > I would like to canvas some opinions on options for shared storage in a Xen > cluster. So > far I've experimented with using iSCSI and clvm which mixed success. > > The primary concern I have with both of these options is that there seems to > be no obvious > way to ensure exclusive access to the LUN/device to the VM I want to run. > On a couple of > occasions during my playing I've accidentally started the same VM on two > servers and > corrupted the said filesystem. > > I've tried setting up GFS but I don't think I'm smart enough to do that. > The fencing has > me baffled. In fact fencing had me baffled with clvm but I somehow managed > to trick it > into working though probably not how it's supposed to. > > I'd be happy to persist with either of the above methods if I could work out > how to lock > the device. Can anyone offer some advice? > > Regards > Brett Worth

3 3

Installing xen from xen srpm compiled rpms
by Joseph L. Casale 26 Aug '08

26 Aug '08

When I use yum to install xen 3.2.0 and xen-libs it also pulls in then centos kernel-xen? I thought the srpm contained all that was needed besides obvious deps like bridge utils etc? To get this running, I change the grub stanza kernel-xen creates to have the kernel point to xen.gz-3.2 and one of the module lines to point to my custom initrd for pciback loading. That leaves the other module line kernel-xen wrote for vmlinuz-2.6.18-92.1.10.el5xen intact. Why does kernel-xen get pulled in and what's the significance of the vmlinuz line? Thanks! jlc

1 0

VMware Server clock woes (running too fast)
by Michael Ekstrand 25 Aug '08

25 Aug '08

I'm running VMware Server 1.0.6 on a CentOS 5.2 host and am having some clock difficulties. Host OS is x86_64 running on 1.9 GHz AMD Sempron, nVidia chipset. Guest OS's are 32-bit FreeBSD (clock works fine after disabling ACPI, setting the clock source to the PIT, and running the guest tools), WinXP (unknown clock status), and i686 CentOS 5.2 (here is the problem). I've tried pretty much everything to try to fix it. I have host.cpukHz, host.noTSC, and ptsc.noTSC set in /etc/vmware/config. I've booted my kernel with noapic, nosmp, noacpi, divider=10. Sadly, I hit the clocksource=pit with divider bug, so I have not been able to boot with both that and divider=10, although clocksource=pit without a divider also does not work. I even built a custom kernel with SMP and APIC disabled, CPU_HZ=100, and booted with clocksource=pit noacpi, and it also gains time. Could anyone provide a recommendation as to what I can do to fix this problem? -- mouse, n: A device for pointing at the xterm in which you want to type. Confused by the strange files? I cryptographically sign my messages. For more information see <http://www.elehack.net/resources/gpg>.

3 6

Shared Storage Options
by Brett Worth 21 Aug '08

21 Aug '08

Hello all. I would like to canvas some opinions on options for shared storage in a Xen cluster. So far I've experimented with using iSCSI and clvm which mixed success. The primary concern I have with both of these options is that there seems to be no obvious way to ensure exclusive access to the LUN/device to the VM I want to run. On a couple of occasions during my playing I've accidentally started the same VM on two servers and corrupted the said filesystem. I've tried setting up GFS but I don't think I'm smart enough to do that. The fencing has me baffled. In fact fencing had me baffled with clvm but I somehow managed to trick it into working though probably not how it's supposed to. I'd be happy to persist with either of the above methods if I could work out how to lock the device. Can anyone offer some advice? Regards Brett Worth

1 0

Problem with keyboard layout
by Erik Edelmann 20 Aug '08

20 Aug '08

Hi! I'm trying to set up a fully virtualized server using Xen; both host and guest operating system is CentOS-5.2. Otherwise it seems to work fairly well, but I can't get my finnish keyboard work correctly for the guest (when using virt-viewer. No problems on the host). In the beginning, using default settings, the behaviour was as if the keyboard layout had been set to "U.S. English". Trying to set the keyboard layout using administration tools inside the guest had no effect. I also tried vfb = [ "type=vnc,vncunused=1,keymap=fi" ] in the guest config file, and (keymap 'fi') in xend-config.sxp, as suggested by http://wiki.centos.org/TipsAndTricks/Xen, but neither of those had any effect either. Setting keymap = "fi" in the guest config file improved the situation a bit, but there were still a few keys that behaved oddly, e.g. [shift]-[6] gave "K" (should give "&") and ['] gave "b" (should give "'"). I then tried swedish keyboard layout, by setting keymap = "sv" in the guest config file (swedish and finnish keyboards are, I think, the same). That fixed most problems, with only one remaining (as far as I've noticed this far): The [tilde, circumflex, diaeresis]-key won't work. Pressing that key gives nothing, and that key + space gives just space (with and without shift or altgr). Any helpful ideas? Regards, Erik

1 0

Re: [CentOS-virt] iowait / Perfomance problems with xen on drbd (centos 5.2)
by cetertick 18 Aug '08

18 Aug '08

1 0

iowait / Perfomance problems with xen on drbd (centos 5.2)
by Jan Kellermann 18 Aug '08

18 Aug '08

Hi, we have 2 servers on centos5.2 in a cluster with the redhat cman in the configuration SERVER1 > LVM \ CMAN DRBD > XEN SERVER2 > LVM / For each xen we create a new local LVM on each node, put them in a drbd and install an os (debian 4 or ubuntu 8). The xens are running as pvm. Everything works fine since over 4 months now. But we have some performance-Problems: Writing on the Xen-devices produces an iowait about 50 to 60% on the xen-processors. we have 3 szenarios tested: a) Xen on DRBD b) Xen on DRBD but disconnected c) direct mounted DRBD You can see the difference in Write pro Char and Write per Block. a: 3792 / 4011 b: 52037 / 103777 c: 57135 / 325002 See bonnie_result.txt for more data. We attached our drbd.conf and a xen-config for your information. The Server are each 2xDual-Core AMD Opteron(tm) Processor 2214 HE with 32 Gb RAM and 2TB-Harddrive on Raid5 running von CentOS 5.2. The XEN-DomUs are Debian 4 or Ubuntu 8. The NICs are bonded Intel 1GBit. For the DRBD we have an own connection on a seperately subnet. Though we are wondering what there happens. Any Idea? And: YES, we tried a some configurations in the last past months before we are asking you today :) Best regards an Thank you in advance Jan resource server206 { protocol C; handlers { pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f"; pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f"; local-io-error "echo o > /proc/sysrq-trigger ; halt -f"; } startup { degr-wfc-timeout 120; # 2 minutes. wait-after-sb; } disk { on-io-error detach; } net { allow-two-primaries; after-sb-0pri discard-least-changes; after-sb-1pri violently-as0p; after-sb-2pri violently-as0p; rr-conflict violently; max-buffers 16384; max-epoch-size 16384; sndbuf-size 1M; } syncer { rate 100M; al-extents 3313; } on server101.werk21system.de { device /dev/drbd6; disk /dev/xendisk/server206; address 10.20.0.101:7795; meta-disk internal; } on server102.werk21system.de { device /dev/drbd6; disk /dev/xendisk/server206 ; address 10.20.0.102:7795; meta-disk internal; } } ## Ubuntu 64Bit Kernel kernel = '/etc/xen/kernel/vmlinuz-2.6.24-19-xen' ramdisk = '/etc/xen/kernel/initrd.img-2.6.24-19-xen' memory = '1024' root = '/dev/xvda ro' disk = [ 'drbd:server206,xvda,w' ] name = 'server206' vcpus = 2 vif = [ 'ip=X.Y.Z.205,bridge=xenbr0','ip=10.10.10.205,bridge=xenbr1' ] vfb = [ 'type=vnc,vncunused=1,keymap=de' ] keymap = 'de' on_poweroff = 'destroy' on_reboot = 'restart' on_crash = 'restart' ================================================================================= XEN ON DRBD CONNECTED Version 1.03b ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP ubuntu64 2G 3792 6 4011 0 3170 0 33006 40 182491 6 231.1 0 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ ================================================================================= XEN ON DRBD DISCONNECTED Version 1.03b ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP ubuntu64 2G 52037 85 103777 26 43139 5 33510 41 174650 5 212.8 0 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ ubuntu64,2G,52037,85,103777,26,43139,5,33510,41,174650,5,212.8,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ================================================================================= DRBD CONNECTED W/O XEN Version 1.03 ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP server101 2G 57135 97 325002 94 16498 3 61150 94 1166962 100 +++++ +++ ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ server101,2G,57135,97,325002,94,16498,3,61150,94,1166962,100,+++++,+++,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++

1 0

can cron.daily crash my dom0s?
by Heiko 18 Aug '08

18 Aug '08

Hello, I have 2 servers which share 2 partitions with drbd, on each machine runs one VM on the drbd device, so that I have primary/secondary and secondary/primary drbd devices. There are also some more XEN VM´s that only do aa mysql replication and one is standalone. In the last 4 weeks I had 2 incidents where both machines did a sudden reboot, first one machine and 2 minutes later the other one. I cant find anything in the logfiles, only that a few seconds before the secondary drbd device got a timeout (Aug 18 04:02:14 xen-A1 kernel: drbd1: PingAck did not arrive in time.) the cron.daily started: Aug 18 04:02:01 xen-B1 crond[25033]: (root) CMD (run-parts /etc/cron.daily) Aug 18 04:02:01 xen-B1 anacron[25037]: Updated timestamp for job `cron.daily' to 2008-08-18 Aug 18 04:06:06 xen-B1 crond[2963]: (CRON) STARTUP (V5.0) the last line seems to be the reboot. here the content of my cron.daily folder. [root@xen-B1.blab:/etc/cron.daily]# ls 0anacron 0logwatch cups logrotate makewhatis.cron mlocate.cron prelink rpm tmpwatch I had also heartbeat running on the machines, after the last crash I thougt it was heartbeat that rebooted the machines, so I disabled it, but now I see it isnt heartbeat that causes these reboots. I use centos 5.1 with no selfcompiled packages. Why are my machines doing this, and how to fix this? greetings and thanks Rupert

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

virt August 2008