August 2016 - Users - oVirt List Archives

Move VM disks from gluster storage to local storage
by Siavash Safi 14 Aug '16

14 Aug '16

Hi, An unknown bug broke our gluster storage (dom_md/ids is corrupted) and oVirt no longer activates the storage(I tried to recover it using the similar issues reported in mailing list but it didn't work). As I checked VM disk images are still accessible when I mount the gluster storage manually. How can we manually move the VM disk images to local storage? (oVirt complains about gluster storage being inactive when using the web interface for move/copy) Thanks, Siavash

2 4

How to open vm console by API ?
by Wang Evan 14 Aug '16

14 Aug '16

--_000_HK2PR0401MB13322CE62E444F628CF2E3F5D71F0HK2PR0401MB1332_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi : I want to integrate oVirt-engine into our system platform. In reference to = ovirt rest API , I have finished added host and create virtual machine. But= I can't find the way to open vm console by API or CLI ,so what should I do= ? Thanks ! Evan --_000_HK2PR0401MB13322CE62E444F628CF2E3F5D71F0HK2PR0401MB1332_ Content-Type: text/html; charset="us-ascii" Content-ID: <959C49C01EEEAB4B9F2C281FC1C76AB6(a)sct-15-1-485-9-msonline-outlook-33ea8.templateTenant> Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"= > <meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang=3D"ZH-CN" link=3D"#0563C1" vlink=3D"#954F72" style=3D"text-justi= fy-trim:punctuation"> <div class=3D"WordSection1"> <p class=3D"MsoNormal"><span lang=3D"EN-US">Hi :<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">I want to integrate oVirt-engin= e into our system platform. In reference to ovirt rest API , I have finishe= d added host and create virtual machine. But I can't find the way to open v= m console by API or CLI ,so what should I do ?<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">Thanks !<o:p></o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p> <p class=3D"MsoNormal"><span lang=3D"EN-US">Evan<o:p></o:p></span></p> </div> </body> </html> --_000_HK2PR0401MB13322CE62E444F628CF2E3F5D71F0HK2PR0401MB1332_--

3 2

LVM2 Thinprovisioned
by Fernando Frediani 14 Aug '16

14 Aug '16

Hello all. When you use oVirt with a Block Storage the only option available to store de VMs is LVM. Does LVM in oVirt use Thinprovisoned (supported in LVM2) instead of having to use the SAN Thinprovisioned features ? Fernando

5 8

General system updates policy
by David Gossage 14 Aug '16

14 Aug '16

Is it considered safe from an ovirt stability standpoint to apply yum updates to the hosts and engine as centos/redhat release them? For example the recent https://rhn.redhat.com/errata/RHSA-2016-1606.html update for qemu. If I run yum update and update that is their any worry for me that it has not been tested with oVirt and so versions will break something. Same with kernels, libraries etc.. *David Gossage* *Carousel Checks Inc. | System Administrator* *Office* 708.613.2284

3 3

Storage for my Environment
by Michael Cooper 14 Aug '16

14 Aug '16

This is a multi-part message in MIME format. --------------F4353BC018BCA8D035BFD678 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Hello Guys, I am sorry ask a stupid question again, however I am not sure how to add storage to the environment that I have at the moment. I have 4 Servers 3 of them are AMD and one Intel Core i7, on my servers I have 2 Dell SC1435's and one HP DL385 G5 I have the Engine Running and I have added a node as well, Both of them are Physical servers they both have 1 tb drives, I would like to add the drive in the node as storage how would I accomplish that? Thank you very much in advance, -- *Michael Cooper* http://www.coopfire.com Linux/VMWare Certified Professional --------------F4353BC018BCA8D035BFD678 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> Hello Guys,<br> <br> I am sorry ask a stupid question again, however I am not sure how to add storage to the environment that I have at the moment. I have 4 Servers 3 of them are AMD and one Intel Core i7, on my servers I have 2 Dell SC1435's and one HP DL385 G5<br> <br> I have the Engine Running and I have added a node as well, Both of them are Physical servers they both have 1 tb drives, I would like to add the drive in the node as storage how would I accomplish that?<br> <br> Thank you very much in advance, <br> <div class="moz-signature">-- <br> <b><font color="#008080">Michael Cooper</font></b><br> <a class="moz-txt-link-freetext" href="http://www.coopfire.com">http://www.coopfire.com</a><br> Linux/VMWare Certified Professional<br> </div> </body> </html> --------------F4353BC018BCA8D035BFD678--

3 3

Re: [ovirt-users] IP Address Stealing
by Subhendu Ghosh 14 Aug '16

14 Aug '16

----_com.ninefolders.hd3.email_133710414088413_alt Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 Tm90IGJ1aWx0IGludG8gb3ZpcnQgQUZBSUssIMKgYnV0IGFuIGVidGFibGVzIHJ1bGUgY2FuIGFs bG93IHlvdSB0byBmaWx0ZXIgb3V0IG1hYytpcCBjb21iaW5hdGlvbnPCoAoKTG9vayBhdCB0aGUg YW50aS1zcG9vZmluZyBydWxlcyBvbiBlYnRhYmxlcy5uZXRmaWx0ZXIub3JnCgpJdCBkb2Vzbid0 IHByZXZlbnQgdGhlIHVzZXIgYWRkaW5nIGl0IGluIHRoZSB2bSwgYnV0IHRoZSBpbmZyYXN0cnVj dHVyZSBibG9ja3MgaXQncyB1c2FnZS4KCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f CkZyb206IEJpbGwgQmlsbCA8amF4MjU2OEBvdXRsb29rLmNvbT4KU2VudDogQXVnIDMsIDIwMTYg MjI6NDAKVG86IHVzZXJzQG92aXJ0Lm9yZwpTdWJqZWN0OiBbb3ZpcnQtdXNlcnNdIElQIEFkZHJl c3MgU3RlYWxpbmcKCkhlbGxvLAoKwqAKCkl0IGlzIHBvc3NpYmxlIHRvIHByZXZlbnQgYSBWTSBm cm9tIGFkZGluZyBhbiBJUD8gRm9yIGV4YW1wbGUsIGlmIHdlIHByb3Zpc2lvbiBhIFZNIHdpdGgg b25lIElQLCBpZiB0aGUgdXNlciBoYXMgcm9vdCBhY2Nlc3MgdGhleSBjYW4gc2ltcGx5IGFkZCBy YW5kb20gSVDigJlzIGZyb20gd2l0aGluIHRoZSBzYW1lIHJhbmdlIGFzIHN1YiBpbnRlcmZhY2Vz OiBldGgwOjAgZXRoMDoxIGV0aDA6MiBzbyBvbiBhbmQgc28gZm9ydGguCgrCoAoKU3VibmV0dGlu ZyBpcyBub3QgaWRlYWwgaW4gdGhpcyBzaXR1YXRpb24gYmVjYXVzZSBpdOKAmXMgYSBodWdlIHdh c3RlIG9mIElQIHNwYWNlLgoKwqA= ----_com.ninefolders.hd3.email_133710414088413_alt Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6Q2FsaWJyaSwgQXJpYWwsIEhlbHZldGljYSwgc2Fucy1z ZXJpZjsgZm9udC1zaXplOjEyLjBwdDsgY29sb3I6IzFGNDk3RCI+PGRpdj5Ob3QgYnVpbHQgaW50 byBvdmlydCBBRkFJSywgJm5ic3A7YnV0IGFuIGVidGFibGVzIHJ1bGUgY2FuIGFsbG93IHlvdSB0 byBmaWx0ZXIgb3V0IG1hYytpcCBjb21iaW5hdGlvbnMmbmJzcDs8L2Rpdj48ZGl2Pjxicj48L2Rp dj48ZGl2Pkxvb2sgYXQgdGhlIGFudGktc3Bvb2ZpbmcgcnVsZXMgb24gZWJ0YWJsZXMubmV0Zmls dGVyLm9yZzwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+SXQgZG9lc24ndCBwcmV2ZW50IHRoZSB1 c2VyIGFkZGluZyBpdCBpbiB0aGUgdm0sIGJ1dCB0aGUgaW5mcmFzdHJ1Y3R1cmUgYmxvY2tzIGl0 J3MgdXNhZ2UuPC9kaXY+CjxkaXY+PGJyPjwvZGl2Pgo8L2Rpdj48ZGl2IGNsYXNzPSJxdW90ZWRf c2VwYXJhdGVfYm9keSIvPjxkaXYgaWQ9InF1b3RlZF9oZWFkZXIiIHN0eWxlPSJjbGVhcjpib3Ro OyI+PGhyIHN0eWxlPSJib3JkZXI6bm9uZTsgaGVpZ2h0OjFweDsgY29sb3I6I0UxRTFFMTsgYmFj a2dyb3VuZC1jb2xvcjojRTFFMUUxOyIvPjxkaXYgc3R5bGU9ImJvcmRlcjpub25lOyBwYWRkaW5n OjMuMHB0IDBjbSAwY20gMGNtIj48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExLjBwdDtmb250LWZh bWlseTpDYWxpYnJpLCBBcmlhbCwgSGVsdmV0aWNhLCBzYW5zLXNlcmlmIj48Yj5Gcm9tOjwvYj4g QmlsbCBCaWxsICZsdDtqYXgyNTY4QG91dGxvb2suY29tJmd0Ozxicj48Yj5TZW50OjwvYj4gQXVn IDMsIDIwMTYgMjI6NDA8YnI+PGI+VG86PC9iPiB1c2Vyc0BvdmlydC5vcmc8YnI+PGI+U3ViamVj dDo8L2I+IFtvdmlydC11c2Vyc10gSVAgQWRkcmVzcyBTdGVhbGluZzxicj48L3NwYW4+PC9kaXY+ PC9kaXY+PGJyIHR5cGU9J2F0dHJpYnV0aW9uJz48ZGl2IGlkPSJxdW90ZWRfYm9keSI+Cgo8bWV0 YSBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiIGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD11 dGYtOCI+CjxtZXRhIG5hbWU9IkdlbmVyYXRvciIgY29udGVudD0iTWljcm9zb2Z0IFdvcmQgMTUg KGZpbHRlcmVkIG1lZGl1bSkiPgo8c3R5bGU+PCEtLQovKiBGb250IERlZmluaXRpb25zICovCkBm b250LWZhY2UKCXtmb250LWZhbWlseToiQ2FtYnJpYSBNYXRoIjsKCXBhbm9zZS0xOjIgNCA1IDMg NSA0IDYgMyAyIDQ7fQpAZm9udC1mYWNlCgl7Zm9udC1mYW1pbHk6Q2FsaWJyaTsKCXBhbm9zZS0x OjIgMTUgNSAyIDIgMiA0IDMgMiA0O30KLyogU3R5bGUgRGVmaW5pdGlvbnMgKi8KcC5Nc29Ob3Jt YWwsIGxpLk1zb05vcm1hbCwgZGl2Lk1zb05vcm1hbAoJe21hcmdpbjowaW47CgltYXJnaW4tYm90 dG9tOi4wMDAxcHQ7Cglmb250LXNpemU6MTEuMHB0OwoJZm9udC1mYW1pbHk6IkNhbGlicmkiLHNh bnMtc2VyaWY7fQphOmxpbmssIHNwYW4uTXNvSHlwZXJsaW5rCgl7bXNvLXN0eWxlLXByaW9yaXR5 Ojk5OwoJY29sb3I6Ymx1ZTsKCXRleHQtZGVjb3JhdGlvbjp1bmRlcmxpbmU7fQphOnZpc2l0ZWQs IHNwYW4uTXNvSHlwZXJsaW5rRm9sbG93ZWQKCXttc28tc3R5bGUtcHJpb3JpdHk6OTk7Cgljb2xv cjojOTU0RjcyOwoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9Ci5Nc29DaHBEZWZhdWx0Cgl7 bXNvLXN0eWxlLXR5cGU6ZXhwb3J0LW9ubHk7fQpAcGFnZSBXb3JkU2VjdGlvbjEKCXtzaXplOjgu NWluIDExLjBpbjsKCW1hcmdpbjoxLjBpbiAxLjBpbiAxLjBpbiAxLjBpbjt9CmRpdi5Xb3JkU2Vj dGlvbjEKCXtwYWdlOldvcmRTZWN0aW9uMTt9Ci0tPjwvc3R5bGU+CgoKPGRpdiBjbGFzcz0iV29y ZFNlY3Rpb24xIj4KPHAgY2xhc3M9Ik1zb05vcm1hbCI+SGVsbG8sPC9wPgo8cCBjbGFzcz0iTXNv Tm9ybWFsIj48bzpwPiZuYnNwOzwvbzpwPjwvcD4KPHAgY2xhc3M9Ik1zb05vcm1hbCI+SXQgaXMg cG9zc2libGUgdG8gcHJldmVudCBhIFZNIGZyb20gYWRkaW5nIGFuIElQPyBGb3IgZXhhbXBsZSwg aWYgd2UgcHJvdmlzaW9uIGEgVk0gd2l0aCBvbmUgSVAsIGlmIHRoZSB1c2VyIGhhcyByb290IGFj Y2VzcyB0aGV5IGNhbiBzaW1wbHkgYWRkIHJhbmRvbSBJUOKAmXMgZnJvbSB3aXRoaW4gdGhlIHNh bWUgcmFuZ2UgYXMgc3ViIGludGVyZmFjZXM6IGV0aDA6MCBldGgwOjEgZXRoMDoyIHNvIG9uIGFu ZCBzbwogZm9ydGguPC9wPgo8cCBjbGFzcz0iTXNvTm9ybWFsIj48bzpwPiZuYnNwOzwvbzpwPjwv cD4KPHAgY2xhc3M9Ik1zb05vcm1hbCI+U3VibmV0dGluZyBpcyBub3QgaWRlYWwgaW4gdGhpcyBz aXR1YXRpb24gYmVjYXVzZSBpdOKAmXMgYSBodWdlIHdhc3RlIG9mIElQIHNwYWNlLjwvcD4KPHAg Y2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMi4wcHQ7Zm9udC1mYW1p bHk6JnF1b3Q7VGltZXMgTmV3IFJvbWFuJnF1b3Q7LHNlcmlmIj48bzpwPiZuYnNwOzwvbzpwPjwv c3Bhbj48L3A+CjwvZGl2PgoKCjwvZGl2Pg== ----_com.ninefolders.hd3.email_133710414088413_alt--

3 3

import qcow2 image to ovirt
by David David 14 Aug '16

14 Aug '16

Hi all ovirt 4.0 there is KVM qcow2 image: file format: qcow2 virtual size: 466G (500106788864 bytes) disk size: 86G cluster_size: 65536 How to import the image with the same disk size, 86 GB, to ovirt ?

3 10

ovirt 3.6.6 and gluster 3.7.13
by David Gossage 14 Aug '16

14 Aug '16

Anyone running one of recent 3.6.x lines and gluster using 3.7.13? I am looking to upgrade gluster from 3.7.11->3.7.13 for some bug fixes, but have been told by users on gluster mail list due to some gluster changes I'd need to change the disk parameters to use writeback cache. Something to do with aio support being removed. I believe this could be done with custom parameters? But I believe strage tests are done using dd and would they fail with current settings then? Last upgrade to 3.7.13 I had to rollback to 3.7.11 due to stability isues where gluster storage would go into down state and always show N/A as space available/used. Even if hosts saw storage still and VM's were running on it on all 3 hosts. Saw a lot of messages like these that went away once gluster rollback finished [2016-07-09 15:27:46.935694] I [fuse-bridge.c:4083:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.22 kernel 7.22 [2016-07-09 15:27:49.555466] W [MSGID: 114031] [client-rpc-fops.c:3050:client3_3_readv_cbk] 0-GLUSTER1-client-1: remote operation failed [Operation not permitted] [2016-07-09 15:27:49.556574] W [MSGID: 114031] [client-rpc-fops.c:3050:client3_3_readv_cbk] 0-GLUSTER1-client-0: remote operation failed [Operation not permitted] [2016-07-09 15:27:49.556659] W [fuse-bridge.c:2227:fuse_readv_cbk] 0-glusterfs-fuse: 80: READ => -1 gfid=deb61291-5176-4b81-8315-3f1cf8e3534d fd=0x7f5224002f68 (Operation not permitted) [2016-07-09 15:27:59.612477] W [MSGID: 114031] [client-rpc-fops.c:3050:client3_3_readv_cbk] 0-GLUSTER1-client-1: remote operation failed [Operation not permitted] [2016-07-09 15:27:59.613700] W [MSGID: 114031] [client-rpc-fops.c:3050:client3_3_readv_cbk] 0-GLUSTER1-client-0: remote operation failed [Operation not permitted] [2016-07-09 15:27:59.613781] W [fuse-bridge.c:2227:fuse_readv_cbk] 0-glusterfs-fuse: 168: READ => -1 gfid=deb61291-5176-4b81-8315-3f1cf8e3534d fd=0x7f5224002f68 (Operation not permitted) *David Gossage* *Carousel Checks Inc. | System Administrator* *Office* 708.613.2284

7 32

oVirt 4.0.2 RC
by Fernando Fuentes 12 Aug '16

12 Aug '16

So I went to do an update to my ovirt system and found that the RC is coming down to my production box... IE: 4.0.2 I did a repo list and found - centos-ovirt40-candidate Than found that 4.0.2 its also coming down from the ovirt-4.0 repo... ovirt-engine-sdk-python noarch 3.6.8.0-1.el7 centos-ovirt40-candidate 480 k ovirt-release40 noarch 4.0.2-2 ovirt-4.0 8.3 k ovirt-vmconsole noarch 1.0.4-1.el7 centos-ovirt40-candidate 29 k ovirt-vmconsole-proxy noarch 1.0.4-1.el7 centos-ovirt40-candidate 17 k python-ovirt-engine-sdk4 x86_64 4.0.0-0.5.a5.el7 centos-ovirt40-candidate 308 k Is this safe to upgrade? Regards, -- Fernando Fuentes ffuentes(a)txweather.org http://www.txweather.org

2 2

Failed to activate Storage Domain vms (Data Center Default)
by Gonzalo Faramiñan 12 Aug '16

12 Aug '16

Hello everyone, I'm brand new to oVirt, but anyway I'm trying to solve a problem because of staff changes. Any help is really appreciated. Context: - oVirt Engine Version: 3.1.0-3.19.el6 running on Centos 6.7 - two nodes running Centos 6.7 connected with Gluster 3.3.1.15.el6, replicate configured - six VMs with high-availability on six separated virtual disk created into de Default volume. The Data Center was working fine for a few years and after a maintenance (step-by-step well done) reboot, the Default volume lost GBs of data. Just 23MB of replicated data remained :_( Now the Master Storage Domain seems to be broken and we cannot get it up and running in any way. Whatever we try, we end up facing this message: "No valid Data Storage Domains are available in Data Center Default (please check your storage infrastructure)." Over this list we saw same log messages, but couldn't solve the problem. I include what I think are the main error messages Thanks in advance! Webgui: 2016-Aug-12, 14:37:11 Host nodo2 cannot access one of the Storage Domains attached to it, or the Data Center object. Setting Host state to Non-Operational. 2016-Aug-12, 14:37:11 Failed to connect Host nodo2 to Storage Pool Default 2016-Aug-12, 14:40:02 Failed to activate Storage Domain vms (Data Center Default) by admin@internal Cluster's admin machine: $ tail /var/log/ovirt-engine/engine.log 2016-08-12 14:12:12,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) Vds: nodo1 2016-08-12 14:12:12,285 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-62) Command ConnectStoragePoolVDS execution failed. Exception: IRSNoMasterDomainException: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=6c820dd3-24dc-472f-9b9b-b366da23b22f, msdUUID=fe3dad77-6f27-40cd-8be9-b9e9cd1fb9bf' 2016-08-12 14:12:12,286 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-62) FINISH, ConnectStoragePoolVDSCommand, log id: 125fb199 2016-08-12 14:12:12,287 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) IrsBroker::Failed::GetStoragePoolInfoVDS 2016-08-12 14:12:12,287 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) Exception: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: 'spUUID=6c820dd3-24dc-472f-9b9b-b366da23b22f, msdUUID=fe3dad77-6f27-40cd-8be9-b9e9cd1fb9bf' 2016-08-12 14:12:12,302 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (QuartzScheduler_Worker-62) [3165a3b2] The message key ReconstructMasterDomain is missing from bundles/ExecutionMessages 2016-08-12 14:12:12,350 INFO [org.ovirt.engine.core.bll.storage.ReconstructMasterDomainCommand] (QuartzScheduler_Worker-62) [3165a3b2] Running command: ReconstructMasterDomainCommand internal: true. Entities affected : ID: fe3dad77-6f27-40cd-8be9-b9e9cd1fb9bf Type: Storage 2016-08-12 14:12:12,397 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (QuartzScheduler_Worker-62) [3165a3b2] START, MarkPoolInReconstructModeVDSCommand(storagePoolId = 6c820dd3-24dc-472f-9b9b-b366da23b22f, ignoreFailoverLimit = false, compatabilityVersion = null, reconstructMarkAction = ClearCache), log id: 40a6ee33 2016-08-12 14:12:12,397 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [3165a3b2] clearing cache for problematic entities in pool 6c820dd3-24dc-472f-9b9b-b366da23b22f 2016-08-12 14:12:12,398 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MarkPoolInReconstructModeVDSCommand] (QuartzScheduler_Worker-62) [3165a3b2] FINISH, MarkPoolInReconstructModeVDSCommand, log id: 40a6ee33

1 0

Best way to create project-based virtual labs
by Clint Smith 12 Aug '16

12 Aug '16

> This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. --B_3553852069_1160118647 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: quoted-printable Hi All, I have gone through work of setting up ovirt and have integrated a director= y server. I am now reading about permissions and quotas; I'm trying to figu= re out the best mechanisms for sectioning off resources to groups of users t= hat are on different projects. I would like each member to have the ability to create Vms and templates wi= thin their respective project group. It=E2=80=99s ok if members within the group = see the each others Vms, however, I would like to keep team resources isolat= ed to the team, if possible. I=E2=80=99m not sure whether to create a new host, cl= uster, datacenter, or storage domain for each team. Ovirt seems highly flexi= ble in this area so I was wondering if anyone has any suggestions. Thanks very much! Clint --B_3553852069_1160118647 Content-type: text/html; charset="UTF-8" Content-transfer-encoding: quoted-printable <html><head></head><body style=3D"word-wrap: break-word; -webkit-nbsp-mode: s= pace; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size:= 14px; font-family: Calibri, sans-serif;"><div>Hi All,</div><div>I have gone= through work of setting up ovirt and have integrated a directory server. &n= bsp;I am now reading about permissions and quotas; I'm trying to figure out = the best mechanisms for sectioning off resources to groups of users that are= on different projects.</div><div><br></div><div>I would like each member to= have the ability to create Vms and templates within their respective projec= t group.  It’s ok if members within the group see the each others= Vms, however, I would like to keep team resources isolated to the team, if = possible. I’m not sure whether to create a new host, cluster, datacent= er, or storage domain for each team. Ovirt seems highly flexible in this are= a so I was wondering if anyone has any suggestions.</div><div><br></div><div= >Thanks very much!</div><div>Clint</div><div><div id=3D"MAC_OUTLOOK_SIGNATURE"= ></div></div></body></html> --B_3553852069_1160118647--

1 0

oVirt updates available on host due to libvirt missing
by Gianluca Cecchi 12 Aug '16

12 Aug '16

Hello, My self hosted engine environment was born in 3.6.0 in November with CentOS 7 on host and CentOS 7 appliance. I managed several updates applying 3.6.2, then 3.6.5, then 4.0. Now I'm at 4.0.2 final and in web admin gui I see a message regarding updates available on host (hosted_engine_1) that doesn't go away. The host usually was updated through "yum update" and not from the gui during updates described above. In events pane it seems the problem is related with libvirt package Host hosted_engine_1 has available updates: libvirt. Actually at this moment the libvirt package (that seems actually a sort of meta-package) is not installed and I think has been never here. Situation is: [root@ractor log]# rpm -qa|grep libvirt libvirt-daemon-driver-network-1.2.17-13.el7_2.5.x86_64 libvirt-daemon-driver-interface-1.2.17-13.el7_2.5.x86_64 libvirt-daemon-kvm-1.2.17-13.el7_2.5.x86_64 libvirt-client-1.2.17-13.el7_2.5.x86_64 libvirt-daemon-1.2.17-13.el7_2.5.x86_64 libvirt-lock-sanlock-1.2.17-13.el7_2.5.x86_64 libvirt-daemon-driver-storage-1.2.17-13.el7_2.5.x86_64 libvirt-daemon-driver-qemu-1.2.17-13.el7_2.5.x86_64 libvirt-daemon-driver-nodedev-1.2.17-13.el7_2.5.x86_64 libvirt-python-1.2.17-2.el7.x86_64 libvirt-daemon-config-nwfilter-1.2.17-13.el7_2.5.x86_64 libvirt-daemon-driver-nwfilter-1.2.17-13.el7_2.5.x86_64 libvirt-daemon-driver-secret-1.2.17-13.el7_2.5.x86_64 [root@ractor log]# If I run "yum install libvirt" I'm proposed: Dependencies Resolved ==================================================================================================== Package Arch Version Repository Size ==================================================================================================== Installing: libvirt x86_64 1.2.17-13.el7_2.5 updates 119 k Installing for dependencies: libvirt-daemon-config-network x86_64 1.2.17-13.el7_2.5 updates 120 k libvirt-daemon-driver-lxc x86_64 1.2.17-13.el7_2.5 updates 747 k Transaction Summary ==================================================================================================== Install 1 Package (+2 Dependent packages) How to proceed? Thanks, Gianluca

5 11

[ANN] oVirt 4.0.2 Final Release is now available
by Sandro Bonazzola 12 Aug '16

12 Aug '16

The oVirt Project is pleased to announce the availability of oVirt 4.0.2, as of August 12th, 2016. This release is available now for: * Fedora 23 (tech preview) * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.2 or later * CentOS Linux (or similar) 7.2 or later * Fedora 23 (tech preview) * oVirt Next Generation Node 4.0 Please take a look at our community page[1] to know how to ask questions and interact with developers and users. All issues or bugs should be reported via oVirt Bugzilla[2]. This update is the second in a series of stabilization updates to the 4.0 series. 4.0.2 brings 24 enhancements and more than 200 bugfixes, including 107 high or urgent severity fixes, on top of oVirt 4.0 series See the release notes [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: * A new oVirt Live ISO is available. [4] * A new oVirt Next Generation Node will be available soon [4]. * A new oVirt Engine Appliance is already available. * Mirrors[5] might need up to one day to synchronize. Additional Resources: * Read more about the oVirt 4.0.2 release highlights: http://www.ovirt.org/release/4.0.2/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.0.2/ [4] http://resources.ovirt.org/pub/ovirt-4.0/iso/ [5] http://www.ovirt.org/Repository_mirrors#Current_mirrors -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 2

Re: [ovirt-users] Unable to login to the WEB UI
by Fabrice Bacchella 12 Aug '16

12 Aug '16

--Apple-Mail=_F7422B19-9C53-401B-B9C1-3EB9A88300B1 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > Le 11 ao=C3=BBt 2016 =C3=A0 11:37, Fabrice Bacchella = <fabrice.bacchella(a)icloud.com> a =C3=A9crit : >=20 >=20 >> Le 11 ao=C3=BBt 2016 =C3=A0 09:31, Martin Perina <mperina(a)redhat.com = <mailto:mperina@redhat.com>> a =C3=A9crit : >>=20 >> Hi Fabrice, >>=20 >> so it seems to me that ovirt-engine-rename didn't work as expected, = because you have changed ENGINE_FQDN in 10-setup-protocols.conf. We = don't support user updates on automatically generated files in = /etc/ovirt-engine/engine.conf.d/. Please next time you'd like to change = something, change it in 99-custom-???.conf file. >=20 > I roll back this change, as you said it was not enough and then the = rename command.. >=20 >>=20 >> Now how to get things working: I'm afraid it would be long and = painful process, but let's try: >>=20 >> 1. Change manually ENGINE_FQDN to the new value you have used as new = FQDN in ovirt-engine-rename in those files: >>=20 >> /etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf >> /etc/ovirt-engine/imageuploader.conf.d/10-engine-setup.conf >> /etc/ovirt-engine/isouploader.conf.d/10-engine-setup.conf >> /etc/ovirt-engine/logcollector.conf.d/10-engine-setup.conf >>=20 >> 2. Now, let's check your custom certificates, I know you are using = your custom CA, does the trustore you have set into = ENGINE_HTTPS_PKI_TRUST_STORE contains all certificates which are needed = to verify HTTPS certificates you have set in Apache for new FQDN? If so, = then please restart your engine and try >>=20 >> Thanks >>=20 >> Martin Perina >=20 > I'm not sur the PKI part is the biggest problem. I managed to get it = work after a rename and using a custom truststore with all the needed = CA. >=20 > My main problem is with this strange=20 > User login failure: java.lang.RuntimeException: server_error: = org.codehaus.jackson.JsonParseException: Unexpected character ('<' (code = 60)): expected a valid value (number, String, array, object, 'true', = 'false' or 'null') >=20 > that no one seems to understand where it came from. Ravi suggest to do = not use custom certificate, but I think it's impossible to test this = now, because of the incomplete operation of the rename command. So I = will but back my trust store and we should focus on this message. >=20 > By the way, I'm on irc on the channel with the nick FabriceB. Ok we finally nailed that problem with the help of Ravi Nori. Because of = the new SSO settings, ovirt-engine made a called to itself, from within = the same process. But it needed to go through apache to authentify = itself by itself and was intercepted by my SSO setup. I will need to = rewrite it and split URL. --Apple-Mail=_F7422B19-9C53-401B-B9C1-3EB9A88300B1 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">Le 11 ao=C3=BBt 2016 =C3=A0 11:37, Fabrice Bacchella <<a = href=3D"mailto:fabrice.bacchella@icloud.com" = class=3D"">fabrice.bacchella(a)icloud.com</a>> a =C3=A9crit :</div><br = class=3D"Apple-interchange-newline"><div class=3D""><meta = http-equiv=3D"Content-Type" content=3D"text/html charset=3Dutf-8" = class=3D""><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: = space; -webkit-line-break: after-white-space;" class=3D""><br = class=3D""><div class=3D""><blockquote type=3D"cite" class=3D""><div = class=3D"">Le 11 ao=C3=BBt 2016 =C3=A0 09:31, Martin Perina <<a = href=3D"mailto:mperina@redhat.com" class=3D"">mperina(a)redhat.com</a>> = a =C3=A9crit :</div><br class=3D"Apple-interchange-newline"><div = class=3D""><div dir=3D"ltr" class=3D""><div class=3D"gmail_default" = style=3D"font-family:arial,helvetica,sans-serif">Hi Fabrice,<br = class=3D""><br class=3D""></div><div class=3D"gmail_default" = style=3D"font-family:arial,helvetica,sans-serif">so it seems to me that = ovirt-engine-rename didn't work as expected, because you have changed = ENGINE_FQDN in 10-setup-protocols.conf. We don't support user updates on = automatically generated files in /etc/ovirt-engine/engine.conf.d/. = Please next time you'd like to change something, change it in = 99-custom-???.conf file.<br class=3D""></div></div></div></blockquote><div= class=3D""><br class=3D""></div>I roll back this change, as you said it = was not enough and then the rename command..</div><div class=3D""><br = class=3D""><blockquote type=3D"cite" class=3D""><div class=3D""><div = dir=3D"ltr" class=3D""><div class=3D"gmail_default" = style=3D"font-family:arial,helvetica,sans-serif"><br class=3D""></div><div= class=3D"gmail_default" = style=3D"font-family:arial,helvetica,sans-serif">Now how to get things = working: I'm afraid it would be long and painful process, but let's = try:<br class=3D""><br class=3D""></div><div class=3D"gmail_default" = style=3D"font-family:arial,helvetica,sans-serif">1. Change manually = ENGINE_FQDN to the new value you have used as new FQDN in = ovirt-engine-rename in those files:<br class=3D""><br = class=3D"">    /etc/ovirt-engine/engine.conf.<wbr = class=3D"">d/10-setup-protocols.conf<br class=3D"">    = /etc/ovirt-engine/<wbr class=3D"">imageuploader.conf.d/10-<wbr = class=3D"">engine-setup.conf<br class=3D"">     /etc/ovirt-engine/isouploader.<wbr = class=3D"">conf.d/10-engine-setup.conf<br class=3D"">     /etc/ovirt-engine/<wbr = class=3D"">logcollector.conf.d/10-engine-<wbr class=3D"">setup.conf<br = class=3D""><br class=3D""></div><div class=3D"gmail_default" = style=3D"font-family:arial,helvetica,sans-serif">2. Now, let's check = your custom certificates, I know you are using your custom CA, does the = trustore you have set into ENGINE_HTTPS_PKI_TRUST_STORE contains all = certificates which are needed to verify HTTPS certificates you have set = in Apache for new FQDN? If so, then please restart your engine and = try<br class=3D""><br class=3D""></div><div class=3D"gmail_default" = style=3D"font-family:arial,helvetica,sans-serif">Thanks<br class=3D""><br = class=3D""></div><div class=3D"gmail_default" = style=3D"font-family:arial,helvetica,sans-serif">Martin Perina<br = class=3D""></div></div></div></blockquote></div><br class=3D""><div = class=3D"">I'm not sur the PKI part is the biggest problem. I managed to = get it work after a rename and using a custom truststore with all the = needed CA.</div><div class=3D""><br class=3D""></div><div class=3D"">My = main problem is with this strange </div><div class=3D"">User login = failure: java.lang.RuntimeException: server_error: = org.codehaus.jackson.JsonParseException: Unexpected character ('<' = (code 60)): expected a valid value (number, String, array, object, = 'true', 'false' or 'null')</div><div class=3D""><br class=3D""></div><div = class=3D"">that no one seems to understand where it came from. Ravi = suggest to do not use custom certificate, but I think it's impossible to = test this now, because of the incomplete operation of the rename = command. So I will but back my trust store and we should focus on this = message.</div><div class=3D""><br class=3D""></div><div class=3D"">By = the way, I'm on irc on the channel with the nick = FabriceB.</div></div></div></blockquote><br class=3D""></div><div>Ok we = finally nailed that problem with the help of Ravi Nori. Because of the = new SSO settings, ovirt-engine made a called to itself, from within the = same process. But it needed to go through apache to authentify itself by = itself and was intercepted by my SSO setup. I will need to rewrite it = and split URL.</div><div><br class=3D""></div><div><br = class=3D""></div><br class=3D""></body></html>= --Apple-Mail=_F7422B19-9C53-401B-B9C1-3EB9A88300B1--

1 0

Missing vdsm-vhostmd-hook for oVirt 4.x
by Arsène Gschwind 11 Aug '16

11 Aug '16

Hi, I'm missing vdsm-vhostmd-hook for oVirt 4, will this hook not be available for this version? Regards, Arsène

2 2

oVirt upgrade
by Budur Nagaraju 11 Aug '16

11 Aug '16

HI How to upgrade oVirt3.5 to 4 ? am using centos6.7. Thanks, Nagaraju

4 8

time zone
by Fernando Fuentes 11 Aug '16

11 Aug '16

Team, My vms are coming up with an exclamation mark saying that the guest time zone differs from the configuration. My linux vms are not doing this. Only my windows vm. On windows I have it set for CST just like the configuration. The hosts are on CST as well. Any ideas? This is Ovirt 4.0.1 Regards, -- Fernando Fuentes ffuentes(a)txweather.org http://www.txweather.org

3 3

ovirt-Guest-agent CPU usage
by Tadas 11 Aug '16

11 Aug '16

Hello groups, we are having problem with ovirt-guest agent on Windows os. When started, agent fully utilizes one core (if machine has single core, then you will see 100% CPU usage, if there are two cores, then you will get 50% usage etc). Usage does not drop and persists for a whole time ovirt agent is running. This happens on windows 7 32 and 64 versions and also on windows 10. Have anybody had the same issue? Thank you.

2 9

oVirt Node 3.6
by Michael Cooper 11 Aug '16

11 Aug '16

This is a multi-part message in MIME format. --------------5C2765100B34BC8D67AC316D Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hey Guys New to the group, I have got the controller installed and it's working fine. Now I have burned an ISO of oVirt Node 3.6 this one is the one I used ovirt-node-ng-installer-ovirt-3.6-2016052403. I am getting an error when I try to install it on the server it fails during the install the first time the script it self failed, the second time it couldn't find the hard drive to install on. I am not sure what's going on I am very confused now. Thanks, -- *Michael Cooper* http://www.coopfire.com Linux/VMWare Certified Professional --------------5C2765100B34BC8D67AC316D Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> <p>Hey Guys</p> <p> New to the group, I have got the controller installed and it's working fine. Now I have burned an ISO of oVirt Node 3.6 this one is the one I used ovirt-node-ng-installer-ovirt-3.6-2016052403. I am getting an error when I try to install it on the server it fails during the install the first time the script it self failed, the second time it couldn't find the hard drive to install on. I am not sure what's going on I am very confused now.</p> <p><br> </p> <p>Thanks,<br> </p> <div class="moz-signature">-- <br> <b><font color="#008080">Michael Cooper</font></b><br> <a class="moz-txt-link-freetext" href="http://www.coopfire.com">http://www.coopfire.com</a><br> Linux/VMWare Certified Professional<br> </div> </body> </html> --------------5C2765100B34BC8D67AC316D--

2 2

Importing VM from Xen Server 6.5
by Anantha Raghava 11 Aug '16

11 Aug '16

This is a multi-part message in MIME format. --------------1F376B79B1DD00CE7FD59289 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hi, In version 4.0.1, we see wizard that helps to import VM from VMWare, Xen, OVA appliance etc., using which I am trying to import a VM running in Xen Server 6.5. But we do not see any documentation that explains the process. Can someone guide us in achieving the desired result that is Import a VM from Xen Server 6.5 -- Thanks & Regards, Anantha Raghava Do not print this e-mail unless required. Save Paper & trees. --------------1F376B79B1DD00CE7FD59289 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> <p><font face="Liberation Serif">Hi,</font></p> <p><font face="Liberation Serif">In version 4.0.1, we see wizard that helps to import VM from VMWare, Xen, OVA appliance etc., using which I am trying to import a VM running in Xen Server 6.5. But we do not see any documentation that explains the process.</font></p> <p><font face="Liberation Serif">Can someone guide us in achieving the desired result that is Import a VM from Xen Server 6.5<br> </font></p> -- <div class="moz-signature"> <p style="margin-bottom: 0cm; line-height: 100%"><font face="Times New Roman, serif">Thanks & Regards,</font></p> <address style="line-height: 100%"><font face="Times New Roman, serif">Anantha Raghava</font></address> <font color="#66cc00"><font face="Times New Roman, serif">Do not print this e-mail unless required. Save Paper & trees.</font></font> </div> </body> </html> --------------1F376B79B1DD00CE7FD59289--

4 15

3.6 : iSCSI LUN not detected
by Alexis HAUSER 11 Aug '16

11 Aug '16

Hi, I am reinstalling a new Node with a new hosted-engine and I would like to import an iSCSI storage from a previous ovirt installation. However, I can see all LUN present on that iSCSI but the one I want... I checked from the iSCSI array and this disk still exists, it's just not detected from Ovirt (3.6)... I tried to make a new data domain and chosed that same iSCSI and it's also not detected. Any ideas ? I didn't remove the storage from the Engine interface on the previous installation, just just turned off all VMs accessing the iSCSI and unplugged the cable. Is it possible there is still a lock file or something from the previous hypervisor ?

4 7

How to asssign a static IP to VM?
by lifuqiong 11 Aug '16

11 Aug '16

This is a multipart message in MIME format. ------=_NextPart_000_003D_01D1F40C.5C780750 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi all, I searched google and found there is no way to assign a static IP to VM until 2012, in http://lists.ovirt.org/pipermail/users/2012-May/007559.html; Is there any solution to assign static IP now? Thank you Mark ------=_NextPart_000_003D_01D1F40C.5C780750 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta = http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><style></style></head><body lang=3DZH-CN link=3Dblue = vlink=3Dpurple style=3D'text-justify-trim:punctuation'><div = class=3DWordSection1><p class=3DMsoNormal><span lang=3DEN-US>Hi = all,<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>         = <o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>         I searched = google and found there is no way to assign a static IP to VM until 2012, = in <a = href=3D"http://lists.ovirt.org/pipermail/users/2012-May/007559.html">http= ://lists.ovirt.org/pipermail/users/2012-May/007559.html</a>;<o:p></o:p></= span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>Is there any solution to assign static IP = now?<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>Thank you<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>Mark<o:p></o:p></span></p></div></body></html> ------=_NextPart_000_003D_01D1F40C.5C780750--

2 1

Convert OnApp VM to oVirt
by Fernando Frediani 11 Aug '16

11 Aug '16

Hi, Has anyone done a VM conversion from OnApp (therefore running in LVM) to oVirt/RHEV format being either buried in LVM or in a QCOW2 file. I've seen some instructions using qemu-img but wanted to find out if anyone has found any issues in this process. Any adjusts to be done before booting the VM the first time in the new platform ? Both hypervisors are KVM. Fernando

1 0

leasing of vms
by Budur Nagaraju 11 Aug '16

11 Aug '16

HI Is there a feature to lease the vms in oVirt ? Thanks, Nagaraju

5 5

vm paused unknown storage error one node out of 3 only
by David Gossage 11 Aug '16

11 Aug '16

Out of a 3 node cluster running oVirt 3.6.6.2-1.el7.centos with a 3 replicate gluster 3.7.14 starting a VM i just copied in on one node of the 3 gets the following errors. The other 2 the vm starts fine. All ovirt and gluster are centos 7 based. VM on start of the one node it tries to default to on its own accord immediately puts into paused for unknown reason. Telling it to start on different node starts ok. node with issue already has 5 VMs running fine on it same gluster storage plus the hosted engine on different volume. gluster nodes logs did not have any errors for volume nodes own gluster logs had this in log dfb8777a-7e8c-40ff-8faa-252beabba5f8 couldnt find in .glusterfs .shard or images/ 7919f4a0-125c-4b11-b5c9-fb50cc195c43 is the gfid of the bootable drive of the vm [2016-08-11 04:31:39.982952] W [MSGID: 114031] [client-rpc-fops.c:3050:client3_3_readv_cbk] 0-GLUSTER1-client-2: remote operation failed [No such file or directory] [2016-08-11 04:31:39.983683] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-2: remote operation failed [No such file or directory] [2016-08-11 04:31:39.984182] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-0: remote operation failed [No such file or directory] [2016-08-11 04:31:39.984221] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-1: remote operation failed [No such file or directory] [2016-08-11 04:31:39.985941] W [MSGID: 108008] [afr-read-txn.c:244:afr_read_txn] 0-GLUSTER1-replicate-0: Unreadable subvolume -1 found with event generation 3 for gfid dfb8777a-7e8c-40ff-8faa-252beabba5f8. (Possible split-brain) [2016-08-11 04:31:39.986633] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-2: remote operation failed [No such file or directory] [2016-08-11 04:31:39.987644] E [MSGID: 109040] [dht-helper.c:1190:dht_migration_complete_check_task] 0-GLUSTER1-dht: (null): failed to lookup the file on GLUSTER1-dht [Stale file handle] [2016-08-11 04:31:39.987751] W [fuse-bridge.c:2227:fuse_readv_cbk] 0-glusterfs-fuse: 15152930: READ => -1 gfid=7919f4a0-125c-4b11-b5c9-fb50cc195c43 fd=0x7f00a80bdb64 (Stale file handle) [2016-08-11 04:31:39.986567] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-0: remote operation failed [No such file or directory] [2016-08-11 04:31:39.986567] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-1: remote operation failed [No such file or directory] [2016-08-11 04:35:21.210145] W [MSGID: 108008] [afr-read-txn.c:244:afr_read_txn] 0-GLUSTER1-replicate-0: Unreadable subvolume -1 found with event generation 3 for gfid dfb8777a-7e8c-40ff-8faa-252beabba5f8. (Possible split-brain) [2016-08-11 04:35:21.210873] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-1: remote operation failed [No such file or directory] [2016-08-11 04:35:21.210888] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-2: remote operation failed [No such file or directory] [2016-08-11 04:35:21.210947] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-0: remote operation failed [No such file or directory] [2016-08-11 04:35:21.213270] E [MSGID: 109040] [dht-helper.c:1190:dht_migration_complete_check_task] 0-GLUSTER1-dht: (null): failed to lookup the file on GLUSTER1-dht [Stale file handle] [2016-08-11 04:35:21.213345] W [fuse-bridge.c:2227:fuse_readv_cbk] 0-glusterfs-fuse: 15156910: READ => -1 gfid=7919f4a0-125c-4b11-b5c9-fb50cc195c43 fd=0x7f00a80bf6d0 (Stale file handle) [2016-08-11 04:35:21.211516] W [MSGID: 108008] [afr-read-txn.c:244:afr_read_txn] 0-GLUSTER1-replicate-0: Unreadable subvolume -1 found with event generation 3 for gfid dfb8777a-7e8c-40ff-8faa-252beabba5f8. (Possible split-brain) [2016-08-11 04:35:21.212013] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-0: remote operation failed [No such file or directory] [2016-08-11 04:35:21.212081] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-1: remote operation failed [No such file or directory] [2016-08-11 04:35:21.212121] W [MSGID: 114031] [client-rpc-fops.c:1572:client3_3_fstat_cbk] 0-GLUSTER1-client-2: remote operation failed [No such file or directory] I attached vdsm.log starting from when I spun up vm on offending node

1 0