- Users - oVirt List Archives

Building ovirt-host-deploy gives `configure: error: otopi-devtools required but missing`
by Leni Kadali Mutungi 19 May '17

19 May '17

Hello. I got the error mentioned in the subject when when trying to build ovirt-host-deploy. Full output here: https://paste.fedoraproject.org/paste/Dh7FF1XjhDa2TGNSBs~o815M1UNdIGYhyRLiv… The troubleshooting I've done so far is as follows: 1. Rebuilt otopi, running the commands `autoreconf -ivf` and then `./configure --enable-java-sdk --with-maven`. This made `make` download a host of stuff for otopi project from https://repo.maven.apache.org It did this again when I ran `make install`. When I went back to the ovirt-host-deploy directory, I ran `./configure`, both with the --enable-java-sdk and --with-maven options. Got the same error again. 2. I tried running entering the directory src/java and running `mvn install`. I received a build success message and then proceeded to run ./configure --build=x86_64-linux-gnu --host=x86_64-linux-gnu --program-prefix= --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib64 --libexecdir=/usr/libexec --localstatedir=/var --sharedstatedir=/var/lib --mandir=/usr/share/man --disable-python-syntax-check --enable-java-sdk --with-local-version=otopi-1.7.0.master COMMONS_LOGGING_JAR=/usr/share/java/commons-logging.jar JUNIT_JAR=/usr/share/java/junit.jar I omitted the --disable-dependency-tracking and --docdir=/usr/share/doc/otopi-1.7.0 options because of the following error: configure: WARNING: unrecognized options: --disable-dependency-tracking and the fact that I didn't have the directory /usr/share/doc/otopi-1.7.0 respectively. I got the following output: https://paste.fedoraproject.org/paste/90D0k1AyVPGDbNhk1WxlBl5M1UNdIGYhyRLiv… Running `sudo make install` gives me the same errors. It seems otopi is failing to compile properly and as a result, running ./configure within the ovirt-host-deploy directory ends with an error saying otopi-devtools are missing. Documentation of my environment as it stands is here: https://github.com/leni1/oVirt-docs-Debian/blob/master/oVirt-Development-En… Any ideas on what I should try next are welcome. -- - Warm regards Leni Kadali Mutungi

6 14

Upgrade from rhel 6.7 to 6.8 breaks virt-viewer console
by cmc 18 May '17

18 May '17

Hi, Having trouble launching consoles for VMs on rhel 6.8 (virt-viewer 2.0-14). I get: "At least Remote Viewer version 99.0-1 is required to setup this connection" It works fine in rhel 6.7 (using firefox or chrome). I downgraded the version of virt-viewer to the 6.7 version (2.0-7) in 6.8 but then I get a proxy error (no proxy is set in the browser). Can someone tell me whether it is possible to get virt-viewer to launch a console for a VM with oVirt 4.1 and rhel 6.8? This redhat article (https://access.redhat.com/articles/2800531) says you need to upgrade to rhel 7.0, but that is not an option. I've also read that it was possible with a workaround with 4.0 but not 4.1. Thanks for any help. Cam

1 0

[GlusterFS] Regarding gluster backup-volfile-servers option
by TranceWorldLogic . 18 May '17

18 May '17

Hi, Before trying out, I want to understand how glusterfs will react for below scenario. Please help me. Let consider I have two host hostA and hostB I have setup replica volume on hostA and hostB. (consider as storage domain for DATA in ovirt). I have configure data domain mount command with backup server option (backup-volfile-server) as hostB (I mean main server as hostA and backup as hostB) 1> As I understood, VDSM execute mount command on both hostA and hostB.(for creating data domain) 2> That mean, HostB glusterFS CLIENT will communicate with main server (hostA). (Please correct me if I am wrong here.) 3> Let say HostA got down (say shutdown, power off scenario) 4> Due to backup option I will have data domain available on HostB. (Now glusterFS CLIENT on HostB will start communicating with HostB GlusterFS SERVER). 5> Now let say HostA comes up. 6> Will it sync all data from HostB to HostA glusterFS server ? (as per doc, yes, i not tried yet, want to confirm my understanding) 7> Will glusterFS CLIENT on HostB start communicate with main server (HostA) ? Please let me know, I am new to glusterFS. Thanks, ~Rohit

2 4

Workaround for https://bugzilla.redhat.com/show_bug.cgi?id=1435207
by gflwqs gflwqs 18 May '17

18 May '17

Hi list, I think i have run into https://bugzilla.redhat.com/show_bug.cgi?id=1435207. However last comment is from 2017-05-17. Since all vm:s on the host is getting unresponsive the only thing i can do to fix it is to restart vdsmd. That works for an hour or so but then all vm:s getting unresponsive again. Does anybody know if there is a workaround for this bug? Regards Christian

1 0

ovirtmgmt network out of sync
by Alex R 18 May '17

18 May '17

Hi, I upgraded to the latest version (users(a)ovirt.org) a few weeks ago and ever since then I cannot open a console unless I am on the local network ( 10.3.1.0/24). I think it is related to the Ovirtmgmt interface being "out-of-sync". If I try to fix it in the gui, I get an error: "Error while executing action HostSetupNetworks: Network is currently being used" This is because the hosted engine in on the ovirtmgmt network. Is there a way I can fix this via cli? This is a single host with a hosted engine. I use it for development only. Thank you.

2 8

vm migration failure and jobs
by Fabrice Bacchella 17 May '17

17 May '17

--Apple-Mail=_4B76C00E-DF31-4824-916F-F2E20C451C16 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I'm switching a host to maintenance state and it's failing because of = problem migrating one of it's VM. I'm listing the current jobs running in ovirt and getting that list: $ ./ovcmd job list -t '{id!s} {description!s} {start_time!s}' 00ebb251-2229-4178-82cd-dff421de96ea Moving Host nb0104 to Maintenance = 2017-05-17 12:48:59.598000+02:00 fb83ab93-0455-4cde-a93f-3a43b7346ef9 Moving Host nb0104 to Maintenance = 2017-05-17 12:43:56.902000+02:00 f9b85fd3-5ef4-4b16-8472-3dc4119880d1 Moving Host nb0104 to Maintenance = 2017-05-17 12:38:53.918000+02:00 9c7b8799-56e7-480a-9066-9dde49eebda6 Moving Host nb0104 to Maintenance = 2017-05-17 12:33:50.689000+02:00 f6afaf10-1676-4573-91af-170f80a0a67e Moving Host nb0104 to Maintenance = 2017-05-17 12:28:48.602000+02:00 f32c55b4-ec62-49ca-84e6-70ac7922895c Moving Host nb0104 to Maintenance = 2017-05-17 12:23:46.118000+02:00 b7443f5f-21f3-4ed7-8230-00e772e6b678 Moving Host nb0104 to Maintenance = 2017-05-17 12:18:43.860000+02:00 5c57a6e9-05f9-434d-a581-748638b601a8 Moving Host nb0104 to Maintenance = 2017-05-17 12:13:41.558000+02:00 3a499570-d4c1-4d7e-a5bb-d487e19c8dc9 Moving Host nb0104 to Maintenance = 2017-05-17 12:08:39.960000+02:00 03d2202f-f884-4fb0-95e7-f78733c93265 Moving Host nb0104 to Maintenance = 2017-05-17 12:03:34.449000+02:00 f246eafd-c1d0-4e9e-b87c-962f9a494b97 Moving Host nb0104 to Maintenance = 2017-05-17 11:58:29.952000+02:00 904c932b-e695-4b8b-b975-8148e5800992 Moving Host nb0104 to Maintenance = 2017-05-17 11:53:27.592000+02:00 6dd2dce7-9b82-47b0-a39c-ff7e90e6c6ef Moving Host nb0104 to Maintenance = 2017-05-17 11:48:24.683000+02:00 69ea38e4-5b22-4c3a-8650-71c1ca059801 Moving Host nb0104 to Maintenance = 2017-05-17 11:43:20.137000+02:00 a321ab67-ae12-44e0-a787-75bd818c6821 Moving Host nb0104 to Maintenance = 2017-05-17 11:38:18.115000+02:00 ffd29e6f-51f5-4da4-a8c1-e027431377e2 Moving Host nb0104 to Maintenance = 2017-05-17 11:33:15.927000+02:00 3c7a07d4-8136-4309-ae47-3b35a77b206a Moving Host nb0104 to Maintenance = 2017-05-17 11:28:11.985000+02:00 a5f50eed-35d3-46e7-af2b-684bae7e918f Moving Host nb0104 to Maintenance = 2017-05-17 11:23:09.829000+02:00 d307dd44-e1c1-4fd1-9471-1602f0aef541 Moving Host nb0104 to Maintenance = 2017-05-17 11:18:06.736000+02:00 ad56ebec-9c12-4b2c-91a3-5043d76257c9 Moving Host nb0104 to Maintenance = 2017-05-17 11:13:02.169000+02:00 1f2debf4-15a3-483e-be66-2afff331a83b Moving Host nb0104 to Maintenance = 2017-05-17 11:07:59.661000+02:00 =20 So each failed job launch a new one but don't terminate. Is that an expected situation ?= --Apple-Mail=_4B76C00E-DF31-4824-916F-F2E20C451C16 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">I'm switching a host to maintenance state and it's failing = because of problem migrating one of it's VM.<div class=3D""><br = class=3D""></div><div class=3D"">I'm listing the current jobs running in = ovirt and getting that list:</div><div class=3D""><div style=3D"margin: = 0px; font-size: 11px; line-height: normal; font-family: Menlo;" = class=3D""><span style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">$ ./ovcmd job list -t '{id!s} {description!s} = {start_time!s}'</span></div></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">00ebb251-2229-4178-82cd-dff421de96ea Moving Host nb0104 to = Maintenance 2017-05-17 12:48:59.598000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">fb83ab93-0455-4cde-a93f-3a43b7346ef9 = Moving Host nb0104 to Maintenance 2017-05-17 = 12:43:56.902000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">f9b85fd3-5ef4-4b16-8472-3dc4119880d1 Moving Host nb0104 to = Maintenance 2017-05-17 12:38:53.918000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">9c7b8799-56e7-480a-9066-9dde49eebda6 = Moving Host nb0104 to Maintenance 2017-05-17 = 12:33:50.689000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">f6afaf10-1676-4573-91af-170f80a0a67e Moving Host nb0104 to = Maintenance 2017-05-17 12:28:48.602000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">f32c55b4-ec62-49ca-84e6-70ac7922895c = Moving Host nb0104 to Maintenance 2017-05-17 = 12:23:46.118000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">b7443f5f-21f3-4ed7-8230-00e772e6b678 Moving Host nb0104 to = Maintenance 2017-05-17 12:18:43.860000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">5c57a6e9-05f9-434d-a581-748638b601a8 = Moving Host nb0104 to Maintenance 2017-05-17 = 12:13:41.558000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">3a499570-d4c1-4d7e-a5bb-d487e19c8dc9 Moving Host nb0104 to = Maintenance 2017-05-17 12:08:39.960000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">03d2202f-f884-4fb0-95e7-f78733c93265 = Moving Host nb0104 to Maintenance 2017-05-17 = 12:03:34.449000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">f246eafd-c1d0-4e9e-b87c-962f9a494b97 Moving Host nb0104 to = Maintenance 2017-05-17 11:58:29.952000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">904c932b-e695-4b8b-b975-8148e5800992 = Moving Host nb0104 to Maintenance 2017-05-17 = 11:53:27.592000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">6dd2dce7-9b82-47b0-a39c-ff7e90e6c6ef Moving Host nb0104 to = Maintenance 2017-05-17 11:48:24.683000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">69ea38e4-5b22-4c3a-8650-71c1ca059801 = Moving Host nb0104 to Maintenance 2017-05-17 = 11:43:20.137000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">a321ab67-ae12-44e0-a787-75bd818c6821 Moving Host nb0104 to = Maintenance 2017-05-17 11:38:18.115000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">ffd29e6f-51f5-4da4-a8c1-e027431377e2 = Moving Host nb0104 to Maintenance 2017-05-17 = 11:33:15.927000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">3c7a07d4-8136-4309-ae47-3b35a77b206a Moving Host nb0104 to = Maintenance 2017-05-17 11:28:11.985000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">a5f50eed-35d3-46e7-af2b-684bae7e918f = Moving Host nb0104 to Maintenance 2017-05-17 = 11:23:09.829000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">d307dd44-e1c1-4fd1-9471-1602f0aef541 Moving Host nb0104 to = Maintenance 2017-05-17 11:18:06.736000+02:00</span></div><div = style=3D"margin: 0px; font-size: 11px; line-height: normal; font-family: = Menlo;" class=3D""><span style=3D"font-variant-ligatures: = no-common-ligatures" class=3D"">ad56ebec-9c12-4b2c-91a3-5043d76257c9 = Moving Host nb0104 to Maintenance 2017-05-17 = 11:13:02.169000+02:00</span></div><div style=3D"margin: 0px; font-size: = 11px; line-height: normal; font-family: Menlo;" class=3D""><span = style=3D"font-variant-ligatures: no-common-ligatures" = class=3D"">1f2debf4-15a3-483e-be66-2afff331a83b Moving Host nb0104 to = Maintenance 2017-05-17 11:07:59.661000+02:00</span></div><div = class=3D""> </div><div class=3D"">So each failed job launch a new = one but don't terminate.</div><div class=3D""><br class=3D""></div><div = class=3D"">Is that an expected situation ?</div></body></html>= --Apple-Mail=_4B76C00E-DF31-4824-916F-F2E20C451C16--

1 0

Feature: enhanced OVA support
by Arik Hadas 17 May '17

17 May '17

Hi everyone, We would like to share our plan for extending the currently provided support for OVA files with: 1. Support for uploading OVA. 2. Support for exporting a VM/template as OVA. 3. Support for importing OVA that was generated by oVirt (today, we only support those that are VMware-compatible). 4. Support for downloading OVA. This can be found on the feature page <http://www.ovirt.org/develop/release-management/features/virt/enhance-impor…> . Your feedback and cooperation will be highly appreciated. Thanks, Arik

6 9

ovirt 4.1: migrate vm to node 2 results in lost connectivity
by yayo (j) 17 May '17

17 May '17

Hi all, I have a simple 3 node ovirt 4.1 gluster. All works fine but when I create or move a vm to node 2 the connection is lost, if I move the vm back to node 1 all works fine again. Looking to ovirt engine, network seems identical (for now I have only ovirtmng network). If I ping something from node 2, ping works fine (internet in general). Where can I check also? thank you

2 4

Smtp configuration for notification
by wodel youchi 17 May '17

17 May '17

Hi, When we install the vm engine, in the configuration process we are asked to give an smtp server and email addresses for notification but then nothing. When we looked to the event notification configuration we found this file ovirt-engine-notifier.conf and we thought that the first configuration was there but since the notification service was disabled notifications were not working, but No, there was no configuration on that file we had to modify it and now notifications are working. The question is : is the first smtp configuration used ? If yes, when? Can we test it ? And if we want to modify it, where the configuration is stored ? Regards

2 1

Regenerating SSL keys
by Jamie Lawrence 16 May '17

16 May '17

The key generated by the engine install ended up with a bad CN; it has a five-digit number appended to the host name, and no SAN. I've lived with this through setup, but now I'm getting close to prod use, and need to clean up so that it is usable for general consumption. And the SPICE HTML client is completely busted due to this; that's a problem because we're mostly MacOS on the client side, and the Mac Spice client is unusable for normal humans. I'm wary of attempting to regenerate these manually, as I don't have a handle on how the keysare used by the various components. What is the approved method of regenerating these keys? -j

3 3

Ovirt nested in VMware
by Mark Duggan 16 May '17

16 May '17

Hi everyone, >From reading through the mailing list, it does appear that it's possible to have the ovirt nodes/hosts be VMware virtual machines, once I enable the appropriate settings on the VMware side. All seems to have gone well, I can see the hosts in the ovirt interface, but when I attempt to create and start a VM it never gets past printing the SeaBios version and the machine UUID to the screen/console. It doesn't appear to try to boot from the hard disk or an ISO that I've attached. Has anyone else encountered similar behaviour? Are there additional debug logs I can look at or enable to help further diagnose what is happening? Thanks Mark

3 7

Backup ovirt engine
by andrewzabomb＠aol.com 16 May '17

16 May '17

------=_Part_53727_1194598365.1494860695128 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit I'm not sure how to backup the Ovirt engine to an external hard drive. I plan on updating to Ovirt 3.6 (as I currently have 3.5), then centOS 7 (currently using centOS 6), and after updating the Ovirt 3.6 to 4.0, but I want to have a backup file on an external drive before going through with the updates. Thanks ------=_Part_53727_1194598365.1494860695128 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <font color='black' size='2' face='arial'><pre class="bz_comment_text bz_wrap_comment_text" id="comment_text_0" style="font-size: small; white-space: pre-wrap; word-wrap: break-word; width: 50em;"><br> </pre><pre class="bz_comment_text bz_wrap_comment_text" id="comment_text_0" style="font-size: small; white-space: pre-wrap; word-wrap: break-word; width: 50em;"><font face="Arial, Helvetica, sans-serif">I'm not sure how to backup the Ovirt engine to an external hard drive. I plan on updating to Ovirt 3.6 (as I currently have 3.5), then centOS 7 (currently using centOS 6), and after updating the Ovirt 3.6 to 4.0, but I want to have a backup file on an external drive before going through with the updates. </font></pre><pre class="bz_comment_text bz_wrap_comment_text" id="comment_text_0" style="font-size: small; white-space: pre-wrap; word-wrap: break-word; width: 50em;"><font face="Arial, Helvetica, sans-serif"><br> </font></pre><pre class="bz_comment_text bz_wrap_comment_text" id="comment_text_0" style="font-size: small; white-space: pre-wrap; word-wrap: break-word; width: 50em;"><font face="Arial, Helvetica, sans-serif">Thanks</font></pre></font> ------=_Part_53727_1194598365.1494860695128--

2 1

Ovirt + Citrix Xenserver support?
by santosh bhabal 16 May '17

16 May '17

Hello Experts, I am new to Ovirt community. Apology if this question has asked earlier. I just wanted to know that does Ovirt support Citrix Xenserver or not? Reagrds Santosh.

4 4

Self-Hosted Engine Deploy - CephFS Not a Storage Option
by Michael Poat 16 May '17

16 May '17

This is a multi-part message in MIME format. --------------EDA4F48E9FCD0C6C900C6E59 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hello, I currently have a 30 node ~200TB Raw Ceph storage primarily used as a CephFS POSIX Complaint storage for my enclave. Currently I am working on setting up a dual node High Availability ovirt 4.1 cluster. Considering avoiding any single points of failure, I would like to use CephFS as my storage domains and want to use the Self-Hosed Engine feature. When setting up the Self-Hosted Engine and reaching the steps for "Configuring Storage", POSIX Compliant FS or CephFS is not an option... Prompt: |During customization use CTRL-D to abort. Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs3, nfs4)[nfs3]:| Is there a work around for this or any future POSIX FS/CephFS Support for the Self-Hosted-Engine setup? I was able to create CephFS Domains within Ovirt and they work great. I was also wondering if it would be possible to migrate the self-hosted VM to the CephFS storage but this would require shutting down the VM itself, sort of a catch-22. Thanks, -Michael --------------EDA4F48E9FCD0C6C900C6E59 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body text="#000000" bgcolor="#FFFFFF"> <p>Hello,<br> </p> <p>I currently have a 30 node ~200TB Raw Ceph storage primarily used as a CephFS POSIX Complaint storage for my enclave. Currently I am working on setting up a dual node High Availability ovirt 4.1 cluster. Considering avoiding any single points of failure, I would like to use CephFS as my storage domains and want to use the Self-Hosed Engine feature.<br> </p> <p>When setting up the Self-Hosted Engine and reaching the steps for "Configuring Storage", POSIX Compliant FS or CephFS is not an option...</p> <p>Prompt:<br> </p> <pre class="highlight plaintext"><code> During customization use CTRL-D to abort. Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs3, nfs4)[nfs3]:</code></pre> <p>Is there a work around for this or any future POSIX FS/CephFS Support for the Self-Hosted-Engine setup? I was able to create CephFS Domains within Ovirt and they work great. I was also wondering if it would be possible to migrate the self-hosted VM to the CephFS storage but this would require shutting down the VM itself, sort of a catch-22.</p> <p>Thanks,</p> <p>-Michael<br> </p> </body> </html> --------------EDA4F48E9FCD0C6C900C6E59--

2 1

Setting up GeoReplication
by Jim Kusznir 16 May '17

16 May '17

Hi All: I've been trying to set up georeplication for a while now, but can't seem to make it work. I've found documentation on the web (mostly https://gluster.readthedocs.io/en/refactor/Administrator%20Guide/Geo%20Repl…) and I found http://blog.gluster.org/2015/09/introducing-georepsetup-gluster-geo-replica… Unfortunately, it seems that some critical steps are missing from both, and I can't figure out for sure what they are. My environment: Production: replica 2 + arbitrator running on my 3-node oVirt cluster, 3 volumes (engine, data, iso). New geo-replication: Raspberry Pi3 with USB hard drive shoved in some other data closet off-site. I've installed rasbian-lite, and after much fighting, got glusterfs-*-3.8.11 installed. I've created my mountpoint (USB hard drive, much larger than my gluster volumes), and then ran the command. I get this far: [ OK] georep.nwfiber.com is Reachable(Port 22) [ OK] SSH Connection established root(a)georep.nwfiber.com [ OK] Master Volume and Slave Volume are compatible (Version: 3.8.11) [NOT OK] Unable to Mount Gluster Volume georep.nwfiber.com:engine-rep Trying it with the steps in the gluster docs also has the same problem. No long files are generated on the slave. Log files on the master include: [root@ovirt1 geo-replication]# more georepsetup.mount.log [2017-05-13 17:26:27.318599] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-glusterfs: Started running glusterfs version 3.8.11 (args: glusterfs --xlator-option="*dht.lookup-unhashed=off" --volfile-server localhost --volfile-id engine -l /var/log/glusterfs/geo-repli cation/georepsetup.mount.log --client-pid=-1 /tmp/georepsetup_wZtfkN) [2017-05-13 17:26:27.341170] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2017-05-13 17:26:27.341260] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to ::1:24007 failed (Connection refused ) [2017-05-13 17:26:27.341846] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: local host (Transport endpoint is not connected) [2017-05-13 17:26:31.335849] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 2 [2017-05-13 17:26:31.337545] I [MSGID: 114020] [client.c:2356:notify] 0-engine-client-0: parent translators are ready, attempting co nnect on transport [2017-05-13 17:26:31.344485] I [MSGID: 114020] [client.c:2356:notify] 0-engine-client-1: parent translators are ready, attempting co nnect on transport [2017-05-13 17:26:31.345146] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-engine-client-0: changing port to 49157 (from 0) [2017-05-13 17:26:31.350868] I [MSGID: 114020] [client.c:2356:notify] 0-engine-client-2: parent translators are ready, attempting co nnect on transport [2017-05-13 17:26:31.355946] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-engine-client-0: Using P rogram GlusterFS 3.3, Num (1298437), Version (330) [2017-05-13 17:26:31.356280] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-engine-client-1: changing port to 49157 (from 0) Final graph: +------------------------------------------------------------------------------+ 1: volume engine-client-0 2: type protocol/client 3: option clnt-lk-version 1 4: option volfile-checksum 0 5: option volfile-key engine 6: option client-version 3.8.11 7: option process-uuid ovirt1.nwfiber.com-25660-2017/05/13-17:26:27:311929-engine-client-0-0-0 8: option fops-version 1298437 9: option ping-timeout 30 10: option remote-host ovirt1.nwfiber.com 11: option remote-subvolume /gluster/brick1/engine 12: option transport-type socket 13: option username 028984cf-0399-42e6-b04b-bb9b1685c536 14: option password eae737cc-9659-405f-865e-9a7ef97a3307 15: option filter-O_DIRECT off 16: option send-gids true 17: end-volume 18: 19: volume engine-client-1 20: type protocol/client 21: option ping-timeout 30 22: option remote-host ovirt2.nwfiber.com 23: option remote-subvolume /gluster/brick1/engine 24: option transport-type socket 25: option username 028984cf-0399-42e6-b04b-bb9b1685c536 26: option password eae737cc-9659-405f-865e-9a7ef97a3307 27: option filter-O_DIRECT off 28: option send-gids true 29: end-volume 30: 31: volume engine-client-2 32: type protocol/client 33: option ping-timeout 30 34: option remote-host ovirt3.nwfiber.com 35: option remote-subvolume /gluster/brick1/engine 36: option transport-type socket 37: option username 028984cf-0399-42e6-b04b-bb9b1685c536 38: option password eae737cc-9659-405f-865e-9a7ef97a3307 39: option filter-O_DIRECT off 40: option send-gids true 41: end-volume 42: 43: volume engine-replicate-0 44: type cluster/replicate 45: option arbiter-count 1 46: option data-self-heal-algorithm full 47: option eager-lock enable 48: option quorum-type auto 49: option shd-max-threads 6 50: option shd-wait-qlength 10000 51: option locking-scheme granular 52: subvolumes engine-client-0 engine-client-1 engine-client-2 53: end-volume 54: 55: volume engine-dht 56: type cluster/distribute 57: option lock-migration off 58: subvolumes engine-replicate-0 59: end-volume 60: 61: volume engine-shard 62: type features/shard 63: option shard-block-size 512MB 64: subvolumes engine-dht 65: end-volume 66: 67: volume engine-write-behind 68: type performance/write-behind 69: option strict-O_DIRECT on 70: subvolumes engine-shard 71: end-volume 72: 73: volume engine-readdir-ahead 74: type performance/readdir-ahead 75: subvolumes engine-write-behind 76: end-volume 77: 78: volume engine-open-behind 79: type performance/open-behind 80: subvolumes engine-readdir-ahead 81: end-volume 82: 83: volume engine 84: type debug/io-stats 85: option log-level INFO 86: option latency-measurement off 87: option count-fop-hits off 88: subvolumes engine-open-behind 89: end-volume 90: 91: volume meta-autoload 92: type meta 93: subvolumes engine 94: end-volume 95: +------------------------------------------------------------------------------+ [2017-05-13 17:26:31.360579] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-engine-client-0: Connected to engine -client-0, attached to remote volume '/gluster/brick1/engine'. [2017-05-13 17:26:31.360599] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-engine-client-0: Server and Client l k-version numbers are not same, reopening the fds [2017-05-13 17:26:31.360707] I [MSGID: 108005] [afr-common.c:4387:afr_notify] 0-engine-replicate-0: Subvolume 'engine-client-0' came back up; going online. [2017-05-13 17:26:31.360793] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-engine-client-0: Server lk versi on = 1 [2017-05-13 17:26:31.361284] I [rpc-clnt.c:1965:rpc_clnt_reconfig] 0-engine-client-2: changing port to 49158 (from 0) [2017-05-13 17:26:31.365070] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-engine-client-1: Using P rogram GlusterFS 3.3, Num (1298437), Version (330) [2017-05-13 17:26:31.365788] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-engine-client-1: Connected to engine -client-1, attached to remote volume '/gluster/brick1/engine'. [2017-05-13 17:26:31.365821] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-engine-client-1: Server and Client l k-version numbers are not same, reopening the fds [2017-05-13 17:26:31.366059] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-engine-client-1: Server lk versi on = 1 [2017-05-13 17:26:31.369948] I [MSGID: 114057] [client-handshake.c:1440:select_server_supported_programs] 0-engine-client-2: Using P rogram GlusterFS 3.3, Num (1298437), Version (330) [2017-05-13 17:26:31.370657] I [MSGID: 114046] [client-handshake.c:1216:client_setvolume_cbk] 0-engine-client-2: Connected to engine -client-2, attached to remote volume '/gluster/brick1/engine'. [2017-05-13 17:26:31.370683] I [MSGID: 114047] [client-handshake.c:1227:client_setvolume_cbk] 0-engine-client-2: Server and Client l k-version numbers are not same, reopening the fds [2017-05-13 17:26:31.383548] I [MSGID: 114035] [client-handshake.c:202:client_set_lk_version_cbk] 0-engine-client-2: Server lk versi on = 1 [2017-05-13 17:26:31.383649] I [fuse-bridge.c:4147:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.24 k ernel 7.22 [2017-05-13 17:26:31.383676] I [fuse-bridge.c:4832:fuse_graph_sync] 0-fuse: switched to graph 0 [2017-05-13 17:26:31.385453] I [MSGID: 108031] [afr-common.c:2157:afr_local_discovery_cbk] 0-engine-replicate-0: selecting local rea d_child engine-client-0 [2017-05-13 17:26:31.396741] I [fuse-bridge.c:5080:fuse_thread_proc] 0-fuse: unmounting /tmp/georepsetup_wZtfkN [2017-05-13 17:26:31.397086] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f8838df6dc5] -->glusterf s(glusterfs_sigwaiter+0xe5) [0x7f883a488cd5] -->glusterfs(cleanup_and_exit+0x6b) [0x7f883a488b4b] ) 0-: received signum (15), shutti ng down [2017-05-13 17:26:31.397112] I [fuse-bridge.c:5788:fini] 0-fuse: Unmounting '/tmp/georepsetup_wZtfkN'. [2017-05-13 17:26:31.413901] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-glusterfs: Started running glusterfs version 3.8.11 (args: glusterfs --xlator-option="*dht.lookup-unhashed=off" --volfile-server georep.nwfiber.com --volfile-id engine -l /var/log/glusterfs/ geo-replication/georepsetup.mount.log --client-pid=-1 /tmp/georepsetup_M5poIr) [2017-05-13 17:26:31.458733] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2017-05-13 17:26:31.458833] E [socket.c:2309:socket_connect_finish] 0-glusterfs: connection to 192.168.8.126:24007 failed (Connecti on refused) [2017-05-13 17:26:31.458886] E [glusterfsd-mgmt.c:1908:mgmt_rpc_notify] 0-glusterfsd-mgmt: failed to connect with remote-host: geore p.nwfiber.com (Transport endpoint is not connected) [2017-05-13 17:26:31.458900] I [glusterfsd-mgmt.c:1926:mgmt_rpc_notify] 0-glusterfsd-mgmt: Exhausted all volfile servers [2017-05-13 17:26:31.459173] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libgfrpc.so.0(rpc_clnt_notify+0xdb) [0x7f18d6c89aab] -->glusterfs(+0x10309) [0x7f18d73b9309] -->glusterfs(cleanup_and_exit+0x6b) [0x7f18d73b2b4b] ) 0-: received signum (1), shutting dow n [2017-05-13 17:26:31.459218] I [fuse-bridge.c:5788:fini] 0-fuse: Unmounting '/tmp/georepsetup_M5poIr'. [2017-05-13 17:26:31.459887] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libpthread.so.0(+0x7dc5) [0x7f18d5d20dc5] -->glusterf s(glusterfs_sigwaiter+0xe5) [0x7f18d73b2cd5] -->glusterfs(cleanup_and_exit+0x6b) [0x7f18d73b2b4b] ) 0-: received signum (15), shutti ng down I don't know what to make of that. On a whim, I thought that perhaps the georep setup does not set up the remote volume (I assumed it would, I thought that was what the ssh was required for, and none of the instructions mentioned create your destination (replication) volume. So I tried to create it, but it won't let me create a volume with replica 1. this is already a backup, I don't need a backup of a backup. This further supported my thought that the volume needs to be created by the georep setup commands. Where am I wrong / what do I need to do to fix this? --Jim

2 3

Fwd: [Pkg-libvirt-discuss] Packaging oVirt for Debian
by Leni Kadali Mutungi 15 May '17

15 May '17

Forwarding this so that it is seen on oVirt's mailing list as well. In future, I'll try to make sure that I mail both the Debian Virtualization team and the oVirt users insofar as the topic is relevant to both sides. ---------- Forwarded message ---------- From: Guido Günther <agx(a)sigxcpu.org> Date: Mon, 15 May 2017 08:13:52 +0200 Subject: Re: [Pkg-libvirt-discuss] Packaging oVirt for Debian To: Leni Kadali Mutungi <lenikmutungi(a)gmail.com> On Mon, May 15, 2017 at 05:20:19AM +0300, Leni Kadali Mutungi wrote: > Hello all. This is where I am so far with the compiling and packaging. > > http://lists.ovirt.org/pipermail/users/2017-April/081523.html Nice you're making progress! > > I am now looking for how to enable the virt service and assign an IP > address that > ovirt-host-deploy can use. > > Also it seems that the yumpackager.py and miniyum.py scripts are > dependencies for ovirt-host-deploy. So it seems I need to write/find a > python script that is equivalent to yumpackager.py and miniyum.py so > that that dependency for ovirt-host-deploy is satisfied > as well, because setting it to not use a package was a short-term > solution to get it to run successfully. Have a look at python-apt. That will allow you to write a wrapper similar to miniyum.py. > > So if I could be pointed in the direction of a suitable script that > would work with Debian's aptitude, apt-get and apt in a similar > manner, I'd be much obliged. Please keep them mailing list in cc: so more people get a chance to help you! Cheers, -- Guido -- - Warm regards Leni Kadali Mutungi

1 0

ovirt-engine4, 404 - Not Found
by David David 15 May '17

15 May '17

Hello Centos7. Fresh install engine 4.1 Getting "404 - Not Found", while entering in webUI main page using https. how to fix it? engine.log in attachment.

2 1

Removing *250GB Disk from Gluster SD - Error
by Sven Achtelik 15 May '17

15 May '17

--_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi All, I was trying to remove a ~250GB Disk from a Gluster SD and the engine has = gone crazy. The Storage latency went up dramatically, which caused a change= of the spm and everything to get unresponsive for about 10-30 seconds. How= do I remove such a big disk in a way that this doesn't happen again ? I an= yone running gluster on with a caching option ? The Bricks are on a raid 5+= 0 and should be pretty fast. Are there any values that can be tuned in the = Engine - maybe for the acceptance of a little more storage latency ? Thank you, Sven --_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV=3D"Content-Type" CONTENT= =3D"text/html; charset=3Dus-ascii"><meta name=3DGenerator content=3D"Micros= oft Word 15 (filtered medium)"><style></style></head><body lang=3DDE link=3D"#0563C1" v= link=3D"#954F72"><div class=3DWordSection1><p class=3DMsoNormal>Hi All, <o:= p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>= <span lang=3DEN-US>I was trying to remove a  ~250GB Disk from a Gluste= r SD and the engine has gone crazy. The Storage latency went up dramaticall= y, which caused a change of the spm and everything to get unresponsive for = about 10-30 seconds. How do I remove such a big disk in a way that this doe= sn’t happen again ? I anyone running gluster on with a caching option= ? The Bricks are on a raid 5+0 and should be pretty fast. Are there any va= lues that can be tuned in the Engine – maybe for the acceptance of a = little more storage latency ? <o:p></o:p></span></p><p class=3DMsoNormal><s= pan lang=3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span lan= g=3DEN-US>Thank you, <o:p></o:p></span></p><p class=3DMsoNormal><span lang= =3DEN-US><o:p> </o:p></span></p><p class=3DMsoNormal><span lang=3DEN-U= S>Sven<o:p></o:p></span></p><p class=3DMsoNormal><o:p> </o:p></p></div= ></body></html>= --_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4ECBSOCRATESasl_--

1 0

Internet access for oVirt Nodes?
by Matthias Leopold 15 May '17

15 May '17

hi, do hypervisors, that are running oVirt Node (not standard CentOS/RHEL), need internet access for updates or can they be in a private, non routed network (and updates happen via engine)? it seems the latter is the case, but i want to be sure thx matthias

2 1

Re: [ovirt-users] can i Extend volume from replica 2 to replica 3 with arbiter
by Ravishankar N 15 May '17

15 May '17

This is a multi-part message in MIME format. --------------0CEFB242D3E16A95E29AC6A4 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit > ---------- Forwarded message ---------- > From: *Khalid Jamal* <khalid.jamal(a)earthlinktele.com > <mailto:khalid.jamal@earthlinktele.com>> > Date: Sat, May 13, 2017 at 10:51 PM > Subject: [ovirt-users] can i Extend volume from replica 2 to replica 3 > with arbiter > To: users(a)ovirt.org <mailto:users@ovirt.org> > > > Dear Team > > i need you advice for convert our volume replica 2 to replica 3 with > arbiter but important thing it's production environments , i try to > convert the same name of volume in replica 2 to convert is to the > replica 3 to avoid losing vm's or any data that's what i do it : > > > # gluster volume create gfs1 replica 3 arbiter 1 s1:/export/sdb1/br1 > s2:/export/sdb1/br1 s3:/export/sdb1/br1 s1:/export/sdc1/br1 > s2:/export/sdc1/br1 s3:/export/sdc1/br1 s4:/export/sdb1/br1 > s5:/export/sdb1/br1 s6:/export/sdb1/br1 s4:/export/sdc1/br1 > s5:/export/sdc1/br1 s6:/export/sdc1/br1 > > that's the result : > > > volume create: gfs1: failed: Volume gfs1 already exists > > If you are converting an existing replica 2 to arbiter, you would need to use the `add-brick` command. The syntax is given here: https://review.gluster.org/#/c/14126/8//COMMIT_MSG Hope that helps, Ravi > > i try to change the name but without any success what shall i do. > > > best regards > > > > Eng khalid jamal > System Admin@IT Department > Earthlink Telecom > > Email: khalid.jamal(a)earthlinktele.com > <mailto:khalid.jamal@earthlinktele.com> > No: 3355 > skype: engkhalid21986 > NO : 07704268321 > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org <mailto:Users@ovirt.org> > http://lists.ovirt.org/mailman/listinfo/users > <http://lists.ovirt.org/mailman/listinfo/users> > > --------------0CEFB242D3E16A95E29AC6A4 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <br> <blockquote cite="mid:CACjzOvcGHqfYQiAy4XR+vVCtHa=SM=-gXatrnaY2nN9NGunSsw@mail.gmail.com" type="cite"> <div dir="ltr"> <div> <div class="gmail_quote">---------- Forwarded message ----------<br> From: <b class="gmail_sendername">Khalid Jamal</b> <span dir="ltr"><<a moz-do-not-send="true" href="mailto:khalid.jamal@earthlinktele.com">khalid.jamal(a)earthlinktele.com</a>></span><br> Date: Sat, May 13, 2017 at 10:51 PM<br> Subject: [ovirt-users] can i Extend volume from replica 2 to replica 3 with arbiter<br> To: <a moz-do-not-send="true" href="mailto:users@ovirt.org">users(a)ovirt.org</a><br> <br> <br> <div> <p>Dear Team</p> <p>i need you advice for convert our volume replica 2 to replica 3 with arbiter but important thing it's production environments , i try to convert the same name of volume in replica 2 to convert is to the replica 3 to avoid losing vm's or any data that's what i do it :</p> <p><br> </p> <p><span style="color:rgb(0,0,255)"># gluster volume create gfs1 replica 3 arbiter 1 s1:/export/sdb1/br1 s2:/export/sdb1/br1 s3:/export/sdb1/br1 s1:/export/sdc1/br1 s2:/export/sdc1/br1 s3:/export/sdc1/br1 s4:/export/sdb1/br1 s5:/export/sdb1/br1 s6:/export/sdb1/br1 s4:/export/sdc1/br1 s5:/export/sdc1/br1 s6:/export/sdc1/br1</span></p> <p>that's the result :</p> <p><br> </p> <p><span style="color:rgb(255,0,0)">volume create: gfs1: failed: Volume gfs1 already exists</span></p> <p><span style="color:rgb(255,0,0)"><br> </span></p> </div> </div> </div> </div> </blockquote> If you are converting an existing replica 2 to arbiter, you would need to use the `add-brick` command. The syntax is given here: <a class="moz-txt-link-freetext" href="https://review.gluster.org/#/c/14126/8//COMMIT_MSG">https://review.gluster.org/#/c/14126/8//COMMIT_MSG</a><br> Hope that helps,<br> Ravi<br> <blockquote cite="mid:CACjzOvcGHqfYQiAy4XR+vVCtHa=SM=-gXatrnaY2nN9NGunSsw@mail.gmail.com" type="cite"> <div dir="ltr"> <div> <div class="gmail_quote"> <div> <p><span style="color:rgb(0,0,0)">i try to change the name but without any success what shall i do.</span></p> <p><br> </p> <p>best regards</p> <p><br> </p> <p><br> </p> <p>Eng khalid jamal<br> System Admin@IT Department<br> Earthlink Telecom</p> <div class="m_-3760168994860256500io-ox-signature"> <p>Email: <a moz-do-not-send="true" href="mailto:khalid.jamal@earthlinktele.com" target="_blank">khalid.jamal(a)earthlinktele.com</a><br> No: 3355<br> skype: engkhalid21986<br> NO : 07704268321</p> </div> </div> <br> ______________________________<wbr>_________________<br> Users mailing list<br> <a moz-do-not-send="true" href="mailto:Users@ovirt.org">Users(a)ovirt.org</a><br> <a moz-do-not-send="true" href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br> <br> </div> <br> </div> </div> </blockquote> <p><br> </p> </body> </html> --------------0CEFB242D3E16A95E29AC6A4--

1 0

Maintenance mode for storage?
by Troels Arvin 14 May '17

14 May '17

Hello, I would like to make use of the new ovirt feature where a LUN may be removed from a storage domain, provided there's enough free space on the remaining LUNs in the domain. It seems the storage domain needs to be put in maintenance mode before this may be accomplished. But what's the consequence of putting a storage domain in maintenance mode? Can guests using the domain keep running while the storage domain is in maintenance mode? Does something stop working while a storage domain is in maintenance mode? -- Regards, Troels Arvin

3 3

Engine deploy tab is missing when restoring from db-backup?
by gflwqs gflwqs 14 May '17

14 May '17

Hi list, I have restored my 4.1 engine. After i have restored the engine the engine deploy tab is missing? And since it is not possible anymore to deploy thru command line i am not able to deploy new hosts? - Does anybody know a workaround to deploy new hosts? - Is this a bug or am i doing something wrong when restoring? This is how i restored: [root@ovirt-engine ~]# engine-backup --mode=restore --file=backup.tar --log=restore.log --provision-db --provision-dwh-db --restore-permissions Thanks! Christian

2 1

The number of LVs on the domain VPLEX_DATA_DOMAIN exceeded 300, you are approaching the limit where performance may degrade.
by Rogério Ceni Coelho 14 May '17

14 May '17

Hi oVirt Admins, I have two data domains using FC SAN, with 150 VMs. Each VM have 3 or 4 disks. A few time ago i saw the above message on Events. What can i do ? What are the alternatives ? What can i do ? The number of LVs on the domain VPLEX_DATA_DOMAIN exceeded 300, you are approaching the limit where performance may degrade.

2 1

problem while updating oVirt from 3.6 to 4.0
by Nelson Lameiras 14 May '17

14 May '17

------=_Part_37643342_929927371.1494519067933 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello,=20 Not sure if I should post here, or on the dev mailling list.=20 I had a serious problem when upgrading an oVirt cluster from 3.6 to 4.0 (be= fore updating to 4.1)=20 The error on engine-setup log was :=20 "schema.sh: FATAL: Cannot execute sql command: --file=3D/usr/share/ovirt-en= gine/dbscripts/upgrade/04_00_0930_disallow_boot_protocol_to_be_null.sql"=20 After long hours of debuguing and analysing I found out the problem. On dat= abase, some entries on table network_attachements had a NULL value which we= re incompatible with the sql file above.=20 I'm guessing this is an "exotic situation" which shouldn't exist... in theo= ry ;)=20 Anyway, I'm fairly sure that the solution for this problem would be to patc= h the following file 'ovirt-engine/packaging/dbscripts/upgrade/04_00_0910_d= o_not_allow_null_boot_protocol.sql'=20 by adding the following line " update network_attachments set boot_protocol= =3D ' NONE ' where boot_protocol is null ;"=20 If a dev want to discuss it further, I'll be happy to explain my thoughts o= n this matter.=20 cordialement, regards,=20 =09Nelson LAMEIRAS=20 Ing=C3=A9nieur Syst=C3=A8mes et R=C3=A9seaux / Systems and Networks enginee= r=20 Tel: +33 5 32 09 09 70=20 nelson.lameiras(a)lyra-network.com=20 www.lyra-network.com | www.payzen.eu=20 =09 =09 =09 Lyra Network, 109 rue de l'innovation, 31670 Lab=C3=A8ge, FRANCE=20 ------=_Part_37643342_929927371.1494519067933 Content-Type: multipart/related; boundary="----=_Part_37643343_1124091921.1494519067933" ------=_Part_37643343_1124091921.1494519067933 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: arial, helvetica, sans-serif; font-s= ize: 12pt; color: #000000"><div>Hello,<br></div><div><br data-mce-bogus=3D"= 1"></div><div>Not sure if I should post here, or on the dev mailling list.<= br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div><div>I ha= d a serious problem when upgrading an oVirt cluster from 3.6 to 4.0 (before= updating to 4.1)<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"= 1"></div><div>The error on engine-setup log was : <br data-mce-bogus=3D"1">= </div><div>"schema.sh: FATAL: Cannot execute sql command: --file=3D/usr/sha= re/ovirt-engine/dbscripts/upgrade/04_00_0930_disallow_boot_protocol_to_be_n= ull.sql"<br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div>= <div>After long hours of debuguing and analysing I found out the problem. O= n database, some entries on table network_attachements had a NULL value whi= ch were incompatible with the sql file above.<br data-mce-bogus=3D"1"></div= ><div>I'm guessing this is an "exotic situation" which shouldn't exist... i= n theory ;)<br data-mce-bogus=3D"1"></div><div><br></div><div>Anyway, I'm f= airly sure that the solution for this problem would be to patch the followi= ng file 'ovirt-engine/packaging/dbscripts/upgrade/04_00_0910_do_not_allow_n= ull_boot_protocol.sql' </div><div>by adding the following line "<span class= =3D"pl-k">update</span> network_attachments <span class=3D"pl-k">set</span>= boot_protocol<span class=3D"pl-k">=3D</span><span class=3D"pl-s"><span cla= ss=3D"pl-pds">'</span>NONE<span class=3D"pl-pds">'</span></span> <span clas= s=3D"pl-k">where</span> boot_protocol is <span class=3D"pl-k">null</span>;"= <br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></div><div>If = a dev want to discuss it further, I'll be happy to explain my thoughts on t= his matter. <br data-mce-bogus=3D"1"></div><div><br data-mce-bogus=3D"1"></= div><div data-marker=3D"__SIG_PRE__"><div>cordialement, regards,</div><div>= <br data-mce-bogus=3D"1"></div><table style=3D"margin: 0px; table-layout: f= ixed; border: none; width: 345pt; padding: 0px;" data-mce-style=3D"margin: = 0px; table-layout: fixed; border: none; width: 345pt; padding: 0px;" width= =3D"460" cellspacing=3D"0" cellpadding=3D"0" border=3D"0"><tbody><tr><td st= yle=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2= b3c7a; line-height: 16px; width: 86.25pt; text-align: left;" data-mce-style= =3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c= 7a; line-height: 16px; width: 86.25pt; text-align: left;" width=3D"115" val= ign=3D"top"><a href=3D"https://www.lyra-network.com/" style=3D"border: none= ; text-decoration: none; width: 100%; display: block; clear: both;" data-mc= e-href=3D"https://www.lyra-network.com/" data-mce-style=3D"border: none; te= xt-decoration: none; width: 100%; display: block; clear: both;"><img src=3D= "cid:1db6da5091d14a0982ffcf8c4fef8a46b32a3417@zimbra" alt=3D"" data-mce-src= =3D"/home/admin(a)lyra-network.com/corporate-documents/element-signature_logo= _lyra_115x94.jpg" doc=3D"corporate-documents/element-signature_logo_lyra_11= 5x94.jpg" height=3D"94" width=3D"115" border=3D"0"></a><br data-mce-bogus= =3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-family: Arial,san= s-serif; color: #2b3c7a; line-height: 16px; width: 258.75pt;" data-mce-styl= e=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3= c7a; line-height: 16px; width: 258.75pt;" width=3D"345" valign=3D"top"><tab= le style=3D"margin: 0; width: 258.75pt; table-layout: fixed; border: none;"= data-mce-style=3D"margin: 0; width: 258.75pt; table-layout: fixed; border:= none;" width=3D"345" cellspacing=3D"0" cellpadding=3D"0" border=3D"0"><tbo= dy><tr><td style=3D"font-size: 16px; font-family: Arial,sans-serif; color: = #2b3c7a; line-height: 18px; font-weight: bold;" data-mce-style=3D"font-size= : 16px; font-family: Arial,sans-serif; color: #2b3c7a; line-height: 18px; f= ont-weight: bold;">Nelson LAMEIRAS</td></tr><tr><td style=3D"font-family: A= rial,sans-serif; color: #2b3c7a; font-size: 11px; line-height: 16px;" data-= mce-style=3D"font-family: Arial,sans-serif; color: #2b3c7a; font-size: 11px= ; line-height: 16px;">Ing=C3=A9nieur Syst=C3=A8mes et R=C3=A9seaux<span sty= le=3D"font-family: Arial,sans-serif; color: #337ab7; font-size: 11px;" data= -mce-style=3D"font-family: Arial,sans-serif; color: #337ab7; font-size: 11p= x;"> / Systems and Networks engineer</span></td></tr><tr><td style=3D"line-= height: 16px; font-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 1= 1px;" data-mce-style=3D"line-height: 16px; font-family: 'Arial',sans-serif;= color: #2b3c7a; font-size: 11px;"><span style=3D"font-family: Arial,sans-s= erif; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"font-family: Aria= l,sans-serif; color: #2b3c7a; font-size: 11px;">Tel: +33 5 32 09 09 70</spa= n></td></tr><tr><td style=3D"line-height: 16px; font-family: 'Arial',sans-s= erif; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"line-height: 16px= ; font-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 11px;"><a hre= f=3D"mailto:nelson.lameiras@lyra-network.com" style=3D"font-size: 11px; fon= t-family: Arial,sans-serif; line-height: 16px; text-decoration: none;" data= -mce-href=3D"mailto:nelson.lameiras@lyra-network.com" data-mce-style=3D"fon= t-size: 11px; font-family: Arial,sans-serif; line-height: 16px; text-decora= tion: none;">nelson.lameiras(a)lyra-network.com</a><br data-mce-bogus=3D"1"><= /td></tr><tr><td style=3D"line-height: 16px; font-family: 'Arial',sans-seri= f; color: #2b3c7a; font-size: 11px;" data-mce-style=3D"line-height: 16px; f= ont-family: 'Arial',sans-serif; color: #2b3c7a; font-size: 11px;"><a href= =3D"https://www.lyra-network.com/" style=3D"font-size: 11px; font-family: A= rial,sans-serif; line-height: 16px; border: none; text-decoration: none;" d= ata-mce-href=3D"https://www.lyra-network.com/" data-mce-style=3D"font-size:= 11px; font-family: Arial,sans-serif; line-height: 16px; border: none; text= -decoration: none;">www.lyra-network.com</a> <a href=3D"https://payzen.eu" = style=3D"font-size: 11px; font-family: Arial,sans-serif; line-height: 16px;= border: none; text-decoration: none;" data-mce-href=3D"https://payzen.eu" = data-mce-style=3D"font-size: 11px; font-family: Arial,sans-serif; line-heig= ht: 16px; border: none; text-decoration: none;"> | www.payzen.eu</a><br dat= a-mce-bogus=3D"1"></td></tr></tbody></table></td></tr></tbody></table><tabl= e style=3D"margin: 0; table-layout: fixed; border: none; width: 345pt;" dat= a-mce-style=3D"margin: 0; table-layout: fixed; border: none; width: 345pt;"= width=3D"460" cellspacing=3D"0" cellpadding=3D"0"><tbody><tr><td style=3D"= margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c7a; = line-height: 16px; width: 24pt; text-align: left;" data-mce-style=3D"margin= : 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b3c7a; line-h= eight: 16px; width: 24pt; text-align: left;" width=3D"32" valign=3D"top"><a= href=3D"https://www.youtube.com/channel/UCrVl1CO_Jlu3KbiRH-tQ_vA" style=3D= "border: none; text-decoration: none; margin: 0; float: left; display: inli= ne-block; width: 32px;" data-mce-href=3D"https://www.youtube.com/channel/UC= rVl1CO_Jlu3KbiRH-tQ_vA" data-mce-style=3D"border: none; text-decoration: no= ne; margin: 0; float: left; display: inline-block; width: 32px;"><img src= =3D"cid:99ac6520e8e3715f40f650ce0d5f88a03a9bd713@zimbra" alt=3D"" data-mce-= src=3D"/home/admin(a)lyra-network.com/corporate-documents/element-signature_l= ogo_YouTube_32x28.jpg" doc=3D"corporate-documents/element-signature_logo_Yo= uTube_32x28.jpg" height=3D"28" width=3D"32" border=3D"0"></a><br data-mce-b= ogus=3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-family: Arial= ,sans-serif; color: #2b3c7a; line-height: 16px; width: 30.75pt; text-align:= left;" data-mce-style=3D"margin: 0; font-size: 11px; font-family: Arial,sa= ns-serif; color: #2b3c7a; line-height: 16px; width: 30.75pt; text-align: le= ft;" width=3D"41" valign=3D"top"><a href=3D"https://www.linkedin.com/compan= y/lyra-network_2" style=3D"border: none; text-decoration: none; margin: 0; = float: left; display: inline-block; width: 41px;" data-mce-href=3D"https://= www.linkedin.com/company/lyra-network_2" data-mce-style=3D"border: none; te= xt-decoration: none; margin: 0; float: left; display: inline-block; width: = 41px;"><img src=3D"cid:a70d2dafceb98e64513f5a16b7d3ea0ab5a0f1f5@zimbra" dat= a-mce-src=3D"/home/admin(a)lyra-network.com/corporate-documents/element-signa= ture_logo_LinkedIn_41x28.jpg" doc=3D"corporate-documents/element-signature_= logo_LinkedIn_41x28.jpg" height=3D"28" width=3D"41" border=3D"0"></a><br da= ta-mce-bogus=3D"1"></td><td style=3D"margin: 0; font-size: 11px; font-famil= y: Arial,sans-serif; color: #2b3c7a; line-height: 16px; width: 31.5pt; text= -align: left;" data-mce-style=3D"margin: 0; font-size: 11px; font-family: A= rial,sans-serif; color: #2b3c7a; line-height: 16px; width: 31.5pt; text-ali= gn: left;" width=3D"42" valign=3D"top"><a href=3D"https://twitter.com/LyraN= etwork" style=3D"border: none; text-decoration: none; margin: 0; float: lef= t; display: inline-block; width: 42px;" data-mce-href=3D"https://twitter.co= m/LyraNetwork" data-mce-style=3D"border: none; text-decoration: none; margi= n: 0; float: left; display: inline-block; width: 42px;"><img src=3D"cid:a99= 4fe545de6341d6b369e33bbb18605bbbcef66@zimbra" alt=3D"" data-mce-src=3D"/hom= e/admin@lyra-network.com/corporate-documents/element-signature_logo_Twitter= _42x28.jpg" doc=3D"corporate-documents/element-signature_logo_Twitter_42x28= .jpg" height=3D"28" width=3D"42" border=3D"0"></a><br data-mce-bogus=3D"1">= </td><td style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif= ; color: #2b3c7a; line-height: 16px; width: 258.75pt; text-align: left;" da= ta-mce-style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; = color: #2b3c7a; line-height: 16px; width: 258.75pt; text-align: left;" widt= h=3D"345" valign=3D"top"><a href=3D"https://payzen.eu" style=3D"border: non= e; text-decoration: none; margin: 0; float: left; display: inline-block; wi= dth: 61px;" data-mce-href=3D"https://payzen.eu" data-mce-style=3D"border: n= one; text-decoration: none; margin: 0; float: left; display: inline-block; = width: 61px;"><img src=3D"cid:86ad24eaa2a146e1b7ee93db04f055468345dc13@zimb= ra" alt=3D"" data-mce-src=3D"/home/admin(a)lyra-network.com/corporate-documen= ts/element-signature_payzen_61x28.jpg" doc=3D"corporate-documents/element-s= ignature_payzen_61x28.jpg" height=3D"28" width=3D"61" border=3D"0"></a><br = data-mce-bogus=3D"1"></td></tr></tbody></table><table style=3D"margin: 0; t= able-layout: fixed; border: none; width: 345pt;" data-mce-style=3D"margin: = 0; table-layout: fixed; border: none; width: 345pt;" width=3D"460" cellspac= ing=3D"0" cellpadding=3D"0"><tbody><tr><td><hr style=3D"background: #293b79= none repeat scroll 0% 0%; width: 100%; height: 4px; color: #293b79; margin= : 0px;" data-mce-style=3D"background: #293b79 none repeat scroll 0% 0%; wid= th: 100%; height: 4px; color: #293b79; margin: 0px;"></td></tr></tbody></ta= ble><table style=3D"margin: 0; table-layout: fixed; border: none; width: 34= 5pt;" data-mce-style=3D"margin: 0; table-layout: fixed; border: none; width= : 345pt;" width=3D"460" cellspacing=3D"0" cellpadding=3D"0"><tbody><tr><td = style=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: = #2b3c7a; line-height: 16px; width: 30.75pt; text-align: left;" data-mce-sty= le=3D"margin: 0; font-size: 11px; font-family: Arial,sans-serif; color: #2b= 3c7a; line-height: 16px; width: 30.75pt; text-align: left;"><div>Lyra Netwo= rk, 109 rue de l'innovation, 31670 Lab=C3=A8ge, FRANCE</div></td></tr></tbo= dy></table><div><br></div></div></div></body></html> ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_logo_lyra_115x94.jpg Content-Disposition: attachment; filename=element-signature_logo_lyra_115x94.jpg Content-Transfer-Encoding: base64 Content-ID: <1db6da5091d14a0982ffcf8c4fef8a46b32a3417@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOkU1QUU4Nzk1OEExMzExRTZBNTFCRjVENEYyNDYxNTQ1IiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOkU1QUU4Nzk0OEExMzExRTZBNTFCRjVENEYyNDYxNTQ1IiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIAF4AcwMBEQACEQEDEQH/xACdAAEBAAIDAQEAAAAAAAAAAAAACAUH AgMGBAEBAQADAQEAAAAAAAAAAAAAAAACBAUBAxAAAAUDAgAHDQcCBwAAAAAAAAECAwQRBQYSByFR E7RWFzcxQSKS0nOT03RVlQgYYXEyQiMUFYEzsVJicmODOBEAAgECAwcEAgIDAAAAAAAAAAECEQNR EwQhgbESMlIzMUGhFHEVwQUiQzT/2gAMAwEAAhEDEQA/AKpAE9b/AGQZdF3FtNpsd4l29M2DHSll iS6w0bzsp5slqJCiLvERnTuENTRQg7bckntK15vmojj1WfMP0rc+Jy/JD7Fjt+EMueJ6bbnBN4bR lkWdkt+XPtDaHSfjKnSHyUpTZkg+TcLSdFGRjyv3rUo0iqP8EoQkntZ7fcOy5VdrXGYxuccGW2+S 3nCecYq3oUWnU2RmfhGXAPPSXLcJNzVVT8kNVbnKKUHRmppW1/zBOSXVtZS4lpSjNtP8nLKhfcSR alqdPXp+ERhauKKTe38nX1WfMP0qc+Jy/JHPsWO34RPLniOqz5h+lTnxOX5IfYsdvwhlzxHVZ8w/ Spz4nL8kPsWO34Qy54jqs+YfpU58Tl+SH2LHb8IZc8R1WfMP0qc+Jy/JD7Fjt+EMueJ2bCX3MH9y LxZr7eJdxKBCkoW0/JdfaJ5mUy2a0EszL/MRHTuGGshDLTiqVf8AAst81GUGMssgAAAAE5b89s+L +zwefPDV0fhlv4FW71oo0ZRaAAAAAAAAAAAAACdtj+3DLfNXDn7I1dX4Y7uBWtdbKJGUWQAAAACc t+e2fF/Z4PPnhq6Pwy38Crd60UaMotAAAAAAAAAAAAABO2x/bhlvmrhz9kaur8Md3ArWutlEjKLI AAAABOW/PbPi/s8Hnzw1dH4Zb+BVu9aKNGUWjAKzrGk5cnEjkq/nVo5RMbk3NOnkzd/uU0fgKvdH rky5eb2I86rQz48iQAAAAAAAAABO2x/bhlvmrhz9kaur8Md3ArWutlEjKLIAAAABOW/PbPi/s8Hn zw1dH4Zb+BVu9aKNGUWjSD//AKkj+xnzJQ0V/wA2/wDkr/7D3e7GX5DiOMfzlniMTEMPIRORIJfg tOeCladCk/nNJH94raa1GcuVnpck4qqOrJdz4dr2yazKOhDjkxhlUGMszop98i/TOlD/AE/CNX+0 x23p27nIJXKRqeeyjdnLMd27sGSzLdEO4Xd4uWifqkhDDiFut0qrUSzQlNa9wz7g9bemjK44puiI yuNRTOzGs53hud+gvzsYjwMVnqNfLuqUTrEck69bitZmStPc1NJIz4hy5ZtKLpKskIzk36bDHRt2 9yMsuMw9v8ejybNBc5M5s5Rp5Uy4aEZuMJSai4dPCZFStBN6a3BLne1nMyT6Uffgu8GQ5DnysXuN mbtZx461TG1ms3kyGiLWRHXToMz8Hg7nfMQvaWMYcydTsLjcqG2BSPYnbY/twy3zVw5+yNXV+GO7 gVrXWyiRlFkAAAAAnLfntnxf2eDz54auj8Mt/Aq3etFGjKLROmdZbAxL5g/5yey6/GjREJW2wSTc M3YpoKms0F3VcY1bNpzscqKs5UnU9pad4cG3Fefw1UWXFO7x3mULkpaJJnoM6JNC10WREak/aXGK 8tLO1/ns2HorilsNTYzar/kOQWTa+5tmmBjk+W9cKGqimkrJS68RcCkoV/yC7clGMXcXrJI8Yptq OBsj5oEpTiNmSRESSuKSJJFwUJlzgoKv9f1P8Hrf9Db1wh/vbVJh6tH7lhbOvi5RBpr/AEqKMXR1 PZrYaC2x3Jgbawp+IZjBkwpkWS480603rSslkRU7qTOuiqFlUlEfepw6WosO61ODK9ufLsZ27f36 RkG/8q9OwXbe3PgKciMPp0uHHS22hpxRf60o1f4VC9DlsUrWjEHWdSghllknbY/twy3zVw5+yNXV +GO7gVrXWyiRlFkAAAAAnLfntnxf2eDz54auj8Mt/Aq3etFGjKLRxU00o6qQlR8ZkRhUGMyO7W7H 7FOvUpCSZgMrfMqERqNJeCgj41qokvtMTtxcpJL3OSdFU1n8vFimPwbrnF18O55DIXybhlw8ihZm s08RLdqVOJJC5rZqqgvSJ42V7v3MpM3dTBnyWbtBQmHFnXFpLzdXOWjW9tWo2irwPpd0pWhVPBPU R0qILTVWx+y+STuYmQj7sxHH1Kctb7NuahnMflKW2akk3J/bvGlojqtpv8ZuJP8ACR8Ag9M8dtTu YdErdfEJTCZKrY/L5JSySbrbCdKmicdWRLeWlJK/bs8skq+ElSacJ8HVppr3OZiP2RuxFK4W5xi3 LK2T5D8NmY8baHHnWySSeTSa6to1K8JTumn3gtM6PbtQzDYYqnqTtsf24Zb5q4c/ZGrq/DHdwK1r rZRIyiyAAAAATlvz2z4v7PB588NXR+GW/gVbvWijRlFoADGZHjVmyO2Ltd4YOTAcUlbjJLcbJRoO qam2pCuA+GlROFxwdV6nJRT2M+q226DbLfHt8BkmIcRtLMdlNaJQgqEVTqZ/eYjKTbqwlQ5Hb4Bp Uk4zRpUpa1FoTQ1uEaVqPg7qiUZGffDmYodSbNZ0toaTBjk02hbTaCaQSUtu/wBxCSpQkr/MXfHe d4iiP12z2h5k2XYMdxlSkuKbW0hSTW2kkIUZGVKpSkiI+8RApPEURydtltdQpDsRlxCtepKm0mR8 qdXKkZfn/NxjnMxQ+kcOk7bH9uGW+auHP2Rq6vwx3cCta62USMosgAAAAE5b89s+L+zwefPDV0fh lv4FW71oo0ZRaAAAAAAAAAAAAACdtj+3DLfNXDn7I1dX4Y7uBWtdbKJGUWQAAAACb9/3mWN4cbff WTTLUWEt1xX4UpTNeNSj+wiGtolW1LfwKt7qRuTrY226RwfSkKH1rnaz3zI4jrZ226RwfSkH1rna xmRxHWztt0jg+lIPrXO1jMjiOtnbbpHB9KQfWudrGZHEdbO23SOD6Ug+tc7WMyOJ+o3W24WtKE5F CUpR0SknCqZmH1rnazjuxW2pnbTfbPeGnHbXMamNtK0OLaVqJKjKtDELlqUNklQ7C5GfS6mOu+f4 XZpy4F0vMWHMbJKlsOrJKyJRVTUvtIdjZnJVSOuaXqfF1sbbdI4PpSEvrXO1nMyOJp7YiQxJ3oyi RHcS9Hejz3GXUcKVoVOZNKi+wyOovaxUsx3cDwtdbKNGUWgAAAADX+4GzGPZveWbtcpsuO+xGTFS iObRINCFrcIz1oWdaun3xas6qVtUSR5ztKTqeZ+lrCvely8Zj1Q9f2M8EQyEPpawr3pcvGY9UH7G eCGQh9LWFe9Ll4zHqg/YzwQyEPpawr3pcvGY9UH7GeCGQh9LWFe9Ll4zHqg/YzwQyEc2flfwxl5t 1NzuJqbUSiI1MUqX/UOr+xmn6I5LTRaaxNg4XhNuxOHIiwX3n0SXCdWb5pMyMk6eDSlPEPDU6mV5 pteg0+nVpNI8zm+xeNZfkDt7nzprEl5Dbam2FNEgibTpKmttR97jErWslCNEkTlaUnUwP0tYV70u XjMeqHp+xngiOQj023+zGPYReXrtbZsuQ+/GVFUiQbRoJC1ocMy0IQdatF3x5XtVK4qNInC0oups AVT0AAAAAAAAAAAAAAAAAAAAAAAAAAAAD//Z ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_logo_YouTube_32x28.jpg Content-Disposition: attachment; filename=element-signature_logo_YouTube_32x28.jpg Content-Transfer-Encoding: base64 Content-ID: <99ac6520e8e3715f40f650ce0d5f88a03a9bd713@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOjQ1REY5Njk1OEExNzExRTY5OUVDOTI1QTU3QzAwNzI0IiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOjQ1REY5Njk0OEExNzExRTY5OUVDOTI1QTU3QzAwNzI0IiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIABwAIAMBEQACEQEDEQH/xAB5AAADAQEAAAAAAAAAAAAAAAAABwgF BgEAAgMBAAAAAAAAAAAAAAAAAAQCAwUBEAABBAECBAUFAAAAAAAAAAABAgMEBQARBiESEwcxUdIU CEEik1UYEQACAQMCBQUAAAAAAAAAAAAAAQIRAwQhMVFhEiITQaHBYhX/2gAMAwEAAhEDEQA/AKpw AnD5Hbg3JA35XxKqxmxUPVrJEaI862FuqkPp4IbI5lHQDNXBhFwbaW4tebqcMIvfYjURtz6eesv1 YzWz9fYh38zR7eX2+mu5lHV3VhaNOe8aTJgTHnweVXEBba1cQRkb8IeNtJbHYN9WpW+YY2T53inQ 4HfzZk6a4lmHGaiOSHl8EoT7mSOZR+gBIzUxU3Yklz+Be4+9DRl30N3dMOxjbyro9EzHW3MqupHc L7qlaoX1SsFvlHl44moPpa6XXiW113FPuu3qrT5I7dfrJLUxllMRl15hQWjqBbiuXmTqCQlQx23F rHdSqTrNFFZlDAou7vZa43xuSNaw7CPFZZhIiKbeSsqKkOuuE/aCNNHcexspW40a9Sm5bcmcH/J1 5+0rvxOenGf0o8GQ8DN7ZXxzv9vbpqrhy0huMQJCHlstocBKU+ITqANcru50ZRao9SUbLTqPvMwv DAAwAMAP/9k= ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_logo_LinkedIn_41x28.jpg Content-Disposition: attachment; filename=element-signature_logo_LinkedIn_41x28.jpg Content-Transfer-Encoding: base64 Content-ID: <a70d2dafceb98e64513f5a16b7d3ea0ab5a0f1f5@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOjY2MEYzRTFGOEExNzExRTY5QzI5OUNGQkY1MzM2MUQ1IiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOjY2MEYzRTFFOEExNzExRTY5QzI5OUNGQkY1MzM2MUQ1IiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIABwAKQMBEQACEQEDEQH/xAB2AAEBAQEAAAAAAAAAAAAAAAAABggH AQEAAwEAAAAAAAAAAAAAAAAAAwQFAhAAAQMEAgICAgMBAAAAAAAAAQIDBAARBQYhEjEHMghBE1Fh IhcRAAICAQIDCQAAAAAAAAAAAAABAgMREgQxkTIhQVGhscETMxX/2gAMAwEAAhEDEQA/ANU0Bl33 zsuzQfZcmHj8tMiMKaihDLMl1psKcQkXslSUjk8mtjZ1xdeWkVbW9RDZ/ZN8wOXkYnI7LKMuL1Lq o+RddaIWkLHVwLAPCuf4NWYVwksqPkcNtd5V+ldr2ef7MwkaZmJsqK6p/uy9JdcbUBGcULpUog8i 9Q7uuKreEjquT1GsKxC2KAUBk37B2/6y72t1tB7X8dbIvf8Aq3mtvZfVzKlvUWWw7Dr+Dfy8rCt4 d153Z8ew0FNx3kohuxmUyFtAfFPyBUOBz+arwhKWE89L9SRtLmTuns4xj7LLaxYaGNE6SYojlJZ6 rhLUf19f89eyj4qa1t7ft449ziPWairGLQoBQHFvZ/onObht0jNxclFjMPNtNpZdS4Vj9aAk36gj mtDb7yMIaWiGdTbySSfqnsKbdctAFh1Fm3Bwfx8fFT/ox8GcfAyk9dfX7OapuGNzj+SiPRoJcKmG kuBRDjS2x1uAPK71DfvYzg444nUKmnk7lWcTigFAKAUAoBQCgP/Z ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_logo_Twitter_42x28.jpg Content-Disposition: attachment; filename=element-signature_logo_Twitter_42x28.jpg Content-Transfer-Encoding: base64 Content-ID: <a994fe545de6341d6b369e33bbb18605bbbcef66@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOjdDMkI3MjMyOEExNzExRTY5MDUyRTk1NEIyREUwNjVCIiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOjdDMkI3MjMxOEExNzExRTY5MDUyRTk1NEIyREUwNjVCIiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIABwAKgMBEQACEQEDEQH/xAB3AAEBAQEBAAAAAAAAAAAAAAAABwUI BgEBAAMBAQAAAAAAAAAAAAAAAAMEBQIBEAABAwIEBwEBAQAAAAAAAAABAgMEAAUREhMGITFBFBUH CIEiFhEAAgIBAgQHAAAAAAAAAAAAAAERAgMxBCHBEgVBUWGBQhMV/9oADAMBAAIRAxEAPwDC9g7u 3dH33uJiNeri2wxcJQQ01JfCUNodVwCUqwSlI/AK3sGKropS0Kd7OWZMXcPsyZDdnQ7he5UFhQQ/ LZelOMoURiEqWlRAOFdumNOGqyeTYtPzFfL1df8ASm5XCTP0ey0e5eceyZu4zZc5VhjlGOFZ/cKJ dMKNeRNhbclzrOJxQCgOSW7o5a/oKXMRFXNT5iYw/EaAUtbL61tOBKTwXglWOXrW30zgj0RUmLlb 9p3rZ/r/ANd3GxWJtm3XC8B1EO2RsEqDkng88pAP8JSnEk8ugqlt6Xy5Fa3FImyNVUI8z8nJCU7o SOSRAA/O5qbuXx9+Rxg8ToGsssCgFAc/7q+b9xXrc11u7V3iNN3CW/JbQUuhaUuuFYBIHMA9K08e +rWqUPgivbC25MofK25Qoq81DKjwKlJeUT+kE13+jXyZ59DKX6a9WXPYfmO+msTPJdtp6AWMuhq4 5swHPVFVN1uFkiFoS46dJSqqEgoBQCgFAKAUAoBQH//Z ------=_Part_37643343_1124091921.1494519067933 Content-Type: image/jpeg; name=element-signature_payzen_61x28.jpg Content-Disposition: attachment; filename=element-signature_payzen_61x28.jpg Content-Transfer-Encoding: base64 Content-ID: <86ad24eaa2a146e1b7ee93db04f055468345dc13@zimbra> /9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNreQABAAQAAAA8AAD/4QOBaHR0cDov L25zLmFkb2JlLmNvbS94YXAvMS4wLwA8P3hwYWNrZXQgYmVnaW49Iu+7vyIgaWQ9Ilc1TTBNcENl aGlIenJlU3pOVGN6a2M5ZCI/PiA8eDp4bXBtZXRhIHhtbG5zOng9ImFkb2JlOm5zOm1ldGEvIiB4 OnhtcHRrPSJBZG9iZSBYTVAgQ29yZSA1LjYtYzEzMiA3OS4xNTkyODQsIDIwMTYvMDQvMTktMTM6 MTM6NDAgICAgICAgICI+IDxyZGY6UkRGIHhtbG5zOnJkZj0iaHR0cDovL3d3dy53My5vcmcvMTk5 OS8wMi8yMi1yZGYtc3ludGF4LW5zIyI+IDxyZGY6RGVzY3JpcHRpb24gcmRmOmFib3V0PSIiIHht bG5zOnhtcE1NPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvbW0vIiB4bWxuczpzdFJlZj0i aHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL3NUeXBlL1Jlc291cmNlUmVmIyIgeG1sbnM6eG1w PSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bXBNTTpPcmlnaW5hbERvY3VtZW50SUQ9 InhtcC5kaWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1LTgxYmQtMTYwMTFjZjk5YWVjIiB4bXBNTTpEb2N1 bWVudElEPSJ4bXAuZGlkOkU1NjczQjM2OEEzNDExRTZCOEJBQ0Y4Mzg3RTEzODkyIiB4bXBNTTpJ bnN0YW5jZUlEPSJ4bXAuaWlkOkU1NjczQjM1OEEzNDExRTZCOEJBQ0Y4Mzg3RTEzODkyIiB4bXA6 Q3JlYXRvclRvb2w9IkFkb2JlIFBob3Rvc2hvcCBDQyAyMDE1LjUgKFdpbmRvd3MpIj4gPHhtcE1N OkRlcml2ZWRGcm9tIHN0UmVmOmluc3RhbmNlSUQ9InhtcC5paWQ6ZGQwZjkyYzUtNzhhZi1jZTQ1 LTgxYmQtMTYwMTFjZjk5YWVjIiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOmRkMGY5MmM1LTc4 YWYtY2U0NS04MWJkLTE2MDExY2Y5OWFlYyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRG PiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pv/uAA5BZG9iZQBkwAAAAAH/2wCEAAYE BAQFBAYFBQYJBgUGCQsIBgYICwwKCgsKCgwQDAwMDAwMEAwODxAPDgwTExQUExMcGxsbHB8fHx8f Hx8fHx8BBwcHDQwNGBAQGBoVERUaHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8fHx8f Hx8fHx8fHx8fHx8fH//AABEIABwAPQMBEQACEQEDEQH/xABvAAABBAMAAAAAAAAAAAAAAAAAAQUG BwIDBAEBAAAAAAAAAAAAAAAAAAAAABAAAQQABAQEAgsBAAAAAAAAAQIDBAUAERIGITETFEEiFQfS I1FhcYGhMlIkRMQWhhEBAAAAAAAAAAAAAAAAAAAAAP/aAAwDAQACEQMRAD8AvqZ7q7OhzZMSS9IQ Yjy2JT/avqZbW2rSvU6lBSACOeeAljLzTzSHmVhxpxIW24k5pUlQzBBHgRgM8BBJ9fKuvcGwr3La wgxIlfGeaagyVsJ1uOOBRUBmOSRgI0bnZgfQwdx7qDrroYZSVzBrcJ0hKM2xq+7AWBU7PTXTEShc 2svRx6MuWp5o5gjigj68BombFRKmPyTfXTPXWpzoszloaRqOelCQPKkeAwEP6lp6f6V6vYaP9Z6b 3fcr7ntuhno6vPnxwGyohb2ntbpr6Y17NdKt7Bp5+YHlPJLitKyltI0KGk+XPANVgzV1Eyyqbe3s IMmnhsMbVaYcebDraY+XVbQ15XXFOghQVnkMBkbjcVPTUs6M5IkPbnpWa1hKlrWG7QZBp0hROnUh xRUfHTgJDWuwtsbptVTpC1xaqhgJfkuFTji9DjoKiTmpSlq/HAcO2d11d/cuXUySJG4C0+NvbfCH CmK2hClHUop0GQ6E+dWfAeUYBi2lY2E+zgW7twhVlHDk+7AkzFO9u2lRdjORFIEZrTmAkA+GYwDl TwLJhjZFouxsF3NzN6r7Lj7imExHUOSHWi0TpyCdORIzzwHT/J/7n+vgLVAA5YBChBUlRSCpOelR HEZ88sA2WG3YVhb1lnJW4VVJcXFjAgM9VxOjqKTlmVJTnp48M8Ax2+3N3J3TJu6KVAbRKisxnWpr brh+SpasxoKf14BBD91hxE2kB+nt5Px4AEL3VGoiZSAr4qyjyOP2+fAL2nuvw/e0vDl8iT8eAbv8 Lur0vPvYXrPrfrfU6bvb59Lp6NOev83HngLBwBgDAGAMAYAwBgP/2Q== ------=_Part_37643343_1124091921.1494519067933-- ------=_Part_37643342_929927371.1494519067933--

2 1

High latency on storage domains and sanlock renewal error
by Stefano Bovina 13 May '17

13 May '17

Hi, the engine logs show high latency on storage domains: "Storage domain <xxxx> experienced a high latency of 19.2814 seconds from ...... This may cause performance and functional issues." Looking at host logs, I found also these locking errors: 2017-05-02 20:52:13+0200 33883 [10098]: s1 renewal error -202 delta_length 10 last_success 33853 2017-05-02 20:52:19+0200 33889 [10098]: 6a386652 aio collect 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 result 1048576:0 other free 2017-05-02 21:08:51+0200 34880 [10098]: 6a386652 aio timeout 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe4f2000 ioto 10 to_count 24 2017-05-02 21:08:51+0200 34880 [10098]: s1 delta_renew read rv -202 offset 0 /dev/6a386652-629d-4045-835b-21d2f5c104aa/ids 2017-05-02 21:08:51+0200 34880 [10098]: s1 renewal error -202 delta_length 10 last_success 34850 2017-05-02 21:08:53+0200 34883 [10098]: 6a386652 aio collect 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe4f2000 result 1048576:0 other free 2017-05-02 21:30:40+0200 36189 [10098]: 6a386652 aio timeout 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 ioto 10 to_count 25 2017-05-02 21:30:40+0200 36189 [10098]: s1 delta_renew read rv -202 offset 0 /dev/6a386652-629d-4045-835b-21d2f5c104aa/ids 2017-05-02 21:30:40+0200 36189 [10098]: s1 renewal error -202 delta_length 10 last_success 36159 2017-05-02 21:30:45+0200 36195 [10098]: 6a386652 aio collect 0 0x7f1fb80008c0:0x7f1fb80008d0:0x7f1fbe9fb000 result 1048576:0 other free and this vdsm errors too: Thread-22::ERROR::2017-05-02 21:53:48,147::sdc::137:: Storage.StorageDomainCache::(_findDomain) looking for unfetched domain f8f21d6c-2425-45c4-aded-4cb9b53ebd96 Thread-22::ERROR::2017-05-02 21:53:48,148::sdc::154:: Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain f8f21d6c-2425-45c4-aded-4cb9b53ebd96 Engine instead is showing this errors: 2017-05-02 21:40:38,089 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-96) Command SpmStatusVDSCommand(HostName = < myhost.example.com>, HostId = dcc0275a-b011-4e33-bb95-366ffb0697b3, storagePoolId = 715d1ba2-eabe-48db-9aea-c28c30359808) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SpmStatusVDS, error = (-202, 'Sanlock resource read failure', 'Sanlock exception'), code = 100 2017-05-02 21:41:08,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-53) [6e0d5ebf] Failed in SpmStatusVDS method 2017-05-02 21:41:08,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-53) [6e0d5ebf] Command SpmStatusVDSCommand(HostName = <myhost.example.com>, HostId = 7991933e-5f30-48cd-88bf-b0b525613384, storagePoolId = 4bd73239-22d0-4c44-ab8c-17adcd580309) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SpmStatusVDS, error = (-202, 'Sanlock resource read failure', 'Sanlock exception'), code = 100 2017-05-02 21:41:31,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-61) [2a54a1b2] Failed in SpmStatusVDS method 2017-05-02 21:41:31,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler_Worker-61) [2a54a1b2] Command SpmStatusVDSCommand(HostName = <myhost.example.com>, HostId = dcc0275a-b011-4e33-bb95-366ffb0697b3, storagePoolId = 715d1ba2-eabe-48db-9aea-c28c30359808) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to SpmStatusVDS, error = (-202, 'Sanlock resource read failure', 'Sanlock exception'), code = 100 I'm using Fibre Channel or FCoE connectivity; storage array technical support has analyzed it (also switch and OS configurations), but nothing has been found. Any advice? Thanks Installation info: ovirt-release35-006-1.noarch libgovirt-0.3.3-1.el7_2.1.x86_64 vdsm-4.16.30-0.el7.centos.x86_64 vdsm-xmlrpc-4.16.30-0.el7.centos.noarch vdsm-yajsonrpc-4.16.30-0.el7.centos.noarch vdsm-jsonrpc-4.16.30-0.el7.centos.noarch vdsm-python-zombiereaper-4.16.30-0.el7.centos.noarch vdsm-python-4.16.30-0.el7.centos.noarch vdsm-cli-4.16.30-0.el7.centos.noarch qemu-kvm-ev-2.3.0-29.1.el7.x86_64 qemu-kvm-common-ev-2.3.0-29.1.el7.x86_64 qemu-kvm-tools-ev-2.3.0-29.1.el7.x86_64 libvirt-client-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-storage-1.2.17-13.el7_2.3.x86_64 libvirt-python-1.2.17-2.el7.x86_64 libvirt-daemon-driver-nwfilter-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-nodedev-1.2.17-13.el7_2.3.x86_64 libvirt-lock-sanlock-1.2.17-13.el7_2.3.x86_64 libvirt-glib-0.1.9-1.el7.x86_64 libvirt-daemon-driver-network-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-lxc-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-interface-1.2.17-13.el7_2.3.x86_64 libvirt-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-config-network-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-secret-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-config-nwfilter-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-kvm-1.2.17-13.el7_2.3.x86_64 libvirt-daemon-driver-qemu-1.2.17-13.el7_2.3.x86_64 ------- vdsm.log (high latency) Thread-21::DEBUG::2017-05-02 18:02:23,646::fileSD::261:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n331 bytes (331 B) copied, 0.000285529 s, 1.2 MB/s\n'; <rc> = 0 Thread-18::DEBUG::2017-05-02 18:02:24,335::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/2c501858-bf8d-49a5-a42b-bca341b47827/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-18::DEBUG::2017-05-02 18:02:24,343::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000489782 s, 8.4 MB/s\n'; <rc> = 0 Thread-19::DEBUG::2017-05-02 18:02:24,635::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c5dc09c4-cd79-42d2-a5af-89953076f79e/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-19::DEBUG::2017-05-02 18:02:24,643::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558622 s, 7.3 MB/s\n'; <rc> = 0 Thread-22::DEBUG::2017-05-02 18:02:24,722::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/f8f21d6c-2425-45c4-aded-4cb9b53ebd96/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-22::DEBUG::2017-05-02 18:02:24,729::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632576 s, 6.5 MB/s\n'; <rc> = 0 JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:25,056::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:25,057::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9372::DEBUG::2017-05-02 18:02:25,060::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response Thread-20::DEBUG::2017-05-02 18:02:25,895::blockSD::596:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 19.2814 s, 0.2 kB/s\n'; <rc> = 0 JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:28,075::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:28,076::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9373::DEBUG::2017-05-02 18:02:28,078::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:31,094::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:31,095::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9374::DEBUG::2017-05-02 18:02:31,097::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response Thread-21::DEBUG::2017-05-02 18:02:33,652::fileSD::261:: Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/<myho st.example.com>:_ISO/f105bdc6-efdc-445c-b49e-aa38c91c2569/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) Thread-21::DEBUG::2017-05-02 18:02:33,660::fileSD::261:: Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n331 bytes (331 B) copied, 0.000246594 s, 1.3 MB/s\n'; <rc> = 0 JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:34,112::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:34,114::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9375::DEBUG::2017-05-02 18:02:34,117::task::595:: Storage.TaskManager.Task::(_updateState) Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::moving from state init -> state preparing Thread-9375::INFO::2017-05-02 18:02:34,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) Thread-9375::INFO::2017-05-02 18:02:34,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2c501858-bf8d-49a5-a42b-bca341b47827': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489782', 'lastCheck': '9.8', 'valid': True}, 'f8f21d6c-2425-45c4-aded-4cb9b53ebd96': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632576', 'lastCheck': '9.4', 'valid': True}, '6a386652-629d-4045-835b-21d2f5c104aa': {'code': 0, 'version': 3, 'acquired': True, 'delay': '19.2814', 'lastCheck': '8.2', 'valid': True}, 'f105bdc6-efdc-445c-b49e-aa38c91c2569': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246594', 'lastCheck': '0.5', 'valid': True}, 'c5dc09c4-cd79-42d2-a5af-89953076f79e': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558622', 'lastCheck': '9.5', 'valid': True}} Thread-9375::DEBUG::2017-05-02 18:02:34,118::task::1191:: Storage.TaskManager.Task::(prepare) Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::finished: {'2c501858-bf8d-49a5-a42b-bca341b47827': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489782', 'lastCheck': '9.8', 'valid': True}, 'f8f21d6c-2425-45c4-aded-4cb9b53ebd96': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632576', 'lastCheck': '9.4', 'valid': True}, '6a386652-629d-4045-835b-21d2f5c104aa': {'code': 0, 'version': 3, 'acquired': True, 'delay': '19.2814', 'lastCheck': '8.2', 'valid': True}, 'f105bdc6-efdc-445c-b49e-aa38c91c2569': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000246594', 'lastCheck': '0.5', 'valid': True}, 'c5dc09c4-cd79-42d2-a5af-89953076f79e': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558622', 'lastCheck': '9.5', 'valid': True}} Thread-9375::DEBUG::2017-05-02 18:02:34,119::task::595:: Storage.TaskManager.Task::(_updateState) Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::moving from state preparing -> state finished Thread-9375::DEBUG::2017-05-02 18:02:34,119::resourceManager: :940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-9375::DEBUG::2017-05-02 18:02:34,119::resourceManager: :977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-9375::DEBUG::2017-05-02 18:02:34,119::task::993:: Storage.TaskManager.Task::(_decref) Task=`ea63814e-d25d-4436-8bb5-cfc67af6498d`::ref 0 aborting False Thread-9375::DEBUG::2017-05-02 18:02:34,122::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response JsonRpc (StompReactor)::DEBUG::2017-05-02 18:02:34,128::stompReactor:: 98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> JsonRpcServer::DEBUG::2017-05-02 18:02:34,129::__init__::506:: jsonrpc.JsonRpcServer::(serve_requests) Waiting for request Thread-9376::DEBUG::2017-05-02 18:02:34,132::stompReactor:: 163::yajsonrpc.StompServer::(send) Sending response

3 10