From dron at redhat.com Mon Nov 6 11:39:36 2017 Content-Type: multipart/mixed; boundary="===============8784265928787230363==" MIME-Version: 1.0 From: Dafna Ron To: devel at ovirt.org Subject: [ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 06-11-2017 ] [ 002_bootstrap.verify_add_hosts ] Date: Mon, 06 Nov 2017 11:39:33 +0000 Message-ID: --===============8784265928787230363== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------88DD9FCD3B3DDEA34D4EAEF4 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit Hi, We failed test 002_bootstrap.verify_add_hosts I can see we only tried to install one of the hosts (host-0) and failed. the second host has no log which means we did not try to deploy it. The error suggests that we ovirt-imageio-daemon failed to start. However, there is another message that I think should be addressed about conflicting vdsm and libvirt configurations. ** *Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/* * Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifact/ http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifact= /exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post= -002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/host= -deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host-0-553= 0ab1f.log* * * *(Relevant) error snippet from the log: * * \* 2017-11-06 02:56:46,526-0500 DEBUG otopi.plugins.ovirt_host_deploy.vdsm.pac= kages plugin.execute:921 execute-output: ('/usr/bin/vdsm-tool', 'configure'= , '--force') stdout: Checking configuration status... abrt is not configured for vdsm WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based on vd= sm configuration lvm requires configuration libvirt is not configured for vdsm yet FAILED: conflicting vdsm and libvirt-qemu tls configuration. vdsm.conf with ssl=3DTrue requires the following changes: libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 qemu.conf: spice_tls=3D1. multipath requires configuration 2017-11-06 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.systemd plu= gin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', 'ovirt-imag= eio-daemon.service') stderr: Job for ovirt-imageio-daemon.service failed because the control process exi= ted with error code. See "systemctl status ovirt-imageio-daemon.service" an= d "journalctl -xe" for details. 2017-11-06 02:56:47,552-0500 DEBUG otopi.context context._executeMethod:143= method exception Traceback (most recent call last): File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, in _ex= ecuteMethod method['method']() File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packages= .py", line 179, in _start self.services.state('ovirt-imageio-daemon', True) File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py", lin= e 141, in state service=3Dname, RuntimeError: Failed to start service 'ovirt-imageio-daemon' 2017-11-06 02:56:47,553-0500 ERROR otopi.context context._executeMethod:152= Failed to execute stage 'Closing up': Failed to start service 'ovirt-image= io-daemon' ** ** * * --------------88DD9FCD3B3DDEA34D4EAEF4 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 7bit

Hi,

We failed test 002_bootstrap.verify_add_hosts

I can see we only tried to install one of the hosts (host-0) and failed. the second host has no log which means we did not try to deploy it.

The error suggests that we ovirt-imageio-daemon failed to start. However, there is another message that I think should be addressed about conflicting vdsm and libvirt configurations.

Link to suspecte= d patches: https://gerrit.ovirt.org/#/c/83612/

Link to Job: http://jenkins.ovirt.org/job/ovirt-master= _change-queue-tester/3626/

Link to all logs= : http://jenkins.ovirt.org/jo= b/ovirt-master_change-queue-tester/3626/artifact/

http://jenkins.ovirt.= org/job/ovirt-master_change-queue-tester/3626/artifact/exported-artifacts/b= asic-suit-master-el7/test_logs/basic-suite-master/post-002_bootstrap.py/lag= o-basic-suite-master-engine/_var_log/ovirt-engine/host-deploy/ovirt-host-de= ploy-20171106025647-lago-basic-suite-master-host-0-5530ab1f.log

(Relevant) error= snippet from the log:

<error>
\

2017-11-06 02:=
56:46,526-0500 DEBUG otopi.plugins.ovirt_host_deploy.vdsm.packages plugin.e=
xecute:921 execute-output: ('/usr/bin/vdsm-tool', 'configure', '--force') s=
tdout:

Checking configuration status...

abrt is not configured for vdsm
WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based on vd=
sm configuration
lvm requires configuration
libvirt is not configured for vdsm yet
FAILED: conflicting vdsm and libvirt-qemu tls configuration.
vdsm.conf with ssl=3DTrue requires the following changes:
libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1
qemu.conf: spice_tls=3D1.
multipath requires configuration

2017-11-06 02:=
56:47,551-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:92=
6 execute-output: ('/usr/bin/systemctl', 'start', 'ovirt-imageio-daemon.ser=
vice') stderr:
Job for ovirt-imageio-daemon.service failed because the control process exi=
ted with error code. See "systemctl status ovirt-imageio-daemon.service" an=
d "journalctl -xe" for details.

2017-11-06 02:56:47,552-0500 DEBUG otopi.context context._executeMethod:143=
 method exception
Traceback (most recent call last):
  File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, in _ex=
ecuteMethod
    method['method']()
  File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packages=
.py", line 179, in _start
    self.services.state('ovirt-imageio-daemon', True)
  File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py", lin=
e 141, in state
    service=3Dname,
RuntimeError: Failed to start service 'ovirt-imageio-daemon'
2017-11-06 02:56:47,553-0500 ERROR otopi.context context._executeMethod:152=
 Failed to execute stage 'Closing up': Failed to start service 'ovirt-image=
io-daemon'

</error>

--------------88DD9FCD3B3DDEA34D4EAEF4-- --===============8784265928787230363== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS04OEREOUZDRDNCM0RERUEzNEQ0RUFFRjQKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQKCkhpLAoKV2UgZmFpbGVk IHRlc3QgMDAyX2Jvb3RzdHJhcC52ZXJpZnlfYWRkX2hvc3RzCgpJIGNhbiBzZWUgd2Ugb25seSB0 cmllZCB0byBpbnN0YWxsIG9uZSBvZiB0aGUgaG9zdHMgKGhvc3QtMCkgYW5kIGZhaWxlZC4KdGhl IHNlY29uZCBob3N0IGhhcyBubyBsb2cgd2hpY2ggbWVhbnMgd2UgZGlkIG5vdCB0cnkgdG8gZGVw bG95IGl0LgoKVGhlIGVycm9yIHN1Z2dlc3RzIHRoYXQgd2Ugb3ZpcnQtaW1hZ2Vpby1kYWVtb24g ZmFpbGVkIHRvIHN0YXJ0LgpIb3dldmVyLCB0aGVyZSBpcyBhbm90aGVyIG1lc3NhZ2UgdGhhdCBJ IHRoaW5rIHNob3VsZCBiZSBhZGRyZXNzZWQgYWJvdXQKY29uZmxpY3RpbmcgdmRzbSBhbmQgbGli dmlydCBjb25maWd1cmF0aW9ucy4KCioqCgoqTGluayB0byBzdXNwZWN0ZWQgcGF0Y2hlczogaHR0 cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMvYy84MzYxMi8qCgoqCgpMaW5rIHRvIEpvYjoKaHR0cDov L2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8z NjI2LwoKCkxpbmsgdG8gYWxsIGxvZ3M6Cmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3Zp cnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC8KCmh0dHA6Ly9qZW5r aW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9h cnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9n cy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3Vp dGUtbWFzdGVyLWVuZ2luZS9fdmFyX2xvZy9vdmlydC1lbmdpbmUvaG9zdC1kZXBsb3kvb3ZpcnQt aG9zdC1kZXBsb3ktMjAxNzExMDYwMjU2NDctbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0w LTU1MzBhYjFmLmxvZyoKCioKKgoKKihSZWxldmFudCkgZXJyb3Igc25pcHBldCBmcm9tIHRoZSBs b2c6ICoKCioKCjxlcnJvcj4KClwqCgoyMDE3LTExLTA2IDAyOjU2OjQ2LDUyNi0wNTAwIERFQlVH IG90b3BpLnBsdWdpbnMub3ZpcnRfaG9zdF9kZXBsb3kudmRzbS5wYWNrYWdlcyBwbHVnaW4uZXhl Y3V0ZTo5MjEgZXhlY3V0ZS1vdXRwdXQ6ICgnL3Vzci9iaW4vdmRzbS10b29sJywgJ2NvbmZpZ3Vy ZScsICctLWZvcmNlJykgc3Rkb3V0OgoKQ2hlY2tpbmcgY29uZmlndXJhdGlvbiBzdGF0dXMuLi4K CmFicnQgaXMgbm90IGNvbmZpZ3VyZWQgZm9yIHZkc20KV0FSTklORzogTFZNIGxvY2FsIGNvbmZp Z3VyYXRpb246IC9ldGMvbHZtL2x2bWxvY2FsLmNvbmYgaXMgbm90IGJhc2VkIG9uIHZkc20gY29u ZmlndXJhdGlvbgpsdm0gcmVxdWlyZXMgY29uZmlndXJhdGlvbgpsaWJ2aXJ0IGlzIG5vdCBjb25m aWd1cmVkIGZvciB2ZHNtIHlldApGQUlMRUQ6IGNvbmZsaWN0aW5nIHZkc20gYW5kIGxpYnZpcnQt cWVtdSB0bHMgY29uZmlndXJhdGlvbi4KdmRzbS5jb25mIHdpdGggc3NsPVRydWUgcmVxdWlyZXMg dGhlIGZvbGxvd2luZyBjaGFuZ2VzOgpsaWJ2aXJ0ZC5jb25mOiBsaXN0ZW5fdGNwPTAsIGF1dGhf dGNwPSJzYXNsIiwgbGlzdGVuX3Rscz0xCnFlbXUuY29uZjogc3BpY2VfdGxzPTEuCm11bHRpcGF0 aCByZXF1aXJlcyBjb25maWd1cmF0aW9uCgoKMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTEtMDUwMCBE RUJVRyBvdG9waS5wbHVnaW5zLm90b3BpLnNlcnZpY2VzLnN5c3RlbWQgcGx1Z2luLmV4ZWN1dGU6 OTI2IGV4ZWN1dGUtb3V0cHV0OiAoJy91c3IvYmluL3N5c3RlbWN0bCcsICdzdGFydCcsICdvdmly dC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlJykgc3RkZXJyOgpKb2IgZm9yIG92aXJ0LWltYWdlaW8t ZGFlbW9uLnNlcnZpY2UgZmFpbGVkIGJlY2F1c2UgdGhlIGNvbnRyb2wgcHJvY2VzcyBleGl0ZWQg d2l0aCBlcnJvciBjb2RlLiBTZWUgInN5c3RlbWN0bCBzdGF0dXMgb3ZpcnQtaW1hZ2Vpby1kYWVt b24uc2VydmljZSIgYW5kICJqb3VybmFsY3RsIC14ZSIgZm9yIGRldGFpbHMuCgoyMDE3LTExLTA2 IDAyOjU2OjQ3LDU1Mi0wNTAwIERFQlVHIG90b3BpLmNvbnRleHQgY29udGV4dC5fZXhlY3V0ZU1l dGhvZDoxNDMgbWV0aG9kIGV4Y2VwdGlvbgpUcmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwgbGFz dCk6CiAgRmlsZSAiL3RtcC9vdmlydC1SNFI4Z1poYVFJL3B5dGhvbmxpYi9vdG9waS9jb250ZXh0 LnB5IiwgbGluZSAxMzMsIGluIF9leGVjdXRlTWV0aG9kCiAgICBtZXRob2RbJ21ldGhvZCddKCkK ICBGaWxlICIvdG1wL292aXJ0LVI0UjhnWmhhUUkvb3RvcGktcGx1Z2lucy9vdmlydC1ob3N0LWRl cGxveS92ZHNtL3BhY2thZ2VzLnB5IiwgbGluZSAxNzksIGluIF9zdGFydAogICAgc2VsZi5zZXJ2 aWNlcy5zdGF0ZSgnb3ZpcnQtaW1hZ2Vpby1kYWVtb24nLCBUcnVlKQogIEZpbGUgIi90bXAvb3Zp cnQtUjRSOGdaaGFRSS9vdG9waS1wbHVnaW5zL290b3BpL3NlcnZpY2VzL3N5c3RlbWQucHkiLCBs aW5lIDE0MSwgaW4gc3RhdGUKICAgIHNlcnZpY2U9bmFtZSwKUnVudGltZUVycm9yOiBGYWlsZWQg dG8gc3RhcnQgc2VydmljZSAnb3ZpcnQtaW1hZ2Vpby1kYWVtb24nCjIwMTctMTEtMDYgMDI6NTY6 NDcsNTUzLTA1MDAgRVJST1Igb3RvcGkuY29udGV4dCBjb250ZXh0Ll9leGVjdXRlTWV0aG9kOjE1 MiBGYWlsZWQgdG8gZXhlY3V0ZSBzdGFnZSAnQ2xvc2luZyB1cCc6IEZhaWxlZCB0byBzdGFydCBz ZXJ2aWNlICdvdmlydC1pbWFnZWlvLWRhZW1vbicKCioqCgoqPC9lcnJvcj4qCgoqCioKCgotLS0t LS0tLS0tLS0tLTg4REQ5RkNEM0IzRERFQTM0RDRFQUVGNApDb250ZW50LVR5cGU6IHRleHQvaHRt bDsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3Yml0Cgo8aHRtbD4K ICA8aGVhZD4KCiAgICA8bWV0YSBodHRwLWVxdWl2PSJjb250ZW50LXR5cGUiIGNvbnRlbnQ9InRl eHQvaHRtbDsgY2hhcnNldD11dGYtOCI+CiAgPC9oZWFkPgogIDxib2R5IHRleHQ9IiMwMDAwMDAi IGJnY29sb3I9IiNGRkZGRkYiPgogICAgPHA+SGksIDxicj4KICAgIDwvcD4KICAgIDxwPldlIGZh aWxlZCB0ZXN0IDAwMl9ib290c3RyYXAudmVyaWZ5X2FkZF9ob3N0czwvcD4KICAgIDxwPkkgY2Fu IHNlZSB3ZSBvbmx5IHRyaWVkIHRvIGluc3RhbGwgb25lIG9mIHRoZSBob3N0cyAoaG9zdC0wKSBh bmQKICAgICAgZmFpbGVkLiB0aGUgc2Vjb25kIGhvc3QgaGFzIG5vIGxvZyB3aGljaCBtZWFucyB3 ZSBkaWQgbm90IHRyeSB0bwogICAgICBkZXBsb3kgaXQuIDxicj4KICAgIDwvcD4KICAgIDxwPlRo ZSBlcnJvciBzdWdnZXN0cyB0aGF0IHdlIG92aXJ0LWltYWdlaW8tZGFlbW9uIGZhaWxlZCB0byBz dGFydC4KICAgICAgSG93ZXZlciwgdGhlcmUgaXMgYW5vdGhlciBtZXNzYWdlIHRoYXQgSSB0aGlu ayBzaG91bGQgYmUgYWRkcmVzc2VkCiAgICAgIGFib3V0IGNvbmZsaWN0aW5nIHZkc20gYW5kIGxp YnZpcnQgY29uZmlndXJhdGlvbnMuIDxicj4KICAgIDwvcD4KICAgIDxwPjxiIHN0eWxlPSJmb250 LXdlaWdodDpub3JtYWw7IgogICAgICAgIGlkPSJkb2NzLWludGVybmFsLWd1aWQtNTg1OWI3YTEt OTExZS01NjE2LTNjYmMtOTcyODY1ODdkYjg1Ij4KICAgICAgICA8cCBkaXI9Imx0ciIKICAgICAg ICAgIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21hcmdpbi1ib3R0b206 MHB0OyI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFyaWFsO2NvbG9y OiMwMDAwMDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdodDo0MDA7Zm9u dC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTt2 ZXJ0aWNhbC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcDsiPkxpbmsgdG8gc3Vz cGVjdGVkIHBhdGNoZXM6IDxhIGNsYXNzPSJtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0 dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy8jL2MvODM2MTIvIj5odHRwczovL2dlcnJpdC5vdmlydC5v cmcvIy9jLzgzNjEyLzwvYT48L3NwYW4+PC9wPgogICAgICAgIDxicj4KICAgICAgICA8cCBkaXI9 Imx0ciIKICAgICAgICAgIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21h cmdpbi1ib3R0b206MHB0OyI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5 OkFyaWFsO2NvbG9yOiMwMDAwMDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdl aWdodDo0MDA7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29y YXRpb246bm9uZTt2ZXJ0aWNhbC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcDsi PkxpbmsgdG8gSm9iOiA8YSBjbGFzcz0ibW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVmPSJodHRw Oi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVy LzM2MjYvIj5odHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2Ut cXVldWUtdGVzdGVyLzM2MjYvPC9hPjwvc3Bhbj48L3A+CiAgICAgICAgPGJyPgogICAgICAgIDxw IGRpcj0ibHRyIgogICAgICAgICAgc3R5bGU9ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDow cHQ7bWFyZ2luLWJvdHRvbTowcHQ7Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExcHQ7Zm9udC1m YW1pbHk6QXJpYWw7Y29sb3I6IzAwMDAwMDtiYWNrZ3JvdW5kLWNvbG9yOnRyYW5zcGFyZW50O2Zv bnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5vcm1hbDtmb250LXZhcmlhbnQ6bm9ybWFsO3RleHQt ZGVjb3JhdGlvbjpub25lO3ZlcnRpY2FsLWFsaWduOmJhc2VsaW5lO3doaXRlLXNwYWNlOnByZS13 cmFwOyI+TGluayB0byBhbGwgbG9nczogPGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIg aHJlZj0iaHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1 ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0LyI+aHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9v dmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0LzwvYT48L3NwYW4+ PC9wPgogICAgICAgIDxwIGRpcj0ibHRyIgogICAgICAgICAgc3R5bGU9ImxpbmUtaGVpZ2h0OjEu Mzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQ7Ij48c3BhbiBzdHlsZT0iZm9udC1z aXplOjExcHQ7Zm9udC1mYW1pbHk6QXJpYWw7Y29sb3I6IzAwMDAwMDtiYWNrZ3JvdW5kLWNvbG9y OnRyYW5zcGFyZW50O2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5vcm1hbDtmb250LXZhcmlh bnQ6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO3ZlcnRpY2FsLWFsaWduOmJhc2VsaW5lO3do aXRlLXNwYWNlOnByZS13cmFwOyI+Cjwvc3Bhbj48L3A+CjxhIGNsYXNzPSJtb3otdHh0LWxpbmst ZnJlZXRleHQiIGhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVy X2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFz aWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJf Ym9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWVuZ2luZS9fdmFyX2xvZy9vdmly dC1lbmdpbmUvaG9zdC1kZXBsb3kvb3ZpcnQtaG9zdC1kZXBsb3ktMjAxNzExMDYwMjU2NDctbGFn by1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wLTU1MzBhYjFmLmxvZyI+aHR0cDovL2plbmtpbnMu b3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlm YWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jh c2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1t YXN0ZXItZW5naW5lL192YXJfbG9nL292aXJ0LWVuZ2luZS9ob3N0LWRlcGxveS9vdmlydC1ob3N0 LWRlcGxveS0yMDE3MTEwNjAyNTY0Ny1sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAtNTUz MGFiMWYubG9nPC9hPjwvYj48L3A+CiAgICA8cD48YiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFs OyIKICAgICAgICBpZD0iZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUtNTYxNi0zY2Jj LTk3Mjg2NTg3ZGI4NSI+PGJyPgogICAgICAgIDxwIGRpcj0ibHRyIgogICAgICAgICAgc3R5bGU9 ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQ7Ij48c3Bh biBzdHlsZT0iZm9udC1zaXplOjExcHQ7Zm9udC1mYW1pbHk6QXJpYWw7Y29sb3I6IzAwMDAwMDti YWNrZ3JvdW5kLWNvbG9yOnRyYW5zcGFyZW50O2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5v cm1hbDtmb250LXZhcmlhbnQ6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO3ZlcnRpY2FsLWFs aWduOmJhc2VsaW5lO3doaXRlLXNwYWNlOnByZS13cmFwOyI+KFJlbGV2YW50KSBlcnJvciBzbmlw cGV0IGZyb20gdGhlIGxvZzogPC9zcGFuPjwvcD4KICAgICAgICA8cCBkaXI9Imx0ciIKICAgICAg ICAgIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21hcmdpbi1ib3R0b206 MHB0OyI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFyaWFsO2NvbG9y OiMwMDAwMDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdodDo0MDA7Zm9u dC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTt2 ZXJ0aWNhbC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcDsiPiZsdDtlcnJvciZn dDs8L3NwYW4+PC9wPgogICAgICAgIFw8L2I+PGJyPgogICAgPC9wPgogICAgPHByZSBzdHlsZT0i Y29sb3I6IHJnYigwLCAwLCAwKTsgZm9udC1zdHlsZTogbm9ybWFsOyBmb250LXZhcmlhbnQtbGln YXR1cmVzOiBub3JtYWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7IGZvbnQtd2VpZ2h0OiBu b3JtYWw7IGxldHRlci1zcGFjaW5nOiBub3JtYWw7IG9ycGhhbnM6IDI7IHRleHQtYWxpZ246IHN0 YXJ0OyB0ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9ybTogbm9uZTsgd2lkb3dzOiAyOyB3 b3JkLXNwYWNpbmc6IDBweDsgLXdlYmtpdC10ZXh0LXN0cm9rZS13aWR0aDogMHB4OyB0ZXh0LWRl Y29yYXRpb24tc3R5bGU6IGluaXRpYWw7IHRleHQtZGVjb3JhdGlvbi1jb2xvcjogaW5pdGlhbDsi PjIwMTctMTEtMDYgMDI6NTY6NDYsNTI2LTA1MDAgREVCVUcgb3RvcGkucGx1Z2lucy5vdmlydF9o b3N0X2RlcGxveS52ZHNtLnBhY2thZ2VzIHBsdWdpbi5leGVjdXRlOjkyMSBleGVjdXRlLW91dHB1 dDogKCcvdXNyL2Jpbi92ZHNtLXRvb2wnLCAnY29uZmlndXJlJywgJy0tZm9yY2UnKSBzdGRvdXQ6 CgpDaGVja2luZyBjb25maWd1cmF0aW9uIHN0YXR1cy4uLgoKYWJydCBpcyBub3QgY29uZmlndXJl ZCBmb3IgdmRzbQpXQVJOSU5HOiBMVk0gbG9jYWwgY29uZmlndXJhdGlvbjogL2V0Yy9sdm0vbHZt bG9jYWwuY29uZiBpcyBub3QgYmFzZWQgb24gdmRzbSBjb25maWd1cmF0aW9uCmx2bSByZXF1aXJl cyBjb25maWd1cmF0aW9uCmxpYnZpcnQgaXMgbm90IGNvbmZpZ3VyZWQgZm9yIHZkc20geWV0CkZB SUxFRDogY29uZmxpY3RpbmcgdmRzbSBhbmQgbGlidmlydC1xZW11IHRscyBjb25maWd1cmF0aW9u Lgp2ZHNtLmNvbmYgd2l0aCBzc2w9VHJ1ZSByZXF1aXJlcyB0aGUgZm9sbG93aW5nIGNoYW5nZXM6 CmxpYnZpcnRkLmNvbmY6IGxpc3Rlbl90Y3A9MCwgYXV0aF90Y3A9InNhc2wiLCBsaXN0ZW5fdGxz PTEKcWVtdS5jb25mOiBzcGljZV90bHM9MS4KbXVsdGlwYXRoIHJlcXVpcmVzIGNvbmZpZ3VyYXRp b24KPC9wcmU+CiAgICA8YnIgY2xhc3M9IkFwcGxlLWludGVyY2hhbmdlLW5ld2xpbmUiPgogICAg PHByZSBzdHlsZT0iY29sb3I6IHJnYigwLCAwLCAwKTsgZm9udC1zdHlsZTogbm9ybWFsOyBmb250 LXZhcmlhbnQtbGlnYXR1cmVzOiBub3JtYWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7IGZv bnQtd2VpZ2h0OiBub3JtYWw7IGxldHRlci1zcGFjaW5nOiBub3JtYWw7IG9ycGhhbnM6IDI7IHRl eHQtYWxpZ246IHN0YXJ0OyB0ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9ybTogbm9uZTsg d2lkb3dzOiAyOyB3b3JkLXNwYWNpbmc6IDBweDsgLXdlYmtpdC10ZXh0LXN0cm9rZS13aWR0aDog MHB4OyB0ZXh0LWRlY29yYXRpb24tc3R5bGU6IGluaXRpYWw7IHRleHQtZGVjb3JhdGlvbi1jb2xv cjogaW5pdGlhbDsiPjIwMTctMTEtMDYgMDI6NTY6NDcsNTUxLTA1MDAgREVCVUcgb3RvcGkucGx1 Z2lucy5vdG9waS5zZXJ2aWNlcy5zeXN0ZW1kIHBsdWdpbi5leGVjdXRlOjkyNiBleGVjdXRlLW91 dHB1dDogKCcvdXNyL2Jpbi9zeXN0ZW1jdGwnLCAnc3RhcnQnLCAnb3ZpcnQtaW1hZ2Vpby1kYWVt b24uc2VydmljZScpIHN0ZGVycjoKSm9iIGZvciBvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNl IGZhaWxlZCBiZWNhdXNlIHRoZSBjb250cm9sIHByb2Nlc3MgZXhpdGVkIHdpdGggZXJyb3IgY29k ZS4gU2VlICJzeXN0ZW1jdGwgc3RhdHVzIG92aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UiIGFu ZCAiam91cm5hbGN0bCAteGUiIGZvciBkZXRhaWxzLgoKMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTIt MDUwMCBERUJVRyBvdG9waS5jb250ZXh0IGNvbnRleHQuX2V4ZWN1dGVNZXRob2Q6MTQzIG1ldGhv ZCBleGNlcHRpb24KVHJhY2ViYWNrIChtb3N0IHJlY2VudCBjYWxsIGxhc3QpOgogIEZpbGUgIi90 bXAvb3ZpcnQtUjRSOGdaaGFRSS9weXRob25saWIvb3RvcGkvY29udGV4dC5weSIsIGxpbmUgMTMz LCBpbiBfZXhlY3V0ZU1ldGhvZAogICAgbWV0aG9kWydtZXRob2QnXSgpCiAgRmlsZSAiL3RtcC9v dmlydC1SNFI4Z1poYVFJL290b3BpLXBsdWdpbnMvb3ZpcnQtaG9zdC1kZXBsb3kvdmRzbS9wYWNr YWdlcy5weSIsIGxpbmUgMTc5LCBpbiBfc3RhcnQKICAgIHNlbGYuc2VydmljZXMuc3RhdGUoJ292 aXJ0LWltYWdlaW8tZGFlbW9uJywgVHJ1ZSkKICBGaWxlICIvdG1wL292aXJ0LVI0UjhnWmhhUUkv b3RvcGktcGx1Z2lucy9vdG9waS9zZXJ2aWNlcy9zeXN0ZW1kLnB5IiwgbGluZSAxNDEsIGluIHN0 YXRlCiAgICBzZXJ2aWNlPW5hbWUsClJ1bnRpbWVFcnJvcjogRmFpbGVkIHRvIHN0YXJ0IHNlcnZp Y2UgJ292aXJ0LWltYWdlaW8tZGFlbW9uJwoyMDE3LTExLTA2IDAyOjU2OjQ3LDU1My0wNTAwIEVS Uk9SIG90b3BpLmNvbnRleHQgY29udGV4dC5fZXhlY3V0ZU1ldGhvZDoxNTIgRmFpbGVkIHRvIGV4 ZWN1dGUgc3RhZ2UgJ0Nsb3NpbmcgdXAnOiBGYWlsZWQgdG8gc3RhcnQgc2VydmljZSAnb3ZpcnQt aW1hZ2Vpby1kYWVtb24nPC9wcmU+CiAgICA8cD48YiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFs OyIKICAgICAgICBpZD0iZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUtNTYxNi0zY2Jj LTk3Mjg2NTg3ZGI4NSI+CiAgICAgICAgPHAgZGlyPSJsdHIiCiAgICAgICAgICBzdHlsZT0ibGlu ZS1oZWlnaHQ6MS4zODttYXJnaW4tdG9wOjBwdDttYXJnaW4tYm90dG9tOjBwdDsiPjxzcGFuIHN0 eWxlPSJmb250LXNpemU6MTFwdDtmb250LWZhbWlseTpBcmlhbDtjb2xvcjojMDAwMDAwO2JhY2tn cm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFs O2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxpZ246 YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdyYXA7Ij4mbHQ7L2Vycm9yJmd0Ozwvc3Bhbj48L3A+ CiAgICAgICAgPGJyPgogICAgICA8L2I+PC9wPgogIDwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0t LS0tLS04OEREOUZDRDNCM0RERUEzNEQ0RUFFRjQtLQo= --===============8784265928787230363==-- From ahino at redhat.com Mon Nov 6 11:51:42 2017 Content-Type: multipart/mixed; boundary="===============0455996970764902916==" MIME-Version: 1.0 From: Ala Hino To: devel at ovirt.org Subject: Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 06-11-2017 ] [ 002_bootstrap.verify_add_hosts ] Date: Mon, 06 Nov 2017 13:51:40 +0200 Message-ID: In-Reply-To: a78acb4f-9314-8b6b-b05b-836e46c7eafd@redhat.com --===============0455996970764902916== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Suspected patch (https://gerrit.ovirt.org/#/c/83612/) is about cold merge and has nothing to do with host deploy. On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron wrote: > Hi, > > We failed test 002_bootstrap.verify_add_hosts > > I can see we only tried to install one of the hosts (host-0) and failed. > the second host has no log which means we did not try to deploy it. > > The error suggests that we ovirt-imageio-daemon failed to start. However, > there is another message that I think should be addressed about conflicti= ng > vdsm and libvirt configurations. > > *Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/ > * > > > * Link to Job: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ > Link > to all logs: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifa= ct/ > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifa= ct/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/po= st-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/ho= st-deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host-0-5= 530ab1f.log > * > > > *(Relevant) error snippet from the log: * > > * \* > > 2017-11-06 02:56:46,526-0500 DEBUG otopi.plugins.ovirt_host_deploy.vdsm.p= ackages plugin.execute:921 execute-output: ('/usr/bin/vdsm-tool', 'configur= e', '--force') stdout: > > Checking configuration status... > > abrt is not configured for vdsm > WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based on = vdsm configuration > lvm requires configuration > libvirt is not configured for vdsm yet > FAILED: conflicting vdsm and libvirt-qemu tls configuration. > vdsm.conf with ssl=3DTrue requires the following changes: > libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 > qemu.conf: spice_tls=3D1. > multipath requires configuration > > > 2017-11-06 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.systemd p= lugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', 'ovirt-im= ageio-daemon.service') stderr: > Job for ovirt-imageio-daemon.service failed because the control process e= xited with error code. See "systemctl status ovirt-imageio-daemon.service" = and "journalctl -xe" for details. > > 2017-11-06 02:56:47,552-0500 DEBUG otopi.context context._executeMethod:1= 43 method exception > Traceback (most recent call last): > File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, in _= executeMethod > method['method']() > File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packag= es.py", line 179, in _start > self.services.state('ovirt-imageio-daemon', True) > File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py", l= ine 141, in state > service=3Dname, > RuntimeError: Failed to start service 'ovirt-imageio-daemon' > 2017-11-06 02:56:47,553-0500 ERROR otopi.context context._executeMethod:1= 52 Failed to execute stage 'Closing up': Failed to start service 'ovirt-ima= geio-daemon' > > ** > > --===============0455996970764902916== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+U3VzcGVjdGVkIHBhdGNoICg8YSBocmVmPSJodHRwczovL2dlcnJpdC5v dmlydC5vcmcvIy9jLzgzNjEyLyI+aHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMvYy84MzYxMi88 L2E+KSBpcyBhYm91dCBjb2xkIG1lcmdlIGFuZCBoYXMgbm90aGluZyB0byBkbyB3aXRoIGhvc3Qg ZGVwbG95LjwvZGl2PjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBjbGFzcz0iZ21h aWxfcXVvdGUiPk9uIE1vbiwgTm92IDYsIDIwMTcgYXQgMTozOSBQTSwgRGFmbmEgUm9uIDxzcGFu IGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOmRyb25AcmVkaGF0LmNvbSIgdGFyZ2V0PSJf YmxhbmsiPmRyb25AcmVkaGF0LmNvbTwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnI+PGJsb2NrcXVv dGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxl ZnQ6MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+CiAgCgogICAgCiAgCiAgPGRpdiB0 ZXh0PSIjMDAwMDAwIiBiZ2NvbG9yPSIjRkZGRkZGIj4KICAgIDxwPkhpLCA8YnI+CiAgICA8L3A+ CiAgICA8cD5XZSBmYWlsZWQgdGVzdCAwMDJfYm9vdHN0cmFwLnZlcmlmeV9hZGRfaG9zdHM8L3A+ CiAgICA8cD5JIGNhbiBzZWUgd2Ugb25seSB0cmllZCB0byBpbnN0YWxsIG9uZSBvZiB0aGUgaG9z dHMgKGhvc3QtMCkgYW5kCiAgICAgIGZhaWxlZC4gdGhlIHNlY29uZCBob3N0IGhhcyBubyBsb2cg d2hpY2ggbWVhbnMgd2UgZGlkIG5vdCB0cnkgdG8KICAgICAgZGVwbG95IGl0LiA8YnI+CiAgICA8 L3A+CiAgICA8cD5UaGUgZXJyb3Igc3VnZ2VzdHMgdGhhdCB3ZSBvdmlydC1pbWFnZWlvLWRhZW1v biBmYWlsZWQgdG8gc3RhcnQuCiAgICAgIEhvd2V2ZXIsIHRoZXJlIGlzIGFub3RoZXIgbWVzc2Fn ZSB0aGF0IEkgdGhpbmsgc2hvdWxkIGJlIGFkZHJlc3NlZAogICAgICBhYm91dCBjb25mbGljdGlu ZyB2ZHNtIGFuZCBsaWJ2aXJ0IGNvbmZpZ3VyYXRpb25zLiA8YnI+CiAgICA8L3A+CiAgICA8cD48 YiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFsIiBpZD0ibV8tNjEyMzYyMDQ4NjQ3NzQxNzM2MWRv Y3MtaW50ZXJuYWwtZ3VpZC01ODU5YjdhMS05MTFlLTU2MTYtM2NiYy05NzI4NjU4N2RiODUiPgog ICAgICAgIDwvYj48L3A+PHAgZGlyPSJsdHIiIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdp bi10b3A6MHB0O21hcmdpbi1ib3R0b206MHB0Ij48YiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFs IiBpZD0ibV8tNjEyMzYyMDQ4NjQ3NzQxNzM2MWRvY3MtaW50ZXJuYWwtZ3VpZC01ODU5YjdhMS05 MTFlLTU2MTYtM2NiYy05NzI4NjU4N2RiODUiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTFwdDtm b250LWZhbWlseTpBcmlhbDtjb2xvcjojMDAwMDAwO2JhY2tncm91bmQtY29sb3I6dHJhbnNwYXJl bnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7 dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxpZ246YmFzZWxpbmU7d2hpdGUtc3BhY2U6 cHJlLXdyYXAiPkxpbmsgdG8gc3VzcGVjdGVkIHBhdGNoZXM6IDxhIGNsYXNzPSJtXy02MTIzNjIw NDg2NDc3NDE3MzYxbW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVmPSJodHRwczovL2dlcnJpdC5v dmlydC5vcmcvIy9jLzgzNjEyLyIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vZ2Vycml0Lm92aXJ0 Lm9yZy8jL2MvPHdicj44MzYxMi88L2E+PC9zcGFuPjwvYj48L3A+PGIgc3R5bGU9ImZvbnQtd2Vp Z2h0Om5vcm1hbCIgaWQ9Im1fLTYxMjM2MjA0ODY0Nzc0MTczNjFkb2NzLWludGVybmFsLWd1aWQt NTg1OWI3YTEtOTExZS01NjE2LTNjYmMtOTcyODY1ODdkYjg1Ij4KICAgICAgICA8YnI+CiAgICAg ICAgPHAgZGlyPSJsdHIiIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21h cmdpbi1ib3R0b206MHB0Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExcHQ7Zm9udC1mYW1pbHk6 QXJpYWw7Y29sb3I6IzAwMDAwMDtiYWNrZ3JvdW5kLWNvbG9yOnRyYW5zcGFyZW50O2ZvbnQtd2Vp Z2h0OjQwMDtmb250LXN0eWxlOm5vcm1hbDtmb250LXZhcmlhbnQ6bm9ybWFsO3RleHQtZGVjb3Jh dGlvbjpub25lO3ZlcnRpY2FsLWFsaWduOmJhc2VsaW5lO3doaXRlLXNwYWNlOnByZS13cmFwIj5M aW5rIHRvIEpvYjogPGEgY2xhc3M9Im1fLTYxMjM2MjA0ODY0Nzc0MTczNjFtb3otdHh0LWxpbmst ZnJlZXRleHQiIGhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVy X2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi8iIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vamVua2lu cy5vdmlydC5vcmcvam9iLzx3YnI+b3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS08d2JyPnRlc3Rl ci8zNjI2LzwvYT48L3NwYW4+PC9wPgogICAgICAgIDxicj4KICAgICAgICA8cCBkaXI9Imx0ciIg c3R5bGU9ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQi PjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTFwdDtmb250LWZhbWlseTpBcmlhbDtjb2xvcjojMDAw MDAwO2JhY2tncm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5 bGU6bm9ybWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVydGlj YWwtYWxpZ246YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdyYXAiPkxpbmsgdG8gYWxsIGxvZ3M6 IDxhIGNsYXNzPSJtXy02MTIzNjIwNDg2NDc3NDE3MzYxbW96LXR4dC1saW5rLWZyZWV0ZXh0IiBo cmVmPSJodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVl dWUtdGVzdGVyLzM2MjYvYXJ0aWZhY3QvIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMu b3ZpcnQub3JnL2pvYi88d2JyPm92aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtPHdicj50ZXN0ZXIv MzYyNi9hcnRpZmFjdC88L2E+PC9zcGFuPjwvcD4KICAgICAgICA8cCBkaXI9Imx0ciIgc3R5bGU9 ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQiPjxzcGFu IHN0eWxlPSJmb250LXNpemU6MTFwdDtmb250LWZhbWlseTpBcmlhbDtjb2xvcjojMDAwMDAwO2Jh Y2tncm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9y bWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxp Z246YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdyYXAiPgo8L3NwYW4+PC9wPgo8YSBjbGFzcz0i bV8tNjEyMzYyMDQ4NjQ3NzQxNzM2MW1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0iaHR0cDov L2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8z NjI2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVz dF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNp Yy1zdWl0ZS1tYXN0ZXItZW5naW5lL192YXJfbG9nL292aXJ0LWVuZ2luZS9ob3N0LWRlcGxveS9v dmlydC1ob3N0LWRlcGxveS0yMDE3MTEwNjAyNTY0Ny1sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1o b3N0LTAtNTUzMGFiMWYubG9nIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMub3ZpcnQu b3JnL2pvYi88d2JyPm92aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtPHdicj50ZXN0ZXIvMzYyNi9h cnRpZmFjdC9leHBvcnRlZC08d2JyPmFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci08d2JyPmVs Ny90ZXN0X2xvZ3MvYmFzaWMtc3VpdGUtPHdicj5tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5 Lzx3YnI+bGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItPHdicj5lbmdpbmUvX3Zhcl9sb2cvb3ZpcnQt ZW5naW5lLzx3YnI+aG9zdC1kZXBsb3kvb3ZpcnQtaG9zdC1kZXBsb3ktPHdicj4yMDE3MTEwNjAy NTY0Ny1sYWdvLWJhc2ljLTx3YnI+c3VpdGUtbWFzdGVyLWhvc3QtMC01NTMwYWIxZi48d2JyPmxv ZzwvYT48L2I+PHA+PC9wPgogICAgPHA+PGIgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbCIgaWQ9 Im1fLTYxMjM2MjA0ODY0Nzc0MTczNjFkb2NzLWludGVybmFsLWd1aWQtNTg1OWI3YTEtOTExZS01 NjE2LTNjYmMtOTcyODY1ODdkYjg1Ij48YnI+CiAgICAgICAgPC9iPjwvcD48cCBkaXI9Imx0ciIg c3R5bGU9ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQi PjxiIHN0eWxlPSJmb250LXdlaWdodDpub3JtYWwiIGlkPSJtXy02MTIzNjIwNDg2NDc3NDE3MzYx ZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUtNTYxNi0zY2JjLTk3Mjg2NTg3ZGI4NSI+ PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFyaWFsO2NvbG9yOiMwMDAw MDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdodDo0MDA7Zm9udC1zdHls ZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTt2ZXJ0aWNh bC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcCI+KFJlbGV2YW50KSBlcnJvciBz bmlwcGV0IGZyb20gdGhlIGxvZzogPC9zcGFuPjwvYj48L3A+PGIgc3R5bGU9ImZvbnQtd2VpZ2h0 Om5vcm1hbCIgaWQ9Im1fLTYxMjM2MjA0ODY0Nzc0MTczNjFkb2NzLWludGVybmFsLWd1aWQtNTg1 OWI3YTEtOTExZS01NjE2LTNjYmMtOTcyODY1ODdkYjg1Ij4KICAgICAgICA8cCBkaXI9Imx0ciIg c3R5bGU9ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQi PjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTFwdDtmb250LWZhbWlseTpBcmlhbDtjb2xvcjojMDAw MDAwO2JhY2tncm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5 bGU6bm9ybWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVydGlj YWwtYWxpZ246YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdyYXAiPiZsdDtlcnJvciZndDs8L3Nw YW4+PC9wPgogICAgICAgIFw8L2I+PGJyPgogICAgPHA+PC9wPgogICAgPHByZSBzdHlsZT0iY29s b3I6cmdiKDAsMCwwKTtmb250LXN0eWxlOm5vcm1hbDtmb250LXZhcmlhbnQtbGlnYXR1cmVzOm5v cm1hbDtmb250LXZhcmlhbnQtY2Fwczpub3JtYWw7Zm9udC13ZWlnaHQ6bm9ybWFsO2xldHRlci1z cGFjaW5nOm5vcm1hbDt0ZXh0LWFsaWduOnN0YXJ0O3RleHQtaW5kZW50OjBweDt0ZXh0LXRyYW5z Zm9ybTpub25lO3dvcmQtc3BhY2luZzowcHg7dGV4dC1kZWNvcmF0aW9uLXN0eWxlOmluaXRpYWw7 dGV4dC1kZWNvcmF0aW9uLWNvbG9yOmluaXRpYWwiPjIwMTctMTEtMDYgMDI6NTY6NDYsNTI2LTA1 MDAgREVCVUcgb3RvcGkucGx1Z2lucy5vdmlydF9ob3N0Xzx3YnI+ZGVwbG95LnZkc20ucGFja2Fn ZXMgcGx1Z2luLmV4ZWN1dGU6OTIxIGV4ZWN1dGUtb3V0cHV0OiAoJiMzOTsvdXNyL2Jpbi92ZHNt LXRvb2wmIzM5OywgJiMzOTtjb25maWd1cmUmIzM5OywgJiMzOTstLWZvcmNlJiMzOTspIHN0ZG91 dDoKCkNoZWNraW5nIGNvbmZpZ3VyYXRpb24gc3RhdHVzLi4uCgphYnJ0IGlzIG5vdCBjb25maWd1 cmVkIGZvciB2ZHNtCldBUk5JTkc6IExWTSBsb2NhbCBjb25maWd1cmF0aW9uOiAvZXRjL2x2bS9s dm1sb2NhbC5jb25mIGlzIG5vdCBiYXNlZCBvbiB2ZHNtIGNvbmZpZ3VyYXRpb24KbHZtIHJlcXVp cmVzIGNvbmZpZ3VyYXRpb24KbGlidmlydCBpcyBub3QgY29uZmlndXJlZCBmb3IgdmRzbSB5ZXQK RkFJTEVEOiBjb25mbGljdGluZyB2ZHNtIGFuZCBsaWJ2aXJ0LXFlbXUgdGxzIGNvbmZpZ3VyYXRp b24uCnZkc20uY29uZiB3aXRoIHNzbD1UcnVlIHJlcXVpcmVzIHRoZSBmb2xsb3dpbmcgY2hhbmdl czoKbGlidmlydGQuY29uZjogbGlzdGVuX3RjcD0wLCBhdXRoX3RjcD0mcXVvdDtzYXNsJnF1b3Q7 LCBsaXN0ZW5fdGxzPTEKcWVtdS5jb25mOiBzcGljZV90bHM9MS4KbXVsdGlwYXRoIHJlcXVpcmVz IGNvbmZpZ3VyYXRpb24KPC9wcmU+CiAgICA8YnIgY2xhc3M9Im1fLTYxMjM2MjA0ODY0Nzc0MTcz NjFBcHBsZS1pbnRlcmNoYW5nZS1uZXdsaW5lIj4KICAgIDxwcmUgc3R5bGU9ImNvbG9yOnJnYigw LDAsMCk7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50LWxpZ2F0dXJlczpub3JtYWw7Zm9u dC12YXJpYW50LWNhcHM6bm9ybWFsO2ZvbnQtd2VpZ2h0Om5vcm1hbDtsZXR0ZXItc3BhY2luZzpu b3JtYWw7dGV4dC1hbGlnbjpzdGFydDt0ZXh0LWluZGVudDowcHg7dGV4dC10cmFuc2Zvcm06bm9u ZTt3b3JkLXNwYWNpbmc6MHB4O3RleHQtZGVjb3JhdGlvbi1zdHlsZTppbml0aWFsO3RleHQtZGVj b3JhdGlvbi1jb2xvcjppbml0aWFsIj4yMDE3LTExLTA2IDAyOjU2OjQ3LDU1MS0wNTAwIERFQlVH IG90b3BpLnBsdWdpbnMub3RvcGkuc2VydmljZXMuPHdicj5zeXN0ZW1kIHBsdWdpbi5leGVjdXRl OjkyNiBleGVjdXRlLW91dHB1dDogKCYjMzk7L3Vzci9iaW4vc3lzdGVtY3RsJiMzOTssICYjMzk7 c3RhcnQmIzM5OywgJiMzOTtvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlJiMzOTs8d2JyPikg c3RkZXJyOgpKb2IgZm9yIG92aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UgZmFpbGVkIGJlY2F1 c2UgdGhlIGNvbnRyb2wgcHJvY2VzcyBleGl0ZWQgd2l0aCBlcnJvciBjb2RlLiBTZWUgJnF1b3Q7 c3lzdGVtY3RsIHN0YXR1cyBvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlJnF1b3Q7IGFuZCAm cXVvdDtqb3VybmFsY3RsIC14ZSZxdW90OyBmb3IgZGV0YWlscy4KCjIwMTctMTEtMDYgMDI6NTY6 NDcsNTUyLTA1MDAgREVCVUcgb3RvcGkuY29udGV4dCBjb250ZXh0Ll9leGVjdXRlTWV0aG9kOjE0 MyBtZXRob2QgZXhjZXB0aW9uClRyYWNlYmFjayAobW9zdCByZWNlbnQgY2FsbCBsYXN0KToKICBG aWxlICZxdW90Oy90bXAvb3ZpcnQtUjRSOGdaaGFRSS88d2JyPnB5dGhvbmxpYi9vdG9waS9jb250 ZXh0LnB5JnF1b3Q7LCBsaW5lIDEzMywgaW4gX2V4ZWN1dGVNZXRob2QKICAgIG1ldGhvZFsmIzM5 O21ldGhvZCYjMzk7XSgpCiAgRmlsZSAmcXVvdDsvdG1wL292aXJ0LVI0UjhnWmhhUUkvb3RvcGkt PHdicj5wbHVnaW5zL292aXJ0LWhvc3QtZGVwbG95Lzx3YnI+dmRzbS9wYWNrYWdlcy5weSZxdW90 OywgbGluZSAxNzksIGluIF9zdGFydAogICAgc2VsZi5zZXJ2aWNlcy5zdGF0ZSgmIzM5O292aXJ0 LTx3YnI+aW1hZ2Vpby1kYWVtb24mIzM5OywgVHJ1ZSkKICBGaWxlICZxdW90Oy90bXAvb3ZpcnQt UjRSOGdaaGFRSS9vdG9waS08d2JyPnBsdWdpbnMvb3RvcGkvc2VydmljZXMvPHdicj5zeXN0ZW1k LnB5JnF1b3Q7LCBsaW5lIDE0MSwgaW4gc3RhdGUKICAgIHNlcnZpY2U9bmFtZSwKUnVudGltZUVy cm9yOiBGYWlsZWQgdG8gc3RhcnQgc2VydmljZSAmIzM5O292aXJ0LWltYWdlaW8tZGFlbW9uJiMz OTsKMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTMtMDUwMCBFUlJPUiBvdG9waS5jb250ZXh0IGNvbnRl eHQuX2V4ZWN1dGVNZXRob2Q6MTUyIEZhaWxlZCB0byBleGVjdXRlIHN0YWdlICYjMzk7Q2xvc2lu ZyB1cCYjMzk7OiBGYWlsZWQgdG8gc3RhcnQgc2VydmljZSAmIzM5O292aXJ0LWltYWdlaW8tZGFl bW9uJiMzOTs8L3ByZT4KICAgIDxwPjxiIHN0eWxlPSJmb250LXdlaWdodDpub3JtYWwiIGlkPSJt Xy02MTIzNjIwNDg2NDc3NDE3MzYxZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUtNTYx Ni0zY2JjLTk3Mjg2NTg3ZGI4NSI+CiAgICAgICAgPC9iPjwvcD48cCBkaXI9Imx0ciIgc3R5bGU9 ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQiPjxiIHN0 eWxlPSJmb250LXdlaWdodDpub3JtYWwiIGlkPSJtXy02MTIzNjIwNDg2NDc3NDE3MzYxZG9jcy1p bnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUtNTYxNi0zY2JjLTk3Mjg2NTg3ZGI4NSI+PHNwYW4g c3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFyaWFsO2NvbG9yOiMwMDAwMDA7YmFj a2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdodDo0MDA7Zm9udC1zdHlsZTpub3Jt YWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTt2ZXJ0aWNhbC1hbGln bjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcCI+Jmx0Oy9lcnJvciZndDs8L3NwYW4+PC9i PjwvcD48YiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFsIiBpZD0ibV8tNjEyMzYyMDQ4NjQ3NzQx NzM2MWRvY3MtaW50ZXJuYWwtZ3VpZC01ODU5YjdhMS05MTFlLTU2MTYtM2NiYy05NzI4NjU4N2Ri ODUiPgogICAgICAgIDxicj4KICAgICAgPC9iPjxwPjwvcD4KICA8L2Rpdj4KCjwvYmxvY2txdW90 ZT48L2Rpdj48YnI+PC9kaXY+Cg== --===============0455996970764902916==-- From dron at redhat.com Mon Nov 6 11:57:43 2017 Content-Type: multipart/mixed; boundary="===============3352095384987614555==" MIME-Version: 1.0 From: Dafna Ron To: devel at ovirt.org Subject: Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 06-11-2017 ] [ 002_bootstrap.verify_add_hosts ] Date: Mon, 06 Nov 2017 11:57:38 +0000 Message-ID: <0313f791-1704-3975-010b-abc22909a381@redhat.com> In-Reply-To: CAPuOgO3Lm8eJpU+iapGym2czEDQ669+wrQ7Gy+Xd22HQujOxWg@mail.gmail.com --===============3352095384987614555== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------5DECD70B48A640569C491C90 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit adding Didi. On 11/06/2017 11:51 AM, Ala Hino wrote: > Suspected patch (https://gerrit.ovirt.org/#/c/83612/) is about cold > merge and has nothing to do with host deploy. > > On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron > wrote: > > Hi, > > We failed test 002_bootstrap.verify_add_hosts > > I can see we only tried to install one of the hosts (host-0) and > failed. the second host has no log which means we did not try to > deploy it. > > The error suggests that we ovirt-imageio-daemon failed to start. > However, there is another message that I think should be addressed > about conflicting vdsm and libvirt configurations. > > ** > > *Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/ > * > > * > > Link to Job: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ > > > > Link to all logs: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ar= tifact/ > > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ar= tifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-maste= r/post-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engin= e/host-deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host= -0-5530ab1f.log > * > > > * > * > > *(Relevant) error snippet from the log: * > > * > > > > \* > > 2017-11-06 02:56:46,526-0500 DEBUG otopi.plugins.ovirt_host_deploy.vd= sm.packages plugin.execute:921 execute-output: ('/usr/bin/vdsm-tool', 'conf= igure', '--force') stdout: > > Checking configuration status... > > abrt is not configured for vdsm > WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based= on vdsm configuration > lvm requires configuration > libvirt is not configured for vdsm yet > FAILED: conflicting vdsm and libvirt-qemu tls configuration. > vdsm.conf with ssl=3DTrue requires the following changes: > libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 > qemu.conf: spice_tls=3D1. > multipath requires configuration > > > 2017-11-06 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.syste= md plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', 'ovir= t-imageio-daemon.service') stderr: > Job for ovirt-imageio-daemon.service failed because the control proce= ss exited with error code. See "systemctl status ovirt-imageio-daemon.servi= ce" and "journalctl -xe" for details. > > 2017-11-06 02:56:47,552-0500 DEBUG otopi.context context._executeMeth= od:143 method exception > Traceback (most recent call last): > File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, = in _executeMethod > method['method']() > File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/pa= ckages.py", line 179, in _start > self.services.state('ovirt-imageio-daemon', True) > File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py= ", line 141, in state > service=3Dname, > RuntimeError: Failed to start service 'ovirt-imageio-daemon' > 2017-11-06 02:56:47,553-0500 ERROR otopi.context context._executeMeth= od:152 Failed to execute stage 'Closing up': Failed to start service 'ovirt= -imageio-daemon' > > ** > > ** > > * > * > > --------------5DECD70B48A640569C491C90 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 7bit

adding Didi.

On 11/06/2017 11:51 AM, Ala Hino wrote:

Suspected patch (https://gerrit.ovirt.org/#/c/83612/) is about cold merge and has nothing to do with host deploy.

On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron <dron(a)redhat.com<= /a>> wrote:

Hi,

We failed test 002_bootstrap.verify_add_hosts

I can see we only tried to install one of the hosts (host-0) and failed. the second host has no log which means we did not try to deploy it.

The error suggests that we ovirt-imageio-daemon failed to start. However, there is another message that I think should be addressed about conflicting vdsm and libvirt configurations.

Lin= k to suspected patches: https://gerrit.ovirt.org/#/c/83612/<= /p>

Link to Jo= b: http://jenkins.ovirt.org/job/ovirt-maste= r_change-queue-tester/3626/

Link to al= l logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifact/

http://jenkins= .ovirt.org/job/ovirt-master_change-queue-tester/3626/artifact/exp= orted-artifacts/basic-suit-master-el7/test_logs/basic-suite-= master/post-002_bootstrap.py/lago-basic-suite-master-engine/_var_= log/ovirt-engine/host-deploy/ovirt-host-deploy-20171106025647-lag= o-basic-suite-master-host-0-5530ab1f.log

(Re= levant) error snippet from the log:

<error&= gt;
\

2017-11-06= 02:56:46,526-0500 DEBUG otopi.plugins.ovirt_host_deploy.vdsm.packages= plugin.execute:921 execute-output: ('/usr/bin/vdsm-tool', 'configure', '--= force') stdout: Checking configuration status... abrt is not configured for vdsm WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based on vd= sm configuration lvm requires configuration libvirt is not configured for vdsm yet FAILED: conflicting vdsm and libvirt-qemu tls configuration. vdsm.conf with ssl=3DTrue requires the following changes: libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 qemu.conf: spice_tls=3D1. multipath requires configuration

2017-11-06= 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.e= xecute:926 execute-output: ('/usr/bin/systemctl', 'start', 'ovirt-imageio-d= aemon.service') stderr: Job for ovirt-imageio-daemon.service failed because the control process exi= ted with error code. See "systemctl status ovirt-imageio-daemon.service" an= d "journalctl -xe" for details. 2017-11-06 02:56:47,552-0500 DEBUG otopi.context context._executeMethod:143= method exception Traceback (most recent call last): File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, i= n _executeMethod method['method']() File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vds= m/packages.py", line 179, in _start self.services.state('ovirt-imageio-daemon', True) File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/system= d.py", line 141, in state service=3Dname, RuntimeError: Failed to start service 'ovirt-imageio-daemon' 2017-11-06 02:56:47,553-0500 ERROR otopi.context context._executeMethod:152= Failed to execute stage 'Closing up': Failed to start service 'ovirt-image= io-daemon'

<= ;/error>

--------------5DECD70B48A640569C491C90-- --===============3352095384987614555== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS01REVDRDcwQjQ4QTY0MDU2OUM0OTFDOTAKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQKCmFkZGluZyBEaWRpLgoK Ck9uIDExLzA2LzIwMTcgMTE6NTEgQU0sIEFsYSBIaW5vIHdyb3RlOgo+IFN1c3BlY3RlZCBwYXRj aCAoaHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMvYy84MzYxMi8pIGlzIGFib3V0IGNvbGQKPiBt ZXJnZSBhbmQgaGFzIG5vdGhpbmcgdG8gZG8gd2l0aCBob3N0IGRlcGxveS4KPgo+IE9uIE1vbiwg Tm92IDYsIDIwMTcgYXQgMTozOSBQTSwgRGFmbmEgUm9uIDxkcm9uQHJlZGhhdC5jb20KPiA8bWFp bHRvOmRyb25AcmVkaGF0LmNvbT4+IHdyb3RlOgo+Cj4gICAgIEhpLAo+Cj4gICAgIFdlIGZhaWxl ZCB0ZXN0IDAwMl9ib290c3RyYXAudmVyaWZ5X2FkZF9ob3N0cwo+Cj4gICAgIEkgY2FuIHNlZSB3 ZSBvbmx5IHRyaWVkIHRvIGluc3RhbGwgb25lIG9mIHRoZSBob3N0cyAoaG9zdC0wKSBhbmQKPiAg ICAgZmFpbGVkLiB0aGUgc2Vjb25kIGhvc3QgaGFzIG5vIGxvZyB3aGljaCBtZWFucyB3ZSBkaWQg bm90IHRyeSB0bwo+ICAgICBkZXBsb3kgaXQuCj4KPiAgICAgVGhlIGVycm9yIHN1Z2dlc3RzIHRo YXQgd2Ugb3ZpcnQtaW1hZ2Vpby1kYWVtb24gZmFpbGVkIHRvIHN0YXJ0Lgo+ICAgICBIb3dldmVy LCB0aGVyZSBpcyBhbm90aGVyIG1lc3NhZ2UgdGhhdCBJIHRoaW5rIHNob3VsZCBiZSBhZGRyZXNz ZWQKPiAgICAgYWJvdXQgY29uZmxpY3RpbmcgdmRzbSBhbmQgbGlidmlydCBjb25maWd1cmF0aW9u cy4KPgo+ICAgICAqKgo+Cj4gICAgICpMaW5rIHRvIHN1c3BlY3RlZCBwYXRjaGVzOiBodHRwczov L2dlcnJpdC5vdmlydC5vcmcvIy9jLzgzNjEyLwo+ICAgICA8aHR0cHM6Ly9nZXJyaXQub3ZpcnQu b3JnLyMvYy84MzYxMi8+Kgo+Cj4gICAgICoKPgo+ICAgICBMaW5rIHRvIEpvYjoKPiAgICAgaHR0 cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rl ci8zNjI2Lwo+ICAgICA8aHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJf Y2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2Lz4KPgo+Cj4gICAgIExpbmsgdG8gYWxsIGxvZ3M6Cj4g ICAgIGh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1 ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC8KPiAgICAgPGh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9q b2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC8+Cj4KPiAg ICAgaHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVl LXRlc3Rlci8zNjI2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rl ci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkv bGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItZW5naW5lL192YXJfbG9nL292aXJ0LWVuZ2luZS9ob3N0 LWRlcGxveS9vdmlydC1ob3N0LWRlcGxveS0yMDE3MTEwNjAyNTY0Ny1sYWdvLWJhc2ljLXN1aXRl LW1hc3Rlci1ob3N0LTAtNTUzMGFiMWYubG9nCj4gICAgIDxodHRwOi8vamVua2lucy5vdmlydC5v cmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjYvYXJ0aWZhY3QvZXhw b3J0ZWQtYXJ0aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMtc3Vp dGUtbWFzdGVyL3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1l bmdpbmUvX3Zhcl9sb2cvb3ZpcnQtZW5naW5lL2hvc3QtZGVwbG95L292aXJ0LWhvc3QtZGVwbG95 LTIwMTcxMTA2MDI1NjQ3LWxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMC01NTMwYWIxZi5s b2c+Kgo+Cj4KPiAgICAgKgo+ICAgICAqCj4KPiAgICAgKihSZWxldmFudCkgZXJyb3Igc25pcHBl dCBmcm9tIHRoZSBsb2c6ICoKPgo+ICAgICAqCj4KPiAgICAgPGVycm9yPgo+Cj4gICAgIFwqCj4K PiAgICAgMjAxNy0xMS0wNiAwMjo1Njo0Niw1MjYtMDUwMCBERUJVRyBvdG9waS5wbHVnaW5zLm92 aXJ0X2hvc3RfZGVwbG95LnZkc20ucGFja2FnZXMgcGx1Z2luLmV4ZWN1dGU6OTIxIGV4ZWN1dGUt b3V0cHV0OiAoJy91c3IvYmluL3Zkc20tdG9vbCcsICdjb25maWd1cmUnLCAnLS1mb3JjZScpIHN0 ZG91dDoKPgo+ICAgICBDaGVja2luZyBjb25maWd1cmF0aW9uIHN0YXR1cy4uLgo+Cj4gICAgIGFi cnQgaXMgbm90IGNvbmZpZ3VyZWQgZm9yIHZkc20KPiAgICAgV0FSTklORzogTFZNIGxvY2FsIGNv bmZpZ3VyYXRpb246IC9ldGMvbHZtL2x2bWxvY2FsLmNvbmYgaXMgbm90IGJhc2VkIG9uIHZkc20g Y29uZmlndXJhdGlvbgo+ICAgICBsdm0gcmVxdWlyZXMgY29uZmlndXJhdGlvbgo+ICAgICBsaWJ2 aXJ0IGlzIG5vdCBjb25maWd1cmVkIGZvciB2ZHNtIHlldAo+ICAgICBGQUlMRUQ6IGNvbmZsaWN0 aW5nIHZkc20gYW5kIGxpYnZpcnQtcWVtdSB0bHMgY29uZmlndXJhdGlvbi4KPiAgICAgdmRzbS5j b25mIHdpdGggc3NsPVRydWUgcmVxdWlyZXMgdGhlIGZvbGxvd2luZyBjaGFuZ2VzOgo+ICAgICBs aWJ2aXJ0ZC5jb25mOiBsaXN0ZW5fdGNwPTAsIGF1dGhfdGNwPSJzYXNsIiwgbGlzdGVuX3Rscz0x Cj4gICAgIHFlbXUuY29uZjogc3BpY2VfdGxzPTEuCj4gICAgIG11bHRpcGF0aCByZXF1aXJlcyBj b25maWd1cmF0aW9uCj4KPgo+ICAgICAyMDE3LTExLTA2IDAyOjU2OjQ3LDU1MS0wNTAwIERFQlVH IG90b3BpLnBsdWdpbnMub3RvcGkuc2VydmljZXMuc3lzdGVtZCBwbHVnaW4uZXhlY3V0ZTo5MjYg ZXhlY3V0ZS1vdXRwdXQ6ICgnL3Vzci9iaW4vc3lzdGVtY3RsJywgJ3N0YXJ0JywgJ292aXJ0LWlt YWdlaW8tZGFlbW9uLnNlcnZpY2UnKSBzdGRlcnI6Cj4gICAgIEpvYiBmb3Igb3ZpcnQtaW1hZ2Vp by1kYWVtb24uc2VydmljZSBmYWlsZWQgYmVjYXVzZSB0aGUgY29udHJvbCBwcm9jZXNzIGV4aXRl ZCB3aXRoIGVycm9yIGNvZGUuIFNlZSAic3lzdGVtY3RsIHN0YXR1cyBvdmlydC1pbWFnZWlvLWRh ZW1vbi5zZXJ2aWNlIiBhbmQgImpvdXJuYWxjdGwgLXhlIiBmb3IgZGV0YWlscy4KPgo+ICAgICAy MDE3LTExLTA2IDAyOjU2OjQ3LDU1Mi0wNTAwIERFQlVHIG90b3BpLmNvbnRleHQgY29udGV4dC5f ZXhlY3V0ZU1ldGhvZDoxNDMgbWV0aG9kIGV4Y2VwdGlvbgo+ICAgICBUcmFjZWJhY2sgKG1vc3Qg cmVjZW50IGNhbGwgbGFzdCk6Cj4gICAgICAgRmlsZSAiL3RtcC9vdmlydC1SNFI4Z1poYVFJL3B5 dGhvbmxpYi9vdG9waS9jb250ZXh0LnB5IiwgbGluZSAxMzMsIGluIF9leGVjdXRlTWV0aG9kCj4g ICAgICAgICBtZXRob2RbJ21ldGhvZCddKCkKPiAgICAgICBGaWxlICIvdG1wL292aXJ0LVI0Ujhn WmhhUUkvb3RvcGktcGx1Z2lucy9vdmlydC1ob3N0LWRlcGxveS92ZHNtL3BhY2thZ2VzLnB5Iiwg bGluZSAxNzksIGluIF9zdGFydAo+ICAgICAgICAgc2VsZi5zZXJ2aWNlcy5zdGF0ZSgnb3ZpcnQt aW1hZ2Vpby1kYWVtb24nLCBUcnVlKQo+ICAgICAgIEZpbGUgIi90bXAvb3ZpcnQtUjRSOGdaaGFR SS9vdG9waS1wbHVnaW5zL290b3BpL3NlcnZpY2VzL3N5c3RlbWQucHkiLCBsaW5lIDE0MSwgaW4g c3RhdGUKPiAgICAgICAgIHNlcnZpY2U9bmFtZSwKPiAgICAgUnVudGltZUVycm9yOiBGYWlsZWQg dG8gc3RhcnQgc2VydmljZSAnb3ZpcnQtaW1hZ2Vpby1kYWVtb24nCj4gICAgIDIwMTctMTEtMDYg MDI6NTY6NDcsNTUzLTA1MDAgRVJST1Igb3RvcGkuY29udGV4dCBjb250ZXh0Ll9leGVjdXRlTWV0 aG9kOjE1MiBGYWlsZWQgdG8gZXhlY3V0ZSBzdGFnZSAnQ2xvc2luZyB1cCc6IEZhaWxlZCB0byBz dGFydCBzZXJ2aWNlICdvdmlydC1pbWFnZWlvLWRhZW1vbicKPgo+ICAgICAqKgo+Cj4gICAgICo8 L2Vycm9yPioKPgo+ICAgICAqCj4gICAgICoKPgo+CgoKLS0tLS0tLS0tLS0tLS01REVDRDcwQjQ4 QTY0MDU2OUM0OTFDOTAKQ29udGVudC1UeXBlOiB0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgKQ29u dGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKPGh0bWw+CiAgPGhlYWQ+CiAgICA8bWV0YSBo dHRwLWVxdWl2PSJDb250ZW50LVR5cGUiIGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD11dGYt OCI+CiAgPC9oZWFkPgogIDxib2R5IHRleHQ9IiMwMDAwMDAiIGJnY29sb3I9IiNGRkZGRkYiPgog ICAgPGRpdiBjbGFzcz0ibW96LWNpdGUtcHJlZml4Ij5hZGRpbmcgRGlkaS4gPGJyPgogICAgICA8 YnI+CiAgICAgIDxicj4KICAgICAgT24gMTEvMDYvMjAxNyAxMTo1MSBBTSwgQWxhIEhpbm8gd3Jv dGU6PGJyPgogICAgPC9kaXY+CiAgICA8YmxvY2txdW90ZSB0eXBlPSJjaXRlIgpjaXRlPSJtaWQ6 Q0FQdU9nTzNMbThlSnBVK2lhcEd5bTJjekVEUTY2OSt3clE3R3krWGQyMkhRdWpPeFdnQG1haWwu Z21haWwuY29tIj4KICAgICAgPGRpdiBkaXI9Imx0ciI+U3VzcGVjdGVkIHBhdGNoICg8YQogICAg ICAgICAgaHJlZj0iaHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMvYy84MzYxMi8iCiAgICAgICAg ICBtb3otZG8tbm90LXNlbmQ9InRydWUiPmh0dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy8jL2MvODM2 MTIvPC9hPikKICAgICAgICBpcyBhYm91dCBjb2xkIG1lcmdlIGFuZCBoYXMgbm90aGluZyB0byBk byB3aXRoIGhvc3QgZGVwbG95LjwvZGl2PgogICAgICA8ZGl2IGNsYXNzPSJnbWFpbF9leHRyYSI+ PGJyPgogICAgICAgIDxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj5PbiBNb24sIE5vdiA2LCAyMDE3 IGF0IDE6MzkgUE0sIERhZm5hCiAgICAgICAgICBSb24gPHNwYW4gZGlyPSJsdHIiPiZsdDs8YSBo cmVmPSJtYWlsdG86ZHJvbkByZWRoYXQuY29tIgogICAgICAgICAgICAgIHRhcmdldD0iX2JsYW5r IiBtb3otZG8tbm90LXNlbmQ9InRydWUiPmRyb25AcmVkaGF0LmNvbTwvYT4mZ3Q7PC9zcGFuPgog ICAgICAgICAgd3JvdGU6PGJyPgogICAgICAgICAgPGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1 b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwCiAgICAgICAgICAgIC44ZXg7Ym9yZGVyLWxlZnQ6MXB4 ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+CiAgICAgICAgICAgIDxkaXYgdGV4dD0iIzAw MDAwMCIgYmdjb2xvcj0iI0ZGRkZGRiI+CiAgICAgICAgICAgICAgPHA+SGksIDxicj4KICAgICAg ICAgICAgICA8L3A+CiAgICAgICAgICAgICAgPHA+V2UgZmFpbGVkIHRlc3QgMDAyX2Jvb3RzdHJh cC52ZXJpZnlfYWRkX2hvc3RzPC9wPgogICAgICAgICAgICAgIDxwPkkgY2FuIHNlZSB3ZSBvbmx5 IHRyaWVkIHRvIGluc3RhbGwgb25lIG9mIHRoZSBob3N0cwogICAgICAgICAgICAgICAgKGhvc3Qt MCkgYW5kIGZhaWxlZC4gdGhlIHNlY29uZCBob3N0IGhhcyBubyBsb2cgd2hpY2gKICAgICAgICAg ICAgICAgIG1lYW5zIHdlIGRpZCBub3QgdHJ5IHRvIGRlcGxveSBpdC4gPGJyPgogICAgICAgICAg ICAgIDwvcD4KICAgICAgICAgICAgICA8cD5UaGUgZXJyb3Igc3VnZ2VzdHMgdGhhdCB3ZSBvdmly dC1pbWFnZWlvLWRhZW1vbiBmYWlsZWQKICAgICAgICAgICAgICAgIHRvIHN0YXJ0LiBIb3dldmVy LCB0aGVyZSBpcyBhbm90aGVyIG1lc3NhZ2UgdGhhdCBJIHRoaW5rCiAgICAgICAgICAgICAgICBz aG91bGQgYmUgYWRkcmVzc2VkIGFib3V0IGNvbmZsaWN0aW5nIHZkc20gYW5kIGxpYnZpcnQKICAg ICAgICAgICAgICAgIGNvbmZpZ3VyYXRpb25zLiA8YnI+CiAgICAgICAgICAgICAgPC9wPgogICAg ICAgICAgICAgIDxwPjxiIHN0eWxlPSJmb250LXdlaWdodDpub3JtYWwiCmlkPSJtXy02MTIzNjIw NDg2NDc3NDE3MzYxZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUtNTYxNi0zY2JjLTk3 Mjg2NTg3ZGI4NSI+CiAgICAgICAgICAgICAgICA8L2I+PC9wPgogICAgICAgICAgICAgIDxwIGRp cj0ibHRyIgogICAgICAgICAgICAgICAgc3R5bGU9ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRv cDowcHQ7bWFyZ2luLWJvdHRvbTowcHQiPjxiCiAgICAgICAgICAgICAgICAgIHN0eWxlPSJmb250 LXdlaWdodDpub3JtYWwiCmlkPSJtXy02MTIzNjIwNDg2NDc3NDE3MzYxZG9jcy1pbnRlcm5hbC1n dWlkLTU4NTliN2ExLTkxMWUtNTYxNi0zY2JjLTk3Mjg2NTg3ZGI4NSI+PHNwYW4gc3R5bGU9ImZv bnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFyaWFsO2NvbG9yOiMwMDAwMDA7YmFja2dyb3VuZC1j b2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdodDo0MDA7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC12 YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTt2ZXJ0aWNhbC1hbGlnbjpiYXNlbGlu ZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcCI+TGluayB0byBzdXNwZWN0ZWQgcGF0Y2hlczogPGEgY2xh c3M9Im1fLTYxMjM2MjA0ODY0Nzc0MTczNjFtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0 dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy8jL2MvODM2MTIvIiB0YXJnZXQ9Il9ibGFuayIgbW96LWRv LW5vdC1zZW5kPSJ0cnVlIj5odHRwczovL2dlcnJpdC5vdmlydC5vcmcvIy9jLzx3YnI+ODM2MTIv PC9hPjwvc3Bhbj48L2I+PC9wPgogICAgICAgICAgICAgIDxiIHN0eWxlPSJmb250LXdlaWdodDpu b3JtYWwiCmlkPSJtXy02MTIzNjIwNDg2NDc3NDE3MzYxZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTli N2ExLTkxMWUtNTYxNi0zY2JjLTk3Mjg2NTg3ZGI4NSI+CiAgICAgICAgICAgICAgICA8YnI+CiAg ICAgICAgICAgICAgICA8cCBkaXI9Imx0ciIKICAgICAgICAgICAgICAgICAgc3R5bGU9ImxpbmUt aGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRvbTowcHQiPjxzcGFuIHN0eWxl PSJmb250LXNpemU6MTFwdDtmb250LWZhbWlseTpBcmlhbDtjb2xvcjojMDAwMDAwO2JhY2tncm91 bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2Zv bnQtdmFyaWFudDpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxpZ246YmFz ZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdyYXAiPkxpbmsgdG8gSm9iOiA8YSBjbGFzcz0ibV8tNjEy MzYyMDQ4NjQ3NzQxNzM2MW1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0iaHR0cDovL2plbmtp bnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2LyIg dGFyZ2V0PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+aHR0cDovL2plbmtpbnMub3Zp cnQub3JnL2pvYi88d2JyPm92aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtPHdicj50ZXN0ZXIvMzYy Ni88L2E+PC9zcGFuPjwvcD4KICAgICAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgICAgIDxw IGRpcj0ibHRyIgogICAgICAgICAgICAgICAgICBzdHlsZT0ibGluZS1oZWlnaHQ6MS4zODttYXJn aW4tdG9wOjBwdDttYXJnaW4tYm90dG9tOjBwdCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0 O2ZvbnQtZmFtaWx5OkFyaWFsO2NvbG9yOiMwMDAwMDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3Bh cmVudDtmb250LXdlaWdodDo0MDA7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1h bDt0ZXh0LWRlY29yYXRpb246bm9uZTt2ZXJ0aWNhbC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFj ZTpwcmUtd3JhcCI+TGluayB0byBhbGwgbG9nczogPGEgY2xhc3M9Im1fLTYxMjM2MjA0ODY0Nzc0 MTczNjFtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9y Zy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC8iIHRh cmdldD0iX2JsYW5rIiBtb3otZG8tbm90LXNlbmQ9InRydWUiPmh0dHA6Ly9qZW5raW5zLm92aXJ0 Lm9yZy9qb2IvPHdicj5vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLTx3YnI+dGVzdGVyLzM2MjYv YXJ0aWZhY3QvPC9hPjwvc3Bhbj48L3A+CiAgICAgICAgICAgICAgICA8cCBkaXI9Imx0ciIKICAg ICAgICAgICAgICAgICAgc3R5bGU9ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFy Z2luLWJvdHRvbTowcHQiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTFwdDtmb250LWZhbWlseTpB cmlhbDtjb2xvcjojMDAwMDAwO2JhY2tncm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9udC13ZWln aHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4dC1kZWNvcmF0 aW9uOm5vbmU7dmVydGljYWwtYWxpZ246YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdyYXAiPgo8 L3NwYW4+PC9wPgogICAgICAgICAgICAgICAgPGEgY2xhc3M9Im1fLTYxMjM2MjA0ODY0Nzc0MTcz NjFtb3otdHh0LWxpbmstZnJlZXRleHQiCmhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9q b2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC9leHBvcnRl ZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1t YXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWVuZ2lu ZS9fdmFyX2xvZy9vdmlydC1lbmdpbmUvaG9zdC1kZXBsb3kvb3ZpcnQtaG9zdC1kZXBsb3ktMjAx NzExMDYwMjU2NDctbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wLTU1MzBhYjFmLmxvZyIK ICAgICAgICAgICAgICAgICAgdGFyZ2V0PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+ aHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi88d2JyPm92aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVl dWUtPHdicj50ZXN0ZXIvMzYyNi9hcnRpZmFjdC9leHBvcnRlZC08d2JyPmFydGlmYWN0cy9iYXNp Yy1zdWl0LW1hc3Rlci08d2JyPmVsNy90ZXN0X2xvZ3MvYmFzaWMtc3VpdGUtPHdicj5tYXN0ZXIv cG9zdC0wMDJfYm9vdHN0cmFwLnB5Lzx3YnI+bGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItPHdicj5l bmdpbmUvX3Zhcl9sb2cvb3ZpcnQtZW5naW5lLzx3YnI+aG9zdC1kZXBsb3kvb3ZpcnQtaG9zdC1k ZXBsb3ktPHdicj4yMDE3MTEwNjAyNTY0Ny1sYWdvLWJhc2ljLTx3YnI+c3VpdGUtbWFzdGVyLWhv c3QtMC01NTMwYWIxZi48d2JyPmxvZzwvYT48L2I+CiAgICAgICAgICAgICAgPHA+PGIgc3R5bGU9 ImZvbnQtd2VpZ2h0Om5vcm1hbCIKaWQ9Im1fLTYxMjM2MjA0ODY0Nzc0MTczNjFkb2NzLWludGVy bmFsLWd1aWQtNTg1OWI3YTEtOTExZS01NjE2LTNjYmMtOTcyODY1ODdkYjg1Ij48YnI+CiAgICAg ICAgICAgICAgICA8L2I+PC9wPgogICAgICAgICAgICAgIDxwIGRpcj0ibHRyIgogICAgICAgICAg ICAgICAgc3R5bGU9ImxpbmUtaGVpZ2h0OjEuMzg7bWFyZ2luLXRvcDowcHQ7bWFyZ2luLWJvdHRv bTowcHQiPjxiCiAgICAgICAgICAgICAgICAgIHN0eWxlPSJmb250LXdlaWdodDpub3JtYWwiCmlk PSJtXy02MTIzNjIwNDg2NDc3NDE3MzYxZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUt NTYxNi0zY2JjLTk3Mjg2NTg3ZGI4NSI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQt ZmFtaWx5OkFyaWFsO2NvbG9yOiMwMDAwMDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtm b250LXdlaWdodDo0MDA7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0 LWRlY29yYXRpb246bm9uZTt2ZXJ0aWNhbC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUt d3JhcCI+KFJlbGV2YW50KSBlcnJvciBzbmlwcGV0IGZyb20gdGhlIGxvZzogPC9zcGFuPjwvYj48 L3A+CiAgICAgICAgICAgICAgPGIgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbCIKaWQ9Im1fLTYx MjM2MjA0ODY0Nzc0MTczNjFkb2NzLWludGVybmFsLWd1aWQtNTg1OWI3YTEtOTExZS01NjE2LTNj YmMtOTcyODY1ODdkYjg1Ij4KICAgICAgICAgICAgICAgIDxwIGRpcj0ibHRyIgogICAgICAgICAg ICAgICAgICBzdHlsZT0ibGluZS1oZWlnaHQ6MS4zODttYXJnaW4tdG9wOjBwdDttYXJnaW4tYm90 dG9tOjBwdCI+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFyaWFsO2Nv bG9yOiMwMDAwMDA7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdodDo0MDA7 Zm9udC1zdHlsZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9u ZTt2ZXJ0aWNhbC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcCI+Jmx0O2Vycm9y Jmd0Ozwvc3Bhbj48L3A+CiAgICAgICAgICAgICAgICBcPC9iPjxicj4KICAgICAgICAgICAgICA8 cHJlIHN0eWxlPSJjb2xvcjpyZ2IoMCwwLDApO2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFu dC1saWdhdHVyZXM6bm9ybWFsO2ZvbnQtdmFyaWFudC1jYXBzOm5vcm1hbDtmb250LXdlaWdodDpu b3JtYWw7bGV0dGVyLXNwYWNpbmc6bm9ybWFsO3RleHQtYWxpZ246c3RhcnQ7dGV4dC1pbmRlbnQ6 MHB4O3RleHQtdHJhbnNmb3JtOm5vbmU7d29yZC1zcGFjaW5nOjBweDt0ZXh0LWRlY29yYXRpb24t c3R5bGU6aW5pdGlhbDt0ZXh0LWRlY29yYXRpb24tY29sb3I6aW5pdGlhbCI+MjAxNy0xMS0wNiAw Mjo1Njo0Niw1MjYtMDUwMCBERUJVRyBvdG9waS5wbHVnaW5zLm92aXJ0X2hvc3RfPHdicj5kZXBs b3kudmRzbS5wYWNrYWdlcyBwbHVnaW4uZXhlY3V0ZTo5MjEgZXhlY3V0ZS1vdXRwdXQ6ICgnL3Vz ci9iaW4vdmRzbS10b29sJywgJ2NvbmZpZ3VyZScsICctLWZvcmNlJykgc3Rkb3V0OgoKQ2hlY2tp bmcgY29uZmlndXJhdGlvbiBzdGF0dXMuLi4KCmFicnQgaXMgbm90IGNvbmZpZ3VyZWQgZm9yIHZk c20KV0FSTklORzogTFZNIGxvY2FsIGNvbmZpZ3VyYXRpb246IC9ldGMvbHZtL2x2bWxvY2FsLmNv bmYgaXMgbm90IGJhc2VkIG9uIHZkc20gY29uZmlndXJhdGlvbgpsdm0gcmVxdWlyZXMgY29uZmln dXJhdGlvbgpsaWJ2aXJ0IGlzIG5vdCBjb25maWd1cmVkIGZvciB2ZHNtIHlldApGQUlMRUQ6IGNv bmZsaWN0aW5nIHZkc20gYW5kIGxpYnZpcnQtcWVtdSB0bHMgY29uZmlndXJhdGlvbi4KdmRzbS5j b25mIHdpdGggc3NsPVRydWUgcmVxdWlyZXMgdGhlIGZvbGxvd2luZyBjaGFuZ2VzOgpsaWJ2aXJ0 ZC5jb25mOiBsaXN0ZW5fdGNwPTAsIGF1dGhfdGNwPSJzYXNsIiwgbGlzdGVuX3Rscz0xCnFlbXUu Y29uZjogc3BpY2VfdGxzPTEuCm11bHRpcGF0aCByZXF1aXJlcyBjb25maWd1cmF0aW9uCjwvcHJl PgogICAgICAgICAgICAgIDxicgogICAgICAgICAgICAgICAgY2xhc3M9Im1fLTYxMjM2MjA0ODY0 Nzc0MTczNjFBcHBsZS1pbnRlcmNoYW5nZS1uZXdsaW5lIj4KICAgICAgICAgICAgICA8cHJlIHN0 eWxlPSJjb2xvcjpyZ2IoMCwwLDApO2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFudC1saWdh dHVyZXM6bm9ybWFsO2ZvbnQtdmFyaWFudC1jYXBzOm5vcm1hbDtmb250LXdlaWdodDpub3JtYWw7 bGV0dGVyLXNwYWNpbmc6bm9ybWFsO3RleHQtYWxpZ246c3RhcnQ7dGV4dC1pbmRlbnQ6MHB4O3Rl eHQtdHJhbnNmb3JtOm5vbmU7d29yZC1zcGFjaW5nOjBweDt0ZXh0LWRlY29yYXRpb24tc3R5bGU6 aW5pdGlhbDt0ZXh0LWRlY29yYXRpb24tY29sb3I6aW5pdGlhbCI+MjAxNy0xMS0wNiAwMjo1Njo0 Nyw1NTEtMDUwMCBERUJVRyBvdG9waS5wbHVnaW5zLm90b3BpLnNlcnZpY2VzLjx3YnI+c3lzdGVt ZCBwbHVnaW4uZXhlY3V0ZTo5MjYgZXhlY3V0ZS1vdXRwdXQ6ICgnL3Vzci9iaW4vc3lzdGVtY3Rs JywgJ3N0YXJ0JywgJ292aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UnPHdicj4pIHN0ZGVycjoK Sm9iIGZvciBvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlIGZhaWxlZCBiZWNhdXNlIHRoZSBj b250cm9sIHByb2Nlc3MgZXhpdGVkIHdpdGggZXJyb3IgY29kZS4gU2VlICJzeXN0ZW1jdGwgc3Rh dHVzIG92aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UiIGFuZCAiam91cm5hbGN0bCAteGUiIGZv ciBkZXRhaWxzLgoKMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTItMDUwMCBERUJVRyBvdG9waS5jb250 ZXh0IGNvbnRleHQuX2V4ZWN1dGVNZXRob2Q6MTQzIG1ldGhvZCBleGNlcHRpb24KVHJhY2ViYWNr IChtb3N0IHJlY2VudCBjYWxsIGxhc3QpOgogIEZpbGUgIi90bXAvb3ZpcnQtUjRSOGdaaGFRSS88 d2JyPnB5dGhvbmxpYi9vdG9waS9jb250ZXh0LnB5IiwgbGluZSAxMzMsIGluIF9leGVjdXRlTWV0 aG9kCiAgICBtZXRob2RbJ21ldGhvZCddKCkKICBGaWxlICIvdG1wL292aXJ0LVI0UjhnWmhhUUkv b3RvcGktPHdicj5wbHVnaW5zL292aXJ0LWhvc3QtZGVwbG95Lzx3YnI+dmRzbS9wYWNrYWdlcy5w eSIsIGxpbmUgMTc5LCBpbiBfc3RhcnQKICAgIHNlbGYuc2VydmljZXMuc3RhdGUoJ292aXJ0LTx3 YnI+aW1hZ2Vpby1kYWVtb24nLCBUcnVlKQogIEZpbGUgIi90bXAvb3ZpcnQtUjRSOGdaaGFRSS9v dG9waS08d2JyPnBsdWdpbnMvb3RvcGkvc2VydmljZXMvPHdicj5zeXN0ZW1kLnB5IiwgbGluZSAx NDEsIGluIHN0YXRlCiAgICBzZXJ2aWNlPW5hbWUsClJ1bnRpbWVFcnJvcjogRmFpbGVkIHRvIHN0 YXJ0IHNlcnZpY2UgJ292aXJ0LWltYWdlaW8tZGFlbW9uJwoyMDE3LTExLTA2IDAyOjU2OjQ3LDU1 My0wNTAwIEVSUk9SIG90b3BpLmNvbnRleHQgY29udGV4dC5fZXhlY3V0ZU1ldGhvZDoxNTIgRmFp bGVkIHRvIGV4ZWN1dGUgc3RhZ2UgJ0Nsb3NpbmcgdXAnOiBGYWlsZWQgdG8gc3RhcnQgc2Vydmlj ZSAnb3ZpcnQtaW1hZ2Vpby1kYWVtb24nPC9wcmU+CiAgICAgICAgICAgICAgPHA+PGIgc3R5bGU9 ImZvbnQtd2VpZ2h0Om5vcm1hbCIKaWQ9Im1fLTYxMjM2MjA0ODY0Nzc0MTczNjFkb2NzLWludGVy bmFsLWd1aWQtNTg1OWI3YTEtOTExZS01NjE2LTNjYmMtOTcyODY1ODdkYjg1Ij4KICAgICAgICAg ICAgICAgIDwvYj48L3A+CiAgICAgICAgICAgICAgPHAgZGlyPSJsdHIiCiAgICAgICAgICAgICAg ICBzdHlsZT0ibGluZS1oZWlnaHQ6MS4zODttYXJnaW4tdG9wOjBwdDttYXJnaW4tYm90dG9tOjBw dCI+PGIKICAgICAgICAgICAgICAgICAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbCIKaWQ9Im1f LTYxMjM2MjA0ODY0Nzc0MTczNjFkb2NzLWludGVybmFsLWd1aWQtNTg1OWI3YTEtOTExZS01NjE2 LTNjYmMtOTcyODY1ODdkYjg1Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExcHQ7Zm9udC1mYW1p bHk6QXJpYWw7Y29sb3I6IzAwMDAwMDtiYWNrZ3JvdW5kLWNvbG9yOnRyYW5zcGFyZW50O2ZvbnQt d2VpZ2h0OjQwMDtmb250LXN0eWxlOm5vcm1hbDtmb250LXZhcmlhbnQ6bm9ybWFsO3RleHQtZGVj b3JhdGlvbjpub25lO3ZlcnRpY2FsLWFsaWduOmJhc2VsaW5lO3doaXRlLXNwYWNlOnByZS13cmFw Ij4mbHQ7L2Vycm9yJmd0Ozwvc3Bhbj48L2I+PC9wPgogICAgICAgICAgICAgIDxiIHN0eWxlPSJm b250LXdlaWdodDpub3JtYWwiCmlkPSJtXy02MTIzNjIwNDg2NDc3NDE3MzYxZG9jcy1pbnRlcm5h bC1ndWlkLTU4NTliN2ExLTkxMWUtNTYxNi0zY2JjLTk3Mjg2NTg3ZGI4NSI+CiAgICAgICAgICAg ICAgICA8YnI+CiAgICAgICAgICAgICAgPC9iPiA8L2Rpdj4KICAgICAgICAgIDwvYmxvY2txdW90 ZT4KICAgICAgICA8L2Rpdj4KICAgICAgICA8YnI+CiAgICAgIDwvZGl2PgogICAgPC9ibG9ja3F1 b3RlPgogICAgPHA+PGJyPgogICAgPC9wPgogIDwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0t LS01REVDRDcwQjQ4QTY0MDU2OUM0OTFDOTAtLQo= --===============3352095384987614555==-- From ykaul at redhat.com Mon Nov 6 13:23:07 2017 Content-Type: multipart/mixed; boundary="===============8438040563941213354==" MIME-Version: 1.0 From: Yaniv Kaul To: devel at ovirt.org Subject: Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 06-11-2017 ] [ 002_bootstrap.verify_add_hosts ] Date: Mon, 06 Nov 2017 15:22:24 +0200 Message-ID: In-Reply-To: a78acb4f-9314-8b6b-b05b-836e46c7eafd@redhat.com --===============8438040563941213354== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron wrote: > Hi, > > We failed test 002_bootstrap.verify_add_hosts > > I can see we only tried to install one of the hosts (host-0) and failed. > the second host has no log which means we did not try to deploy it. > > The error suggests that we ovirt-imageio-daemon failed to start. However, > there is another message that I think should be addressed about conflicti= ng > vdsm and libvirt configurations. > > *Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/ > * > > > * Link to Job: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ > Link > to all logs: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifa= ct/ > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifa= ct/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/po= st-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/ho= st-deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host-0-5= 530ab1f.log > * > > > *(Relevant) error snippet from the log: * > > * \* > > 2017-11-06 02:56:46,526-0500 DEBUG otopi.plugins.ovirt_host_deploy.vdsm.p= ackages plugin.execute:921 execute-output: ('/usr/bin/vdsm-tool', 'configur= e', '--force') stdout: > > Checking configuration status... > > abrt is not configured for vdsm > WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based on = vdsm configuration > lvm requires configuration > libvirt is not configured for vdsm yet > FAILED: conflicting vdsm and libvirt-qemu tls configuration. > vdsm.conf with ssl=3DTrue requires the following changes: > libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 > qemu.conf: spice_tls=3D1. > multipath requires configuration > > > 2017-11-06 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.systemd p= lugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', 'ovirt-im= ageio-daemon.service') stderr: > Job for ovirt-imageio-daemon.service failed because the control process e= xited with error code. See "systemctl status ovirt-imageio-daemon.service" = and "journalctl -xe" for details. > > 2017-11-06 02:56:47,552-0500 DEBUG otopi.context context._executeMethod:1= 43 method exception > Traceback (most recent call last): > File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, in _= executeMethod > method['method']() > File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packag= es.py", line 179, in _start > self.services.state('ovirt-imageio-daemon', True) > File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py", l= ine 141, in state > service=3Dname, > RuntimeError: Failed to start service 'ovirt-imageio-daemon' > 2017-11-06 02:56:47,553-0500 ERROR otopi.context context._executeMethod:1= 52 Failed to execute stage 'Closing up': Failed to start service 'ovirt-ima= geio-daemon' > > ** > The problem: Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: Starting oVirt ImageIO Daemon... Nov 6 02:56:47 lago-basic-suite-master-host-0 python: detected unhandled Python exception in '/usr/bin/ovirt-imageio-daemon' Nov 6 02:56:47 lago-basic-suite-master-host-0 python: can't communicate with ABRT daemon, is it running? [Errno 2] No such file or directory Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: Traceback (most recent call last): Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/bin/ovirt-imageio-daemon", line 14, in Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: server.main(sys.argv) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 57, in main Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: start(config) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 85, in start Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: WSGIRequestHandler) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__ Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: self.server_bind() Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 48, in server_bind Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: HTTPServer.server_bind(self) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: SocketServer.TCPServer.server_bind(self) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: self.socket.bind(self.server_address) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/socket.py", line 224, in meth Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: return getattr(self._sock,name)(*args) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: socket.error: [Errno 98] Address already in use > > > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > --===============8438040563941213354== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBjbGFz cz0iZ21haWxfcXVvdGUiPk9uIE1vbiwgTm92IDYsIDIwMTcgYXQgMTozOSBQTSwgRGFmbmEgUm9u IDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOmRyb25AcmVkaGF0LmNvbSIgdGFy Z2V0PSJfYmxhbmsiPmRyb25AcmVkaGF0LmNvbTwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnI+PGJs b2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjBweCAwcHggMHB4IDAu OGV4O2JvcmRlci1sZWZ0OjFweCBzb2xpZCByZ2IoMjA0LDIwNCwyMDQpO3BhZGRpbmctbGVmdDox ZXgiPgogIAoKICAgIAogIAogIDxkaXYgYmdjb2xvcj0iI0ZGRkZGRiI+CiAgICA8cD5IaSwgPGJy PgogICAgPC9wPgogICAgPHA+V2UgZmFpbGVkIHRlc3QgMDAyX2Jvb3RzdHJhcC52ZXJpZnlfYWRk X2hvc3RzPC9wPgogICAgPHA+SSBjYW4gc2VlIHdlIG9ubHkgdHJpZWQgdG8gaW5zdGFsbCBvbmUg b2YgdGhlIGhvc3RzIChob3N0LTApIGFuZAogICAgICBmYWlsZWQuIHRoZSBzZWNvbmQgaG9zdCBo YXMgbm8gbG9nIHdoaWNoIG1lYW5zIHdlIGRpZCBub3QgdHJ5IHRvCiAgICAgIGRlcGxveSBpdC4g PGJyPgogICAgPC9wPgogICAgPHA+VGhlIGVycm9yIHN1Z2dlc3RzIHRoYXQgd2Ugb3ZpcnQtaW1h Z2Vpby1kYWVtb24gZmFpbGVkIHRvIHN0YXJ0LgogICAgICBIb3dldmVyLCB0aGVyZSBpcyBhbm90 aGVyIG1lc3NhZ2UgdGhhdCBJIHRoaW5rIHNob3VsZCBiZSBhZGRyZXNzZWQKICAgICAgYWJvdXQg Y29uZmxpY3RpbmcgdmRzbSBhbmQgbGlidmlydCBjb25maWd1cmF0aW9ucy4gPGJyPgogICAgPC9w PgogICAgPHA+PGIgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbCIgaWQ9ImdtYWlsLW1fLTE3NjY5 MDA4MDQ5NDQwMjk4MjFkb2NzLWludGVybmFsLWd1aWQtNTg1OWI3YTEtOTExZS01NjE2LTNjYmMt OTcyODY1ODdkYjg1Ij4KICAgICAgICA8L2I+PC9wPjxwIGRpcj0ibHRyIiBzdHlsZT0ibGluZS1o ZWlnaHQ6MS4zODttYXJnaW4tdG9wOjBwdDttYXJnaW4tYm90dG9tOjBwdCI+PGIgc3R5bGU9ImZv bnQtd2VpZ2h0Om5vcm1hbCIgaWQ9ImdtYWlsLW1fLTE3NjY5MDA4MDQ5NDQwMjk4MjFkb2NzLWlu dGVybmFsLWd1aWQtNTg1OWI3YTEtOTExZS01NjE2LTNjYmMtOTcyODY1ODdkYjg1Ij48c3BhbiBz dHlsZT0iZm9udC1zaXplOjExcHQ7Zm9udC1mYW1pbHk6QXJpYWw7Y29sb3I6cmdiKDAsMCwwKTti YWNrZ3JvdW5kLWNvbG9yOnRyYW5zcGFyZW50O2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5v cm1hbDtmb250LXZhcmlhbnQ6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO3ZlcnRpY2FsLWFs aWduOmJhc2VsaW5lO3doaXRlLXNwYWNlOnByZS13cmFwIj5MaW5rIHRvIHN1c3BlY3RlZCBwYXRj aGVzOiA8YSBjbGFzcz0iZ21haWwtbV8tMTc2NjkwMDgwNDk0NDAyOTgyMW1vei10eHQtbGluay1m cmVldGV4dCIgaHJlZj0iaHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMvYy84MzYxMi8iIHRhcmdl dD0iX2JsYW5rIj5odHRwczovL2dlcnJpdC5vdmlydC5vcmcvIy9jLzx3YnI+ODM2MTIvPC9hPjwv c3Bhbj48L2I+PC9wPjxiIHN0eWxlPSJmb250LXdlaWdodDpub3JtYWwiIGlkPSJnbWFpbC1tXy0x NzY2OTAwODA0OTQ0MDI5ODIxZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUtNTYxNi0z Y2JjLTk3Mjg2NTg3ZGI4NSI+CiAgICAgICAgPGJyPgogICAgICAgIDxwIGRpcj0ibHRyIiBzdHls ZT0ibGluZS1oZWlnaHQ6MS4zODttYXJnaW4tdG9wOjBwdDttYXJnaW4tYm90dG9tOjBwdCI+PHNw YW4gc3R5bGU9ImZvbnQtc2l6ZToxMXB0O2ZvbnQtZmFtaWx5OkFyaWFsO2NvbG9yOnJnYigwLDAs MCk7YmFja2dyb3VuZC1jb2xvcjp0cmFuc3BhcmVudDtmb250LXdlaWdodDo0MDA7Zm9udC1zdHls ZTpub3JtYWw7Zm9udC12YXJpYW50Om5vcm1hbDt0ZXh0LWRlY29yYXRpb246bm9uZTt2ZXJ0aWNh bC1hbGlnbjpiYXNlbGluZTt3aGl0ZS1zcGFjZTpwcmUtd3JhcCI+TGluayB0byBKb2I6IDxhIGNs YXNzPSJnbWFpbC1tXy0xNzY2OTAwODA0OTQ0MDI5ODIxbW96LXR4dC1saW5rLWZyZWV0ZXh0IiBo cmVmPSJodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVl dWUtdGVzdGVyLzM2MjYvIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMub3ZpcnQub3Jn L2pvYi88d2JyPm92aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtPHdicj50ZXN0ZXIvMzYyNi88L2E+ PC9zcGFuPjwvcD4KICAgICAgICA8YnI+CiAgICAgICAgPHAgZGlyPSJsdHIiIHN0eWxlPSJsaW5l LWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21hcmdpbi1ib3R0b206MHB0Ij48c3BhbiBzdHls ZT0iZm9udC1zaXplOjExcHQ7Zm9udC1mYW1pbHk6QXJpYWw7Y29sb3I6cmdiKDAsMCwwKTtiYWNr Z3JvdW5kLWNvbG9yOnRyYW5zcGFyZW50O2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5vcm1h bDtmb250LXZhcmlhbnQ6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO3ZlcnRpY2FsLWFsaWdu OmJhc2VsaW5lO3doaXRlLXNwYWNlOnByZS13cmFwIj5MaW5rIHRvIGFsbCBsb2dzOiA8YSBjbGFz cz0iZ21haWwtbV8tMTc2NjkwMDgwNDk0NDAyOTgyMW1vei10eHQtbGluay1mcmVldGV4dCIgaHJl Zj0iaHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVl LXRlc3Rlci8zNjI2L2FydGlmYWN0LyIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9qZW5raW5zLm92 aXJ0Lm9yZy9qb2IvPHdicj5vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLTx3YnI+dGVzdGVyLzM2 MjYvYXJ0aWZhY3QvPC9hPjwvc3Bhbj48L3A+CiAgICAgICAgPHAgZGlyPSJsdHIiIHN0eWxlPSJs aW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21hcmdpbi1ib3R0b206MHB0Ij48c3BhbiBz dHlsZT0iZm9udC1zaXplOjExcHQ7Zm9udC1mYW1pbHk6QXJpYWw7Y29sb3I6cmdiKDAsMCwwKTti YWNrZ3JvdW5kLWNvbG9yOnRyYW5zcGFyZW50O2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5v cm1hbDtmb250LXZhcmlhbnQ6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO3ZlcnRpY2FsLWFs aWduOmJhc2VsaW5lO3doaXRlLXNwYWNlOnByZS13cmFwIj4KPC9zcGFuPjwvcD4KPGEgY2xhc3M9 ImdtYWlsLW1fLTE3NjY5MDA4MDQ5NDQwMjk4MjFtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9 Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10 ZXN0ZXIvMzYyNi9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXIt ZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xh Z28tYmFzaWMtc3VpdGUtbWFzdGVyLWVuZ2luZS9fdmFyX2xvZy9vdmlydC1lbmdpbmUvaG9zdC1k ZXBsb3kvb3ZpcnQtaG9zdC1kZXBsb3ktMjAxNzExMDYwMjU2NDctbGFnby1iYXNpYy1zdWl0ZS1t YXN0ZXItaG9zdC0wLTU1MzBhYjFmLmxvZyIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9qZW5raW5z Lm92aXJ0Lm9yZy9qb2IvPHdicj5vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLTx3YnI+dGVzdGVy LzM2MjYvYXJ0aWZhY3QvZXhwb3J0ZWQtPHdicj5hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXIt PHdicj5lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLTx3YnI+bWFzdGVyL3Bvc3QtMDAyX2Jvb3Rz dHJhcC5weS88d2JyPmxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLTx3YnI+ZW5naW5lL192YXJfbG9n L292aXJ0LWVuZ2luZS88d2JyPmhvc3QtZGVwbG95L292aXJ0LWhvc3QtZGVwbG95LTx3YnI+MjAx NzExMDYwMjU2NDctbGFnby1iYXNpYy08d2JyPnN1aXRlLW1hc3Rlci1ob3N0LTAtNTUzMGFiMWYu PHdicj5sb2c8L2E+PC9iPjxwPjwvcD4KICAgIDxwPjxiIHN0eWxlPSJmb250LXdlaWdodDpub3Jt YWwiIGlkPSJnbWFpbC1tXy0xNzY2OTAwODA0OTQ0MDI5ODIxZG9jcy1pbnRlcm5hbC1ndWlkLTU4 NTliN2ExLTkxMWUtNTYxNi0zY2JjLTk3Mjg2NTg3ZGI4NSI+PGJyPgogICAgICAgIDwvYj48L3A+ PHAgZGlyPSJsdHIiIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdpbi10b3A6MHB0O21hcmdp bi1ib3R0b206MHB0Ij48YiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFsIiBpZD0iZ21haWwtbV8t MTc2NjkwMDgwNDk0NDAyOTgyMWRvY3MtaW50ZXJuYWwtZ3VpZC01ODU5YjdhMS05MTFlLTU2MTYt M2NiYy05NzI4NjU4N2RiODUiPjxzcGFuIHN0eWxlPSJmb250LXNpemU6MTFwdDtmb250LWZhbWls eTpBcmlhbDtjb2xvcjpyZ2IoMCwwLDApO2JhY2tncm91bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9u dC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtdmFyaWFudDpub3JtYWw7dGV4dC1k ZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxpZ246YmFzZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdy YXAiPihSZWxldmFudCkgZXJyb3Igc25pcHBldCBmcm9tIHRoZSBsb2c6IDwvc3Bhbj48L2I+PC9w PjxiIHN0eWxlPSJmb250LXdlaWdodDpub3JtYWwiIGlkPSJnbWFpbC1tXy0xNzY2OTAwODA0OTQ0 MDI5ODIxZG9jcy1pbnRlcm5hbC1ndWlkLTU4NTliN2ExLTkxMWUtNTYxNi0zY2JjLTk3Mjg2NTg3 ZGI4NSI+CiAgICAgICAgPHAgZGlyPSJsdHIiIHN0eWxlPSJsaW5lLWhlaWdodDoxLjM4O21hcmdp bi10b3A6MHB0O21hcmdpbi1ib3R0b206MHB0Ij48c3BhbiBzdHlsZT0iZm9udC1zaXplOjExcHQ7 Zm9udC1mYW1pbHk6QXJpYWw7Y29sb3I6cmdiKDAsMCwwKTtiYWNrZ3JvdW5kLWNvbG9yOnRyYW5z cGFyZW50O2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5vcm1hbDtmb250LXZhcmlhbnQ6bm9y bWFsO3RleHQtZGVjb3JhdGlvbjpub25lO3ZlcnRpY2FsLWFsaWduOmJhc2VsaW5lO3doaXRlLXNw YWNlOnByZS13cmFwIj4mbHQ7ZXJyb3ImZ3Q7PC9zcGFuPjwvcD4KICAgICAgICBcPC9iPjxicj4K ICAgIDxwPjwvcD4KICAgIDxwcmUgc3R5bGU9ImNvbG9yOnJnYigwLDAsMCk7Zm9udC1zdHlsZTpu b3JtYWw7Zm9udC12YXJpYW50LWxpZ2F0dXJlczpub3JtYWw7Zm9udC12YXJpYW50LWNhcHM6bm9y bWFsO2ZvbnQtd2VpZ2h0Om5vcm1hbDtsZXR0ZXItc3BhY2luZzpub3JtYWw7dGV4dC1hbGlnbjpz dGFydDt0ZXh0LWluZGVudDowcHg7dGV4dC10cmFuc2Zvcm06bm9uZTt3b3JkLXNwYWNpbmc6MHB4 O3RleHQtZGVjb3JhdGlvbi1zdHlsZTppbml0aWFsO3RleHQtZGVjb3JhdGlvbi1jb2xvcjppbml0 aWFsIj4yMDE3LTExLTA2IDAyOjU2OjQ2LDUyNi0wNTAwIERFQlVHIG90b3BpLnBsdWdpbnMub3Zp cnRfaG9zdF88d2JyPmRlcGxveS52ZHNtLnBhY2thZ2VzIHBsdWdpbi5leGVjdXRlOjkyMSBleGVj dXRlLW91dHB1dDogKCYjMzk7L3Vzci9iaW4vdmRzbS10b29sJiMzOTssICYjMzk7Y29uZmlndXJl JiMzOTssICYjMzk7LS1mb3JjZSYjMzk7KSBzdGRvdXQ6CgpDaGVja2luZyBjb25maWd1cmF0aW9u IHN0YXR1cy4uLgoKYWJydCBpcyBub3QgY29uZmlndXJlZCBmb3IgdmRzbQpXQVJOSU5HOiBMVk0g bG9jYWwgY29uZmlndXJhdGlvbjogL2V0Yy9sdm0vbHZtbG9jYWwuY29uZiBpcyBub3QgYmFzZWQg b24gdmRzbSBjb25maWd1cmF0aW9uCmx2bSByZXF1aXJlcyBjb25maWd1cmF0aW9uCmxpYnZpcnQg aXMgbm90IGNvbmZpZ3VyZWQgZm9yIHZkc20geWV0CkZBSUxFRDogY29uZmxpY3RpbmcgdmRzbSBh bmQgbGlidmlydC1xZW11IHRscyBjb25maWd1cmF0aW9uLgp2ZHNtLmNvbmYgd2l0aCBzc2w9VHJ1 ZSByZXF1aXJlcyB0aGUgZm9sbG93aW5nIGNoYW5nZXM6CmxpYnZpcnRkLmNvbmY6IGxpc3Rlbl90 Y3A9MCwgYXV0aF90Y3A9JnF1b3Q7c2FzbCZxdW90OywgbGlzdGVuX3Rscz0xCnFlbXUuY29uZjog c3BpY2VfdGxzPTEuCm11bHRpcGF0aCByZXF1aXJlcyBjb25maWd1cmF0aW9uCjwvcHJlPgogICAg PGJyIGNsYXNzPSJnbWFpbC1tXy0xNzY2OTAwODA0OTQ0MDI5ODIxQXBwbGUtaW50ZXJjaGFuZ2Ut bmV3bGluZSI+CiAgICA8cHJlIHN0eWxlPSJjb2xvcjpyZ2IoMCwwLDApO2ZvbnQtc3R5bGU6bm9y bWFsO2ZvbnQtdmFyaWFudC1saWdhdHVyZXM6bm9ybWFsO2ZvbnQtdmFyaWFudC1jYXBzOm5vcm1h bDtmb250LXdlaWdodDpub3JtYWw7bGV0dGVyLXNwYWNpbmc6bm9ybWFsO3RleHQtYWxpZ246c3Rh cnQ7dGV4dC1pbmRlbnQ6MHB4O3RleHQtdHJhbnNmb3JtOm5vbmU7d29yZC1zcGFjaW5nOjBweDt0 ZXh0LWRlY29yYXRpb24tc3R5bGU6aW5pdGlhbDt0ZXh0LWRlY29yYXRpb24tY29sb3I6aW5pdGlh bCI+MjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTEtMDUwMCBERUJVRyBvdG9waS5wbHVnaW5zLm90b3Bp LnNlcnZpY2VzLjx3YnI+c3lzdGVtZCBwbHVnaW4uZXhlY3V0ZTo5MjYgZXhlY3V0ZS1vdXRwdXQ6 ICgmIzM5Oy91c3IvYmluL3N5c3RlbWN0bCYjMzk7LCAmIzM5O3N0YXJ0JiMzOTssICYjMzk7b3Zp cnQtaW1hZ2Vpby1kYWVtb24uc2VydmljZSYjMzk7PHdicj4pIHN0ZGVycjoKSm9iIGZvciBvdmly dC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlIGZhaWxlZCBiZWNhdXNlIHRoZSBjb250cm9sIHByb2Nl c3MgZXhpdGVkIHdpdGggZXJyb3IgY29kZS4gU2VlICZxdW90O3N5c3RlbWN0bCBzdGF0dXMgb3Zp cnQtaW1hZ2Vpby1kYWVtb24uc2VydmljZSZxdW90OyBhbmQgJnF1b3Q7am91cm5hbGN0bCAteGUm cXVvdDsgZm9yIGRldGFpbHMuCgoyMDE3LTExLTA2IDAyOjU2OjQ3LDU1Mi0wNTAwIERFQlVHIG90 b3BpLmNvbnRleHQgY29udGV4dC5fZXhlY3V0ZU1ldGhvZDoxNDMgbWV0aG9kIGV4Y2VwdGlvbgpU cmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwgbGFzdCk6CiAgRmlsZSAmcXVvdDsvdG1wL292aXJ0 LVI0UjhnWmhhUUkvPHdicj5weXRob25saWIvb3RvcGkvY29udGV4dC5weSZxdW90OywgbGluZSAx MzMsIGluIF9leGVjdXRlTWV0aG9kCiAgICBtZXRob2RbJiMzOTttZXRob2QmIzM5O10oKQogIEZp bGUgJnF1b3Q7L3RtcC9vdmlydC1SNFI4Z1poYVFJL290b3BpLTx3YnI+cGx1Z2lucy9vdmlydC1o b3N0LWRlcGxveS88d2JyPnZkc20vcGFja2FnZXMucHkmcXVvdDssIGxpbmUgMTc5LCBpbiBfc3Rh cnQKICAgIHNlbGYuc2VydmljZXMuc3RhdGUoJiMzOTtvdmlydC08d2JyPmltYWdlaW8tZGFlbW9u JiMzOTssIFRydWUpCiAgRmlsZSAmcXVvdDsvdG1wL292aXJ0LVI0UjhnWmhhUUkvb3RvcGktPHdi cj5wbHVnaW5zL290b3BpL3NlcnZpY2VzLzx3YnI+c3lzdGVtZC5weSZxdW90OywgbGluZSAxNDEs IGluIHN0YXRlCiAgICBzZXJ2aWNlPW5hbWUsClJ1bnRpbWVFcnJvcjogRmFpbGVkIHRvIHN0YXJ0 IHNlcnZpY2UgJiMzOTtvdmlydC1pbWFnZWlvLWRhZW1vbiYjMzk7CjIwMTctMTEtMDYgMDI6NTY6 NDcsNTUzLTA1MDAgRVJST1Igb3RvcGkuY29udGV4dCBjb250ZXh0Ll9leGVjdXRlTWV0aG9kOjE1 MiBGYWlsZWQgdG8gZXhlY3V0ZSBzdGFnZSAmIzM5O0Nsb3NpbmcgdXAmIzM5OzogRmFpbGVkIHRv IHN0YXJ0IHNlcnZpY2UgJiMzOTtvdmlydC1pbWFnZWlvLWRhZW1vbiYjMzk7PC9wcmU+CiAgICA8 cD48YiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFsIiBpZD0iZ21haWwtbV8tMTc2NjkwMDgwNDk0 NDAyOTgyMWRvY3MtaW50ZXJuYWwtZ3VpZC01ODU5YjdhMS05MTFlLTU2MTYtM2NiYy05NzI4NjU4 N2RiODUiPgogICAgICAgIDwvYj48L3A+PHAgZGlyPSJsdHIiIHN0eWxlPSJsaW5lLWhlaWdodDox LjM4O21hcmdpbi10b3A6MHB0O21hcmdpbi1ib3R0b206MHB0Ij48YiBzdHlsZT0iZm9udC13ZWln aHQ6bm9ybWFsIiBpZD0iZ21haWwtbV8tMTc2NjkwMDgwNDk0NDAyOTgyMWRvY3MtaW50ZXJuYWwt Z3VpZC01ODU5YjdhMS05MTFlLTU2MTYtM2NiYy05NzI4NjU4N2RiODUiPjxzcGFuIHN0eWxlPSJm b250LXNpemU6MTFwdDtmb250LWZhbWlseTpBcmlhbDtjb2xvcjpyZ2IoMCwwLDApO2JhY2tncm91 bmQtY29sb3I6dHJhbnNwYXJlbnQ7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2Zv bnQtdmFyaWFudDpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7dmVydGljYWwtYWxpZ246YmFz ZWxpbmU7d2hpdGUtc3BhY2U6cHJlLXdyYXAiPiZsdDsvZXJyb3ImZ3Q7PC9zcGFuPjwvYj48L3A+ PC9kaXY+PC9ibG9ja3F1b3RlPjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhlIHByb2JsZW06PC9kaXY+ PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBzeXN0 ZW1kOiBTdGFydGluZyBvVmlydCBJbWFnZUlPIERhZW1vbi4uLjwvZGl2PjxkaXY+Tm92wqAgNiAw Mjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgcHl0aG9uOiBkZXRlY3RlZCB1 bmhhbmRsZWQgUHl0aG9uIGV4Y2VwdGlvbiBpbiAmIzM5Oy91c3IvYmluL292aXJ0LWltYWdlaW8t ZGFlbW9uJiMzOTs8L2Rpdj48ZGl2Pk5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1t YXN0ZXItaG9zdC0wIHB5dGhvbjogY2FuJiMzOTt0IGNvbW11bmljYXRlIHdpdGggQUJSVCBkYWVt b24sIGlzIGl0IHJ1bm5pbmc/IFtFcnJubyAyXSBObyBzdWNoIGZpbGUgb3IgZGlyZWN0b3J5PC9k aXY+PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBv dmlydC1pbWFnZWlvLWRhZW1vbjogVHJhY2ViYWNrIChtb3N0IHJlY2VudCBjYWxsIGxhc3QpOjwv ZGl2PjxkaXY+Tm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAg b3ZpcnQtaW1hZ2Vpby1kYWVtb246IEZpbGUgJnF1b3Q7L3Vzci9iaW4vb3ZpcnQtaW1hZ2Vpby1k YWVtb24mcXVvdDssIGxpbmUgMTQsIGluICZsdDttb2R1bGUmZ3Q7PC9kaXY+PGRpdj5Ob3bCoCA2 IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRh ZW1vbjogc2VydmVyLm1haW4oc3lzLmFyZ3YpPC9kaXY+PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3IGxh Z28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjogRmlsZSAm cXVvdDsvdXNyL2xpYi9weXRob24yLjcvc2l0ZS1wYWNrYWdlcy9vdmlydF9pbWFnZWlvX2RhZW1v bi9zZXJ2ZXIucHkmcXVvdDssIGxpbmUgNTcsIGluIG1haW48L2Rpdj48ZGl2Pk5vdsKgIDYgMDI6 NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9u OiBzdGFydChjb25maWcpPC9kaXY+PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3Vp dGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjogRmlsZSAmcXVvdDsvdXNyL2xp Yi9weXRob24yLjcvc2l0ZS1wYWNrYWdlcy9vdmlydF9pbWFnZWlvX2RhZW1vbi9zZXJ2ZXIucHkm cXVvdDssIGxpbmUgODUsIGluIHN0YXJ0PC9kaXY+PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3IGxhZ28t YmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjogV1NHSVJlcXVl c3RIYW5kbGVyKTwvZGl2PjxkaXY+Tm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1h c3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246IEZpbGUgJnF1b3Q7L3Vzci9saWI2NC9w eXRob24yLjcvU29ja2V0U2VydmVyLnB5JnF1b3Q7LCBsaW5lIDQxOSwgaW4gX19pbml0X188L2Rp dj48ZGl2Pk5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92 aXJ0LWltYWdlaW8tZGFlbW9uOiBzZWxmLnNlcnZlcl9iaW5kKCk8L2Rpdj48ZGl2Pk5vdsKgIDYg MDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFl bW9uOiBGaWxlICZxdW90Oy91c3IvbGliNjQvcHl0aG9uMi43L3dzZ2lyZWYvc2ltcGxlX3NlcnZl ci5weSZxdW90OywgbGluZSA0OCwgaW4gc2VydmVyX2JpbmQ8L2Rpdj48ZGl2Pk5vdsKgIDYgMDI6 NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9u OiBIVFRQU2VydmVyLnNlcnZlcl9iaW5kKHNlbGYpPC9kaXY+PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3 IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjogRmls ZSAmcXVvdDsvdXNyL2xpYjY0L3B5dGhvbjIuNy9CYXNlSFRUUFNlcnZlci5weSZxdW90OywgbGlu ZSAxMDgsIGluIHNlcnZlcl9iaW5kPC9kaXY+PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFz aWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjogU29ja2V0U2VydmVy LlRDUFNlcnZlci5zZXJ2ZXJfYmluZChzZWxmKTwvZGl2PjxkaXY+Tm92wqAgNiAwMjo1Njo0NyBs YWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246IEZpbGUg JnF1b3Q7L3Vzci9saWI2NC9weXRob24yLjcvU29ja2V0U2VydmVyLnB5JnF1b3Q7LCBsaW5lIDQz MCwgaW4gc2VydmVyX2JpbmQ8L2Rpdj48ZGl2Pk5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1z dWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOiBzZWxmLnNvY2tldC5iaW5k KHNlbGYuc2VydmVyX2FkZHJlc3MpPC9kaXY+PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFz aWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjogRmlsZSAmcXVvdDsv dXNyL2xpYjY0L3B5dGhvbjIuNy9zb2NrZXQucHkmcXVvdDssIGxpbmUgMjI0LCBpbiBtZXRoPC9k aXY+PGRpdj5Ob3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBv dmlydC1pbWFnZWlvLWRhZW1vbjogcmV0dXJuIGdldGF0dHIoc2VsZi5fc29jayxuYW1lKSgqYXJn cyk8L2Rpdj48ZGl2Pk5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9z dC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOiBzb2NrZXQuZXJyb3I6IFtFcnJubyA5OF0gQWRkcmVz cyBhbHJlYWR5IGluIHVzZcKgPC9kaXY+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBz dHlsZT0ibWFyZ2luOjBweCAwcHggMHB4IDAuOGV4O2JvcmRlci1sZWZ0OjFweCBzb2xpZCByZ2Io MjA0LDIwNCwyMDQpO3BhZGRpbmctbGVmdDoxZXgiPjxkaXYgYmdjb2xvcj0iI0ZGRkZGRiI+PGIg c3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbCIgaWQ9ImdtYWlsLW1fLTE3NjY5MDA4MDQ5NDQwMjk4 MjFkb2NzLWludGVybmFsLWd1aWQtNTg1OWI3YTEtOTExZS01NjE2LTNjYmMtOTcyODY1ODdkYjg1 Ij4KICAgICAgICA8YnI+CiAgICAgIDwvYj48cD48L3A+CiAgPC9kaXY+Cgo8YnI+X19fX19fX19f X19fX19fX19fX19fX19fX19fX19fPHdicj5fX19fX19fX19fX19fX19fXzxicj4KRGV2ZWwgbWFp bGluZyBsaXN0PGJyPgo8YSBocmVmPSJtYWlsdG86RGV2ZWxAb3ZpcnQub3JnIj5EZXZlbEBvdmly dC5vcmc8L2E+PGJyPgo8YSBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlz dGluZm8vZGV2ZWwiIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0 cy5vdmlydC5vcmcvPHdicj5tYWlsbWFuL2xpc3RpbmZvL2RldmVsPC9hPjxicj48L2Jsb2NrcXVv dGU+PC9kaXY+PGJyPjwvZGl2PjwvZGl2Pgo= --===============8438040563941213354==-- From didi at redhat.com Mon Nov 6 14:15:43 2017 Content-Type: multipart/mixed; boundary="===============8588779202502557427==" MIME-Version: 1.0 From: Yedidyah Bar David To: devel at ovirt.org Subject: Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 06-11-2017 ] [ 002_bootstrap.verify_add_hosts ] Date: Mon, 06 Nov 2017 16:15:41 +0200 Message-ID: In-Reply-To: 0313f791-1704-3975-010b-abc22909a381@redhat.com --===============8588779202502557427== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Mon, Nov 6, 2017 at 1:57 PM, Dafna Ron wrote: > adding Didi. > > > On 11/06/2017 11:51 AM, Ala Hino wrote: > > Suspected patch (https://gerrit.ovirt.org/#/c/83612/) is about cold merge > and has nothing to do with host deploy. > > On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron wrote: >> >> Hi, >> >> We failed test 002_bootstrap.verify_add_hosts >> >> I can see we only tried to install one of the hosts (host-0) and failed. >> the second host has no log which means we did not try to deploy it. >> >> The error suggests that we ovirt-imageio-daemon failed to start. However, >> there is another message that I think should be addressed about conflict= ing >> vdsm and libvirt configurations. >> >> Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/ >> >> >> Link to Job: >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ >> >> >> Link to all logs: >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artif= act/ >> >> >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artif= act/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/p= ost-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/h= ost-deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host-0-= 5530ab1f.log >> >> >> (Relevant) error snippet from the log: >> >> >> >> \ >> >> 2017-11-06 02:56:46,526-0500 DEBUG >> otopi.plugins.ovirt_host_deploy.vdsm.packages plugin.execute:921 >> execute-output: ('/usr/bin/vdsm-tool', 'configure', '--force') stdout: >> >> Checking configuration status... >> >> abrt is not configured for vdsm >> WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based on >> vdsm configuration >> lvm requires configuration >> libvirt is not configured for vdsm yet >> FAILED: conflicting vdsm and libvirt-qemu tls configuration. >> vdsm.conf with ssl=3DTrue requires the following changes: >> libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 >> qemu.conf: spice_tls=3D1. >> multipath requires configuration >> >> >> 2017-11-06 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.systemd >> plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', >> 'ovirt-imageio-daemon.service') stderr: >> Job for ovirt-imageio-daemon.service failed because the control process >> exited with error code. See "systemctl status ovirt-imageio-daemon.servi= ce" >> and "journalctl -xe" for details. >> >> 2017-11-06 02:56:47,552-0500 DEBUG otopi.context >> context._executeMethod:143 method exception >> Traceback (most recent call last): >> File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, in >> _executeMethod >> method['method']() >> File >> "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packages.py", >> line 179, in _start >> self.services.state('ovirt-imageio-daemon', True) >> File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py", >> line 141, in state >> service=3Dname, >> RuntimeError: Failed to start service 'ovirt-imageio-daemon' >> 2017-11-06 02:56:47,553-0500 ERROR otopi.context >> context._executeMethod:152 Failed to execute stage 'Closing up': Failed = to >> start service 'ovirt-imageio-daemon' In /var/log/messages of the host [1], there is: Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: Starting oVirt ImageIO Daemon... Nov 6 02:56:47 lago-basic-suite-master-host-0 python: detected unhandled Python exception in '/usr/bin/ovirt-imageio-daemon' Nov 6 02:56:47 lago-basic-suite-master-host-0 python: can't communicate with ABRT daemon, is it running? [Errno 2] No such file or directory Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: Traceback (most recent call last): Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/bin/ovirt-imageio-daemon", line 14, in Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: server.main(sys.argv) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 57, in main Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: start(config) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 85, in start Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: WSGIRequestHandler) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__ Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: self.server_bind() Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 48, in server_bind Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: HTTPServer.server_bind(self) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: SocketServer.TCPServer.server_bind(self) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: self.socket.bind(self.server_address) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: File "/usr/lib64/python2.7/socket.py", line 224, in meth Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: return getattr(self._sock,name)(*args) Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: socket.error: [Errno 98] Address already in use Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: ovirt-imageio-daemon.service: main process exited, code=3Dexited, status=3D1/FAILURE ovirt-host-deploy stops it, and immediately tries to start it: 2017-11-06 02:56:47,203-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'stop', 'ovirt-imageio-daemon.service'), rc=3D0 ... 2017-11-06 02:56:47,550-0500 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:863 execute-result: ('/usr/bin/systemctl', 'start', 'ovirt-imageio-daemon.service'), rc=3D1 Also, imageio-daemon's log [2] looks a bit weird to me - it has 5 'Starting' lines, but no other lines I would have expected to have, reading its source, and as I can see in another run, that did finish successfully [3]. Adding Idan, but not sure it's a bug in the daemon. [1] http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/arti= fact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/= post-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ [2] http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/arti= fact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/= post-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-imageio= -daemon/daemon.log [3] http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3628/arti= fact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/= post-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-imageio= -daemon/daemon.log >> >> >> >> > > -- = Didi --===============8588779202502557427==-- From nsoffer at redhat.com Mon Nov 6 20:26:23 2017 Content-Type: multipart/mixed; boundary="===============4006064017139027792==" MIME-Version: 1.0 From: Nir Soffer To: devel at ovirt.org Subject: Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 06-11-2017 ] [ 002_bootstrap.verify_add_hosts ] Date: Mon, 06 Nov 2017 20:26:10 +0000 Message-ID: In-Reply-To: CAHRwYXuz8tOXaeqarBdAV6mh1TSpQjv-eau6jTHU2OsN2o2Ciw@mail.gmail.com --===============4006064017139027792== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Mon, Nov 6, 2017 at 4:16 PM Yedidyah Bar David wrote: > On Mon, Nov 6, 2017 at 1:57 PM, Dafna Ron wrote: > > adding Didi. > > > > > > On 11/06/2017 11:51 AM, Ala Hino wrote: > > > > Suspected patch (https://gerrit.ovirt.org/#/c/83612/) is about cold > merge > > and has nothing to do with host deploy. > > > > On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron wrote: > >> > >> Hi, > >> > >> We failed test 002_bootstrap.verify_add_hosts > >> > >> I can see we only tried to install one of the hosts (host-0) and faile= d. > >> the second host has no log which means we did not try to deploy it. > >> > >> The error suggests that we ovirt-imageio-daemon failed to start. > However, > >> there is another message that I think should be addressed about > conflicting > >> vdsm and libvirt configurations. > >> > >> Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/ > >> > >> > >> Link to Job: > >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ > >> > >> > >> Link to all logs: > >> > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifa= ct/ > >> > >> > >> > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifa= ct/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/po= st-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/ho= st-deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host-0-5= 530ab1f.log > >> > >> > >> (Relevant) error snippet from the log: > >> > >> > >> > >> \ > >> > >> 2017-11-06 02:56:46,526-0500 DEBUG > >> otopi.plugins.ovirt_host_deploy.vdsm.packages plugin.execute:921 > >> execute-output: ('/usr/bin/vdsm-tool', 'configure', '--force') stdout: > >> > >> Checking configuration status... > >> > >> abrt is not configured for vdsm > >> WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based = on > >> vdsm configuration > >> lvm requires configuration > >> libvirt is not configured for vdsm yet > >> FAILED: conflicting vdsm and libvirt-qemu tls configuration. > >> vdsm.conf with ssl=3DTrue requires the following changes: > >> libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 > >> qemu.conf: spice_tls=3D1. > >> multipath requires configuration > >> > >> > >> 2017-11-06 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.systemd > >> plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', > >> 'ovirt-imageio-daemon.service') stderr: > >> Job for ovirt-imageio-daemon.service failed because the control process > >> exited with error code. See "systemctl status > ovirt-imageio-daemon.service" > >> and "journalctl -xe" for details. > >> > >> 2017-11-06 02:56:47,552-0500 DEBUG otopi.context > >> context._executeMethod:143 method exception > >> Traceback (most recent call last): > >> File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, in > >> _executeMethod > >> method['method']() > >> File > >> > "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packages.py", > >> line 179, in _start > >> self.services.state('ovirt-imageio-daemon', True) > >> File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py", > >> line 141, in state > >> service=3Dname, > >> RuntimeError: Failed to start service 'ovirt-imageio-daemon' > >> 2017-11-06 02:56:47,553-0500 ERROR otopi.context > >> context._executeMethod:152 Failed to execute stage 'Closing up': Failed > to > >> start service 'ovirt-imageio-daemon' > > In /var/log/messages of the host [1], there is: > > Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: Starting oVirt > ImageIO Daemon... > Nov 6 02:56:47 lago-basic-suite-master-host-0 python: detected > unhandled Python exception in '/usr/bin/ovirt-imageio-daemon' > Nov 6 02:56:47 lago-basic-suite-master-host-0 python: can't > communicate with ABRT daemon, is it running? [Errno 2] No such file or > directory > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > Traceback (most recent call last): > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/bin/ovirt-imageio-daemon", line 14, in > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > server.main(sys.argv) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", > line 57, in main > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > start(config) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", > line 85, in start > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > WSGIRequestHandler) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__ > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > self.server_bind() > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 48, in > server_bind > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > HTTPServer.server_bind(self) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in > server_bind > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > SocketServer.TCPServer.server_bind(self) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > self.socket.bind(self.server_address) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/socket.py", line 224, in meth > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > return getattr(self._sock,name)(*args) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > socket.error: [Errno 98] Address already in use > Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: > ovirt-imageio-daemon.service: main process exited, code=3Dexited, > status=3D1/FAILURE > > ovirt-host-deploy stops it, and immediately tries to start it: > > 2017-11-06 02:56:47,203-0500 DEBUG > otopi.plugins.otopi.services.systemd plugin.executeRaw:863 > execute-result: ('/usr/bin/systemctl', 'stop', > 'ovirt-imageio-daemon.service'), rc=3D0 > ... > 2017-11-06 02:56:47,550-0500 DEBUG > otopi.plugins.otopi.services.systemd plugin.executeRaw:863 > execute-result: ('/usr/bin/systemctl', 'start', > 'ovirt-imageio-daemon.service'), rc=3D1 > > Also, imageio-daemon's log [2] looks a bit weird to me - it has 5 > 'Starting' lines, but no > other lines I would have expected to have, reading its source, and as > I can see in another > run, that did finish successfully [3]. > > Adding Idan, but not sure it's a bug in the daemon. > > [1] > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifa= ct/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/po= st-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ > > [2] > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifa= ct/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/po= st-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-imageio-d= aemon/daemon.log > > [3] > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3628/artifa= ct/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/po= st-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-imageio-d= aemon/daemon.log Looks like the daemon is already running on this host - maybe host deploy is trying to start the service twice? We did not change the startup code couple of years, so this must be some change in another component. This patch will make it easier to detect future issues, logging any error to the daemon log during startup: https://gerrit.ovirt.org/83670/ Nir > > > >> > >> > >> > >> > > > > > > > > -- > Didi > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > --===============4006064017139027792== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdiBjbGFzcz0iZ21haWxfcXVvdGUiPjxkaXYgZGlyPSJsdHIiPk9u IE1vbiwgTm92IDYsIDIwMTcgYXQgNDoxNiBQTSBZZWRpZHlhaCBCYXIgRGF2aWQgJmx0OzxhIGhy ZWY9Im1haWx0bzpkaWRpQHJlZGhhdC5jb20iPmRpZGlAcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3Rl Ojxicj48L2Rpdj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46 MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij5P biBNb24sIE5vdiA2LCAyMDE3IGF0IDE6NTcgUE0sIERhZm5hIFJvbiAmbHQ7PGEgaHJlZj0ibWFp bHRvOmRyb25AcmVkaGF0LmNvbSIgdGFyZ2V0PSJfYmxhbmsiPmRyb25AcmVkaGF0LmNvbTwvYT4m Z3Q7IHdyb3RlOjxicj4KJmd0OyBhZGRpbmcgRGlkaS48YnI+CiZndDs8YnI+CiZndDs8YnI+CiZn dDsgT24gMTEvMDYvMjAxNyAxMTo1MSBBTSwgQWxhIEhpbm8gd3JvdGU6PGJyPgomZ3Q7PGJyPgom Z3Q7IFN1c3BlY3RlZCBwYXRjaCAoPGEgaHJlZj0iaHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMv Yy84MzYxMi8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vZ2Vycml0 Lm92aXJ0Lm9yZy8jL2MvODM2MTIvPC9hPikgaXMgYWJvdXQgY29sZCBtZXJnZTxicj4KJmd0OyBh bmQgaGFzIG5vdGhpbmcgdG8gZG8gd2l0aCBob3N0IGRlcGxveS48YnI+CiZndDs8YnI+CiZndDsg T24gTW9uLCBOb3YgNiwgMjAxNyBhdCAxOjM5IFBNLCBEYWZuYSBSb24gJmx0OzxhIGhyZWY9Im1h aWx0bzpkcm9uQHJlZGhhdC5jb20iIHRhcmdldD0iX2JsYW5rIj5kcm9uQHJlZGhhdC5jb208L2E+ Jmd0OyB3cm90ZTo8YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyBIaSw8YnI+CiZndDsmZ3Q7PGJy PgomZ3Q7Jmd0OyBXZSBmYWlsZWQgdGVzdCAwMDJfYm9vdHN0cmFwLnZlcmlmeV9hZGRfaG9zdHM8 YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyBJIGNhbiBzZWUgd2Ugb25seSB0cmllZCB0byBpbnN0 YWxsIG9uZSBvZiB0aGUgaG9zdHMgKGhvc3QtMCkgYW5kIGZhaWxlZC48YnI+CiZndDsmZ3Q7IHRo ZSBzZWNvbmQgaG9zdCBoYXMgbm8gbG9nIHdoaWNoIG1lYW5zIHdlIGRpZCBub3QgdHJ5IHRvIGRl cGxveSBpdC48YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyBUaGUgZXJyb3Igc3VnZ2VzdHMgdGhh dCB3ZSBvdmlydC1pbWFnZWlvLWRhZW1vbiBmYWlsZWQgdG8gc3RhcnQuIEhvd2V2ZXIsPGJyPgom Z3Q7Jmd0OyB0aGVyZSBpcyBhbm90aGVyIG1lc3NhZ2UgdGhhdCBJIHRoaW5rIHNob3VsZCBiZSBh ZGRyZXNzZWQgYWJvdXQgY29uZmxpY3Rpbmc8YnI+CiZndDsmZ3Q7IHZkc20gYW5kIGxpYnZpcnQg Y29uZmlndXJhdGlvbnMuPGJyPgomZ3Q7Jmd0Ozxicj4KJmd0OyZndDsgTGluayB0byBzdXNwZWN0 ZWQgcGF0Y2hlczogPGEgaHJlZj0iaHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMvYy84MzYxMi8i IHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vZ2Vycml0Lm92aXJ0Lm9y Zy8jL2MvODM2MTIvPC9hPjxicj4KJmd0OyZndDs8YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyBM aW5rIHRvIEpvYjo8YnI+CiZndDsmZ3Q7IDxhIGhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9y Zy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi8iIHJlbD0ibm9yZWZl cnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQt bWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi88L2E+PGJyPgomZ3Q7Jmd0Ozxicj4KJmd0 OyZndDs8YnI+CiZndDsmZ3Q7IExpbmsgdG8gYWxsIGxvZ3M6PGJyPgomZ3Q7Jmd0OyA8YSBocmVm PSJodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUt dGVzdGVyLzM2MjYvYXJ0aWZhY3QvIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5o dHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVz dGVyLzM2MjYvYXJ0aWZhY3QvPC9hPjxicj4KJmd0OyZndDs8YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7 Jmd0OyA8YSBocmVmPSJodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9j aGFuZ2UtcXVldWUtdGVzdGVyLzM2MjYvYXJ0aWZhY3QvZXhwb3J0ZWQtYXJ0aWZhY3RzL2Jhc2lj LXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMtc3VpdGUtbWFzdGVyL3Bvc3QtMDAyX2Jv b3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1lbmdpbmUvX3Zhcl9sb2cvb3ZpcnQt ZW5naW5lL2hvc3QtZGVwbG95L292aXJ0LWhvc3QtZGVwbG95LTIwMTcxMTA2MDI1NjQ3LWxhZ28t YmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMC01NTMwYWIxZi5sb2ciIHJlbD0ibm9yZWZlcnJlciIg dGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVy X2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFz aWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJf Ym9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWVuZ2luZS9fdmFyX2xvZy9vdmly dC1lbmdpbmUvaG9zdC1kZXBsb3kvb3ZpcnQtaG9zdC1kZXBsb3ktMjAxNzExMDYwMjU2NDctbGFn by1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wLTU1MzBhYjFmLmxvZzwvYT48YnI+CiZndDsmZ3Q7 PGJyPgomZ3Q7Jmd0Ozxicj4KJmd0OyZndDsgKFJlbGV2YW50KSBlcnJvciBzbmlwcGV0IGZyb20g dGhlIGxvZzo8YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAmbHQ7ZXJyb3ImZ3Q7PGJyPgomZ3Q7 Jmd0Ozxicj4KJmd0OyZndDsgXDxicj4KJmd0OyZndDs8YnI+CiZndDsmZ3Q7IDIwMTctMTEtMDYg MDI6NTY6NDYsNTI2LTA1MDAgREVCVUc8YnI+CiZndDsmZ3Q7IG90b3BpLnBsdWdpbnMub3ZpcnRf aG9zdF9kZXBsb3kudmRzbS5wYWNrYWdlcyBwbHVnaW4uZXhlY3V0ZTo5MjE8YnI+CiZndDsmZ3Q7 IGV4ZWN1dGUtb3V0cHV0OiAoJiMzOTsvdXNyL2Jpbi92ZHNtLXRvb2wmIzM5OywgJiMzOTtjb25m aWd1cmUmIzM5OywgJiMzOTstLWZvcmNlJiMzOTspIHN0ZG91dDo8YnI+CiZndDsmZ3Q7PGJyPgom Z3Q7Jmd0OyBDaGVja2luZyBjb25maWd1cmF0aW9uIHN0YXR1cy4uLjxicj4KJmd0OyZndDs8YnI+ CiZndDsmZ3Q7IGFicnQgaXMgbm90IGNvbmZpZ3VyZWQgZm9yIHZkc208YnI+CiZndDsmZ3Q7IFdB Uk5JTkc6IExWTSBsb2NhbCBjb25maWd1cmF0aW9uOiAvZXRjL2x2bS9sdm1sb2NhbC5jb25mIGlz IG5vdCBiYXNlZCBvbjxicj4KJmd0OyZndDsgdmRzbSBjb25maWd1cmF0aW9uPGJyPgomZ3Q7Jmd0 OyBsdm0gcmVxdWlyZXMgY29uZmlndXJhdGlvbjxicj4KJmd0OyZndDsgbGlidmlydCBpcyBub3Qg Y29uZmlndXJlZCBmb3IgdmRzbSB5ZXQ8YnI+CiZndDsmZ3Q7IEZBSUxFRDogY29uZmxpY3Rpbmcg dmRzbSBhbmQgbGlidmlydC1xZW11IHRscyBjb25maWd1cmF0aW9uLjxicj4KJmd0OyZndDsgdmRz bS5jb25mIHdpdGggc3NsPVRydWUgcmVxdWlyZXMgdGhlIGZvbGxvd2luZyBjaGFuZ2VzOjxicj4K Jmd0OyZndDsgbGlidmlydGQuY29uZjogbGlzdGVuX3RjcD0wLCBhdXRoX3RjcD0mcXVvdDtzYXNs JnF1b3Q7LCBsaXN0ZW5fdGxzPTE8YnI+CiZndDsmZ3Q7IHFlbXUuY29uZjogc3BpY2VfdGxzPTEu PGJyPgomZ3Q7Jmd0OyBtdWx0aXBhdGggcmVxdWlyZXMgY29uZmlndXJhdGlvbjxicj4KJmd0OyZn dDs8YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAyMDE3LTExLTA2IDAyOjU2OjQ3LDU1MS0wNTAw IERFQlVHIG90b3BpLnBsdWdpbnMub3RvcGkuc2VydmljZXMuc3lzdGVtZDxicj4KJmd0OyZndDsg cGx1Z2luLmV4ZWN1dGU6OTI2IGV4ZWN1dGUtb3V0cHV0OiAoJiMzOTsvdXNyL2Jpbi9zeXN0ZW1j dGwmIzM5OywgJiMzOTtzdGFydCYjMzk7LDxicj4KJmd0OyZndDsgJiMzOTtvdmlydC1pbWFnZWlv LWRhZW1vbi5zZXJ2aWNlJiMzOTspIHN0ZGVycjo8YnI+CiZndDsmZ3Q7IEpvYiBmb3Igb3ZpcnQt aW1hZ2Vpby1kYWVtb24uc2VydmljZSBmYWlsZWQgYmVjYXVzZSB0aGUgY29udHJvbCBwcm9jZXNz PGJyPgomZ3Q7Jmd0OyBleGl0ZWQgd2l0aCBlcnJvciBjb2RlLiBTZWUgJnF1b3Q7c3lzdGVtY3Rs IHN0YXR1cyBvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlJnF1b3Q7PGJyPgomZ3Q7Jmd0OyBh bmQgJnF1b3Q7am91cm5hbGN0bCAteGUmcXVvdDsgZm9yIGRldGFpbHMuPGJyPgomZ3Q7Jmd0Ozxi cj4KJmd0OyZndDsgMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTItMDUwMCBERUJVRyBvdG9waS5jb250 ZXh0PGJyPgomZ3Q7Jmd0OyBjb250ZXh0Ll9leGVjdXRlTWV0aG9kOjE0MyBtZXRob2QgZXhjZXB0 aW9uPGJyPgomZ3Q7Jmd0OyBUcmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwgbGFzdCk6PGJyPgom Z3Q7Jmd0O8KgIMKgRmlsZSAmcXVvdDsvdG1wL292aXJ0LVI0UjhnWmhhUUkvcHl0aG9ubGliL290 b3BpL2NvbnRleHQucHkmcXVvdDssIGxpbmUgMTMzLCBpbjxicj4KJmd0OyZndDsgX2V4ZWN1dGVN ZXRob2Q8YnI+CiZndDsmZ3Q7wqAgwqAgwqBtZXRob2RbJiMzOTttZXRob2QmIzM5O10oKTxicj4K Jmd0OyZndDvCoCDCoEZpbGU8YnI+CiZndDsmZ3Q7ICZxdW90Oy90bXAvb3ZpcnQtUjRSOGdaaGFR SS9vdG9waS1wbHVnaW5zL292aXJ0LWhvc3QtZGVwbG95L3Zkc20vcGFja2FnZXMucHkmcXVvdDss PGJyPgomZ3Q7Jmd0OyBsaW5lIDE3OSwgaW4gX3N0YXJ0PGJyPgomZ3Q7Jmd0O8KgIMKgIMKgc2Vs Zi5zZXJ2aWNlcy5zdGF0ZSgmIzM5O292aXJ0LWltYWdlaW8tZGFlbW9uJiMzOTssIFRydWUpPGJy PgomZ3Q7Jmd0O8KgIMKgRmlsZSAmcXVvdDsvdG1wL292aXJ0LVI0UjhnWmhhUUkvb3RvcGktcGx1 Z2lucy9vdG9waS9zZXJ2aWNlcy9zeXN0ZW1kLnB5JnF1b3Q7LDxicj4KJmd0OyZndDsgbGluZSAx NDEsIGluIHN0YXRlPGJyPgomZ3Q7Jmd0O8KgIMKgIMKgc2VydmljZT1uYW1lLDxicj4KJmd0OyZn dDsgUnVudGltZUVycm9yOiBGYWlsZWQgdG8gc3RhcnQgc2VydmljZSAmIzM5O292aXJ0LWltYWdl aW8tZGFlbW9uJiMzOTs8YnI+CiZndDsmZ3Q7IDIwMTctMTEtMDYgMDI6NTY6NDcsNTUzLTA1MDAg RVJST1Igb3RvcGkuY29udGV4dDxicj4KJmd0OyZndDsgY29udGV4dC5fZXhlY3V0ZU1ldGhvZDox NTIgRmFpbGVkIHRvIGV4ZWN1dGUgc3RhZ2UgJiMzOTtDbG9zaW5nIHVwJiMzOTs6IEZhaWxlZCB0 bzxicj4KJmd0OyZndDsgc3RhcnQgc2VydmljZSAmIzM5O292aXJ0LWltYWdlaW8tZGFlbW9uJiMz OTs8YnI+Cjxicj4KSW4gL3Zhci9sb2cvbWVzc2FnZXMgb2YgdGhlIGhvc3QgWzFdLCB0aGVyZSBp czo8YnI+Cjxicj4KTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0 LTAgc3lzdGVtZDogU3RhcnRpbmcgb1ZpcnQ8YnI+CkltYWdlSU8gRGFlbW9uLi4uPGJyPgpOb3bC oCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBweXRob246IGRldGVj dGVkPGJyPgp1bmhhbmRsZWQgUHl0aG9uIGV4Y2VwdGlvbiBpbiAmIzM5Oy91c3IvYmluL292aXJ0 LWltYWdlaW8tZGFlbW9uJiMzOTs8YnI+Ck5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0 ZS1tYXN0ZXItaG9zdC0wIHB5dGhvbjogY2FuJiMzOTt0PGJyPgpjb21tdW5pY2F0ZSB3aXRoIEFC UlQgZGFlbW9uLCBpcyBpdCBydW5uaW5nPyBbRXJybm8gMl0gTm8gc3VjaCBmaWxlIG9yPGJyPgpk aXJlY3Rvcnk8YnI+Ck5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9z dC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4KVHJhY2ViYWNrIChtb3N0IHJlY2VudCBjYWxs IGxhc3QpOjxicj4KTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0 LTAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgpGaWxlICZxdW90Oy91c3IvYmluL292aXJ0LWlt YWdlaW8tZGFlbW9uJnF1b3Q7LCBsaW5lIDE0LCBpbiAmbHQ7bW9kdWxlJmd0Ozxicj4KTm92wqAg NiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1k YWVtb246PGJyPgpzZXJ2ZXIubWFpbihzeXMuYXJndik8YnI+Ck5vdsKgIDYgMDI6NTY6NDcgbGFn by1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4KRmls ZSAmcXVvdDsvdXNyL2xpYi9weXRob24yLjcvc2l0ZS1wYWNrYWdlcy9vdmlydF9pbWFnZWlvX2Rh ZW1vbi9zZXJ2ZXIucHkmcXVvdDssPGJyPgpsaW5lIDU3LCBpbiBtYWluPGJyPgpOb3bCoCA2IDAy OjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1v bjo8YnI+CnN0YXJ0KGNvbmZpZyk8YnI+Ck5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0 ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4KRmlsZSAmcXVvdDsvdXNy L2xpYi9weXRob24yLjcvc2l0ZS1wYWNrYWdlcy9vdmlydF9pbWFnZWlvX2RhZW1vbi9zZXJ2ZXIu cHkmcXVvdDssPGJyPgpsaW5lIDg1LCBpbiBzdGFydDxicj4KTm92wqAgNiAwMjo1Njo0NyBsYWdv LWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgpXU0dJ UmVxdWVzdEhhbmRsZXIpPGJyPgpOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFz dGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CkZpbGUgJnF1b3Q7L3Vzci9saWI2 NC9weXRob24yLjcvU29ja2V0U2VydmVyLnB5JnF1b3Q7LCBsaW5lIDQxOSwgaW4gX19pbml0X188 YnI+Ck5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0 LWltYWdlaW8tZGFlbW9uOjxicj4Kc2VsZi5zZXJ2ZXJfYmluZCgpPGJyPgpOb3bCoCA2IDAyOjU2 OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjo8 YnI+CkZpbGUgJnF1b3Q7L3Vzci9saWI2NC9weXRob24yLjcvd3NnaXJlZi9zaW1wbGVfc2VydmVy LnB5JnF1b3Q7LCBsaW5lIDQ4LCBpbjxicj4Kc2VydmVyX2JpbmQ8YnI+Ck5vdsKgIDYgMDI6NTY6 NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxi cj4KSFRUUFNlcnZlci5zZXJ2ZXJfYmluZChzZWxmKTxicj4KTm92wqAgNiAwMjo1Njo0NyBsYWdv LWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgpGaWxl ICZxdW90Oy91c3IvbGliNjQvcHl0aG9uMi43L0Jhc2VIVFRQU2VydmVyLnB5JnF1b3Q7LCBsaW5l IDEwOCwgaW48YnI+CnNlcnZlcl9iaW5kPGJyPgpOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMt c3VpdGUtbWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+ClNvY2tldFNlcnZl ci5UQ1BTZXJ2ZXIuc2VydmVyX2JpbmQoc2VsZik8YnI+Ck5vdsKgIDYgMDI6NTY6NDcgbGFnby1i YXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4KRmlsZSAm cXVvdDsvdXNyL2xpYjY0L3B5dGhvbjIuNy9Tb2NrZXRTZXJ2ZXIucHkmcXVvdDssIGxpbmUgNDMw LCBpbiBzZXJ2ZXJfYmluZDxicj4KTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1h c3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgpzZWxmLnNvY2tldC5iaW5kKHNl bGYuc2VydmVyX2FkZHJlc3MpPGJyPgpOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUt bWFzdGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CkZpbGUgJnF1b3Q7L3Vzci9s aWI2NC9weXRob24yLjcvc29ja2V0LnB5JnF1b3Q7LCBsaW5lIDIyNCwgaW4gbWV0aDxicj4KTm92 wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vp by1kYWVtb246PGJyPgpyZXR1cm4gZ2V0YXR0cihzZWxmLl9zb2NrLG5hbWUpKCphcmdzKTxicj4K Tm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1h Z2Vpby1kYWVtb246PGJyPgpzb2NrZXQuZXJyb3I6IFtFcnJubyA5OF0gQWRkcmVzcyBhbHJlYWR5 IGluIHVzZTxicj4KTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0 LTAgc3lzdGVtZDo8YnI+Cm92aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2U6IG1haW4gcHJvY2Vz cyBleGl0ZWQsIGNvZGU9ZXhpdGVkLDxicj4Kc3RhdHVzPTEvRkFJTFVSRTxicj4KPGJyPgpvdmly dC1ob3N0LWRlcGxveSBzdG9wcyBpdCwgYW5kIGltbWVkaWF0ZWx5IHRyaWVzIHRvIHN0YXJ0IGl0 Ojxicj4KPGJyPgoyMDE3LTExLTA2IDAyOjU2OjQ3LDIwMy0wNTAwIERFQlVHPGJyPgpvdG9waS5w bHVnaW5zLm90b3BpLnNlcnZpY2VzLnN5c3RlbWQgcGx1Z2luLmV4ZWN1dGVSYXc6ODYzPGJyPgpl eGVjdXRlLXJlc3VsdDogKCYjMzk7L3Vzci9iaW4vc3lzdGVtY3RsJiMzOTssICYjMzk7c3RvcCYj Mzk7LDxicj4KJiMzOTtvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlJiMzOTspLCByYz0wPGJy PgouLi48YnI+CjIwMTctMTEtMDYgMDI6NTY6NDcsNTUwLTA1MDAgREVCVUc8YnI+Cm90b3BpLnBs dWdpbnMub3RvcGkuc2VydmljZXMuc3lzdGVtZCBwbHVnaW4uZXhlY3V0ZVJhdzo4NjM8YnI+CmV4 ZWN1dGUtcmVzdWx0OiAoJiMzOTsvdXNyL2Jpbi9zeXN0ZW1jdGwmIzM5OywgJiMzOTtzdGFydCYj Mzk7LDxicj4KJiMzOTtvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlJiMzOTspLCByYz0xPGJy Pgo8YnI+CkFsc28sIGltYWdlaW8tZGFlbW9uJiMzOTtzIGxvZyBbMl0gbG9va3MgYSBiaXQgd2Vp cmQgdG8gbWUgLSBpdCBoYXMgNTxicj4KJiMzOTtTdGFydGluZyYjMzk7IGxpbmVzLCBidXQgbm88 YnI+Cm90aGVyIGxpbmVzIEkgd291bGQgaGF2ZSBleHBlY3RlZCB0byBoYXZlLCByZWFkaW5nIGl0 cyBzb3VyY2UsIGFuZCBhczxicj4KSSBjYW4gc2VlIGluIGFub3RoZXI8YnI+CnJ1biwgdGhhdCBk aWQgZmluaXNoIHN1Y2Nlc3NmdWxseSBbM10uPGJyPgo8YnI+CkFkZGluZyBJZGFuLCBidXQgbm90 IHN1cmUgaXQmIzM5O3MgYSBidWcgaW4gdGhlIGRhZW1vbi48YnI+Cjxicj4KWzFdIDxhIGhyZWY9 Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10 ZXN0ZXIvMzYyNi9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXIt ZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xh Z28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMC9fdmFyX2xvZy8iIHJlbD0ibm9yZWZlcnJlciIg dGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVy X2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFz aWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJf Ym9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMC9fdmFyX2xvZy88L2E+ PGJyPgo8YnI+ClsyXSA8YSBocmVmPSJodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0 LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjYvYXJ0aWZhY3QvZXhwb3J0ZWQtYXJ0aWZh Y3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMtc3VpdGUtbWFzdGVyL3Bv c3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAvX3Zhcl9s b2cvb3ZpcnQtaW1hZ2Vpby1kYWVtb24vZGFlbW9uLmxvZyIgcmVsPSJub3JlZmVycmVyIiB0YXJn ZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hh bmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1z dWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290 c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wL192YXJfbG9nL292aXJ0LWlt YWdlaW8tZGFlbW9uL2RhZW1vbi5sb2c8L2E+PGJyPgo8YnI+ClszXSA8YSBocmVmPSJodHRwOi8v amVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2 MjgvYXJ0aWZhY3QvZXhwb3J0ZWQtYXJ0aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0 X2xvZ3MvYmFzaWMtc3VpdGUtbWFzdGVyL3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2lj LXN1aXRlLW1hc3Rlci1ob3N0LTAvX3Zhcl9sb2cvb3ZpcnQtaW1hZ2Vpby1kYWVtb24vZGFlbW9u LmxvZyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMub3Zp cnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI4L2FydGlmYWN0 L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2lj LXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0 ZXItaG9zdC0wL192YXJfbG9nL292aXJ0LWltYWdlaW8tZGFlbW9uL2RhZW1vbi5sb2c8L2E+PC9i bG9ja3F1b3RlPjxkaXY+PGJyPjwvZGl2PjxkaXY+TG9va3MgbGlrZSB0aGUgZGFlbW9uIGlzIGFs cmVhZHkgcnVubmluZyBvbiB0aGlzIGhvc3QgLSBtYXliZSBob3N0IGRlcGxveTwvZGl2PjxkaXY+ aXMgdHJ5aW5nIHRvIHN0YXJ0IHRoZSBzZXJ2aWNlIHR3aWNlPzwvZGl2PjxkaXY+PGJyPjwvZGl2 PjxkaXY+V2UgZGlkIG5vdCBjaGFuZ2UgdGhlIHN0YXJ0dXAgY29kZSBjb3VwbGUgb2YgeWVhcnMs IHNvIHRoaXMgbXVzdCBiZSBzb21lPC9kaXY+PGRpdj5jaGFuZ2UgaW4gYW5vdGhlciBjb21wb25l bnQuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5UaGlzIHBhdGNoIHdpbGwgbWFrZSBpdCBlYXNp ZXIgdG8gZGV0ZWN0IGZ1dHVyZSBpc3N1ZXMsIGxvZ2dpbmcgYW55IGVycm9yPC9kaXY+PGRpdj50 byB0aGUgZGFlbW9uIGxvZyBkdXJpbmcgc3RhcnR1cDo8L2Rpdj48ZGl2PjxhIGhyZWY9Imh0dHBz Oi8vZ2Vycml0Lm92aXJ0Lm9yZy84MzY3MC8iPmh0dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy84MzY3 MC88L2E+PGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+TmlyPC9kaXY+PGRpdj7CoDwvZGl2 PjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowIDAgMCAuOGV4 O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPjxicj4KPGJyPgom Z3Q7Jmd0Ozxicj4KJmd0OyZndDsgJmx0Oy9lcnJvciZndDs8YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7 Jmd0Ozxicj4KJmd0Ozxicj4KJmd0Ozxicj4KPGJyPgo8YnI+Cjxicj4KLS08YnI+CkRpZGk8YnI+ Cl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPGJyPgpEZXZl bCBtYWlsaW5nIGxpc3Q8YnI+CjxhIGhyZWY9Im1haWx0bzpEZXZlbEBvdmlydC5vcmciIHRhcmdl dD0iX2JsYW5rIj5EZXZlbEBvdmlydC5vcmc8L2E+PGJyPgo8YSBocmVmPSJodHRwOi8vbGlzdHMu b3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vZGV2ZWwiIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0 PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby9kZXZlbDwv YT48YnI+CjwvYmxvY2txdW90ZT48L2Rpdj48L2Rpdj4K --===============4006064017139027792==-- From dron at redhat.com Tue Nov 7 09:54:11 2017 Content-Type: multipart/mixed; boundary="===============4941397867394669870==" MIME-Version: 1.0 From: Dafna Ron To: devel at ovirt.org Subject: Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 06-11-2017 ] [ 002_bootstrap.verify_add_hosts ] Date: Tue, 07 Nov 2017 09:54:05 +0000 Message-ID: In-Reply-To: CAMRbyyufL8QaLfgfdZD2-VbvTRxbgbY3k5_2kK7aha0XvcQAEg@mail.gmail.com --===============4941397867394669870== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------A6910E3AD3267E1D5DC1BE4B Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit we had the same failure this morning: Failed build: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3646/ All Logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3646/artifact/ engine log: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3646/artifact= /exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post= -002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/host= -deploy/ovirt-host-deploy-20171107030411-lago-basic-suite-master-host-0-5f9= 0b210.log host logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3646/artifact= /exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post= -002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ On 11/06/2017 08:26 PM, Nir Soffer wrote: > On Mon, Nov 6, 2017 at 4:16 PM Yedidyah Bar David > wrote: > > On Mon, Nov 6, 2017 at 1:57 PM, Dafna Ron > wrote: > > adding Didi. > > > > > > On 11/06/2017 11:51 AM, Ala Hino wrote: > > > > Suspected patch (https://gerrit.ovirt.org/#/c/83612/) is about > cold merge > > and has nothing to do with host deploy. > > > > On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron > wrote: > >> > >> Hi, > >> > >> We failed test 002_bootstrap.verify_add_hosts > >> > >> I can see we only tried to install one of the hosts (host-0) > and failed. > >> the second host has no log which means we did not try to deploy it. > >> > >> The error suggests that we ovirt-imageio-daemon failed to > start. However, > >> there is another message that I think should be addressed about > conflicting > >> vdsm and libvirt configurations. > >> > >> Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/ > >> > >> > >> Link to Job: > >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ > >> > >> > >> Link to all logs: > >> > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ar= tifact/ > >> > >> > >> > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ar= tifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-maste= r/post-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engin= e/host-deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host= -0-5530ab1f.log > >> > >> > >> (Relevant) error snippet from the log: > >> > >> > >> > >> \ > >> > >> 2017-11-06 02:56:46,526-0500 DEBUG > >> otopi.plugins.ovirt_host_deploy.vdsm.packages plugin.execute:921 > >> execute-output: ('/usr/bin/vdsm-tool', 'configure', '--force') > stdout: > >> > >> Checking configuration status... > >> > >> abrt is not configured for vdsm > >> WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not > based on > >> vdsm configuration > >> lvm requires configuration > >> libvirt is not configured for vdsm yet > >> FAILED: conflicting vdsm and libvirt-qemu tls configuration. > >> vdsm.conf with ssl=3DTrue requires the following changes: > >> libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 > >> qemu.conf: spice_tls=3D1. > >> multipath requires configuration > >> > >> > >> 2017-11-06 02:56:47,551-0500 DEBUG > otopi.plugins.otopi.services.systemd > >> plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', > >> 'ovirt-imageio-daemon.service') stderr: > >> Job for ovirt-imageio-daemon.service failed because the control > process > >> exited with error code. See "systemctl status > ovirt-imageio-daemon.service" > >> and "journalctl -xe" for details. > >> > >> 2017-11-06 02:56:47,552-0500 DEBUG otopi.context > >> context._executeMethod:143 method exception > >> Traceback (most recent call last): > >> File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line > 133, in > >> _executeMethod > >> method['method']() > >> File > >> > "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packages.= py", > >> line 179, in _start > >> self.services.state('ovirt-imageio-daemon', True) > >> File > "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py", > >> line 141, in state > >> service=3Dname, > >> RuntimeError: Failed to start service 'ovirt-imageio-daemon' > >> 2017-11-06 02:56:47,553-0500 ERROR otopi.context > >> context._executeMethod:152 Failed to execute stage 'Closing > up': Failed to > >> start service 'ovirt-imageio-daemon' > > In /var/log/messages of the host [1], there is: > > Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: Starting oVirt > ImageIO Daemon... > Nov 6 02:56:47 lago-basic-suite-master-host-0 python: detected > unhandled Python exception in '/usr/bin/ovirt-imageio-daemon' > Nov 6 02:56:47 lago-basic-suite-master-host-0 python: can't > communicate with ABRT daemon, is it running? [Errno 2] No such file or > directory > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > Traceback (most recent call last): > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/bin/ovirt-imageio-daemon", line 14, in > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > server.main(sys.argv) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File > "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", > line 57, in main > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > start(config) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File > "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", > line 85, in start > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > WSGIRequestHandler) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__ > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > self.server_bind() > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 48, in > server_bind > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > HTTPServer.server_bind(self) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in > server_bind > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > SocketServer.TCPServer.server_bind(self) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > self.socket.bind(self.server_address) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > File "/usr/lib64/python2.7/socket.py", line 224, in meth > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > return getattr(self._sock,name)(*args) > Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: > socket.error: [Errno 98] Address already in use > Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: > ovirt-imageio-daemon.service: main process exited, code=3Dexited, > status=3D1/FAILURE > > ovirt-host-deploy stops it, and immediately tries to start it: > > 2017-11-06 02:56:47,203-0500 DEBUG > otopi.plugins.otopi.services.systemd plugin.executeRaw:863 > execute-result: ('/usr/bin/systemctl', 'stop', > 'ovirt-imageio-daemon.service'), rc=3D0 > ... > 2017-11-06 02:56:47,550-0500 DEBUG > otopi.plugins.otopi.services.systemd plugin.executeRaw:863 > execute-result: ('/usr/bin/systemctl', 'start', > 'ovirt-imageio-daemon.service'), rc=3D1 > > Also, imageio-daemon's log [2] looks a bit weird to me - it has 5 > 'Starting' lines, but no > other lines I would have expected to have, reading its source, and as > I can see in another > run, that did finish successfully [3]. > > Adding Idan, but not sure it's a bug in the daemon. > > [1] > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ar= tifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-maste= r/post-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ > > [2] > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ar= tifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-maste= r/post-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-image= io-daemon/daemon.log > > [3] > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3628/ar= tifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-maste= r/post-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-image= io-daemon/daemon.log > > > Looks like the daemon is already running on this host - maybe host deploy > is trying to start the service twice? > > We did not change the startup code couple of years, so this must be some > change in another component. > > This patch will make it easier to detect future issues, logging any error > to the daemon log during startup: > https://gerrit.ovirt.org/83670/ > > Nir > = > > > > >> > >> > >> > >> > > > > > > > > -- > Didi > _______________________________________________ > Devel mailing list > Devel(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/devel > --------------A6910E3AD3267E1D5DC1BE4B Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit

we had the same failure this morning:
Failed build:

http://jenkins.ovirt.org/job/ovirt-mas= ter_change-queue-tester/3646/

All Logs:

http://jenkins.ovirt.org/job/= ovirt-master_change-queue-tester/3646/artifact/

engine log:

http://jenkins.ovirt.= org/job/ovirt-master_change-queue-tester/3646/artifact/exported-artifacts/b= asic-suit-master-el7/test_logs/basic-suite-master/post-002_bootstrap.py/lag= o-basic-suite-master-engine/_var_log/ovirt-engine/host-deploy/ovirt-host-de= ploy-20171107030411-lago-basic-suite-master-host-0-5f90b210.log

host logs:

http://jenkins.ovirt.org/job/ovirt-master_chang= e-queue-tester/3646/artifact/exported-artifacts/basic-suit-master-el7/test_= logs/basic-suite-master/post-002_bootstrap.py/lago-basic-suite-master-host-= 0/_var_log/

On 11/06/2017 08:26 PM, Nir Soffer wrote:

On Mon, Nov 6, 2017 at 4:16 PM Yedidyah Bar David <didi(a)redhat.com> wrote:

On Mon, Nov 6, 2017 at 1:57 PM, Dafna Ron <dron(a)redhat.com> wrote:
> adding Didi.
>
>
> On 11/06/2017 11:51 AM, Ala Hino wrote:
>
> Suspected patch (https://gerrit.ovirt.org/#/c/83612/) is about cold merge
> and has nothing to do with host deploy.
>
> On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron <dron(a)redhat.com> wrote:
>>
>> Hi,
>>
>> We failed test 002_bootstrap.verify_add_hosts
>>
>> I can see we only tried to install one of the hosts (host-0) and failed.
>> the second host has no log which means we did not try to deploy it.
>>
>> The error suggests that we ovirt-imageio-daemon failed to start. However,
>> there is another message that I think should be addressed about conflicting
>> vdsm and libvirt configurations.
>>
>> Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/
>>
>>
>> Link to Job:
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/
>>
>>
>> Link to all logs:
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifac= t/
>>
>>
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifac= t/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/pos= t-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/hos= t-deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host-0-55= 30ab1f.log
>>
>>
>> (Relevant) error snippet from the log:
>>
>> <error>
>>
>> \
>>
>> 2017-11-06 02:56:46,526-0500 DEBUG
>> otopi.plugins.ovirt_host_deploy.vdsm.packages plugin.execute:921
>> execute-output: ('/usr/bin/vdsm-tool', 'configure', '--force') stdout:
>>
>> Checking configuration status...
>>
>> abrt is not configured for vdsm
>> WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based on
>> vdsm configuration
>> lvm requires configuration
>> libvirt is not configured for vdsm yet
>> FAILED: conflicting vdsm and libvirt-qemu tls configuration.
>> vdsm.conf with ssl=3DTrue requires the following changes:
>> libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1
>> qemu.conf: spice_tls=3D1.
>> multipath requires configuration
>>
>>
>> 2017-11-06 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.systemd
>> plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start',
>> 'ovirt-imageio-daemon.service') stderr:
>> Job for ovirt-imageio-daemon.service failed because the control process
>> exited with error code. See "systemctl status ovirt-imageio-daemon.service"
>> and "journalctl -xe" for details.
>>
>> 2017-11-06 02:56:47,552-0500 DEBUG otopi.context
>> context._executeMethod:143 method exception
>> Traceback (most recent call last):
>>=C2=A0 =C2=A0File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, in
>> _executeMethod
>>=C2=A0 =C2=A0 =C2=A0method['method']()
>>=C2=A0 =C2=A0File
>> "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packages.py", >> line 179, in _start
>>=C2=A0 =C2=A0 =C2=A0self.services.state('ovirt-imageio-= daemon', True)
>>=C2=A0 =C2=A0File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py"= ,
>> line 141, in state
>>=C2=A0 =C2=A0 =C2=A0service=3Dname,
>> RuntimeError: Failed to start service 'ovirt-imageio-daemon'
>> 2017-11-06 02:56:47,553-0500 ERROR otopi.context
>> context._executeMethod:152 Failed to execute stage 'Closing up': Failed to
>> start service 'ovirt-imageio-daemon'

In /var/log/messages of the host [1], there is:

Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 systemd: Starting oVirt
ImageIO Daemon...
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 python: detected
unhandled Python exception in '/usr/bin/ovirt-imageio-daemon'
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 python: can= 't
communicate with ABRT daemon, is it running? [Errno 2] No such file or
directory
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
Traceback (most recent call last):
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
File "/usr/bin/ovirt-imageio-daemon", line 14, in <module>
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
server.main(sys.argv)
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.p= y",
line 57, in main
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
start(config)
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.p= y",
line 85, in start
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
WSGIRequestHandler)
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
self.server_bind()
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 48, in
server_bind
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
HTTPServer.server_bind(self)
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in
server_bind
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
SocketServer.TCPServer.server_bind(self)
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
self.socket.bind(self.server_address)
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
File "/usr/lib64/python2.7/socket.py", line 224, in meth
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
return getattr(self._sock,name)(*args)
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon:
socket.error: [Errno 98] Address already in use
Nov=C2=A0 6 02:56:47 lago-basic-suite-master-host-0 systemd:
ovirt-imageio-daemon.service: main process exited, code=3Dexited,
status=3D1/FAILURE

ovirt-host-deploy stops it, and immediately tries to start it:

2017-11-06 02:56:47,203-0500 DEBUG
otopi.plugins.otopi.services.systemd plugin.executeRaw:863
execute-result: ('/usr/bin/systemctl', 'stop',
'ovirt-imageio-daemon.service'), rc=3D0
...
2017-11-06 02:56:47,550-0500 DEBUG
otopi.plugins.otopi.services.systemd plugin.executeRaw:863
execute-result: ('/usr/bin/systemctl', 'start',
'ovirt-imageio-daemon.service'), rc=3D1

Also, imageio-daemon's log [2] looks a bit weird to me - it has 5
'Starting' lines, but no
other lines I would have expected to have, reading its source, and as
I can see in another
run, that did finish successfully [3].

Adding Idan, but not sure it's a bug in the daemon.

[1] http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifac= t/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/pos= t-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/

[2] http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artifac= t/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/pos= t-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-imageio-da= emon/daemon.log

[3] http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3628/artifac= t/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/pos= t-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-imageio-da= emon/daemon.log

Looks like the daemon is already running on this host - maybe host deploy

is trying to start the service twice?

We did not change the startup code couple of years, so this must be some

change in another component.

This patch will make it easier to detect future issues, logging any error

to the daemon log during startup:

https://gerrit.ovirt.org/83670/<= br>

Nir

=C2=A0

>>
>> </error>
>>
>>
>
>

--
Didi
_______________________________________________
Devel mailing list
Devel(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel

--------------A6910E3AD3267E1D5DC1BE4B-- --===============4941397867394669870== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS1BNjkxMEUzQUQzMjY3RTFENURDMUJFNEIKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQKCndlIGhhZCB0aGUgc2Ft ZSBmYWlsdXJlIHRoaXMgbW9ybmluZzoKCkZhaWxlZCBidWlsZDoKCmh0dHA6Ly9qZW5raW5zLm92 aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzY0Ni8KCkFsbCBM b2dzOgoKaHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1 ZXVlLXRlc3Rlci8zNjQ2L2FydGlmYWN0LwoKZW5naW5lIGxvZzoKCmh0dHA6Ly9qZW5raW5zLm92 aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzY0Ni9hcnRpZmFj dC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNp Yy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFz dGVyLWVuZ2luZS9fdmFyX2xvZy9vdmlydC1lbmdpbmUvaG9zdC1kZXBsb3kvb3ZpcnQtaG9zdC1k ZXBsb3ktMjAxNzExMDcwMzA0MTEtbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wLTVmOTBi MjEwLmxvZwoKaG9zdCBsb2dzOgoKaHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1t YXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjQ2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0 cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0 LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wL192YXJfbG9n LwoKCk9uIDExLzA2LzIwMTcgMDg6MjYgUE0sIE5pciBTb2ZmZXIgd3JvdGU6Cj4gT24gTW9uLCBO b3YgNiwgMjAxNyBhdCA0OjE2IFBNIFllZGlkeWFoIEJhciBEYXZpZCA8ZGlkaUByZWRoYXQuY29t Cj4gPG1haWx0bzpkaWRpQHJlZGhhdC5jb20+PiB3cm90ZToKPgo+ICAgICBPbiBNb24sIE5vdiA2 LCAyMDE3IGF0IDE6NTcgUE0sIERhZm5hIFJvbiA8ZHJvbkByZWRoYXQuY29tCj4gICAgIDxtYWls dG86ZHJvbkByZWRoYXQuY29tPj4gd3JvdGU6Cj4gICAgID4gYWRkaW5nIERpZGkuCj4gICAgID4K PiAgICAgPgo+ICAgICA+IE9uIDExLzA2LzIwMTcgMTE6NTEgQU0sIEFsYSBIaW5vIHdyb3RlOgo+ ICAgICA+Cj4gICAgID4gU3VzcGVjdGVkIHBhdGNoIChodHRwczovL2dlcnJpdC5vdmlydC5vcmcv Iy9jLzgzNjEyLykgaXMgYWJvdXQKPiAgICAgY29sZCBtZXJnZQo+ICAgICA+IGFuZCBoYXMgbm90 aGluZyB0byBkbyB3aXRoIGhvc3QgZGVwbG95Lgo+ICAgICA+Cj4gICAgID4gT24gTW9uLCBOb3Yg NiwgMjAxNyBhdCAxOjM5IFBNLCBEYWZuYSBSb24gPGRyb25AcmVkaGF0LmNvbQo+ICAgICA8bWFp bHRvOmRyb25AcmVkaGF0LmNvbT4+IHdyb3RlOgo+ICAgICA+Pgo+ICAgICA+PiBIaSwKPiAgICAg Pj4KPiAgICAgPj4gV2UgZmFpbGVkIHRlc3QgMDAyX2Jvb3RzdHJhcC52ZXJpZnlfYWRkX2hvc3Rz Cj4gICAgID4+Cj4gICAgID4+IEkgY2FuIHNlZSB3ZSBvbmx5IHRyaWVkIHRvIGluc3RhbGwgb25l IG9mIHRoZSBob3N0cyAoaG9zdC0wKQo+ICAgICBhbmQgZmFpbGVkLgo+ICAgICA+PiB0aGUgc2Vj b25kIGhvc3QgaGFzIG5vIGxvZyB3aGljaCBtZWFucyB3ZSBkaWQgbm90IHRyeSB0byBkZXBsb3kg aXQuCj4gICAgID4+Cj4gICAgID4+IFRoZSBlcnJvciBzdWdnZXN0cyB0aGF0IHdlIG92aXJ0LWlt YWdlaW8tZGFlbW9uIGZhaWxlZCB0bwo+ICAgICBzdGFydC4gSG93ZXZlciwKPiAgICAgPj4gdGhl cmUgaXMgYW5vdGhlciBtZXNzYWdlIHRoYXQgSSB0aGluayBzaG91bGQgYmUgYWRkcmVzc2VkIGFi b3V0Cj4gICAgIGNvbmZsaWN0aW5nCj4gICAgID4+IHZkc20gYW5kIGxpYnZpcnQgY29uZmlndXJh dGlvbnMuCj4gICAgID4+Cj4gICAgID4+IExpbmsgdG8gc3VzcGVjdGVkIHBhdGNoZXM6IGh0dHBz Oi8vZ2Vycml0Lm92aXJ0Lm9yZy8jL2MvODM2MTIvCj4gICAgID4+Cj4gICAgID4+Cj4gICAgID4+ IExpbmsgdG8gSm9iOgo+ICAgICA+PiBodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0 LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjYvCj4gICAgID4+Cj4gICAgID4+Cj4gICAg ID4+IExpbmsgdG8gYWxsIGxvZ3M6Cj4gICAgID4+Cj4gICAgIGh0dHA6Ly9qZW5raW5zLm92aXJ0 Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC8K PiAgICAgPj4KPiAgICAgPj4KPiAgICAgPj4KPiAgICAgaHR0cDovL2plbmtpbnMub3ZpcnQub3Jn L2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0L2V4cG9y dGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRl LW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItZW5n aW5lL192YXJfbG9nL292aXJ0LWVuZ2luZS9ob3N0LWRlcGxveS9vdmlydC1ob3N0LWRlcGxveS0y MDE3MTEwNjAyNTY0Ny1sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAtNTUzMGFiMWYubG9n Cj4gICAgID4+Cj4gICAgID4+Cj4gICAgID4+IChSZWxldmFudCkgZXJyb3Igc25pcHBldCBmcm9t IHRoZSBsb2c6Cj4gICAgID4+Cj4gICAgID4+IDxlcnJvcj4KPiAgICAgPj4KPiAgICAgPj4gXAo+ ICAgICA+Pgo+ICAgICA+PiAyMDE3LTExLTA2IDAyOjU2OjQ2LDUyNi0wNTAwIERFQlVHCj4gICAg ID4+IG90b3BpLnBsdWdpbnMub3ZpcnRfaG9zdF9kZXBsb3kudmRzbS5wYWNrYWdlcyBwbHVnaW4u ZXhlY3V0ZTo5MjEKPiAgICAgPj4gZXhlY3V0ZS1vdXRwdXQ6ICgnL3Vzci9iaW4vdmRzbS10b29s JywgJ2NvbmZpZ3VyZScsICctLWZvcmNlJykKPiAgICAgc3Rkb3V0Ogo+ICAgICA+Pgo+ICAgICA+ PiBDaGVja2luZyBjb25maWd1cmF0aW9uIHN0YXR1cy4uLgo+ICAgICA+Pgo+ICAgICA+PiBhYnJ0 IGlzIG5vdCBjb25maWd1cmVkIGZvciB2ZHNtCj4gICAgID4+IFdBUk5JTkc6IExWTSBsb2NhbCBj b25maWd1cmF0aW9uOiAvZXRjL2x2bS9sdm1sb2NhbC5jb25mIGlzIG5vdAo+ICAgICBiYXNlZCBv bgo+ICAgICA+PiB2ZHNtIGNvbmZpZ3VyYXRpb24KPiAgICAgPj4gbHZtIHJlcXVpcmVzIGNvbmZp Z3VyYXRpb24KPiAgICAgPj4gbGlidmlydCBpcyBub3QgY29uZmlndXJlZCBmb3IgdmRzbSB5ZXQK PiAgICAgPj4gRkFJTEVEOiBjb25mbGljdGluZyB2ZHNtIGFuZCBsaWJ2aXJ0LXFlbXUgdGxzIGNv bmZpZ3VyYXRpb24uCj4gICAgID4+IHZkc20uY29uZiB3aXRoIHNzbD1UcnVlIHJlcXVpcmVzIHRo ZSBmb2xsb3dpbmcgY2hhbmdlczoKPiAgICAgPj4gbGlidmlydGQuY29uZjogbGlzdGVuX3RjcD0w LCBhdXRoX3RjcD0ic2FzbCIsIGxpc3Rlbl90bHM9MQo+ICAgICA+PiBxZW11LmNvbmY6IHNwaWNl X3Rscz0xLgo+ICAgICA+PiBtdWx0aXBhdGggcmVxdWlyZXMgY29uZmlndXJhdGlvbgo+ICAgICA+ Pgo+ICAgICA+Pgo+ICAgICA+PiAyMDE3LTExLTA2IDAyOjU2OjQ3LDU1MS0wNTAwIERFQlVHCj4g ICAgIG90b3BpLnBsdWdpbnMub3RvcGkuc2VydmljZXMuc3lzdGVtZAo+ICAgICA+PiBwbHVnaW4u ZXhlY3V0ZTo5MjYgZXhlY3V0ZS1vdXRwdXQ6ICgnL3Vzci9iaW4vc3lzdGVtY3RsJywgJ3N0YXJ0 JywKPiAgICAgPj4gJ292aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UnKSBzdGRlcnI6Cj4gICAg ID4+IEpvYiBmb3Igb3ZpcnQtaW1hZ2Vpby1kYWVtb24uc2VydmljZSBmYWlsZWQgYmVjYXVzZSB0 aGUgY29udHJvbAo+ICAgICBwcm9jZXNzCj4gICAgID4+IGV4aXRlZCB3aXRoIGVycm9yIGNvZGUu IFNlZSAic3lzdGVtY3RsIHN0YXR1cwo+ICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNl Igo+ICAgICA+PiBhbmQgImpvdXJuYWxjdGwgLXhlIiBmb3IgZGV0YWlscy4KPiAgICAgPj4KPiAg ICAgPj4gMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTItMDUwMCBERUJVRyBvdG9waS5jb250ZXh0Cj4g ICAgID4+IGNvbnRleHQuX2V4ZWN1dGVNZXRob2Q6MTQzIG1ldGhvZCBleGNlcHRpb24KPiAgICAg Pj4gVHJhY2ViYWNrIChtb3N0IHJlY2VudCBjYWxsIGxhc3QpOgo+ICAgICA+PiAgIEZpbGUgIi90 bXAvb3ZpcnQtUjRSOGdaaGFRSS9weXRob25saWIvb3RvcGkvY29udGV4dC5weSIsIGxpbmUKPiAg ICAgMTMzLCBpbgo+ICAgICA+PiBfZXhlY3V0ZU1ldGhvZAo+ICAgICA+PiAgICAgbWV0aG9kWydt ZXRob2QnXSgpCj4gICAgID4+ICAgRmlsZQo+ICAgICA+Pgo+ICAgICAiL3RtcC9vdmlydC1SNFI4 Z1poYVFJL290b3BpLXBsdWdpbnMvb3ZpcnQtaG9zdC1kZXBsb3kvdmRzbS9wYWNrYWdlcy5weSIs Cj4gICAgID4+IGxpbmUgMTc5LCBpbiBfc3RhcnQKPiAgICAgPj4gICAgIHNlbGYuc2VydmljZXMu c3RhdGUoJ292aXJ0LWltYWdlaW8tZGFlbW9uJywgVHJ1ZSkKPiAgICAgPj4gICBGaWxlCj4gICAg ICIvdG1wL292aXJ0LVI0UjhnWmhhUUkvb3RvcGktcGx1Z2lucy9vdG9waS9zZXJ2aWNlcy9zeXN0 ZW1kLnB5IiwKPiAgICAgPj4gbGluZSAxNDEsIGluIHN0YXRlCj4gICAgID4+ICAgICBzZXJ2aWNl PW5hbWUsCj4gICAgID4+IFJ1bnRpbWVFcnJvcjogRmFpbGVkIHRvIHN0YXJ0IHNlcnZpY2UgJ292 aXJ0LWltYWdlaW8tZGFlbW9uJwo+ICAgICA+PiAyMDE3LTExLTA2IDAyOjU2OjQ3LDU1My0wNTAw IEVSUk9SIG90b3BpLmNvbnRleHQKPiAgICAgPj4gY29udGV4dC5fZXhlY3V0ZU1ldGhvZDoxNTIg RmFpbGVkIHRvIGV4ZWN1dGUgc3RhZ2UgJ0Nsb3NpbmcKPiAgICAgdXAnOiBGYWlsZWQgdG8KPiAg ICAgPj4gc3RhcnQgc2VydmljZSAnb3ZpcnQtaW1hZ2Vpby1kYWVtb24nCj4KPiAgICAgSW4gL3Zh ci9sb2cvbWVzc2FnZXMgb2YgdGhlIGhvc3QgWzFdLCB0aGVyZSBpczoKPgo+ICAgICBOb3YgIDYg MDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIHN5c3RlbWQ6IFN0YXJ0aW5n IG9WaXJ0Cj4gICAgIEltYWdlSU8gRGFlbW9uLi4uCj4gICAgIE5vdiAgNiAwMjo1Njo0NyBsYWdv LWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgcHl0aG9uOiBkZXRlY3RlZAo+ICAgICB1bmhhbmRs ZWQgUHl0aG9uIGV4Y2VwdGlvbiBpbiAnL3Vzci9iaW4vb3ZpcnQtaW1hZ2Vpby1kYWVtb24nCj4g ICAgIE5vdiAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgcHl0aG9u OiBjYW4ndAo+ICAgICBjb21tdW5pY2F0ZSB3aXRoIEFCUlQgZGFlbW9uLCBpcyBpdCBydW5uaW5n PyBbRXJybm8gMl0gTm8gc3VjaCBmaWxlIG9yCj4gICAgIGRpcmVjdG9yeQo+ICAgICBOb3YgIDYg MDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFl bW9uOgo+ICAgICBUcmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwgbGFzdCk6Cj4gICAgIE5vdiAg NiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1k YWVtb246Cj4gICAgIEZpbGUgIi91c3IvYmluL292aXJ0LWltYWdlaW8tZGFlbW9uIiwgbGluZSAx NCwgaW4gPG1vZHVsZT4KPiAgICAgTm92ICA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFz dGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjoKPiAgICAgc2VydmVyLm1haW4oc3lzLmFy Z3YpCj4gICAgIE5vdiAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAg b3ZpcnQtaW1hZ2Vpby1kYWVtb246Cj4gICAgIEZpbGUKPiAgICAgIi91c3IvbGliL3B5dGhvbjIu Ny9zaXRlLXBhY2thZ2VzL292aXJ0X2ltYWdlaW9fZGFlbW9uL3NlcnZlci5weSIsCj4gICAgIGxp bmUgNTcsIGluIG1haW4KPiAgICAgTm92ICA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFz dGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjoKPiAgICAgc3RhcnQoY29uZmlnKQo+ICAg ICBOb3YgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWlt YWdlaW8tZGFlbW9uOgo+ICAgICBGaWxlCj4gICAgICIvdXNyL2xpYi9weXRob24yLjcvc2l0ZS1w YWNrYWdlcy9vdmlydF9pbWFnZWlvX2RhZW1vbi9zZXJ2ZXIucHkiLAo+ICAgICBsaW5lIDg1LCBp biBzdGFydAo+ICAgICBOb3YgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9z dC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOgo+ICAgICBXU0dJUmVxdWVzdEhhbmRsZXIpCj4gICAg IE5vdiAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1h Z2Vpby1kYWVtb246Cj4gICAgIEZpbGUgIi91c3IvbGliNjQvcHl0aG9uMi43L1NvY2tldFNlcnZl ci5weSIsIGxpbmUgNDE5LCBpbiBfX2luaXRfXwo+ICAgICBOb3YgIDYgMDI6NTY6NDcgbGFnby1i YXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOgo+ICAgICBzZWxm LnNlcnZlcl9iaW5kKCkKPiAgICAgTm92ICA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFz dGVyLWhvc3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjoKPiAgICAgRmlsZSAiL3Vzci9saWI2NC9w eXRob24yLjcvd3NnaXJlZi9zaW1wbGVfc2VydmVyLnB5IiwgbGluZSA0OCwgaW4KPiAgICAgc2Vy dmVyX2JpbmQKPiAgICAgTm92ICA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhv c3QtMCBvdmlydC1pbWFnZWlvLWRhZW1vbjoKPiAgICAgSFRUUFNlcnZlci5zZXJ2ZXJfYmluZChz ZWxmKQo+ICAgICBOb3YgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0w IG92aXJ0LWltYWdlaW8tZGFlbW9uOgo+ICAgICBGaWxlICIvdXNyL2xpYjY0L3B5dGhvbjIuNy9C YXNlSFRUUFNlcnZlci5weSIsIGxpbmUgMTA4LCBpbgo+ICAgICBzZXJ2ZXJfYmluZAo+ICAgICBO b3YgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdl aW8tZGFlbW9uOgo+ICAgICBTb2NrZXRTZXJ2ZXIuVENQU2VydmVyLnNlcnZlcl9iaW5kKHNlbGYp Cj4gICAgIE5vdiAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3Zp cnQtaW1hZ2Vpby1kYWVtb246Cj4gICAgIEZpbGUgIi91c3IvbGliNjQvcHl0aG9uMi43L1NvY2tl dFNlcnZlci5weSIsIGxpbmUgNDMwLCBpbiBzZXJ2ZXJfYmluZAo+ICAgICBOb3YgIDYgMDI6NTY6 NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIG92aXJ0LWltYWdlaW8tZGFlbW9uOgo+ ICAgICBzZWxmLnNvY2tldC5iaW5kKHNlbGYuc2VydmVyX2FkZHJlc3MpCj4gICAgIE5vdiAgNiAw Mjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1kYWVt b246Cj4gICAgIEZpbGUgIi91c3IvbGliNjQvcHl0aG9uMi43L3NvY2tldC5weSIsIGxpbmUgMjI0 LCBpbiBtZXRoCj4gICAgIE5vdiAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1o b3N0LTAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246Cj4gICAgIHJldHVybiBnZXRhdHRyKHNlbGYuX3Nv Y2ssbmFtZSkoKmFyZ3MpCj4gICAgIE5vdiAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1h c3Rlci1ob3N0LTAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246Cj4gICAgIHNvY2tldC5lcnJvcjogW0Vy cm5vIDk4XSBBZGRyZXNzIGFscmVhZHkgaW4gdXNlCj4gICAgIE5vdiAgNiAwMjo1Njo0NyBsYWdv LWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAgc3lzdGVtZDoKPiAgICAgb3ZpcnQtaW1hZ2Vpby1k YWVtb24uc2VydmljZTogbWFpbiBwcm9jZXNzIGV4aXRlZCwgY29kZT1leGl0ZWQsCj4gICAgIHN0 YXR1cz0xL0ZBSUxVUkUKPgo+ICAgICBvdmlydC1ob3N0LWRlcGxveSBzdG9wcyBpdCwgYW5kIGlt bWVkaWF0ZWx5IHRyaWVzIHRvIHN0YXJ0IGl0Ogo+Cj4gICAgIDIwMTctMTEtMDYgMDI6NTY6NDcs MjAzLTA1MDAgREVCVUcKPiAgICAgb3RvcGkucGx1Z2lucy5vdG9waS5zZXJ2aWNlcy5zeXN0ZW1k IHBsdWdpbi5leGVjdXRlUmF3Ojg2Mwo+ICAgICBleGVjdXRlLXJlc3VsdDogKCcvdXNyL2Jpbi9z eXN0ZW1jdGwnLCAnc3RvcCcsCj4gICAgICdvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlJyks IHJjPTAKPiAgICAgLi4uCj4gICAgIDIwMTctMTEtMDYgMDI6NTY6NDcsNTUwLTA1MDAgREVCVUcK PiAgICAgb3RvcGkucGx1Z2lucy5vdG9waS5zZXJ2aWNlcy5zeXN0ZW1kIHBsdWdpbi5leGVjdXRl UmF3Ojg2Mwo+ICAgICBleGVjdXRlLXJlc3VsdDogKCcvdXNyL2Jpbi9zeXN0ZW1jdGwnLCAnc3Rh cnQnLAo+ICAgICAnb3ZpcnQtaW1hZ2Vpby1kYWVtb24uc2VydmljZScpLCByYz0xCj4KPiAgICAg QWxzbywgaW1hZ2Vpby1kYWVtb24ncyBsb2cgWzJdIGxvb2tzIGEgYml0IHdlaXJkIHRvIG1lIC0g aXQgaGFzIDUKPiAgICAgJ1N0YXJ0aW5nJyBsaW5lcywgYnV0IG5vCj4gICAgIG90aGVyIGxpbmVz IEkgd291bGQgaGF2ZSBleHBlY3RlZCB0byBoYXZlLCByZWFkaW5nIGl0cyBzb3VyY2UsIGFuZCBh cwo+ICAgICBJIGNhbiBzZWUgaW4gYW5vdGhlcgo+ICAgICBydW4sIHRoYXQgZGlkIGZpbmlzaCBz dWNjZXNzZnVsbHkgWzNdLgo+Cj4gICAgIEFkZGluZyBJZGFuLCBidXQgbm90IHN1cmUgaXQncyBh IGJ1ZyBpbiB0aGUgZGFlbW9uLgo+Cj4gICAgIFsxXQo+ICAgICBodHRwOi8vamVua2lucy5vdmly dC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjYvYXJ0aWZhY3Qv ZXhwb3J0ZWQtYXJ0aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMt c3VpdGUtbWFzdGVyL3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rl ci1ob3N0LTAvX3Zhcl9sb2cvCj4KPiAgICAgWzJdCj4gICAgIGh0dHA6Ly9qZW5raW5zLm92aXJ0 Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC9l eHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1z dWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVy LWhvc3QtMC9fdmFyX2xvZy9vdmlydC1pbWFnZWlvLWRhZW1vbi9kYWVtb24ubG9nCj4KPiAgICAg WzNdCj4gICAgIGh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5n ZS1xdWV1ZS10ZXN0ZXIvMzYyOC9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3Vp dC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0 cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMC9fdmFyX2xvZy9vdmlydC1pbWFn ZWlvLWRhZW1vbi9kYWVtb24ubG9nCj4KPgo+IExvb2tzIGxpa2UgdGhlIGRhZW1vbiBpcyBhbHJl YWR5IHJ1bm5pbmcgb24gdGhpcyBob3N0IC0gbWF5YmUgaG9zdCBkZXBsb3kKPiBpcyB0cnlpbmcg dG8gc3RhcnQgdGhlIHNlcnZpY2UgdHdpY2U/Cj4KPiBXZSBkaWQgbm90IGNoYW5nZSB0aGUgc3Rh cnR1cCBjb2RlIGNvdXBsZSBvZiB5ZWFycywgc28gdGhpcyBtdXN0IGJlIHNvbWUKPiBjaGFuZ2Ug aW4gYW5vdGhlciBjb21wb25lbnQuCj4KPiBUaGlzIHBhdGNoIHdpbGwgbWFrZSBpdCBlYXNpZXIg dG8gZGV0ZWN0IGZ1dHVyZSBpc3N1ZXMsIGxvZ2dpbmcgYW55IGVycm9yCj4gdG8gdGhlIGRhZW1v biBsb2cgZHVyaW5nIHN0YXJ0dXA6Cj4gaHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLzgzNjcwLwo+ Cj4gTmlyCj4gIAo+Cj4KPgo+ICAgICA+Pgo+ICAgICA+PiA8L2Vycm9yPgo+ICAgICA+Pgo+ICAg ICA+Pgo+ICAgICA+Cj4gICAgID4KPgo+Cj4KPiAgICAgLS0KPiAgICAgRGlkaQo+ICAgICBfX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+ICAgICBEZXZlbCBt YWlsaW5nIGxpc3QKPiAgICAgRGV2ZWxAb3ZpcnQub3JnIDxtYWlsdG86RGV2ZWxAb3ZpcnQub3Jn Pgo+ICAgICBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vZGV2ZWwKPgoK Ci0tLS0tLS0tLS0tLS0tQTY5MTBFM0FEMzI2N0UxRDVEQzFCRTRCCkNvbnRlbnQtVHlwZTogdGV4 dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDhiaXQKCjxo dG1sPgogIDxoZWFkPgogICAgPG1ldGEgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIiBjb250ZW50 PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPgogIDwvaGVhZD4KICA8Ym9keSB0ZXh0PSIjMDAw MDAwIiBiZ2NvbG9yPSIjRkZGRkZGIj4KICAgIDxkaXYgY2xhc3M9Im1vei1jaXRlLXByZWZpeCI+ d2UgaGFkIHRoZSBzYW1lIGZhaWx1cmUgdGhpcyBtb3JuaW5nOiA8YnI+CiAgICAgIDxicj4KICAg ICAgRmFpbGVkIGJ1aWxkOjxicj4KICAgICAgPGJyPgo8YSBjbGFzcz0ibW96LXR4dC1saW5rLWZy ZWV0ZXh0IiBocmVmPSJodHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9j aGFuZ2UtcXVldWUtdGVzdGVyLzM2NDYvIj5odHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292 aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2NDYvPC9hPjxicj4KICAgICAgPGJyPgog ICAgICBBbGwgTG9nczogPGJyPgogICAgICA8YnI+CjxhIGNsYXNzPSJtb3otdHh0LWxpbmstZnJl ZXRleHQiIGhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2No YW5nZS1xdWV1ZS10ZXN0ZXIvMzY0Ni9hcnRpZmFjdC8iPmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9y Zy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzY0Ni9hcnRpZmFjdC88L2E+ PGJyPgogICAgICA8YnI+CiAgICAgIGVuZ2luZSBsb2c6IDxicj4KICAgICAgPGJyPgo8YSBjbGFz cz0ibW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVmPSJodHRwOi8vamVua2lucy5vdmlydC5vcmcv am9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2NDYvYXJ0aWZhY3QvZXhwb3J0 ZWQtYXJ0aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMtc3VpdGUt bWFzdGVyL3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1lbmdp bmUvX3Zhcl9sb2cvb3ZpcnQtZW5naW5lL2hvc3QtZGVwbG95L292aXJ0LWhvc3QtZGVwbG95LTIw MTcxMTA3MDMwNDExLWxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMC01ZjkwYjIxMC5sb2ci Pmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10 ZXN0ZXIvMzY0Ni9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXIt ZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xh Z28tYmFzaWMtc3VpdGUtbWFzdGVyLWVuZ2luZS9fdmFyX2xvZy9vdmlydC1lbmdpbmUvaG9zdC1k ZXBsb3kvb3ZpcnQtaG9zdC1kZXBsb3ktMjAxNzExMDcwMzA0MTEtbGFnby1iYXNpYy1zdWl0ZS1t YXN0ZXItaG9zdC0wLTVmOTBiMjEwLmxvZzwvYT48YnI+CiAgICAgIDxicj4KICAgICAgaG9zdCBs b2dzOiA8YnI+CiAgICAgIDxicj4KPGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIgaHJl Zj0iaHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVl LXRlc3Rlci8zNjQ2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rl ci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkv bGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wL192YXJfbG9nLyI+aHR0cDovL2plbmtpbnMu b3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjQ2L2FydGlm YWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jh c2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1t YXN0ZXItaG9zdC0wL192YXJfbG9nLzwvYT48YnI+CiAgICAgIDxicj4KICAgICAgPGJyPgogICAg ICBPbiAxMS8wNi8yMDE3IDA4OjI2IFBNLCBOaXIgU29mZmVyIHdyb3RlOjxicj4KICAgIDwvZGl2 PgogICAgPGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSIKY2l0ZT0ibWlkOkNBTVJieXl1Zkw4UWFMZmdm ZFpEMi1WYnZUUnhiZ2JZM2s1XzJrSzdhaGEwWHZjUUFFZ0BtYWlsLmdtYWlsLmNvbSI+CiAgICAg IDxkaXYgZGlyPSJsdHIiPgogICAgICAgIDxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj4KICAgICAg ICAgIDxkaXYgZGlyPSJsdHIiPk9uIE1vbiwgTm92IDYsIDIwMTcgYXQgNDoxNiBQTSBZZWRpZHlh aCBCYXIKICAgICAgICAgICAgRGF2aWQgJmx0OzxhIGhyZWY9Im1haWx0bzpkaWRpQHJlZGhhdC5j b20iCiAgICAgICAgICAgICAgbW96LWRvLW5vdC1zZW5kPSJ0cnVlIj5kaWRpQHJlZGhhdC5jb208 L2E+Jmd0OyB3cm90ZTo8YnI+CiAgICAgICAgICA8L2Rpdj4KICAgICAgICAgIDxibG9ja3F1b3Rl IGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowIDAgMAogICAgICAgICAgICAuOGV4 O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPk9uIE1vbiwKICAg ICAgICAgICAgTm92IDYsIDIwMTcgYXQgMTo1NyBQTSwgRGFmbmEgUm9uICZsdDs8YQogICAgICAg ICAgICAgIGhyZWY9Im1haWx0bzpkcm9uQHJlZGhhdC5jb20iIHRhcmdldD0iX2JsYW5rIgogICAg ICAgICAgICAgIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+ZHJvbkByZWRoYXQuY29tPC9hPiZndDsg d3JvdGU6PGJyPgogICAgICAgICAgICAmZ3Q7IGFkZGluZyBEaWRpLjxicj4KICAgICAgICAgICAg Jmd0Ozxicj4KICAgICAgICAgICAgJmd0Ozxicj4KICAgICAgICAgICAgJmd0OyBPbiAxMS8wNi8y MDE3IDExOjUxIEFNLCBBbGEgSGlubyB3cm90ZTo8YnI+CiAgICAgICAgICAgICZndDs8YnI+CiAg ICAgICAgICAgICZndDsgU3VzcGVjdGVkIHBhdGNoICg8YQogICAgICAgICAgICAgIGhyZWY9Imh0 dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy8jL2MvODM2MTIvIgogICAgICAgICAgICAgIHJlbD0ibm9y ZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+aHR0cHM6Ly9n ZXJyaXQub3ZpcnQub3JnLyMvYy84MzYxMi88L2E+KQogICAgICAgICAgICBpcyBhYm91dCBjb2xk IG1lcmdlPGJyPgogICAgICAgICAgICAmZ3Q7IGFuZCBoYXMgbm90aGluZyB0byBkbyB3aXRoIGhv c3QgZGVwbG95Ljxicj4KICAgICAgICAgICAgJmd0Ozxicj4KICAgICAgICAgICAgJmd0OyBPbiBN b24sIE5vdiA2LCAyMDE3IGF0IDE6MzkgUE0sIERhZm5hIFJvbiAmbHQ7PGEKICAgICAgICAgICAg ICBocmVmPSJtYWlsdG86ZHJvbkByZWRoYXQuY29tIiB0YXJnZXQ9Il9ibGFuayIKICAgICAgICAg ICAgICBtb3otZG8tbm90LXNlbmQ9InRydWUiPmRyb25AcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3Rl Ojxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IEhpLDxi cj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IFdlIGZhaWxl ZCB0ZXN0IDAwMl9ib290c3RyYXAudmVyaWZ5X2FkZF9ob3N0czxicj4KICAgICAgICAgICAgJmd0 OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IEkgY2FuIHNlZSB3ZSBvbmx5IHRyaWVkIHRv IGluc3RhbGwgb25lIG9mIHRoZSBob3N0cwogICAgICAgICAgICAoaG9zdC0wKSBhbmQgZmFpbGVk Ljxicj4KICAgICAgICAgICAgJmd0OyZndDsgdGhlIHNlY29uZCBob3N0IGhhcyBubyBsb2cgd2hp Y2ggbWVhbnMgd2UgZGlkIG5vdAogICAgICAgICAgICB0cnkgdG8gZGVwbG95IGl0Ljxicj4KICAg ICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IFRoZSBlcnJvciBzdWdn ZXN0cyB0aGF0IHdlIG92aXJ0LWltYWdlaW8tZGFlbW9uCiAgICAgICAgICAgIGZhaWxlZCB0byBz dGFydC4gSG93ZXZlciw8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IHRoZXJlIGlzIGFub3RoZXIg bWVzc2FnZSB0aGF0IEkgdGhpbmsgc2hvdWxkIGJlCiAgICAgICAgICAgIGFkZHJlc3NlZCBhYm91 dCBjb25mbGljdGluZzxicj4KICAgICAgICAgICAgJmd0OyZndDsgdmRzbSBhbmQgbGlidmlydCBj b25maWd1cmF0aW9ucy48YnI+CiAgICAgICAgICAgICZndDsmZ3Q7PGJyPgogICAgICAgICAgICAm Z3Q7Jmd0OyBMaW5rIHRvIHN1c3BlY3RlZCBwYXRjaGVzOiA8YQogICAgICAgICAgICAgIGhyZWY9 Imh0dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy8jL2MvODM2MTIvIgogICAgICAgICAgICAgIHJlbD0i bm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+aHR0cHM6 Ly9nZXJyaXQub3ZpcnQub3JnLyMvYy84MzYxMi88L2E+PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0 Ozxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IExpbmsg dG8gSm9iOjxicj4KICAgICAgICAgICAgJmd0OyZndDsgPGEKaHJlZj0iaHR0cDovL2plbmtpbnMu b3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2LyIKICAg ICAgICAgICAgICByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIiBtb3otZG8tbm90LXNl bmQ9InRydWUiPmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5n ZS1xdWV1ZS10ZXN0ZXIvMzYyNi88L2E+PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAg ICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IExpbmsgdG8gYWxsIGxv Z3M6PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyA8YQpocmVmPSJodHRwOi8vamVua2lucy5vdmly dC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjYvYXJ0aWZhY3Qv IgogICAgICAgICAgICAgIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiIG1vei1kby1u b3Qtc2VuZD0idHJ1ZSI+aHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJf Y2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0LzwvYT48YnI+CiAgICAgICAgICAgICZn dDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAgICAgICAgICAgJmd0OyZndDsg PGEKaHJlZj0iaHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdl LXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0 LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3Ry YXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItZW5naW5lL192YXJfbG9nL292aXJ0LWVuZ2lu ZS9ob3N0LWRlcGxveS9vdmlydC1ob3N0LWRlcGxveS0yMDE3MTEwNjAyNTY0Ny1sYWdvLWJhc2lj LXN1aXRlLW1hc3Rlci1ob3N0LTAtNTUzMGFiMWYubG9nIgogICAgICAgICAgICAgIHJlbD0ibm9y ZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+aHR0cDovL2pl bmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2 L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9s b2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1z dWl0ZS1tYXN0ZXItZW5naW5lL192YXJfbG9nL292aXJ0LWVuZ2luZS9ob3N0LWRlcGxveS9vdmly dC1ob3N0LWRlcGxveS0yMDE3MTEwNjAyNTY0Ny1sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0 LTAtNTUzMGFiMWYubG9nPC9hPjxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAg ICAgICZndDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyAoUmVsZXZhbnQpIGVycm9yIHNu aXBwZXQgZnJvbSB0aGUgbG9nOjxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAg ICAgICZndDsmZ3Q7ICZsdDtlcnJvciZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7PGJyPgog ICAgICAgICAgICAmZ3Q7Jmd0OyBcPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAgICAg ICAgICAgJmd0OyZndDsgMjAxNy0xMS0wNiAwMjo1Njo0Niw1MjYtMDUwMCBERUJVRzxicj4KICAg ICAgICAgICAgJmd0OyZndDsgb3RvcGkucGx1Z2lucy5vdmlydF9ob3N0X2RlcGxveS52ZHNtLnBh Y2thZ2VzCiAgICAgICAgICAgIHBsdWdpbi5leGVjdXRlOjkyMTxicj4KICAgICAgICAgICAgJmd0 OyZndDsgZXhlY3V0ZS1vdXRwdXQ6ICgnL3Vzci9iaW4vdmRzbS10b29sJywgJ2NvbmZpZ3VyZScs CiAgICAgICAgICAgICctLWZvcmNlJykgc3Rkb3V0Ojxicj4KICAgICAgICAgICAgJmd0OyZndDs8 YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IENoZWNraW5nIGNvbmZpZ3VyYXRpb24gc3RhdHVzLi4u PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAgICAgICAgICAgJmd0OyZndDsgYWJydCBp cyBub3QgY29uZmlndXJlZCBmb3IgdmRzbTxicj4KICAgICAgICAgICAgJmd0OyZndDsgV0FSTklO RzogTFZNIGxvY2FsIGNvbmZpZ3VyYXRpb246CiAgICAgICAgICAgIC9ldGMvbHZtL2x2bWxvY2Fs LmNvbmYgaXMgbm90IGJhc2VkIG9uPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyB2ZHNtIGNvbmZp Z3VyYXRpb248YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IGx2bSByZXF1aXJlcyBjb25maWd1cmF0 aW9uPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBsaWJ2aXJ0IGlzIG5vdCBjb25maWd1cmVkIGZv ciB2ZHNtIHlldDxicj4KICAgICAgICAgICAgJmd0OyZndDsgRkFJTEVEOiBjb25mbGljdGluZyB2 ZHNtIGFuZCBsaWJ2aXJ0LXFlbXUgdGxzCiAgICAgICAgICAgIGNvbmZpZ3VyYXRpb24uPGJyPgog ICAgICAgICAgICAmZ3Q7Jmd0OyB2ZHNtLmNvbmYgd2l0aCBzc2w9VHJ1ZSByZXF1aXJlcyB0aGUg Zm9sbG93aW5nCiAgICAgICAgICAgIGNoYW5nZXM6PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBs aWJ2aXJ0ZC5jb25mOiBsaXN0ZW5fdGNwPTAsIGF1dGhfdGNwPSJzYXNsIiwKICAgICAgICAgICAg bGlzdGVuX3Rscz0xPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBxZW11LmNvbmY6IHNwaWNlX3Rs cz0xLjxicj4KICAgICAgICAgICAgJmd0OyZndDsgbXVsdGlwYXRoIHJlcXVpcmVzIGNvbmZpZ3Vy YXRpb248YnI+CiAgICAgICAgICAgICZndDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxi cj4KICAgICAgICAgICAgJmd0OyZndDsgMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTEtMDUwMCBERUJV RwogICAgICAgICAgICBvdG9waS5wbHVnaW5zLm90b3BpLnNlcnZpY2VzLnN5c3RlbWQ8YnI+CiAg ICAgICAgICAgICZndDsmZ3Q7IHBsdWdpbi5leGVjdXRlOjkyNiBleGVjdXRlLW91dHB1dDoKICAg ICAgICAgICAgKCcvdXNyL2Jpbi9zeXN0ZW1jdGwnLCAnc3RhcnQnLDxicj4KICAgICAgICAgICAg Jmd0OyZndDsgJ292aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UnKSBzdGRlcnI6PGJyPgogICAg ICAgICAgICAmZ3Q7Jmd0OyBKb2IgZm9yIG92aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UgZmFp bGVkIGJlY2F1c2UKICAgICAgICAgICAgdGhlIGNvbnRyb2wgcHJvY2Vzczxicj4KICAgICAgICAg ICAgJmd0OyZndDsgZXhpdGVkIHdpdGggZXJyb3IgY29kZS4gU2VlICJzeXN0ZW1jdGwgc3RhdHVz CiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UiPGJyPgogICAgICAgICAg ICAmZ3Q7Jmd0OyBhbmQgImpvdXJuYWxjdGwgLXhlIiBmb3IgZGV0YWlscy48YnI+CiAgICAgICAg ICAgICZndDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyAyMDE3LTExLTA2IDAyOjU2OjQ3 LDU1Mi0wNTAwIERFQlVHIG90b3BpLmNvbnRleHQ8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IGNv bnRleHQuX2V4ZWN1dGVNZXRob2Q6MTQzIG1ldGhvZCBleGNlcHRpb248YnI+CiAgICAgICAgICAg ICZndDsmZ3Q7IFRyYWNlYmFjayAobW9zdCByZWNlbnQgY2FsbCBsYXN0KTo8YnI+CiAgICAgICAg ICAgICZndDsmZ3Q7wqAgwqBGaWxlCiAgICAgICAgICAgICIvdG1wL292aXJ0LVI0UjhnWmhhUUkv cHl0aG9ubGliL290b3BpL2NvbnRleHQucHkiLCBsaW5lCiAgICAgICAgICAgIDEzMywgaW48YnI+ CiAgICAgICAgICAgICZndDsmZ3Q7IF9leGVjdXRlTWV0aG9kPGJyPgogICAgICAgICAgICAmZ3Q7 Jmd0O8KgIMKgIMKgbWV0aG9kWydtZXRob2QnXSgpPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0O8Kg IMKgRmlsZTxicj4KICAgICAgICAgICAgJmd0OyZndDsKIi90bXAvb3ZpcnQtUjRSOGdaaGFRSS9v dG9waS1wbHVnaW5zL292aXJ0LWhvc3QtZGVwbG95L3Zkc20vcGFja2FnZXMucHkiLDxicj4KICAg ICAgICAgICAgJmd0OyZndDsgbGluZSAxNzksIGluIF9zdGFydDxicj4KICAgICAgICAgICAgJmd0 OyZndDvCoCDCoCDCoHNlbGYuc2VydmljZXMuc3RhdGUoJ292aXJ0LWltYWdlaW8tZGFlbW9uJywK ICAgICAgICAgICAgVHJ1ZSk8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7wqAgwqBGaWxlCiAgICAg ICAgICAgICIvdG1wL292aXJ0LVI0UjhnWmhhUUkvb3RvcGktcGx1Z2lucy9vdG9waS9zZXJ2aWNl cy9zeXN0ZW1kLnB5Iiw8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IGxpbmUgMTQxLCBpbiBzdGF0 ZTxicj4KICAgICAgICAgICAgJmd0OyZndDvCoCDCoCDCoHNlcnZpY2U9bmFtZSw8YnI+CiAgICAg ICAgICAgICZndDsmZ3Q7IFJ1bnRpbWVFcnJvcjogRmFpbGVkIHRvIHN0YXJ0IHNlcnZpY2UKICAg ICAgICAgICAgJ292aXJ0LWltYWdlaW8tZGFlbW9uJzxicj4KICAgICAgICAgICAgJmd0OyZndDsg MjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTMtMDUwMCBFUlJPUiBvdG9waS5jb250ZXh0PGJyPgogICAg ICAgICAgICAmZ3Q7Jmd0OyBjb250ZXh0Ll9leGVjdXRlTWV0aG9kOjE1MiBGYWlsZWQgdG8gZXhl Y3V0ZSBzdGFnZQogICAgICAgICAgICAnQ2xvc2luZyB1cCc6IEZhaWxlZCB0bzxicj4KICAgICAg ICAgICAgJmd0OyZndDsgc3RhcnQgc2VydmljZSAnb3ZpcnQtaW1hZ2Vpby1kYWVtb24nPGJyPgog ICAgICAgICAgICA8YnI+CiAgICAgICAgICAgIEluIC92YXIvbG9nL21lc3NhZ2VzIG9mIHRoZSBo b3N0IFsxXSwgdGhlcmUgaXM6PGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICAgIE5vdsKg IDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIHN5c3RlbWQ6CiAgICAg ICAgICAgIFN0YXJ0aW5nIG9WaXJ0PGJyPgogICAgICAgICAgICBJbWFnZUlPIERhZW1vbi4uLjxi cj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1o b3N0LTAgcHl0aG9uOgogICAgICAgICAgICBkZXRlY3RlZDxicj4KICAgICAgICAgICAgdW5oYW5k bGVkIFB5dGhvbiBleGNlcHRpb24gaW4KICAgICAgICAgICAgJy91c3IvYmluL292aXJ0LWltYWdl aW8tZGFlbW9uJzxicj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1 aXRlLW1hc3Rlci1ob3N0LTAgcHl0aG9uOiBjYW4ndDxicj4KICAgICAgICAgICAgY29tbXVuaWNh dGUgd2l0aCBBQlJUIGRhZW1vbiwgaXMgaXQgcnVubmluZz8gW0Vycm5vIDJdIE5vCiAgICAgICAg ICAgIHN1Y2ggZmlsZSBvcjxicj4KICAgICAgICAgICAgZGlyZWN0b3J5PGJyPgogICAgICAgICAg ICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAg ICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAgICAgICAgICAgIFRyYWNlYmFjayAobW9z dCByZWNlbnQgY2FsbCBsYXN0KTo8YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFn by1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFl bW9uOjxicj4KICAgICAgICAgICAgRmlsZSAiL3Vzci9iaW4vb3ZpcnQtaW1hZ2Vpby1kYWVtb24i LCBsaW5lIDE0LCBpbgogICAgICAgICAgICAmbHQ7bW9kdWxlJmd0Ozxicj4KICAgICAgICAgICAg Tm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAgICAgICAg ICAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgogICAgICAgICAgICBzZXJ2ZXIubWFpbihzeXMu YXJndik8YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1t YXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4KICAgICAg ICAgICAgRmlsZQogICAgICAgICAgICAiL3Vzci9saWIvcHl0aG9uMi43L3NpdGUtcGFja2FnZXMv b3ZpcnRfaW1hZ2Vpb19kYWVtb24vc2VydmVyLnB5Iiw8YnI+CiAgICAgICAgICAgIGxpbmUgNTcs IGluIG1haW48YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0 ZS1tYXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4KICAg ICAgICAgICAgc3RhcnQoY29uZmlnKTxicj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1Njo0NyBs YWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAgICAgICAgICAgb3ZpcnQtaW1hZ2Vpby1k YWVtb246PGJyPgogICAgICAgICAgICBGaWxlCiAgICAgICAgICAgICIvdXNyL2xpYi9weXRob24y Ljcvc2l0ZS1wYWNrYWdlcy9vdmlydF9pbWFnZWlvX2RhZW1vbi9zZXJ2ZXIucHkiLDxicj4KICAg ICAgICAgICAgbGluZSA4NSwgaW4gc3RhcnQ8YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6 NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdl aW8tZGFlbW9uOjxicj4KICAgICAgICAgICAgV1NHSVJlcXVlc3RIYW5kbGVyKTxicj4KICAgICAg ICAgICAgTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAg ICAgICAgICAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgogICAgICAgICAgICBGaWxlICIvdXNy L2xpYjY0L3B5dGhvbjIuNy9Tb2NrZXRTZXJ2ZXIucHkiLCBsaW5lIDQxOSwgaW4KICAgICAgICAg ICAgX19pbml0X188YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1z dWl0ZS1tYXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4K ICAgICAgICAgICAgc2VsZi5zZXJ2ZXJfYmluZCgpPGJyPgogICAgICAgICAgICBOb3bCoCA2IDAy OjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmlydC1p bWFnZWlvLWRhZW1vbjo8YnI+CiAgICAgICAgICAgIEZpbGUgIi91c3IvbGliNjQvcHl0aG9uMi43 L3dzZ2lyZWYvc2ltcGxlX3NlcnZlci5weSIsIGxpbmUKICAgICAgICAgICAgNDgsIGluPGJyPgog ICAgICAgICAgICBzZXJ2ZXJfYmluZDxicj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1Njo0NyBs YWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAgICAgICAgICAgb3ZpcnQtaW1hZ2Vpby1k YWVtb246PGJyPgogICAgICAgICAgICBIVFRQU2VydmVyLnNlcnZlcl9iaW5kKHNlbGYpPGJyPgog ICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3Qt MAogICAgICAgICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAgICAgICAgICAgIEZpbGUg Ii91c3IvbGliNjQvcHl0aG9uMi43L0Jhc2VIVFRQU2VydmVyLnB5IiwgbGluZSAxMDgsIGluPGJy PgogICAgICAgICAgICBzZXJ2ZXJfYmluZDxicj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1Njo0 NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAgICAgICAgICAgb3ZpcnQtaW1hZ2Vp by1kYWVtb246PGJyPgogICAgICAgICAgICBTb2NrZXRTZXJ2ZXIuVENQU2VydmVyLnNlcnZlcl9i aW5kKHNlbGYpPGJyPgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3Vp dGUtbWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAg ICAgICAgICAgIEZpbGUgIi91c3IvbGliNjQvcHl0aG9uMi43L1NvY2tldFNlcnZlci5weSIsIGxp bmUgNDMwLCBpbgogICAgICAgICAgICBzZXJ2ZXJfYmluZDxicj4KICAgICAgICAgICAgTm92wqAg NiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAgICAgICAgICAgb3Zp cnQtaW1hZ2Vpby1kYWVtb246PGJyPgogICAgICAgICAgICBzZWxmLnNvY2tldC5iaW5kKHNlbGYu c2VydmVyX2FkZHJlc3MpPGJyPgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFz aWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8 YnI+CiAgICAgICAgICAgIEZpbGUgIi91c3IvbGliNjQvcHl0aG9uMi43L3NvY2tldC5weSIsIGxp bmUgMjI0LCBpbiBtZXRoPGJyPgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFz aWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8 YnI+CiAgICAgICAgICAgIHJldHVybiBnZXRhdHRyKHNlbGYuX3NvY2ssbmFtZSkoKmFyZ3MpPGJy PgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhv c3QtMAogICAgICAgICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAgICAgICAgICAgIHNv Y2tldC5lcnJvcjogW0Vycm5vIDk4XSBBZGRyZXNzIGFscmVhZHkgaW4gdXNlPGJyPgogICAgICAg ICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMCBzeXN0 ZW1kOjxicj4KICAgICAgICAgICAgb3ZpcnQtaW1hZ2Vpby1kYWVtb24uc2VydmljZTogbWFpbiBw cm9jZXNzIGV4aXRlZCwKICAgICAgICAgICAgY29kZT1leGl0ZWQsPGJyPgogICAgICAgICAgICBz dGF0dXM9MS9GQUlMVVJFPGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICAgIG92aXJ0LWhv c3QtZGVwbG95IHN0b3BzIGl0LCBhbmQgaW1tZWRpYXRlbHkgdHJpZXMgdG8gc3RhcnQKICAgICAg ICAgICAgaXQ6PGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICAgIDIwMTctMTEtMDYgMDI6 NTY6NDcsMjAzLTA1MDAgREVCVUc8YnI+CiAgICAgICAgICAgIG90b3BpLnBsdWdpbnMub3RvcGku c2VydmljZXMuc3lzdGVtZCBwbHVnaW4uZXhlY3V0ZVJhdzo4NjM8YnI+CiAgICAgICAgICAgIGV4 ZWN1dGUtcmVzdWx0OiAoJy91c3IvYmluL3N5c3RlbWN0bCcsICdzdG9wJyw8YnI+CiAgICAgICAg ICAgICdvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlJyksIHJjPTA8YnI+CiAgICAgICAgICAg IC4uLjxicj4KICAgICAgICAgICAgMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTAtMDUwMCBERUJVRzxi cj4KICAgICAgICAgICAgb3RvcGkucGx1Z2lucy5vdG9waS5zZXJ2aWNlcy5zeXN0ZW1kIHBsdWdp bi5leGVjdXRlUmF3Ojg2Mzxicj4KICAgICAgICAgICAgZXhlY3V0ZS1yZXN1bHQ6ICgnL3Vzci9i aW4vc3lzdGVtY3RsJywgJ3N0YXJ0Jyw8YnI+CiAgICAgICAgICAgICdvdmlydC1pbWFnZWlvLWRh ZW1vbi5zZXJ2aWNlJyksIHJjPTE8YnI+CiAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgQWxz bywgaW1hZ2Vpby1kYWVtb24ncyBsb2cgWzJdIGxvb2tzIGEgYml0IHdlaXJkIHRvIG1lIC0gaXQK ICAgICAgICAgICAgaGFzIDU8YnI+CiAgICAgICAgICAgICdTdGFydGluZycgbGluZXMsIGJ1dCBu bzxicj4KICAgICAgICAgICAgb3RoZXIgbGluZXMgSSB3b3VsZCBoYXZlIGV4cGVjdGVkIHRvIGhh dmUsIHJlYWRpbmcgaXRzCiAgICAgICAgICAgIHNvdXJjZSwgYW5kIGFzPGJyPgogICAgICAgICAg ICBJIGNhbiBzZWUgaW4gYW5vdGhlcjxicj4KICAgICAgICAgICAgcnVuLCB0aGF0IGRpZCBmaW5p c2ggc3VjY2Vzc2Z1bGx5IFszXS48YnI+CiAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgQWRk aW5nIElkYW4sIGJ1dCBub3Qgc3VyZSBpdCdzIGEgYnVnIGluIHRoZSBkYWVtb24uPGJyPgogICAg ICAgICAgICA8YnI+CiAgICAgICAgICAgIFsxXSA8YQpocmVmPSJodHRwOi8vamVua2lucy5vdmly dC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjYvYXJ0aWZhY3Qv ZXhwb3J0ZWQtYXJ0aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMt c3VpdGUtbWFzdGVyL3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rl ci1ob3N0LTAvX3Zhcl9sb2cvIgogICAgICAgICAgICAgIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0 PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+aHR0cDovL2plbmtpbnMub3ZpcnQub3Jn L2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0L2V4cG9y dGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRl LW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9z dC0wL192YXJfbG9nLzwvYT48YnI+CiAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgWzJdIDxh CmhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1x dWV1ZS10ZXN0ZXIvMzYyNi9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1t YXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFw LnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMC9fdmFyX2xvZy9vdmlydC1pbWFnZWlv LWRhZW1vbi9kYWVtb24ubG9nIgogICAgICAgICAgICAgIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0 PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+aHR0cDovL2plbmtpbnMub3ZpcnQub3Jn L2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0L2V4cG9y dGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRl LW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9z dC0wL192YXJfbG9nL292aXJ0LWltYWdlaW8tZGFlbW9uL2RhZW1vbi5sb2c8L2E+PGJyPgogICAg ICAgICAgICA8YnI+CiAgICAgICAgICAgIFszXSA8YQpocmVmPSJodHRwOi8vamVua2lucy5vdmly dC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjgvYXJ0aWZhY3Qv ZXhwb3J0ZWQtYXJ0aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMt c3VpdGUtbWFzdGVyL3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rl ci1ob3N0LTAvX3Zhcl9sb2cvb3ZpcnQtaW1hZ2Vpby1kYWVtb24vZGFlbW9uLmxvZyIKICAgICAg ICAgICAgICByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIiBtb3otZG8tbm90LXNlbmQ9 InRydWUiPmh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1x dWV1ZS10ZXN0ZXIvMzYyOC9hcnRpZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1t YXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFw LnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMC9fdmFyX2xvZy9vdmlydC1pbWFnZWlv LWRhZW1vbi9kYWVtb24ubG9nPC9hPjwvYmxvY2txdW90ZT4KICAgICAgICAgIDxkaXY+PGJyPgog ICAgICAgICAgPC9kaXY+CiAgICAgICAgICA8ZGl2Pkxvb2tzIGxpa2UgdGhlIGRhZW1vbiBpcyBh bHJlYWR5IHJ1bm5pbmcgb24gdGhpcyBob3N0IC0KICAgICAgICAgICAgbWF5YmUgaG9zdCBkZXBs b3k8L2Rpdj4KICAgICAgICAgIDxkaXY+aXMgdHJ5aW5nIHRvIHN0YXJ0IHRoZSBzZXJ2aWNlIHR3 aWNlPzwvZGl2PgogICAgICAgICAgPGRpdj48YnI+CiAgICAgICAgICA8L2Rpdj4KICAgICAgICAg IDxkaXY+V2UgZGlkIG5vdCBjaGFuZ2UgdGhlIHN0YXJ0dXAgY29kZSBjb3VwbGUgb2YgeWVhcnMs IHNvCiAgICAgICAgICAgIHRoaXMgbXVzdCBiZSBzb21lPC9kaXY+CiAgICAgICAgICA8ZGl2PmNo YW5nZSBpbiBhbm90aGVyIGNvbXBvbmVudC48L2Rpdj4KICAgICAgICAgIDxkaXY+PGJyPgogICAg ICAgICAgPC9kaXY+CiAgICAgICAgICA8ZGl2PlRoaXMgcGF0Y2ggd2lsbCBtYWtlIGl0IGVhc2ll ciB0byBkZXRlY3QgZnV0dXJlIGlzc3VlcywKICAgICAgICAgICAgbG9nZ2luZyBhbnkgZXJyb3I8 L2Rpdj4KICAgICAgICAgIDxkaXY+dG8gdGhlIGRhZW1vbiBsb2cgZHVyaW5nIHN0YXJ0dXA6PC9k aXY+CiAgICAgICAgICA8ZGl2PjxhIGhyZWY9Imh0dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy84MzY3 MC8iCiAgICAgICAgICAgICAgbW96LWRvLW5vdC1zZW5kPSJ0cnVlIj5odHRwczovL2dlcnJpdC5v dmlydC5vcmcvODM2NzAvPC9hPjxicj4KICAgICAgICAgIDwvZGl2PgogICAgICAgICAgPGRpdj48 YnI+CiAgICAgICAgICA8L2Rpdj4KICAgICAgICAgIDxkaXY+TmlyPC9kaXY+CiAgICAgICAgICA8 ZGl2PsKgPC9kaXY+CiAgICAgICAgICA8YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0 eWxlPSJtYXJnaW46MCAwIDAKICAgICAgICAgICAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBz b2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij48YnI+CiAgICAgICAgICAgIDxicj4KICAgICAgICAgICAg Jmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7ICZsdDsvZXJyb3ImZ3Q7PGJyPgogICAg ICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAg ICZndDs8YnI+CiAgICAgICAgICAgICZndDs8YnI+CiAgICAgICAgICAgIDxicj4KICAgICAgICAg ICAgPGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICAgIC0tPGJyPgogICAgICAgICAgICBE aWRpPGJyPgogICAgICAgICAgICBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fXzxicj4KICAgICAgICAgICAgRGV2ZWwgbWFpbGluZyBsaXN0PGJyPgogICAgICAg ICAgICA8YSBocmVmPSJtYWlsdG86RGV2ZWxAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayIKICAg ICAgICAgICAgICBtb3otZG8tbm90LXNlbmQ9InRydWUiPkRldmVsQG92aXJ0Lm9yZzwvYT48YnI+ CiAgICAgICAgICAgIDxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0 aW5mby9kZXZlbCIKICAgICAgICAgICAgICByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5r IiBtb3otZG8tbm90LXNlbmQ9InRydWUiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9s aXN0aW5mby9kZXZlbDwvYT48YnI+CiAgICAgICAgICA8L2Jsb2NrcXVvdGU+CiAgICAgICAgPC9k aXY+CiAgICAgIDwvZGl2PgogICAgPC9ibG9ja3F1b3RlPgogICAgPHA+PGJyPgogICAgPC9wPgog IDwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS1BNjkxMEUzQUQzMjY3RTFENURDMUJFNEIt LQo= --===============4941397867394669870==-- From nsoffer at redhat.com Tue Nov 7 11:40:06 2017 Content-Type: multipart/mixed; boundary="===============1025079295088003895==" MIME-Version: 1.0 From: Nir Soffer To: devel at ovirt.org Subject: Re: [ovirt-devel] [ OST Failure Report ] [ oVirt Master ] [ 06-11-2017 ] [ 002_bootstrap.verify_add_hosts ] Date: Tue, 07 Nov 2017 11:39:55 +0000 Message-ID: In-Reply-To: e3e23875-301e-9735-e956-286df2c81537@redhat.com --===============1025079295088003895== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This still use the older daemon, the patch improving logging was merged today at 13:02 Please check again with current version. On Tue, Nov 7, 2017 at 11:54 AM Dafna Ron wrote: > we had the same failure this morning: > > Failed build: > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3646/ > > All Logs: > > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3646/artifa= ct/ > > engine log: > > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3646/artifa= ct/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/po= st-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/ho= st-deploy/ovirt-host-deploy-20171107030411-lago-basic-suite-master-host-0-5= f90b210.log > > host logs: > > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3646/artifa= ct/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/po= st-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ > > > > On 11/06/2017 08:26 PM, Nir Soffer wrote: > > On Mon, Nov 6, 2017 at 4:16 PM Yedidyah Bar David wro= te: > >> On Mon, Nov 6, 2017 at 1:57 PM, Dafna Ron wrote: >> > adding Didi. >> > >> > >> > On 11/06/2017 11:51 AM, Ala Hino wrote: >> > >> > Suspected patch (https://gerrit.ovirt.org/#/c/83612/) is about cold >> merge >> > and has nothing to do with host deploy. >> > >> > On Mon, Nov 6, 2017 at 1:39 PM, Dafna Ron wrote: >> >> >> >> Hi, >> >> >> >> We failed test 002_bootstrap.verify_add_hosts >> >> >> >> I can see we only tried to install one of the hosts (host-0) and >> failed. >> >> the second host has no log which means we did not try to deploy it. >> >> >> >> The error suggests that we ovirt-imageio-daemon failed to start. >> However, >> >> there is another message that I think should be addressed about >> conflicting >> >> vdsm and libvirt configurations. >> >> >> >> Link to suspected patches: https://gerrit.ovirt.org/#/c/83612/ >> >> >> >> >> >> Link to Job: >> >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/ >> >> >> >> >> >> Link to all logs: >> >> >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artif= act/ >> >> >> >> >> >> >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artif= act/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/p= ost-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/h= ost-deploy/ovirt-host-deploy-20171106025647-lago-basic-suite-master-host-0-= 5530ab1f.log >> >> >> >> >> >> (Relevant) error snippet from the log: >> >> >> >> >> >> >> >> \ >> >> >> >> 2017-11-06 02:56:46,526-0500 DEBUG >> >> otopi.plugins.ovirt_host_deploy.vdsm.packages plugin.execute:921 >> >> execute-output: ('/usr/bin/vdsm-tool', 'configure', '--force') stdout: >> >> >> >> Checking configuration status... >> >> >> >> abrt is not configured for vdsm >> >> WARNING: LVM local configuration: /etc/lvm/lvmlocal.conf is not based >> on >> >> vdsm configuration >> >> lvm requires configuration >> >> libvirt is not configured for vdsm yet >> >> FAILED: conflicting vdsm and libvirt-qemu tls configuration. >> >> vdsm.conf with ssl=3DTrue requires the following changes: >> >> libvirtd.conf: listen_tcp=3D0, auth_tcp=3D"sasl", listen_tls=3D1 >> >> qemu.conf: spice_tls=3D1. >> >> multipath requires configuration >> >> >> >> >> >> 2017-11-06 02:56:47,551-0500 DEBUG otopi.plugins.otopi.services.syste= md >> >> plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', >> >> 'ovirt-imageio-daemon.service') stderr: >> >> Job for ovirt-imageio-daemon.service failed because the control proce= ss >> >> exited with error code. See "systemctl status >> ovirt-imageio-daemon.service" >> >> and "journalctl -xe" for details. >> >> >> >> 2017-11-06 02:56:47,552-0500 DEBUG otopi.context >> >> context._executeMethod:143 method exception >> >> Traceback (most recent call last): >> >> File "/tmp/ovirt-R4R8gZhaQI/pythonlib/otopi/context.py", line 133, = in >> >> _executeMethod >> >> method['method']() >> >> File >> >> >> "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/ovirt-host-deploy/vdsm/packages.py", >> >> line 179, in _start >> >> self.services.state('ovirt-imageio-daemon', True) >> >> File "/tmp/ovirt-R4R8gZhaQI/otopi-plugins/otopi/services/systemd.py= ", >> >> line 141, in state >> >> service=3Dname, >> >> RuntimeError: Failed to start service 'ovirt-imageio-daemon' >> >> 2017-11-06 02:56:47,553-0500 ERROR otopi.context >> >> context._executeMethod:152 Failed to execute stage 'Closing up': >> Failed to >> >> start service 'ovirt-imageio-daemon' >> >> In /var/log/messages of the host [1], there is: >> >> Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: Starting oVirt >> ImageIO Daemon... >> Nov 6 02:56:47 lago-basic-suite-master-host-0 python: detected >> unhandled Python exception in '/usr/bin/ovirt-imageio-daemon' >> Nov 6 02:56:47 lago-basic-suite-master-host-0 python: can't >> communicate with ABRT daemon, is it running? [Errno 2] No such file or >> directory >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> Traceback (most recent call last): >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> File "/usr/bin/ovirt-imageio-daemon", line 14, in >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> server.main(sys.argv) >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", >> line 57, in main >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> start(config) >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", >> line 85, in start >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> WSGIRequestHandler) >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__ >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> self.server_bind() >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 48, in >> server_bind >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> HTTPServer.server_bind(self) >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in >> server_bind >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> SocketServer.TCPServer.server_bind(self) >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> self.socket.bind(self.server_address) >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> File "/usr/lib64/python2.7/socket.py", line 224, in meth >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> return getattr(self._sock,name)(*args) >> Nov 6 02:56:47 lago-basic-suite-master-host-0 ovirt-imageio-daemon: >> socket.error: [Errno 98] Address already in use >> Nov 6 02:56:47 lago-basic-suite-master-host-0 systemd: >> ovirt-imageio-daemon.service: main process exited, code=3Dexited, >> status=3D1/FAILURE >> >> ovirt-host-deploy stops it, and immediately tries to start it: >> >> 2017-11-06 02:56:47,203-0500 DEBUG >> otopi.plugins.otopi.services.systemd plugin.executeRaw:863 >> execute-result: ('/usr/bin/systemctl', 'stop', >> 'ovirt-imageio-daemon.service'), rc=3D0 >> ... >> 2017-11-06 02:56:47,550-0500 DEBUG >> otopi.plugins.otopi.services.systemd plugin.executeRaw:863 >> execute-result: ('/usr/bin/systemctl', 'start', >> 'ovirt-imageio-daemon.service'), rc=3D1 >> >> Also, imageio-daemon's log [2] looks a bit weird to me - it has 5 >> 'Starting' lines, but no >> other lines I would have expected to have, reading its source, and as >> I can see in another >> run, that did finish successfully [3]. >> >> Adding Idan, but not sure it's a bug in the daemon. >> >> [1] >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artif= act/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/p= ost-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ >> >> [2] >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3626/artif= act/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/p= ost-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-imageio-= daemon/daemon.log >> >> [3] >> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3628/artif= act/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/p= ost-002_bootstrap.py/lago-basic-suite-master-host-0/_var_log/ovirt-imageio-= daemon/daemon.log > > > Looks like the daemon is already running on this host - maybe host deploy > is trying to start the service twice? > > We did not change the startup code couple of years, so this must be some > change in another component. > > This patch will make it easier to detect future issues, logging any error > to the daemon log during startup: > https://gerrit.ovirt.org/83670/ > > Nir > > >> >> >> >> >> >> >> >> >> >> >> > >> > >> >> >> >> -- >> Didi >> _______________________________________________ >> Devel mailing list >> Devel(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/devel >> > > --===============1025079295088003895== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+VGhpcyBzdGlsbCB1c2UgdGhlIG9sZGVyIGRhZW1vbiwgdGhlIHBhdGNo IGltcHJvdmluZyBsb2dnaW5nIHdhcyBtZXJnZWQgdG9kYXkgYXQgMTM6MDI8ZGl2PlBsZWFzZSBj aGVjayBhZ2FpbiB3aXRoIGN1cnJlbnQgdmVyc2lvbi48L2Rpdj48L2Rpdj48YnI+PGRpdiBjbGFz cz0iZ21haWxfcXVvdGUiPjxkaXYgZGlyPSJsdHIiPk9uIFR1ZSwgTm92IDcsIDIwMTcgYXQgMTE6 NTQgQU0gRGFmbmEgUm9uICZsdDs8YSBocmVmPSJtYWlsdG86ZHJvbkByZWRoYXQuY29tIj5kcm9u QHJlZGhhdC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+PC9kaXY+PGJsb2NrcXVvdGUgY2xhc3M9Imdt YWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6MXB4ICNjY2Mg c29saWQ7cGFkZGluZy1sZWZ0OjFleCI+CiAgCiAgICAKICAKICA8ZGl2IHRleHQ9IiMwMDAwMDAi IGJnY29sb3I9IiNGRkZGRkYiPgogICAgPGRpdiBjbGFzcz0ibV8xNTI0MDQwODA0OTYxOTM5MDcx bW96LWNpdGUtcHJlZml4Ij53ZSBoYWQgdGhlIHNhbWUgZmFpbHVyZSB0aGlzIG1vcm5pbmc6IDxi cj4KICAgICAgPGJyPgogICAgICBGYWlsZWQgYnVpbGQ6PGJyPgogICAgICA8YnI+CjxhIGNsYXNz PSJtXzE1MjQwNDA4MDQ5NjE5MzkwNzFtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0dHA6 Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIv MzY0Ni8iIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0 LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2NDYvPC9hPjxicj4KICAgICAgPGJyPgogICAg ICBBbGwgTG9nczogPGJyPgogICAgICA8YnI+CjxhIGNsYXNzPSJtXzE1MjQwNDA4MDQ5NjE5Mzkw NzFtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0Lm9yZy9q b2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzY0Ni9hcnRpZmFjdC8iIHRhcmdl dD0iX2JsYW5rIj5odHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFu Z2UtcXVldWUtdGVzdGVyLzM2NDYvYXJ0aWZhY3QvPC9hPjxicj4KICAgICAgPGJyPgogICAgICBl bmdpbmUgbG9nOiA8YnI+CiAgICAgIDxicj4KPGEgY2xhc3M9Im1fMTUyNDA0MDgwNDk2MTkzOTA3 MW1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0iaHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pv Yi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjQ2L2FydGlmYWN0L2V4cG9ydGVk LWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1h c3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItZW5naW5l L192YXJfbG9nL292aXJ0LWVuZ2luZS9ob3N0LWRlcGxveS9vdmlydC1ob3N0LWRlcGxveS0yMDE3 MTEwNzAzMDQxMS1sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAtNWY5MGIyMTAubG9nIiB0 YXJnZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJf Y2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjQ2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNp Yy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9i b290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItZW5naW5lL192YXJfbG9nL292aXJ0 LWVuZ2luZS9ob3N0LWRlcGxveS9vdmlydC1ob3N0LWRlcGxveS0yMDE3MTEwNzAzMDQxMS1sYWdv LWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAtNWY5MGIyMTAubG9nPC9hPjxicj4KICAgICAgPGJy PgogICAgICBob3N0IGxvZ3M6IDxicj4KICAgICAgPGJyPgo8YSBjbGFzcz0ibV8xNTI0MDQwODA0 OTYxOTM5MDcxbW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVmPSJodHRwOi8vamVua2lucy5vdmly dC5vcmcvam9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2NDYvYXJ0aWZhY3Qv ZXhwb3J0ZWQtYXJ0aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMt c3VpdGUtbWFzdGVyL3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rl ci1ob3N0LTAvX3Zhcl9sb2cvIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMub3ZpcnQu b3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjQ2L2FydGlmYWN0L2V4 cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1 aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXIt aG9zdC0wL192YXJfbG9nLzwvYT48L2Rpdj48L2Rpdj48ZGl2IHRleHQ9IiMwMDAwMDAiIGJnY29s b3I9IiNGRkZGRkYiPjxkaXYgY2xhc3M9Im1fMTUyNDA0MDgwNDk2MTkzOTA3MW1vei1jaXRlLXBy ZWZpeCI+PGJyPgogICAgICA8YnI+CiAgICAgIDxicj4KICAgICAgT24gMTEvMDYvMjAxNyAwODoy NiBQTSwgTmlyIFNvZmZlciB3cm90ZTo8YnI+CiAgICA8L2Rpdj48L2Rpdj48ZGl2IHRleHQ9IiMw MDAwMDAiIGJnY29sb3I9IiNGRkZGRkYiPgogICAgPGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+CiAg ICAgIDxkaXYgZGlyPSJsdHIiPgogICAgICAgIDxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj4KICAg ICAgICAgIDxkaXYgZGlyPSJsdHIiPk9uIE1vbiwgTm92IDYsIDIwMTcgYXQgNDoxNiBQTSBZZWRp ZHlhaCBCYXIKICAgICAgICAgICAgRGF2aWQgJmx0OzxhIGhyZWY9Im1haWx0bzpkaWRpQHJlZGhh dC5jb20iIHRhcmdldD0iX2JsYW5rIj5kaWRpQHJlZGhhdC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+ CiAgICAgICAgICA8L2Rpdj4KICAgICAgICAgIDxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90 ZSIgc3R5bGU9Im1hcmdpbjowIDAgMCAuOGV4O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3Bh ZGRpbmctbGVmdDoxZXgiPk9uIE1vbiwKICAgICAgICAgICAgTm92IDYsIDIwMTcgYXQgMTo1NyBQ TSwgRGFmbmEgUm9uICZsdDs8YSBocmVmPSJtYWlsdG86ZHJvbkByZWRoYXQuY29tIiB0YXJnZXQ9 Il9ibGFuayI+ZHJvbkByZWRoYXQuY29tPC9hPiZndDsgd3JvdGU6PGJyPgogICAgICAgICAgICAm Z3Q7IGFkZGluZyBEaWRpLjxicj4KICAgICAgICAgICAgJmd0Ozxicj4KICAgICAgICAgICAgJmd0 Ozxicj4KICAgICAgICAgICAgJmd0OyBPbiAxMS8wNi8yMDE3IDExOjUxIEFNLCBBbGEgSGlubyB3 cm90ZTo8YnI+CiAgICAgICAgICAgICZndDs8YnI+CiAgICAgICAgICAgICZndDsgU3VzcGVjdGVk IHBhdGNoICg8YSBocmVmPSJodHRwczovL2dlcnJpdC5vdmlydC5vcmcvIy9jLzgzNjEyLyIgcmVs PSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9nZXJyaXQub3ZpcnQub3JnLyMv Yy84MzYxMi88L2E+KQogICAgICAgICAgICBpcyBhYm91dCBjb2xkIG1lcmdlPGJyPgogICAgICAg ICAgICAmZ3Q7IGFuZCBoYXMgbm90aGluZyB0byBkbyB3aXRoIGhvc3QgZGVwbG95Ljxicj4KICAg ICAgICAgICAgJmd0Ozxicj4KICAgICAgICAgICAgJmd0OyBPbiBNb24sIE5vdiA2LCAyMDE3IGF0 IDE6MzkgUE0sIERhZm5hIFJvbiAmbHQ7PGEgaHJlZj0ibWFpbHRvOmRyb25AcmVkaGF0LmNvbSIg dGFyZ2V0PSJfYmxhbmsiPmRyb25AcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3RlOjxicj4KICAgICAg ICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IEhpLDxicj4KICAgICAgICAg ICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IFdlIGZhaWxlZCB0ZXN0IDAwMl9i b290c3RyYXAudmVyaWZ5X2FkZF9ob3N0czxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAg ICAgICAgICAgICZndDsmZ3Q7IEkgY2FuIHNlZSB3ZSBvbmx5IHRyaWVkIHRvIGluc3RhbGwgb25l IG9mIHRoZSBob3N0cwogICAgICAgICAgICAoaG9zdC0wKSBhbmQgZmFpbGVkLjxicj4KICAgICAg ICAgICAgJmd0OyZndDsgdGhlIHNlY29uZCBob3N0IGhhcyBubyBsb2cgd2hpY2ggbWVhbnMgd2Ug ZGlkIG5vdAogICAgICAgICAgICB0cnkgdG8gZGVwbG95IGl0Ljxicj4KICAgICAgICAgICAgJmd0 OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IFRoZSBlcnJvciBzdWdnZXN0cyB0aGF0IHdl IG92aXJ0LWltYWdlaW8tZGFlbW9uCiAgICAgICAgICAgIGZhaWxlZCB0byBzdGFydC4gSG93ZXZl ciw8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IHRoZXJlIGlzIGFub3RoZXIgbWVzc2FnZSB0aGF0 IEkgdGhpbmsgc2hvdWxkIGJlCiAgICAgICAgICAgIGFkZHJlc3NlZCBhYm91dCBjb25mbGljdGlu Zzxicj4KICAgICAgICAgICAgJmd0OyZndDsgdmRzbSBhbmQgbGlidmlydCBjb25maWd1cmF0aW9u cy48YnI+CiAgICAgICAgICAgICZndDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBMaW5r IHRvIHN1c3BlY3RlZCBwYXRjaGVzOiA8YSBocmVmPSJodHRwczovL2dlcnJpdC5vdmlydC5vcmcv Iy9jLzgzNjEyLyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9nZXJy aXQub3ZpcnQub3JnLyMvYy84MzYxMi88L2E+PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4K ICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IExpbmsgdG8gSm9i Ojxicj4KICAgICAgICAgICAgJmd0OyZndDsgPGEgaHJlZj0iaHR0cDovL2plbmtpbnMub3ZpcnQu b3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2LyIgcmVsPSJub3Jl ZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmly dC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2LzwvYT48YnI+CiAgICAgICAgICAgICZn dDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAgICAgICAgICAgJmd0OyZndDsg TGluayB0byBhbGwgbG9nczo8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IDxhIGhyZWY9Imh0dHA6 Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIv MzYyNi9hcnRpZmFjdC8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9q ZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYy Ni9hcnRpZmFjdC88L2E+PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAgICAgICAgICAg Jmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IDxhIGhyZWY9Imh0dHA6Ly9qZW5raW5z Lm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRp ZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9i YXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUt bWFzdGVyLWVuZ2luZS9fdmFyX2xvZy9vdmlydC1lbmdpbmUvaG9zdC1kZXBsb3kvb3ZpcnQtaG9z dC1kZXBsb3ktMjAxNzExMDYwMjU2NDctbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wLTU1 MzBhYjFmLmxvZyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2plbmtp bnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2Fy dGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dz L2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0 ZS1tYXN0ZXItZW5naW5lL192YXJfbG9nL292aXJ0LWVuZ2luZS9ob3N0LWRlcGxveS9vdmlydC1o b3N0LWRlcGxveS0yMDE3MTEwNjAyNTY0Ny1sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAt NTUzMGFiMWYubG9nPC9hPjxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAg ICZndDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyAoUmVsZXZhbnQpIGVycm9yIHNuaXBw ZXQgZnJvbSB0aGUgbG9nOjxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAg ICZndDsmZ3Q7ICZsdDtlcnJvciZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7PGJyPgogICAg ICAgICAgICAmZ3Q7Jmd0OyBcPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAgICAgICAg ICAgJmd0OyZndDsgMjAxNy0xMS0wNiAwMjo1Njo0Niw1MjYtMDUwMCBERUJVRzxicj4KICAgICAg ICAgICAgJmd0OyZndDsgb3RvcGkucGx1Z2lucy5vdmlydF9ob3N0X2RlcGxveS52ZHNtLnBhY2th Z2VzCiAgICAgICAgICAgIHBsdWdpbi5leGVjdXRlOjkyMTxicj4KICAgICAgICAgICAgJmd0OyZn dDsgZXhlY3V0ZS1vdXRwdXQ6ICgmIzM5Oy91c3IvYmluL3Zkc20tdG9vbCYjMzk7LCAmIzM5O2Nv bmZpZ3VyZSYjMzk7LAogICAgICAgICAgICAmIzM5Oy0tZm9yY2UmIzM5Oykgc3Rkb3V0Ojxicj4K ICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IENoZWNraW5nIGNv bmZpZ3VyYXRpb24gc3RhdHVzLi4uPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0Ozxicj4KICAgICAg ICAgICAgJmd0OyZndDsgYWJydCBpcyBub3QgY29uZmlndXJlZCBmb3IgdmRzbTxicj4KICAgICAg ICAgICAgJmd0OyZndDsgV0FSTklORzogTFZNIGxvY2FsIGNvbmZpZ3VyYXRpb246CiAgICAgICAg ICAgIC9ldGMvbHZtL2x2bWxvY2FsLmNvbmYgaXMgbm90IGJhc2VkIG9uPGJyPgogICAgICAgICAg ICAmZ3Q7Jmd0OyB2ZHNtIGNvbmZpZ3VyYXRpb248YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IGx2 bSByZXF1aXJlcyBjb25maWd1cmF0aW9uPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBsaWJ2aXJ0 IGlzIG5vdCBjb25maWd1cmVkIGZvciB2ZHNtIHlldDxicj4KICAgICAgICAgICAgJmd0OyZndDsg RkFJTEVEOiBjb25mbGljdGluZyB2ZHNtIGFuZCBsaWJ2aXJ0LXFlbXUgdGxzCiAgICAgICAgICAg IGNvbmZpZ3VyYXRpb24uPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyB2ZHNtLmNvbmYgd2l0aCBz c2w9VHJ1ZSByZXF1aXJlcyB0aGUgZm9sbG93aW5nCiAgICAgICAgICAgIGNoYW5nZXM6PGJyPgog ICAgICAgICAgICAmZ3Q7Jmd0OyBsaWJ2aXJ0ZC5jb25mOiBsaXN0ZW5fdGNwPTAsIGF1dGhfdGNw PSZxdW90O3Nhc2wmcXVvdDssCiAgICAgICAgICAgIGxpc3Rlbl90bHM9MTxicj4KICAgICAgICAg ICAgJmd0OyZndDsgcWVtdS5jb25mOiBzcGljZV90bHM9MS48YnI+CiAgICAgICAgICAgICZndDsm Z3Q7IG11bHRpcGF0aCByZXF1aXJlcyBjb25maWd1cmF0aW9uPGJyPgogICAgICAgICAgICAmZ3Q7 Jmd0Ozxicj4KICAgICAgICAgICAgJmd0OyZndDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IDIw MTctMTEtMDYgMDI6NTY6NDcsNTUxLTA1MDAgREVCVUcKICAgICAgICAgICAgb3RvcGkucGx1Z2lu cy5vdG9waS5zZXJ2aWNlcy5zeXN0ZW1kPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBwbHVnaW4u ZXhlY3V0ZTo5MjYgZXhlY3V0ZS1vdXRwdXQ6CiAgICAgICAgICAgICgmIzM5Oy91c3IvYmluL3N5 c3RlbWN0bCYjMzk7LCAmIzM5O3N0YXJ0JiMzOTssPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyAm IzM5O292aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UmIzM5Oykgc3RkZXJyOjxicj4KICAgICAg ICAgICAgJmd0OyZndDsgSm9iIGZvciBvdmlydC1pbWFnZWlvLWRhZW1vbi5zZXJ2aWNlIGZhaWxl ZCBiZWNhdXNlCiAgICAgICAgICAgIHRoZSBjb250cm9sIHByb2Nlc3M8YnI+CiAgICAgICAgICAg ICZndDsmZ3Q7IGV4aXRlZCB3aXRoIGVycm9yIGNvZGUuIFNlZSAmcXVvdDtzeXN0ZW1jdGwgc3Rh dHVzCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uLnNlcnZpY2UmcXVvdDs8YnI+CiAg ICAgICAgICAgICZndDsmZ3Q7IGFuZCAmcXVvdDtqb3VybmFsY3RsIC14ZSZxdW90OyBmb3IgZGV0 YWlscy48YnI+CiAgICAgICAgICAgICZndDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyAy MDE3LTExLTA2IDAyOjU2OjQ3LDU1Mi0wNTAwIERFQlVHIG90b3BpLmNvbnRleHQ8YnI+CiAgICAg ICAgICAgICZndDsmZ3Q7IGNvbnRleHQuX2V4ZWN1dGVNZXRob2Q6MTQzIG1ldGhvZCBleGNlcHRp b248YnI+CiAgICAgICAgICAgICZndDsmZ3Q7IFRyYWNlYmFjayAobW9zdCByZWNlbnQgY2FsbCBs YXN0KTo8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7wqAgwqBGaWxlCiAgICAgICAgICAgICZxdW90 Oy90bXAvb3ZpcnQtUjRSOGdaaGFRSS9weXRob25saWIvb3RvcGkvY29udGV4dC5weSZxdW90Oywg bGluZQogICAgICAgICAgICAxMzMsIGluPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBfZXhlY3V0 ZU1ldGhvZDxicj4KICAgICAgICAgICAgJmd0OyZndDvCoCDCoCDCoG1ldGhvZFsmIzM5O21ldGhv ZCYjMzk7XSgpPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0O8KgIMKgRmlsZTxicj4KICAgICAgICAg ICAgJmd0OyZndDsKJnF1b3Q7L3RtcC9vdmlydC1SNFI4Z1poYVFJL290b3BpLXBsdWdpbnMvb3Zp cnQtaG9zdC1kZXBsb3kvdmRzbS9wYWNrYWdlcy5weSZxdW90Oyw8YnI+CiAgICAgICAgICAgICZn dDsmZ3Q7IGxpbmUgMTc5LCBpbiBfc3RhcnQ8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7wqAgwqAg wqBzZWxmLnNlcnZpY2VzLnN0YXRlKCYjMzk7b3ZpcnQtaW1hZ2Vpby1kYWVtb24mIzM5OywKICAg ICAgICAgICAgVHJ1ZSk8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7wqAgwqBGaWxlCiAgICAgICAg ICAgICZxdW90Oy90bXAvb3ZpcnQtUjRSOGdaaGFRSS9vdG9waS1wbHVnaW5zL290b3BpL3NlcnZp Y2VzL3N5c3RlbWQucHkmcXVvdDssPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBsaW5lIDE0MSwg aW4gc3RhdGU8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7wqAgwqAgwqBzZXJ2aWNlPW5hbWUsPGJy PgogICAgICAgICAgICAmZ3Q7Jmd0OyBSdW50aW1lRXJyb3I6IEZhaWxlZCB0byBzdGFydCBzZXJ2 aWNlCiAgICAgICAgICAgICYjMzk7b3ZpcnQtaW1hZ2Vpby1kYWVtb24mIzM5Ozxicj4KICAgICAg ICAgICAgJmd0OyZndDsgMjAxNy0xMS0wNiAwMjo1Njo0Nyw1NTMtMDUwMCBFUlJPUiBvdG9waS5j b250ZXh0PGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBjb250ZXh0Ll9leGVjdXRlTWV0aG9kOjE1 MiBGYWlsZWQgdG8gZXhlY3V0ZSBzdGFnZQogICAgICAgICAgICAmIzM5O0Nsb3NpbmcgdXAmIzM5 OzogRmFpbGVkIHRvPGJyPgogICAgICAgICAgICAmZ3Q7Jmd0OyBzdGFydCBzZXJ2aWNlICYjMzk7 b3ZpcnQtaW1hZ2Vpby1kYWVtb24mIzM5Ozxicj4KICAgICAgICAgICAgPGJyPgogICAgICAgICAg ICBJbiAvdmFyL2xvZy9tZXNzYWdlcyBvZiB0aGUgaG9zdCBbMV0sIHRoZXJlIGlzOjxicj4KICAg ICAgICAgICAgPGJyPgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3Vp dGUtbWFzdGVyLWhvc3QtMCBzeXN0ZW1kOgogICAgICAgICAgICBTdGFydGluZyBvVmlydDxicj4K ICAgICAgICAgICAgSW1hZ2VJTyBEYWVtb24uLi48YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6 NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wIHB5dGhvbjoKICAgICAgICAgICAg ZGV0ZWN0ZWQ8YnI+CiAgICAgICAgICAgIHVuaGFuZGxlZCBQeXRob24gZXhjZXB0aW9uIGluCiAg ICAgICAgICAgICYjMzk7L3Vzci9iaW4vb3ZpcnQtaW1hZ2Vpby1kYWVtb24mIzM5Ozxicj4KICAg ICAgICAgICAgTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAg cHl0aG9uOiBjYW4mIzM5O3Q8YnI+CiAgICAgICAgICAgIGNvbW11bmljYXRlIHdpdGggQUJSVCBk YWVtb24sIGlzIGl0IHJ1bm5pbmc/IFtFcnJubyAyXSBObwogICAgICAgICAgICBzdWNoIGZpbGUg b3I8YnI+CiAgICAgICAgICAgIGRpcmVjdG9yeTxicj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1 Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAgICAgICAgICAgb3ZpcnQtaW1h Z2Vpby1kYWVtb246PGJyPgogICAgICAgICAgICBUcmFjZWJhY2sgKG1vc3QgcmVjZW50IGNhbGwg bGFzdCk6PGJyPgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUt bWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAgICAg ICAgICAgIEZpbGUgJnF1b3Q7L3Vzci9iaW4vb3ZpcnQtaW1hZ2Vpby1kYWVtb24mcXVvdDssIGxp bmUgMTQsIGluCiAgICAgICAgICAgICZsdDttb2R1bGUmZ3Q7PGJyPgogICAgICAgICAgICBOb3bC oCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAgICAgICBv dmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAgICAgICAgICAgIHNlcnZlci5tYWluKHN5cy5hcmd2 KTxicj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rl ci1ob3N0LTAKICAgICAgICAgICAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgogICAgICAgICAg ICBGaWxlCiAgICAgICAgICAgICZxdW90Oy91c3IvbGliL3B5dGhvbjIuNy9zaXRlLXBhY2thZ2Vz L292aXJ0X2ltYWdlaW9fZGFlbW9uL3NlcnZlci5weSZxdW90Oyw8YnI+CiAgICAgICAgICAgIGxp bmUgNTcsIGluIG1haW48YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNp Yy1zdWl0ZS1tYXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxi cj4KICAgICAgICAgICAgc3RhcnQoY29uZmlnKTxicj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1 Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAgICAgICAgICAgb3ZpcnQtaW1h Z2Vpby1kYWVtb246PGJyPgogICAgICAgICAgICBGaWxlCiAgICAgICAgICAgICZxdW90Oy91c3Iv bGliL3B5dGhvbjIuNy9zaXRlLXBhY2thZ2VzL292aXJ0X2ltYWdlaW9fZGFlbW9uL3NlcnZlci5w eSZxdW90Oyw8YnI+CiAgICAgICAgICAgIGxpbmUgODUsIGluIHN0YXJ0PGJyPgogICAgICAgICAg ICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAg ICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAgICAgICAgICAgIFdTR0lSZXF1ZXN0SGFu ZGxlcik8YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1t YXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4KICAgICAg ICAgICAgRmlsZSAmcXVvdDsvdXNyL2xpYjY0L3B5dGhvbjIuNy9Tb2NrZXRTZXJ2ZXIucHkmcXVv dDssIGxpbmUgNDE5LCBpbgogICAgICAgICAgICBfX2luaXRfXzxicj4KICAgICAgICAgICAgTm92 wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAKICAgICAgICAgICAg b3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgogICAgICAgICAgICBzZWxmLnNlcnZlcl9iaW5kKCk8 YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXIt aG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxicj4KICAgICAgICAgICAg RmlsZSAmcXVvdDsvdXNyL2xpYjY0L3B5dGhvbjIuNy93c2dpcmVmL3NpbXBsZV9zZXJ2ZXIucHkm cXVvdDssIGxpbmUKICAgICAgICAgICAgNDgsIGluPGJyPgogICAgICAgICAgICBzZXJ2ZXJfYmlu ZDxicj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rl ci1ob3N0LTAKICAgICAgICAgICAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgogICAgICAgICAg ICBIVFRQU2VydmVyLnNlcnZlcl9iaW5kKHNlbGYpPGJyPgogICAgICAgICAgICBOb3bCoCA2IDAy OjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmlydC1p bWFnZWlvLWRhZW1vbjo8YnI+CiAgICAgICAgICAgIEZpbGUgJnF1b3Q7L3Vzci9saWI2NC9weXRo b24yLjcvQmFzZUhUVFBTZXJ2ZXIucHkmcXVvdDssIGxpbmUgMTA4LCBpbjxicj4KICAgICAgICAg ICAgc2VydmVyX2JpbmQ8YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNp Yy1zdWl0ZS1tYXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxi cj4KICAgICAgICAgICAgU29ja2V0U2VydmVyLlRDUFNlcnZlci5zZXJ2ZXJfYmluZChzZWxmKTxi cj4KICAgICAgICAgICAgTm92wqAgNiAwMjo1Njo0NyBsYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1o b3N0LTAKICAgICAgICAgICAgb3ZpcnQtaW1hZ2Vpby1kYWVtb246PGJyPgogICAgICAgICAgICBG aWxlICZxdW90Oy91c3IvbGliNjQvcHl0aG9uMi43L1NvY2tldFNlcnZlci5weSZxdW90OywgbGlu ZSA0MzAsIGluCiAgICAgICAgICAgIHNlcnZlcl9iaW5kPGJyPgogICAgICAgICAgICBOb3bCoCA2 IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmly dC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAgICAgICAgICAgIHNlbGYuc29ja2V0LmJpbmQoc2VsZi5z ZXJ2ZXJfYWRkcmVzcyk8YnI+CiAgICAgICAgICAgIE5vdsKgIDYgMDI6NTY6NDcgbGFnby1iYXNp Yy1zdWl0ZS1tYXN0ZXItaG9zdC0wCiAgICAgICAgICAgIG92aXJ0LWltYWdlaW8tZGFlbW9uOjxi cj4KICAgICAgICAgICAgRmlsZSAmcXVvdDsvdXNyL2xpYjY0L3B5dGhvbjIuNy9zb2NrZXQucHkm cXVvdDssIGxpbmUgMjI0LCBpbiBtZXRoPGJyPgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3 IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmlydC1pbWFnZWlv LWRhZW1vbjo8YnI+CiAgICAgICAgICAgIHJldHVybiBnZXRhdHRyKHNlbGYuX3NvY2ssbmFtZSko KmFyZ3MpPGJyPgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUt bWFzdGVyLWhvc3QtMAogICAgICAgICAgICBvdmlydC1pbWFnZWlvLWRhZW1vbjo8YnI+CiAgICAg ICAgICAgIHNvY2tldC5lcnJvcjogW0Vycm5vIDk4XSBBZGRyZXNzIGFscmVhZHkgaW4gdXNlPGJy PgogICAgICAgICAgICBOb3bCoCA2IDAyOjU2OjQ3IGxhZ28tYmFzaWMtc3VpdGUtbWFzdGVyLWhv c3QtMCBzeXN0ZW1kOjxicj4KICAgICAgICAgICAgb3ZpcnQtaW1hZ2Vpby1kYWVtb24uc2Vydmlj ZTogbWFpbiBwcm9jZXNzIGV4aXRlZCwKICAgICAgICAgICAgY29kZT1leGl0ZWQsPGJyPgogICAg ICAgICAgICBzdGF0dXM9MS9GQUlMVVJFPGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICAg IG92aXJ0LWhvc3QtZGVwbG95IHN0b3BzIGl0LCBhbmQgaW1tZWRpYXRlbHkgdHJpZXMgdG8gc3Rh cnQKICAgICAgICAgICAgaXQ6PGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICAgIDIwMTct MTEtMDYgMDI6NTY6NDcsMjAzLTA1MDAgREVCVUc8YnI+CiAgICAgICAgICAgIG90b3BpLnBsdWdp bnMub3RvcGkuc2VydmljZXMuc3lzdGVtZCBwbHVnaW4uZXhlY3V0ZVJhdzo4NjM8YnI+CiAgICAg ICAgICAgIGV4ZWN1dGUtcmVzdWx0OiAoJiMzOTsvdXNyL2Jpbi9zeXN0ZW1jdGwmIzM5OywgJiMz OTtzdG9wJiMzOTssPGJyPgogICAgICAgICAgICAmIzM5O292aXJ0LWltYWdlaW8tZGFlbW9uLnNl cnZpY2UmIzM5OyksIHJjPTA8YnI+CiAgICAgICAgICAgIC4uLjxicj4KICAgICAgICAgICAgMjAx Ny0xMS0wNiAwMjo1Njo0Nyw1NTAtMDUwMCBERUJVRzxicj4KICAgICAgICAgICAgb3RvcGkucGx1 Z2lucy5vdG9waS5zZXJ2aWNlcy5zeXN0ZW1kIHBsdWdpbi5leGVjdXRlUmF3Ojg2Mzxicj4KICAg ICAgICAgICAgZXhlY3V0ZS1yZXN1bHQ6ICgmIzM5Oy91c3IvYmluL3N5c3RlbWN0bCYjMzk7LCAm IzM5O3N0YXJ0JiMzOTssPGJyPgogICAgICAgICAgICAmIzM5O292aXJ0LWltYWdlaW8tZGFlbW9u LnNlcnZpY2UmIzM5OyksIHJjPTE8YnI+CiAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgQWxz bywgaW1hZ2Vpby1kYWVtb24mIzM5O3MgbG9nIFsyXSBsb29rcyBhIGJpdCB3ZWlyZCB0byBtZSAt IGl0CiAgICAgICAgICAgIGhhcyA1PGJyPgogICAgICAgICAgICAmIzM5O1N0YXJ0aW5nJiMzOTsg bGluZXMsIGJ1dCBubzxicj4KICAgICAgICAgICAgb3RoZXIgbGluZXMgSSB3b3VsZCBoYXZlIGV4 cGVjdGVkIHRvIGhhdmUsIHJlYWRpbmcgaXRzCiAgICAgICAgICAgIHNvdXJjZSwgYW5kIGFzPGJy PgogICAgICAgICAgICBJIGNhbiBzZWUgaW4gYW5vdGhlcjxicj4KICAgICAgICAgICAgcnVuLCB0 aGF0IGRpZCBmaW5pc2ggc3VjY2Vzc2Z1bGx5IFszXS48YnI+CiAgICAgICAgICAgIDxicj4KICAg ICAgICAgICAgQWRkaW5nIElkYW4sIGJ1dCBub3Qgc3VyZSBpdCYjMzk7cyBhIGJ1ZyBpbiB0aGUg ZGFlbW9uLjxicj4KICAgICAgICAgICAgPGJyPgogICAgICAgICAgICBbMV0gPGEgaHJlZj0iaHR0 cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hhbmdlLXF1ZXVlLXRlc3Rl ci8zNjI2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1zdWl0LW1hc3Rlci1lbDcv dGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290c3RyYXAucHkvbGFnby1i YXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wL192YXJfbG9nLyIgcmVsPSJub3JlZmVycmVyIiB0YXJn ZXQ9Il9ibGFuayI+aHR0cDovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1tYXN0ZXJfY2hh bmdlLXF1ZXVlLXRlc3Rlci8zNjI2L2FydGlmYWN0L2V4cG9ydGVkLWFydGlmYWN0cy9iYXNpYy1z dWl0LW1hc3Rlci1lbDcvdGVzdF9sb2dzL2Jhc2ljLXN1aXRlLW1hc3Rlci9wb3N0LTAwMl9ib290 c3RyYXAucHkvbGFnby1iYXNpYy1zdWl0ZS1tYXN0ZXItaG9zdC0wL192YXJfbG9nLzwvYT48YnI+ CiAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgWzJdIDxhIGhyZWY9Imh0dHA6Ly9qZW5raW5z Lm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyNi9hcnRp ZmFjdC9leHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9i YXNpYy1zdWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUt bWFzdGVyLWhvc3QtMC9fdmFyX2xvZy9vdmlydC1pbWFnZWlvLWRhZW1vbi9kYWVtb24ubG9nIiBy ZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vamVua2lucy5vdmlydC5vcmcv am9iL292aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjYvYXJ0aWZhY3QvZXhwb3J0 ZWQtYXJ0aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMtc3VpdGUt bWFzdGVyL3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0 LTAvX3Zhcl9sb2cvb3ZpcnQtaW1hZ2Vpby1kYWVtb24vZGFlbW9uLmxvZzwvYT48YnI+CiAgICAg ICAgICAgIDxicj4KICAgICAgICAgICAgWzNdIDxhIGhyZWY9Imh0dHA6Ly9qZW5raW5zLm92aXJ0 Lm9yZy9qb2Ivb3ZpcnQtbWFzdGVyX2NoYW5nZS1xdWV1ZS10ZXN0ZXIvMzYyOC9hcnRpZmFjdC9l eHBvcnRlZC1hcnRpZmFjdHMvYmFzaWMtc3VpdC1tYXN0ZXItZWw3L3Rlc3RfbG9ncy9iYXNpYy1z dWl0ZS1tYXN0ZXIvcG9zdC0wMDJfYm9vdHN0cmFwLnB5L2xhZ28tYmFzaWMtc3VpdGUtbWFzdGVy LWhvc3QtMC9fdmFyX2xvZy9vdmlydC1pbWFnZWlvLWRhZW1vbi9kYWVtb24ubG9nIiByZWw9Im5v cmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vamVua2lucy5vdmlydC5vcmcvam9iL292 aXJ0LW1hc3Rlcl9jaGFuZ2UtcXVldWUtdGVzdGVyLzM2MjgvYXJ0aWZhY3QvZXhwb3J0ZWQtYXJ0 aWZhY3RzL2Jhc2ljLXN1aXQtbWFzdGVyLWVsNy90ZXN0X2xvZ3MvYmFzaWMtc3VpdGUtbWFzdGVy L3Bvc3QtMDAyX2Jvb3RzdHJhcC5weS9sYWdvLWJhc2ljLXN1aXRlLW1hc3Rlci1ob3N0LTAvX3Zh cl9sb2cvb3ZpcnQtaW1hZ2Vpby1kYWVtb24vZGFlbW9uLmxvZzwvYT48L2Jsb2NrcXVvdGU+CiAg ICAgICAgICA8ZGl2Pjxicj4KICAgICAgICAgIDwvZGl2PgogICAgICAgICAgPGRpdj5Mb29rcyBs aWtlIHRoZSBkYWVtb24gaXMgYWxyZWFkeSBydW5uaW5nIG9uIHRoaXMgaG9zdCAtCiAgICAgICAg ICAgIG1heWJlIGhvc3QgZGVwbG95PC9kaXY+CiAgICAgICAgICA8ZGl2PmlzIHRyeWluZyB0byBz dGFydCB0aGUgc2VydmljZSB0d2ljZT88L2Rpdj4KICAgICAgICAgIDxkaXY+PGJyPgogICAgICAg ICAgPC9kaXY+CiAgICAgICAgICA8ZGl2PldlIGRpZCBub3QgY2hhbmdlIHRoZSBzdGFydHVwIGNv ZGUgY291cGxlIG9mIHllYXJzLCBzbwogICAgICAgICAgICB0aGlzIG11c3QgYmUgc29tZTwvZGl2 PgogICAgICAgICAgPGRpdj5jaGFuZ2UgaW4gYW5vdGhlciBjb21wb25lbnQuPC9kaXY+CiAgICAg ICAgICA8ZGl2Pjxicj4KICAgICAgICAgIDwvZGl2PgogICAgICAgICAgPGRpdj5UaGlzIHBhdGNo IHdpbGwgbWFrZSBpdCBlYXNpZXIgdG8gZGV0ZWN0IGZ1dHVyZSBpc3N1ZXMsCiAgICAgICAgICAg IGxvZ2dpbmcgYW55IGVycm9yPC9kaXY+CiAgICAgICAgICA8ZGl2PnRvIHRoZSBkYWVtb24gbG9n IGR1cmluZyBzdGFydHVwOjwvZGl2PgogICAgICAgICAgPGRpdj48YSBocmVmPSJodHRwczovL2dl cnJpdC5vdmlydC5vcmcvODM2NzAvIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9nZXJyaXQub3Zp cnQub3JnLzgzNjcwLzwvYT48YnI+CiAgICAgICAgICA8L2Rpdj4KICAgICAgICAgIDxkaXY+PGJy PgogICAgICAgICAgPC9kaXY+CiAgICAgICAgICA8ZGl2Pk5pcjwvZGl2PgogICAgICAgICAgPGRp dj7CoDwvZGl2PgogICAgICAgICAgPGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHls ZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1s ZWZ0OjFleCI+PGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7PGJyPgog ICAgICAgICAgICAmZ3Q7Jmd0OyAmbHQ7L2Vycm9yJmd0Ozxicj4KICAgICAgICAgICAgJmd0OyZn dDs8YnI+CiAgICAgICAgICAgICZndDsmZ3Q7PGJyPgogICAgICAgICAgICAmZ3Q7PGJyPgogICAg ICAgICAgICAmZ3Q7PGJyPgogICAgICAgICAgICA8YnI+CiAgICAgICAgICAgIDxicj4KICAgICAg ICAgICAgPGJyPgogICAgICAgICAgICAtLTxicj4KICAgICAgICAgICAgRGlkaTxicj4KICAgICAg ICAgICAgX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188YnI+ CiAgICAgICAgICAgIERldmVsIG1haWxpbmcgbGlzdDxicj4KICAgICAgICAgICAgPGEgaHJlZj0i bWFpbHRvOkRldmVsQG92aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiPkRldmVsQG92aXJ0Lm9yZzwv YT48YnI+CiAgICAgICAgICAgIDxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1h bi9saXN0aW5mby9kZXZlbCIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDov L2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL2RldmVsPC9hPjxicj4KICAgICAgICAg IDwvYmxvY2txdW90ZT4KICAgICAgICA8L2Rpdj4KICAgICAgPC9kaXY+CiAgICA8L2Jsb2NrcXVv dGU+CiAgICA8cD48YnI+CiAgICA8L3A+CiAgPC9kaXY+PC9ibG9ja3F1b3RlPjwvZGl2Pgo= --===============1025079295088003895==--