- Users - oVirt List Archives

Error cloning snapshot
by Maton, Brett 26 Sep '17

26 Sep '17

oVirt: Version 4.1.7.1-1.el7.centos CentOS 7.4 Kernel 3.10.0-693.2.2.el7.x86_64 I'm trying to clone a snapshot to export but am getting the following errors, any suggestions ? In web-ui: Uncaught exception occurred. Please try reloading the page. Details: (TypeError) __gwt$exception: <skipped>: qib(...).e is null Please have your administrator check the UI logs ui.log: 2017-09-26 08:59:40,871+01 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-41) [] Permutation name: 7DB6BC4D2EE32C078419FA8B25F06F9C 2017-09-26 08:59:40,871+01 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-41) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) __gwt$exception: <skipped>: qib(...).e is null at org.ovirt.engine.ui.uicommonweb.models.vms.UnitVmModel.$isHostedEngine(UnitVmModel.java:1888) at org.ovirt.engine.ui.common.widget.uicommon.popup.AbstractVmPopupWidget.$edit(AbstractVmPopupWidget.java:1515) at org.ovirt.engine.ui.common.widget.uicommon.popup.AbstractVmPopupWidget.edit(AbstractVmPopupWidget.java:1515) at org.ovirt.engine.ui.common.widget.uicommon.popup.AbstractVmPopupWidget.edit(AbstractVmPopupWidget.java:1515) at org.ovirt.engine.ui.common.widget.uicommon.popup.AbstractModeSwitchingPopupWidget.edit(AbstractModeSwitchingPopupWidget.java:78) at org.ovirt.engine.ui.common.view.popup.AbstractModelBoundWidgetPopupView.$edit(AbstractModelBoundWidgetPopupView.java:36) at org.ovirt.engine.ui.common.view.popup.AbstractModelBoundWidgetPopupView.edit(AbstractModelBoundWidgetPopupView.java:36) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget.$init(AbstractModelBoundPopupPresenterWidget.java:143) at org.ovirt.engine.ui.common.widget.popup.AbstractVmBasedPopupPresenterWidget.$init(AbstractVmBasedPopupPresenterWidget.java:68) at org.ovirt.engine.ui.common.widget.popup.AbstractVmBasedPopupPresenterWidget.init(AbstractVmBasedPopupPresenterWidget.java:68) at org.ovirt.engine.ui.common.widget.popup.AbstractVmBasedPopupPresenterWidget.init(AbstractVmBasedPopupPresenterWidget.java:68) at org.ovirt.engine.ui.common.uicommon.model.ModelBoundPopupHandler.$handleWindowModelChange(ModelBoundPopupHandler.java:96) at org.ovirt.engine.ui.common.uicommon.model.ModelBoundPopupHandler$1.$eventRaised(ModelBoundPopupHandler.java:77) at org.ovirt.engine.ui.common.uicommon.model.ModelBoundPopupHandler$1.eventRaised(ModelBoundPopupHandler.java:77) at org.ovirt.engine.ui.uicompat.Event.$raise(Event.java:99) at org.ovirt.engine.ui.uicommonweb.models.Model.$onPropertyChanged(Model.java:471) at org.ovirt.engine.ui.uicommonweb.models.Model.onPropertyChanged(Model.java:471) at org.ovirt.engine.ui.uicommonweb.models.Model.$setWindow(Model.java:93) at org.ovirt.engine.ui.uicommonweb.models.vms.VmSnapshotListModel.$cloneVM(VmSnapshotListModel.java:703) at org.ovirt.engine.ui.uicommonweb.models.vms.VmSnapshotListModel.executeCommand(VmSnapshotListModel.java:912) at org.ovirt.engine.ui.uicommonweb.UICommand.$execute(UICommand.java:163) at org.ovirt.engine.ui.common.widget.action.UiCommandButtonDefinition.$onClick(UiCommandButtonDefinition.java:130) at org.ovirt.engine.ui.common.widget.action.UiCommandButtonDefinition.onClick(UiCommandButtonDefinition.java:130) at org.ovirt.engine.ui.common.widget.action.AbstractActionPanel$11.execute(AbstractActionPanel.java:575) at com.google.gwt.user.client.ui.MenuBar$1.execute(MenuBar.java:893) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.SchedulerImpl.runScheduledTasks(SchedulerImpl.java:164) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.SchedulerImpl.$flushFinallyCommands(SchedulerImpl.java:270) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.exit(Impl.java:378) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:335) [gwt-servlet.jar:] at Unknown.Ix/<(Unknown Source) at Unknown.anonymous(Unknown Source)

2 2

ovirt 4.0 repos
by Edward Clay 26 Sep '17

26 Sep '17

Hello, I've recently ran into a couple of problems. One that I'm noticing right now is that when I do a yum check-update I'm getting a 404 . yum clean allyum check-updateLoaded plugins: fastestmirror, versionlockbase | 3.6 kB 00:00:00 http://mirror.centos.org/centos/7/virt/x86_64/ovirt-4. 0/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not FoundTrying other mirror.To address this issue please refer to the below knowledge base article https://access.redhat.com/articles/1320623 If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/ One of the configured repositories failed (CentOS-7 - oVirt 4.0), and yum doesn't have enough cached data to continue. At this point the only safe thing yum can do is fail. There are a few ways to work "fix" this: 1. Contact the upstream for the repository and get them to fix the problem. 2. Reconfigure the baseurl/etc. for the repository, to point to a working upstream. This is most often useful if you are using a newer distribution release than is supported by the repository (and the packages for the previous distribution release still work). 3. Run the command with the repository temporarily disabled yum --disablerepo=centos-ovirt40-release ... 4. Disable the repository permanently, so yum won't use it by default. Yum will then just ignore the repository until you permanently enable it again or use --enablerepo for temporary usage: yum-config-manager --disable centos-ovirt40- release or subscription-manager repos -- disable=centos-ovirt40-release 5. Configure the failing repository to be skipped, if it is unavailable. Note that yum will try to contact the repo. when it runs most commands, so will have to try and fail each time (and thus. yum will be be much slower). If it is a very temporary problem though, this is often a nice compromise: yum-config-manager --save --setopt=centos-ovirt40- release.skip_if_unavailable=true failure: repodata/repomd.xml from centos-ovirt40-release: [Errno 256] No more mirrors to try.http://mirror.centos.org/centos/7/virt/x86_64/ov irt-4.0/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found I have the following two files in /etc/yum.repo.d that I believe are used to point me at ovirt repos. -rw-r--r--. 1 root root 1672 Feb 7 2017 ovirt-4.0- dependencies.repo[ovirt-4.0-epel]name=Extra Packages for Enterprise Linux 7 - $basearch#baseurl=http://download.fedoraproject.org/pub/epel/ 7/$basearchmirrorlist=https://mirrors.fedoraproject.org/metalink?repo=e pel-7&arch=$basearchfailovermethod=priorityenabled=1includepkgs=epel- release,python-uinput,puppet,python-lockfile,python-cpopen,python- ordereddict,python-pthreading,python-inotify,python- argparse,novnc,python-ply,python-kitchen,python-daemon,python- websockify,livecd-tools,spice-html5,mom,python-IPy,python- ioprocess,ioprocess,safelease,python-paramiko,python2-paramiko,python2- crypto,libtomcrypt,libtommath,python-cheetah,python-ecdsa,python2- ecdsa,python-markdown,rubygem-rgen,ovirt-guest-agent*,userspace- rcu,protobuf- java,objenesis,python34*gpgcheck=1gpgkey=https://dl.fedoraproject.org/p ub/epel/RPM-GPG-KEY-EPEL-7 [ovirt-4.0-centos-gluster37]name=CentOS-7 - Gluster 3.7baseurl=http://m irror.centos.org/centos/7/storage/$basearch/gluster- 3.7/gpgcheck=1enabled=1gpgkey=https://raw.githubusercontent.com/CentOS- Storage-SIG/centos-release-storage-common/master/RPM-GPG-KEY-CentOS- SIG-Storage [ovirt-4.0-patternfly1-noarch-epel]name=Copr repo for patternfly1 owned by patternflybaseurl=http://copr-be.cloud.fedoraproject.org/results/pat ternfly/patternfly1/epel-7- $basearch/enabled=1skip_if_unavailable=1gpgcheck=0 [virtio-win-stable]name=virtio-win builds roughly matching what was shipped in latest RHELbaseurl=http://fedorapeople.org/groups/virt/virti o-win/repo/stableenabled=1skip_if_unavailable=1gpgcheck=0 [centos-ovirt40-release]name=CentOS-7 - oVirt 4.0baseurl=http://mirror. centos.org/centos/7/virt/$basearch/ovirt-4.0/gpgcheck=0enabled=1 -rw-r--r--. 1 root root 289 Feb 7 2017 ovirt-4.0.repo[ovirt- 4.0]name=Latest oVirt 4.0 Release#baseurl=http://resources.ovirt.org/pu b/ovirt- 4.0/rpm/el$releasever/mirrorlist=http://resources.ovirt.org/pub/yum- repo/mirrorlist-ovirt-4.0- el$releaseverenabled=1skip_if_unavailable=1gpgcheck=1gpgkey=file:///etc /pki/rpm-gpg/RPM-GPG-ovirt-4.0 Should the 4.0 version/repos still be available and if so what's wrong with my curent config?

2 1

Engine migration and host import
by Ben Bradley 26 Sep '17

26 Sep '17

Hi All I've been running a single-host ovirt setup for several months, having previously used a basic QEMU/KVM for a few years in lab environments. I currently have the ovirt engine running at the bare-metal level, with the box also acting as the single host. I am also running this with local storage. I now have an extra host I can use and would like to migrate to a hosted engine. The following documentation appears to be perfect and pretty clear about the steps involved: https://www.ovirt.org/develop/developer-guide/engine/migrate-to-hosted-engi… and https://www.ovirt.org/documentation/self-hosted/chap-Migrating_from_Bare_Me… However I'd like to try and get a bit more of an understanding of the process that happens behind the scenes during the cut-over from one engine to a new/hosted engine. As an experiment I attempted the following: - created a new VM within my current environment (bare-metal engine) - creating an engine-backup - stopped the bare-metal engine - restored the backup into the new VM - ran engine-setup within the new VM The new engine started up ok and I was able to connect and login to the web UI. However my host was "unresponsive" and I was unable to manage it in any way from the VM. I shut the VM down and started the bare-metal ovirt-engine again on the host and everything worked as before. I didn't try very hard to make it work however. The magic missing from the basic process I tried is the synchronising and importing of the existing host, which is what the hosted-engine utility does. Can anyone describe that process in a bit more detail? Is it possible to perform any part of that process manually? I'm planning to expand my lab and dev environments so for me it's important to discover the following... - That I'm able to reverse the process back to bare-metal engine if I ever need/want to - That I can setup a new VM or host with nothing more than an engine-backup but still be able to regain control of exiting hosts and VMs within the cluster My main concern after my basic attempt at a "restore/migration" above is that I might not be able to re-import/sync an existing host after I have restored engine from a backup. I have been able to export VMs to storage, remove them from ovirt, re-install engine and restore, then import VMs from the export domain. That all worked fine. But it involved shutting down all VMs and removing their definitions from the environment. Are there any pre-requisites to being able to re-import an existing running host (and VMs), such as placing ALL hosts into maintenance mode and shutting down any VMs first? Any insight into host recovery/import/sync processes and steps will be greatly appreciated. Best regards Ben

2 5

Re: [ovirt-users] [ovirt-devel] vdsm vds.dispatcher
by Gary Pedretty 26 Sep '17

26 Sep '17

--Apple-Mail=_BF0F8909-F772-4228-ADA6-BEDEE7C22B79 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 The bug I assumed this was related to is. Bug 1417708 - ovirt-ha-agent should reuse json-rpc connections =20 This is a glusterized 4 host self hosted engine setup. All storage = domains are glusterfs replica 3 volumes on 3 of the 4 hosts that are = part of the cluster. Centos 3.10.0-514.26.2.el7.x86_64 vdsm-4.18.21-1.el7.centos.x86_64 libvirt-2.0.0-10.el7_3.9.x86_64 glusterfs-3.7.20-1.el7.x86_64 qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64 Host and engine are all updated to the latest versions Here are sample of messages log, vdsm,log, supervdsm.log and mom.log messages Aug 28 01:20:11 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:16 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:16 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:19 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:22 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:24 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:37 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:41 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:41 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:44 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:47 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof Aug 28 01:20:49 fai-kvm-1 journal: vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof vdsm.log Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::bindingxmlrpc::319::vds::(wrapper) client [::1] Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from state init -> state preparing Thread-316519::INFO::2017-08-28 = 01:21:13,242::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone) Thread-316519::INFO::2017-08-28 = 01:21:13,243::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, = 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', = 'lastCheck': '1.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '1.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': '1.0', = 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, = 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000513211', = 'lastCheck': '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.3', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': = True, 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': '1.1', 'valid': True}} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '1.1', 'valid': = True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': False, 'delay': '0.000893509', = 'lastCheck': '1.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '1.0', 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000513211', 'lastCheck': '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '1.1', 'valid': True}} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from state preparing -> state finished Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {} Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::ref 0 aborting False Thread-316519::INFO::2017-08-28 = 01:21:13,243::bindingxmlrpc::331::vds::(wrapper) RPC call = storageRepoGetStats finished (code=3D0) in 0.00 seconds Thread-316519::INFO::2017-08-28 = 01:21:13,246::xmlrpc::91::vds.XMLRPCServer::(_process_requests) Request = handler for ::1:51992 stopped Thread-68::DEBUG::2017-08-28 = 01:21:14,093::fileSD::159::Storage.StorageDomainManifest::(__init__) = Reading domain in path = /rhev/data-center/mnt/glusterSD/glustermount:data2/2bf8f623-1d82-444e-ae16= -d32e5fe4dc9e Thread-68::DEBUG::2017-08-28 = 01:21:14,093::persistent::194::Storage.PersistentDict::(__init__) = Created a persistent dict with FileMetadataRW backend Thread-68::DEBUG::2017-08-28 = 01:21:14,096::persistent::236::Storage.PersistentDict::(refresh) read = lines (FileMetadataRW)=3D['CLASS=3DData', 'DESCRIPTION=3Ddata2', = 'IOOPTIMEOUTSEC=3D10', 'LEASERETRIES=3D3', 'LEASETIMESEC=3D60', = 'LOCKPOLICY=3D', 'LOCKRENEWALINTERVALSEC=3D5', 'MASTER_VERSION=3D10', = 'POOL_DESCRIPTION=3DDefault', = 'POOL_DOMAINS=3Dcf2f4c75-966b-4f69-90a2-d8e7d21fc052:Active,5e39db25-561f-= 490a-81b6-46a7225f02b6:Active,95d4ed8a-9184-4863-84d5-af2bedd690da:Attache= d,3e04b3ad-c46c-4903-a7b2-b9af681318d9:Attached,bd1f0364-0d3a-44fa-842a-5d= 339caac412:Attached,403df7fb-6cff-46e1-8e04-41213fbc0e6e:Active,2bf8f623-1= d82-444e-ae16-d32e5fe4dc9e:Active,6654cb0c-3e57-42ca-b996-3660a3d32a43:Act= ive,88886a7d-f4cc-45a6-901e-89999aa35d78:Attached,feaebec7-aae3-45b5-9684-= 1feedede7bec:Active', 'POOL_SPM_ID=3D-1', 'POOL_SPM_LVER=3D-1', 'POOL_UUID=3D5990e442-0395-0118-005c-0000000003a1', = 'REMOTE_PATH=3Dglustermount:data2', 'ROLE=3DMaster', = 'SDUUID=3D2bf8f623-1d82-444e-ae16-d32e5fe4dc9e', 'TYPE=3DGLUSTERFS', = 'VERSION=3D3', '_SHA_CKSUM=3D65b61dc4f10d80c67c6133ffaee280919458a06a'] Thread-68::DEBUG::2017-08-28 = 01:21:14,105::fileSD::679::Storage.StorageDomain::(imageGarbageCollector) = Removing remnants of deleted images [] Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::604::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_imageNS = already registered Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::612::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_volumeNS = already registered jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,244::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling 'Host.getStats' in bridge with {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,245::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state init -> = state preparing jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone) jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': = {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '3.0', 'valid': True}, u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000513211', = 'lastCheck': '1.3', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': '3.1', 'valid': True}} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '3.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '0.000893509', = 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000493711', = 'lastCheck': '1.1', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': = '3.1', 'valid': True}} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state = preparing -> state finished jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {} jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::ref 0 aborting False Reactor thread::INFO::2017-08-28 = 01:21:15,291::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept) Accepted connection from ::1:51994 Reactor thread::DEBUG::2017-08-28 = 01:21:15,299::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11 Reactor thread::INFO::2017-08-28 = 01:21:15,301::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol stomp from ::1:51994 Reactor thread::INFO::2017-08-28 = 01:21:15,301::stompreactor::101::Broker.StompAdapter::(_cmd_connect) = Processing CONNECT request Reactor thread::DEBUG::2017-08-28 = 01:21:15,301::stompreactor::492::protocoldetector.StompDetector::(handle_s= ocket) Stomp detected from ('::1', 51994) JsonRpc (StompReactor)::INFO::2017-08-28 = 01:21:15,313::stompreactor::128::Broker.StompAdapter::(_cmd_subscribe) = Subscribe command received jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,356::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getStats' in bridge with {'cpuStatistics': {'1': = {'cpuUser': '2.27', 'nodeIndex': 0, 'cpuSys': '1.80', 'cpuIdle': '95.93'}, '0': {'cpuUser': = '0.67', 'nodeIndex': 0, 'cpuSys': '1.13', 'cpuIdle': '98.20'}, '3': = {'cpuUser': '5.67', 'nodeIndex': 0, 'cpuSys': '0.60', 'cpuIdle': = '93.73'}, '2': {'cpuUser': '0.93', 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '98.54'}, '5': {'cpuUser': '0.87', 'nodeIndex': 0, 'cpuSys': = '1.40', 'cpuIdle': '97.73'}, '4': {'cpuUser': '1.27', 'nodeIndex': 0, = 'cpuSys': '0.53', 'cpuIdle': '98.20'}, '7': {'cpuUser': '0.27', = 'nodeIndex': 0, 'cpuSys': '0.47', 'cpuIdle': '99.26'}, '6': {'cpuUser': '2.07', 'nodeIndex': 0, = 'cpuSys': '0.53', 'cpuIdle': '97.40'}}, 'numaNodeMemFree': {'0': = {'memPercent': 98, 'memFree': '335'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, = 'rxRate': '0.04', 'vmCount': 1, 'memUsed': '41', 'storageDomains': = {u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '3.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000513211', = 'lastCheck': '1.3', 'valid': True}, = u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': '3.1', 'valid': = True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': = True, 'version': 3, 'acquired': True, 'delay': '0.000493711', = 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000512272', 'lastCheck': = '3.1', 'valid': True}}, 'incomingVmMigrations': 0, 'network': {'enp2s0': {'rxErrors': '0', 'txRate': '0.2', 'rxRate': = '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '18453', 'name': = 'enp2s0', 'tx': '884509425955', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '134148067121', 'state': 'up'}, 'eno1': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'eno1', 'tx': '54488653089', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '46979728698', 'state': 'up'}, = ';vdsmdummy;': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': = ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '0', 'state': 'down'}, 'enp2s0.4': {'rxErrors': = '0', 'txRate': '0.2', 'rxRate': '0.1', 'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': 'enp2s0.4', 'tx': '843385870486', 'txDropped': = '0', 'sampleTime': 1503912069.554311, 'rx': '124132253793', 'state': = 'up'}, 'lo': {'rxErrors': '0', 'txRate': '0.3', 'rxRate': '0.3', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'lo', 'tx': = '444179233658', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '444179233658', 'state': 'up'}, 'enp4s0': {'rxErrors': '0', 'txRate': = '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '14290', 'name': 'enp4s0', 'tx': '9009494', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '187852658', 'state': 'up'}, 'enp4s0.100': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '0', 'name': 'enp4s0.100', 'tx': = '8798732', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '95777939', 'state': 'up'}, 'enp2s0.2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': = 'enp2s0.2', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '66329343', 'state': 'up'}, 'enp2s0.3': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.3', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '5930851', 'state': 'up'}, 'vnet0': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'vnet0', 'tx': '97194738', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '8798642', 'state': 'up'}, 'ovirtmgmt': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '2', 'name': 'ovirtmgmt', 'tx': = '52893439231', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '43528048077', 'state': 'up'}, 'ovirt-3': {'rxErrors': '0', 'txRate': = '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '2', 'name': 'ovirt-3', 'tx': '578', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '4621679', 'state': 'up'}, 'ovirt-4': {'rxErrors': '0', 'txRate': '0.2', 'rxRate': = '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': = 'ovirt-4', 'tx': '843385869908', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '124132039409', 'state': 'up'}, = 'ovirt-2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'ovirt-2', = 'tx': '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '19462774', 'state': 'up'}, 'dmz': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '4', 'name': 'dmz', 'tx': = '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '31428052', 'state': 'up'}}, 'txDropped': '0', 'cpuUser': '1.75', 'ksmPages': 1250, = 'elapsedTime': '127838.51', 'cpuLoad': '2.39', 'cpuSys': '0.86', 'diskStats': {'/var/log': {'free': '47378'}, = '/var/log/core': {'free': '47378'}, '/var/run/vdsm/': {'free': '7868'}, = '/tmp': {'free': '47378'}}, 'cpuUserVdsmd': '2.13', 'netConfigDirty': = 'False', 'memCommitted': 2113, 'ksmState': False, 'vmMigrating': 0, = 'ksmCpu': 0, 'memAvailable': 9216, 'txRate': '0.06', 'bootTime': = '1503727419', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, = 'globalMaintenance': False}, 'momStatus': 'active', 'rxDropped': = '32751', 'outgoingVmMigrations': 0, 'swapTotal': 7999, 'swapFree': 7842, 'dateTime': '2017-08-28T09:21:15 GMT', = 'anonHugePages': '2280', 'memFree': 9455, 'cpuIdle': '97.39', = 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': '0.87'} jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,357::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getStats succeeded in 0.12 seconds jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,580::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling 'Host.getHardwareInfo' in bridge with {} jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,581::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getHardwareInfo' in bridge with {'systemProductName': '', = 'systemUUID': '20DC6410-4F9F-DF11-9A25-7071BC772964', = 'systemSerialNumber': '', 'systemVersion': '', 'systemManufacturer': ''} jsonrpc.Executor/6::INFO::2017-08-28 = 01:21:15,581::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getHardwareInfo succeeded in 0.00 seconds JsonRpc (StompReactor)::ERROR::2017-08-28 = 01:21:15,583::betterAsyncore::113::vds.dispatcher::(recv) SSL error = during reading data: unexpected eof Reactor thread::INFO::2017-08-28 = 01:21:16,325::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept) Accepted connection from ::1:51996 Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11 Reactor thread::INFO::2017-08-28 = 01:21:16,332::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol xml from ::1:51996 Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::bindingxmlrpc::1307::XmlDetector::(handle_socket) xml over = http detected from ('::1', 51996) BindingXMLRPC::INFO::2017-08-28 = 01:21:16,332::xmlrpc::73::vds.XMLRPCServer::(handle_request) Starting = request handler for ::1:51996 supervdsm.log MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,517::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev eno1 classid 0:1388 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:4 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,572::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,573::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:2 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp4s0 classid 0:64 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:3 (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,689::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::vsctl::57::root::(commit) Executing commands: = /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list Port = -- list Interface MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list = Port -- list Interface (cwd None) MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,720::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; <rc> = =3D 0 MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,724::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return network_caps with {'bridges': {'ovirtmgmt': {'ipv6autoconf': = False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'yes', = 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': '10.9.2.1', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': '209.193.4.7', 'DEVICE': = 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.2.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eno1'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '104', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.7071bc772964', 'bridge_id': '8000.7071bc772964', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '16704', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-4': {'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.9.3.1', = 'dhcpv4': False, 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['enp2s0.4'], 'opts': {'multicast_last_member_count': = '2', 'hash_elasticity': '4', 'multicast_query_response_interval': = '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '102', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '8307', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'dmz': {'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'enp4s0.100'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '103', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.001b212f794d', 'bridge_id': '8000.001b212f794d', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '7181', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-2': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.2'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '2', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '320', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-3': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '1', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '14656', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}}, 'bondings': {}, 'nameservers': ['127.0.0.1', '209.193.4.7', = '209.112.128.2'], 'nics': {'enp2s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '68:05:ca:46:06:af', 'speed': 1000, 'gateway': ''}, 'eno1': = {'ipv6gateway': '::', 'ipv6autoconf': False, 'addr': '', 'cfg': = {'BRIDGE': 'ovirtmgmt', 'IPV6INIT': 'no', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'eno1', 'ONBOOT': = 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '', = 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': '70:71:bc:77:29:64', = 'speed': 1000, 'gateway': ''}, 'enp4s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '00:1b:21:2f:79:4d', 'speed': 1000, 'gateway': ''}}, 'supportsIPv6': = True, 'vlans': {'enp2s0.4': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-4', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.4', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 4, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp4s0.100': = {'iface': 'enp4s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'dmz', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0.100', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'vlanid': 100, 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': '::', = 'gateway': ''}, 'enp2s0.2': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-2', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 2, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp2s0.3': = {'iface': 'enp2s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'ovirt-3', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0.3', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 3, 'mtu': '1500', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': = '::', 'gateway': ''}}, 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', = 'ipv6autoconf': False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', = 'DEFROUTE': 'yes', 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': = '10.9.2.1', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': = '255.255.255.0', 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': = '209.193.4.7', 'DEVICE': 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', = 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', = 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': '255.255.255.0', = 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': ['10.9.2.61/24'], 'mtu': = '1500', 'ipv6gateway': '::', 'ports': ['eno1']}, 'ovirt-4': {'iface': = 'ovirt-4', 'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '10.9.3.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.4']}, 'ovirt-2': {'iface': 'ovirt-2', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', = 'DEVICE': 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': = True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['enp2s0.2']}, 'dmz': = {'iface': 'dmz', 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': = 'legacy', 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': = False, 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['vnet0', 'enp4s0.100']}, 'ovirt-3': {'iface': 'ovirt-3', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': = 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': = 'none', 'STP': 'off', 'DEVICE': 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': = 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': = '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', = 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3']}}} MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::92::SuperVdsm.ServerCallback::(wrapper) = call getHardwareInfo with () {} MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return getHardwareInfo with {'systemProductName': '', 'systemUUID': = '20DC6410-4F9F-DF11-9A25-7 ------------------------------------------------------------------------ Gary Pedretty gary(a)ravnalaska.net = <mailto:gary@eraalaska.net> Systems Manager www.flyravn.com = <http://www.flyravn.com/> Ravn Alaska /\ 907-450-7251 5245 Airport Industrial Road / \/\ 907-450-7238 fax Fairbanks, Alaska 99709 /\ / \ \ Second greatest commandment Serving All of Alaska / \/ /\ \ \/\ =E2=80=9CLove your = neighbor as Green, green as far as the eyes can see yourself=E2=80=9D = Matt 22:39 ------------------------------------------------------------------------ > On Aug 27, 2017, at 11:24 PM, Yaniv Kaul <ykaul(a)redhat.com = <mailto:ykaul@redhat.com>> wrote: >=20 > vdsm vds.dispatcher ERROR SSL error during reading data: unexpected = eof --Apple-Mail=_BF0F8909-F772-4228-ADA6-BEDEE7C22B79 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><div class=3D"" style=3D"font-family: LucidaGrande;">The bug = I assumed this was related to is.</div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><span = style=3D"font-family: LucidaGrande;" class=3D"">Bug = 1417708 - ovirt-ha-agent should reuse json-rpc connections =  </span><div class=3D"" style=3D"font-family: LucidaGrande;"><br = class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">This is a glusterized 4 host self hosted engine setup. =  All storage domains are glusterfs replica 3 volumes on 3 of the 4 = hosts that are part of the cluster.</div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><div class=3D"">Centos = 3.10.0-514.26.2.el7.x86_64</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: = LucidaGrande;">vdsm-4.18.21-1.el7.centos.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">libvirt-2.0.0-10.el7_3.9.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">glusterfs-3.7.20-1.el7.x86_64</div><div class=3D"" = style=3D"font-family: = LucidaGrande;">qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64</div><div = class=3D"" style=3D"font-family: LucidaGrande;"><br class=3D""></div><div = class=3D"" style=3D"font-family: LucidaGrande;">Host and engine are all = updated to the latest versions</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">Here are sample of messages log, vdsm,log, supervdsm.log = and mom.log</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">messages</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><div class=3D"">Aug 28 01:20:11 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:16 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:16 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:19 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:22 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:24 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:37 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:41 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:41 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:44 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:47 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div><div class=3D"">Aug 28 01:20:49 fai-kvm-1 journal: vdsm = vds.dispatcher ERROR SSL error during reading data: unexpected = eof</div></div><div class=3D"" style=3D"font-family: LucidaGrande;"><br = class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;">vdsm.log</div><div class=3D"" style=3D"font-family: = LucidaGrande;"><br class=3D""></div><div class=3D"" style=3D"font-family: = LucidaGrande;"><div class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::bindingxmlrpc::319::vds::(wrapper) client [::1]</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,242::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from = state</div><div class=3D"">init -> state preparing</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,242::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone)</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,243::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return</div><div class=3D"">response: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '1.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': = '0.000893509', 'lastCheck': '1.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version':</div><div class=3D"">3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '1.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.1', 'valid': True}, u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid':</div><div class=3D"">True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay':</div><div = class=3D"">'0.000512272', 'lastCheck': '1.1', 'valid': True}}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code':</div><div class=3D"">0,= 'actual': True, 'version': 0,</div><div class=3D"">'acquired': True, = 'delay': '0.000833501', 'lastCheck': '1.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '1.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '1.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e':</div><div class=3D"">{'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000493711', 'lastCheck': '1.3', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec':</div><div class=3D"">{'code': = 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '1.1', 'valid': True}}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::moving from = state</div><div class=3D"">preparing -> state finished</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All) Owner.cancelAll requests {}</div><div = class=3D"">Thread-316519::DEBUG::2017-08-28 = 01:21:13,243::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`7c850537-b9e2-4e4b-b346-5fc8ba40f2d1`::ref 0 aborting = False</div><div class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,243::bindingxmlrpc::331::vds::(wrapper) RPC call = storageRepoGetStats finished (code=3D0) in 0.00 seconds</div><div = class=3D"">Thread-316519::INFO::2017-08-28 = 01:21:13,246::xmlrpc::91::vds.XMLRPCServer::(_process_requests) Request = handler for</div><div class=3D"">::1:51992 stopped</div><div = class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,093::fileSD::159::Storage.StorageDomainManifest::(__init__) = Reading domain in</div><div class=3D"">path = /rhev/data-center/mnt/glusterSD/glustermount:data2/2bf8f623-1d82-444e-ae16= -d32e5fe4dc9e</div><div class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,093::persistent::194::Storage.PersistentDict::(__init__) = Created a persistent</div><div class=3D"">dict with FileMetadataRW = backend</div><div class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,096::persistent::236::Storage.PersistentDict::(refresh) read = lines (FileMetadataRW)=3D['CLASS=3DData', 'DESCRIPTION=3Ddata2', = 'IOOPTIMEOUTSEC=3D10', 'LEASERETRIES=3D3', 'LEASETIMESEC=3D60', = 'LOCKPOLICY=3D', 'LOCKRENEWALINTERVALSEC=3D5', 'MASTER_VERSION=3D10', = 'POOL_DESCRIPTION=3DDefault', = 'POOL_DOMAINS=3Dcf2f4c75-966b-4f69-90a2-d8e7d21fc052:Active,5e39db25-561f-= 490a-81b6-46a7225f02b6:Active,95d4ed8a-9184-4863-84d5-af2bedd690da:Attache= d,3e04b3ad-c46c-4903-a7b2-b9af681318d9:Attached,bd1f0364-0d3a-44fa-842a-5d= 339caac412:Attached,403df7fb-6cff-46e1-8e04-41213fbc0e6e:Active,2bf8f623-1= d82-444e-ae16-d32e5fe4dc9e:Active,6654cb0c-3e57-42ca-b996-3660a3d32a43:Act= ive,88886a7d-f4cc-45a6-901e-89999aa35d78:Attached,feaebec7-aae3-45b5-9684-= 1feedede7bec:Active', 'POOL_SPM_ID=3D-1', 'POOL_SPM_LVER=3D-1',</div><div = class=3D"">'POOL_UUID=3D5990e442-0395-0118-005c-0000000003a1', = 'REMOTE_PATH=3Dglustermount:data2', 'ROLE=3DMaster', = 'SDUUID=3D2bf8f623-1d82-444e-ae16-d32e5fe4dc9e', 'TYPE=3DGLUSTERFS', = 'VERSION=3D3', = '_SHA_CKSUM=3D65b61dc4f10d80c67c6133ffaee280919458a06a']</div><div = class=3D"">Thread-68::DEBUG::2017-08-28 = 01:21:14,105::fileSD::679::Storage.StorageDomain::(imageGarbageCollector) = Removing remnants of deleted images []</div><div = class=3D"">Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::604::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_imageNS = already registered</div><div class=3D"">Thread-68::INFO::2017-08-28 = 01:21:14,105::sd::612::Storage.StorageDomain::(_registerResourceNamespaces= ) Resource namespace 2bf8f623-1d82-444e-ae16-d32e5fe4dc9e_volumeNS = already registered</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,244::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling</div><div class=3D"">'Host.getStats' in bridge with {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,245::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state init = -> state preparing</div><div = class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::49::dispatcher::(wrapper) Run and protect: = repoStats(options=3DNone)</div><div = class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,245::logUtils::52::dispatcher::(wrapper) Run and protect: = repoStats, Return response: {u'5e39db25-561f-490a-81b6-46a7225f02b6': = {'code': 0, 'actual': True, 'version': 0, 'acquired': True,</div><div = class=3D"">'delay': '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False,</div><div class=3D"">'delay': = '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000776587', 'lastCheck': = '3.0', 'valid':</div><div class=3D"">True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid': True},</div><div = class=3D"">u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e':</div><div = class=3D"">{'code': 0, 'actual': True, 'version': 3, 'acquired': True, = 'delay': '0.000493711', 'lastCheck': '1.1', 'valid': True}, = u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, 'actual': True, = 'version': 0, 'acquired':</div><div class=3D"">True, 'delay': = '0.000512272', 'lastCheck': '3.1', 'valid': True}}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::1193::Storage.TaskManager.Task::(prepare) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::finished: = {u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0, 'acquired': True, 'delay': '0.000833501', 'lastCheck': = '3.1', 'valid': True}, u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': = 0, 'actual':</div><div class=3D"">True, 'version': 3, 'acquired': False, = 'delay': '0.000893509', 'lastCheck': '3.1', 'valid': True}, = u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True,</div><div class=3D"">'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000513211', 'lastCheck': = '1.3', 'valid':</div><div class=3D"">True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.1', 'valid': True},</div><div = class=3D"">u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': 0, = 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000512272', = 'lastCheck': '3.1', 'valid': True}}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::597::Storage.TaskManager.Task::(_updateState) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::moving from state = preparing -> state finished</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::952::Storage.ResourceManager.Owner::(releas= eAll) Owner.releaseAll requests {} resources {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::resourceManager::989::Storage.ResourceManager.Owner::(cancel= All)</div><div class=3D"">Owner.cancelAll requests {}</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,246::task::995::Storage.TaskManager.Task::(_decref) = Task=3D`5d8c4aff-86cb-447c-a833-e27e5c23c54d`::ref 0 aborting = False</div><div class=3D"">Reactor thread::INFO::2017-08-28 = 01:21:15,291::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept)</div><div class=3D"">Accepted connection from = ::1:51994</div><div class=3D"">Reactor thread::DEBUG::2017-08-28 = 01:21:15,299::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:15,301::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol stomp from ::1:51994</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:15,301::stompreactor::101::Broker.StompAdapter::(_cmd_connect) = Processing CONNECT request</div><div class=3D"">Reactor = thread::DEBUG::2017-08-28 = 01:21:15,301::stompreactor::492::protocoldetector.StompDetector::(handle_s= ocket) Stomp detected from ('::1', 51994)</div><div class=3D"">JsonRpc = (StompReactor)::INFO::2017-08-28 = 01:21:15,313::stompreactor::128::Broker.StompAdapter::(_cmd_subscribe) = Subscribe command received</div><div = class=3D"">jsonrpc.Executor/4::DEBUG::2017-08-28 = 01:21:15,356::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getStats' in bridge with {'cpuStatistics': {'1': = {'cpuUser': '2.27',</div><div class=3D"">'nodeIndex': 0, 'cpuSys': = '1.80', 'cpuIdle': '95.93'}, '0': {'cpuUser': '0.67', 'nodeIndex': 0, = 'cpuSys': '1.13', 'cpuIdle': '98.20'}, '3': {'cpuUser': '5.67', = 'nodeIndex': 0, 'cpuSys': '0.60', 'cpuIdle': '93.73'},</div><div = class=3D"">'2': {'cpuUser': '0.93', 'nodeIndex': 0, 'cpuSys': = '0.53',</div><div class=3D"">'cpuIdle': '98.54'}, '5': {'cpuUser': = '0.87', 'nodeIndex': 0, 'cpuSys': '1.40', 'cpuIdle': '97.73'}, '4': = {'cpuUser': '1.27', 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': = '98.20'}, '7': {'cpuUser': '0.27', 'nodeIndex': 0, 'cpuSys':</div><div = class=3D"">'0.47', 'cpuIdle': '99.26'}, '6': {'cpuUser': '2.07', = 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '97.40'}}, = 'numaNodeMemFree': {'0': {'memPercent': 98, 'memFree': '335'}}, = 'memShared': 0,</div><div class=3D"">'haScore': 3400, 'thpState': = 'always', 'ksmMergeAcrossNodes': True, 'rxRate': '0.04', 'vmCount': 1, = 'memUsed': '41', 'storageDomains': = {u'403df7fb-6cff-46e1-8e04-41213fbc0e6e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': False, 'delay': '0.000893509', 'lastCheck': = '3.1', 'valid': True}, u'cf2f4c75-966b-4f69-90a2-d8e7d21fc052': {'code': = 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000776587', 'lastCheck': '3.0', 'valid': True}, = u'6654cb0c-3e57-42ca-b996-3660a3d32a43': {'code': 0,</div><div = class=3D"">'actual': True, 'version': 3, 'acquired': True, 'delay': = '0.000513211', 'lastCheck': '1.3', 'valid': True}, = u'5e39db25-561f-490a-81b6-46a7225f02b6': {'code': 0, 'actual': True, = 'version': 0,</div><div class=3D"">'acquired': True, 'delay': = '0.000833501', 'lastCheck': '3.1', 'valid': True}, = u'2bf8f623-1d82-444e-ae16-d32e5fe4dc9e': {'code': 0, 'actual': True, = 'version': 3, 'acquired': True, 'delay': '0.000493711', 'lastCheck': = '1.1', 'valid': True}, u'feaebec7-aae3-45b5-9684-1feedede7bec': {'code': = 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': = '0.000512272', 'lastCheck': '3.1', 'valid': True}}, = 'incomingVmMigrations': 0,</div><div class=3D"">'network': {'enp2s0': = {'rxErrors': '0', 'txRate': '0.2', 'rxRate': '0.1', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '18453', 'name': 'enp2s0', 'tx': = '884509425955', 'txDropped': '0', 'sampleTime':</div><div = class=3D"">1503912069.554311, 'rx': '134148067121', 'state': 'up'}, = 'eno1': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors':</div><div class=3D"">'0', 'speed': '1000',</div><div = class=3D"">'rxDropped': '0', 'name': 'eno1', 'tx': '54488653089', = 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': '46979728698', = 'state': 'up'}, ';vdsmdummy;': {'rxErrors': '0', 'txRate': '0.0', = 'rxRate': '0.0',</div><div class=3D"">'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '0', 'state': 'down'}, = 'enp2s0.4': {'rxErrors': '0', 'txRate': '0.2', 'rxRate': '0.1', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.4', = 'tx': '843385870486', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '124132253793', 'state': 'up'}, 'lo': {'rxErrors': '0', 'txRate': = '0.3', 'rxRate': '0.3', 'txErrors': '0', 'speed': '1000', 'rxDropped': = '0', 'name': 'lo', 'tx': '444179233658', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '444179233658', 'state': 'up'}, 'enp4s0': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '14290', 'name': 'enp4s0',</div><div = class=3D"">'tx': '9009494', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '187852658', 'state': 'up'}, = 'enp4s0.100':</div><div class=3D"">{'rxErrors': '0', 'txRate': '0.0', = 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'enp4s0.100', 'tx': '8798732', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '95777939',</div><div class=3D"">'state': = 'up'}, 'enp2s0.2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'enp2s0.2', = 'tx': '1156', 'txDropped': '0', 'sampleTime': 1503912069.554311, 'rx': = '66329343', 'state': 'up'},</div><div class=3D"">'enp2s0.3': = {'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', = 'speed': '1000', 'rxDropped': '0',</div><div class=3D"">'name': = 'enp2s0.3', 'tx': '1156', 'txDropped': '0', 'sampleTime': = 1503912069.554311, 'rx': '5930851', 'state': 'up'}, 'vnet0': = {'rxErrors': '0', 'txRate': '0.0',</div><div class=3D"">'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', 'name': 'vnet0', = 'tx': '97194738', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '8798642', 'state': 'up'}, 'ovirtmgmt':</div><div = class=3D"">{'rxErrors': '0', 'txRate': '0.0', 'rxRate': '0.0', = 'txErrors': '0', 'speed': '1000', 'rxDropped': '2', 'name': 'ovirtmgmt', = 'tx': '52893439231', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '43528048077', 'state': 'up'}, 'ovirt-3': {'rxErrors': '0', = 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'speed': '1000', = 'rxDropped': '2', 'name': 'ovirt-3', 'tx': '578', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '4621679',</div><div = class=3D"">'state': 'up'}, 'ovirt-4': {'rxErrors': '0', 'txRate': '0.2', = 'rxRate': '0.1', 'txErrors': '0', 'speed': '1000', 'rxDropped': '0', = 'name': 'ovirt-4', 'tx': '843385869908', 'txDropped': '0',</div><div = class=3D"">'sampleTime': 1503912069.554311, 'rx': '124132039409', = 'state': 'up'}, 'ovirt-2': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0',</div><div class=3D"">'txErrors': '0', 'speed': '1000', = 'rxDropped': '0', 'name': 'ovirt-2', 'tx': '578', 'txDropped': '0', = 'sampleTime': 1503912069.554311, 'rx': '19462774', 'state':</div><div = class=3D"">'up'}, 'dmz': {'rxErrors': '0', 'txRate': '0.0', 'rxRate': = '0.0', 'txErrors': '0', 'speed': '1000', 'rxDropped': '4', 'name': = 'dmz', 'tx': '578', 'txDropped': '0', 'sampleTime': 1503912069.554311, = 'rx': '31428052',</div><div class=3D"">'state': 'up'}}, 'txDropped': = '0', 'cpuUser': '1.75', 'ksmPages': 1250, 'elapsedTime': '127838.51', = 'cpuLoad':</div><div class=3D"">'2.39', 'cpuSys': '0.86', 'diskStats': = {'/var/log': {'free': '47378'}, '/var/log/core': {'free': '47378'}, = '/var/run/vdsm/': {'free': '7868'}, '/tmp': {'free': '47378'}}, = 'cpuUserVdsmd': '2.13', 'netConfigDirty': 'False', 'memCommitted': 2113, = 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 9216, = 'txRate': '0.06', 'bootTime': '1503727419', 'haStats': = {'active':</div><div class=3D"">True, 'configured': True, 'score': 3400, = 'localMaintenance': False, 'globalMaintenance': False}, 'momStatus': = 'active', 'rxDropped': '32751', 'outgoingVmMigrations': 0, 'swapTotal': = 7999,</div><div class=3D"">'swapFree': 7842, 'dateTime': = '2017-08-28T09:21:15 GMT', 'anonHugePages': '2280', 'memFree': 9455, = 'cpuIdle': '97.39', 'vmActive': 1, 'v2vJobs': {}, 'cpuSysVdsmd': = '0.87'}</div><div class=3D"">jsonrpc.Executor/4::INFO::2017-08-28 = 01:21:15,357::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getStats succeeded in 0.12 seconds</div><div = class=3D"">jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,580::__init__::530::jsonrpc.JsonRpcServer::(_handle_request) = Calling</div><div class=3D"">'Host.getHardwareInfo' in bridge with = {}</div><div class=3D"">jsonrpc.Executor/6::DEBUG::2017-08-28 = 01:21:15,581::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) = Return 'Host.getHardwareInfo' in bridge with {'systemProductName': '', = 'systemUUID': '20DC6410-4F9F-DF11-9A25-7071BC772964', = 'systemSerialNumber': '', 'systemVersion': '', 'systemManufacturer': = ''}</div><div class=3D"">jsonrpc.Executor/6::INFO::2017-08-28 = 01:21:15,581::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC = call Host.getHardwareInfo succeeded in 0.00 seconds</div><div = class=3D"">JsonRpc (StompReactor)::ERROR::2017-08-28 = 01:21:15,583::betterAsyncore::113::vds.dispatcher::(recv) SSL error = during</div><div class=3D"">reading data: unexpected eof</div><div = class=3D"">Reactor thread::INFO::2017-08-28 = 01:21:16,325::protocoldetector::76::ProtocolDetector.AcceptorImpl::(handle= _accept)</div><div class=3D"">Accepted connection from = ::1:51996</div><div class=3D"">Reactor thread::DEBUG::2017-08-28 = 01:21:16,332::protocoldetector::92::ProtocolDetector.Detector::(__init__) = Using required_size=3D11</div><div class=3D"">Reactor = thread::INFO::2017-08-28 = 01:21:16,332::protocoldetector::128::ProtocolDetector.Detector::(handle_re= ad) Detected protocol xml from ::1:51996</div><div class=3D"">Reactor = thread::DEBUG::2017-08-28 = 01:21:16,332::bindingxmlrpc::1307::XmlDetector::(handle_socket) xml over = http detected from ('::1', 51996)</div><div = class=3D"">BindingXMLRPC::INFO::2017-08-28 = 01:21:16,332::xmlrpc::73::vds.XMLRPCServer::(handle_request) Starting = request handler for ::1:51996</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;">supervdsm.log</div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,517::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev eno1 classid 0:1388 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,545::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:4 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,572::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,573::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:2 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,600::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp4s0 classid 0:64 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,628::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/sbin/tc class show dev enp2s0 classid 0:3 (cwd None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,689::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::vsctl::57::root::(commit) Executing commands: = /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list Port = -- list Interface</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,690::commands::68::root::(execCmd) /usr/bin/taskset --cpu-list = 0-7 /usr/bin/ovs-vsctl --oneline --format=3Djson -- list Bridge -- list = Port -- list Interface (cwd</div><div class=3D"">None)</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,720::commands::86::root::(execCmd) SUCCESS: <err> =3D ''; = <rc> =3D 0</div><div = class=3D"">MainProcess|Thread-316590::DEBUG::2017-08-28 = 01:21:56,724::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return network_caps with {'bridges': {'ovirtmgmt': {'ipv6autoconf': = False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'yes', = 'DNS1': '127.0.0.1', 'IPADDR': '10.9.2.61', 'GATEWAY': '10.9.2.1', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': '209.193.4.7', 'DEVICE': = 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': = '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.2.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eno1'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '104', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.7071bc772964', 'bridge_id': '8000.7071bc772964', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '16704', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-4': {'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.9.3.1', = 'dhcpv4': False, 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['enp2s0.4'], 'opts': {'multicast_last_member_count': = '2', 'hash_elasticity': '4', 'multicast_query_response_interval': = '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '102', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '8307', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'dmz': {'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'enp4s0.100'], = 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', = 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', = 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', = 'hello_timer': '103', 'multicast_querier_interval': '25500', 'max_age': = '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': = '0', 'priority': '32768', 'multicast_membership_interval': '26000', = 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.001b212f794d', 'bridge_id': '8000.001b212f794d', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '7181', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-2': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.2'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '2', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '320', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}, 'ovirt-3': {'ipv6autoconf': False, 'addr': '', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': = 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], = 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': = 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3'], 'opts': {'multicast_last_member_count': '2', = 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', = 'group_fwd_mask': '0x0', 'multicast_snooping': '1', = 'multicast_startup_query_interval': '3125', 'hello_timer': '1', = 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': = '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': = '32768', 'multicast_membership_interval': '26000', 'root_path_cost': = '0', 'root_port': '0', 'multicast_querier': '0', = 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', = 'topology_change': '0', 'hello_time': '200', 'root_id': = '8000.6805ca4606af', 'bridge_id': '8000.6805ca4606af', = 'topology_change_timer': '0', 'ageing_time': '30000', = 'nf_call_ip6tables': '0', 'gc_timer': '14656', 'nf_call_arptables': '0', = 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', = 'default_pvid': '1', 'multicast_query_interval': '12500', 'tcn_timer': = '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': = '0'}}}, 'bondings': {}, 'nameservers': ['127.0.0.1', '209.193.4.7', = '209.112.128.2'], 'nics': {'enp2s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '68:05:ca:46:06:af', 'speed': 1000, 'gateway': ''}, 'eno1': = {'ipv6gateway': '::', 'ipv6autoconf': False, 'addr': '', 'cfg': = {'BRIDGE': 'ovirtmgmt', 'IPV6INIT': 'no', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'eno1', 'ONBOOT': = 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, 'netmask': '', = 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': '70:71:bc:77:29:64', = 'speed': 1000, 'gateway': ''}, 'enp4s0': {'ipv6gateway': '::', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'MTU': = '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'hwaddr': = '00:1b:21:2f:79:4d', 'speed': 1000, 'gateway': ''}}, 'supportsIPv6': = True, 'vlans': {'enp2s0.4': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-4', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.4', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 4, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp4s0.100': = {'iface': 'enp4s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'dmz', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp4s0.100', 'ONBOOT': 'yes'}, = 'ipv6addrs': [], 'vlanid': 100, 'mtu': '1500', 'dhcpv4': False, = 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': '::', = 'gateway': ''}, 'enp2s0.2': {'iface': 'enp2s0', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'BRIDGE': 'ovirt-2', 'IPV6INIT': 'no', 'VLAN': = 'yes', 'MTU': '1500', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', = 'DEVICE': 'enp2s0.2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 2, = 'mtu': '1500', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, = 'ipv4addrs': [], 'ipv6gateway': '::', 'gateway': ''}, 'enp2s0.3': = {'iface': 'enp2s0', 'ipv6autoconf': False, 'addr': '', 'cfg': {'BRIDGE': = 'ovirt-3', 'IPV6INIT': 'no', 'VLAN': 'yes', 'MTU': '1500', = 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'DEVICE': 'enp2s0.3', = 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'vlanid': 3, 'mtu': '1500', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'ipv4addrs': [], 'ipv6gateway': = '::', 'gateway': ''}}, 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', = 'ipv6autoconf': False, 'addr': '10.9.2.61', 'cfg': {'IPV6INIT': 'no', = 'DEFROUTE':</div><div class=3D"">'yes', 'DNS1': '127.0.0.1', 'IPADDR': = '10.9.2.61', 'GATEWAY': '10.9.2.1', 'DELAY': '0', 'NM_CONTROLLED': 'no', = 'NETMASK': '255.255.255.0', 'BOOTPROTO': 'none', 'STP': 'off', 'DNS2': = '209.193.4.7', 'DEVICE': 'ovirtmgmt', 'MTU': '1500', 'TYPE': 'Bridge', = 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', = 'gateway': '10.9.2.1', 'dhcpv4': False, 'netmask': '255.255.255.0', = 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': ['10.9.2.61/24'], 'mtu': = '1500', 'ipv6gateway': '::', 'ports': ['eno1']}, 'ovirt-4': {'iface': = 'ovirt-4', 'ipv6autoconf': False, 'addr': '10.9.3.61', 'cfg': = {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'IPADDR': '10.9.3.61', 'MTU': = '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'NETMASK': '255.255.255.0', = 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'ovirt-4', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [],</div><div = class=3D"">'switch': 'legacy', 'gateway': '10.9.3.1', 'dhcpv4': False, = 'netmask': '255.255.255.0', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': = ['10.9.3.61/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.4']}, 'ovirt-2': {'iface': 'ovirt-2', 'ipv6autoconf': False, = 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': 'no', 'MTU': '1500', = 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'none', 'STP': 'off', = 'DEVICE': 'ovirt-2', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': = True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': '', 'dhcpv4': = False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', 'ipv4addrs': [], = 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['enp2s0.2']}, 'dmz': = {'iface': 'dmz', 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': = 'no', 'DEFROUTE': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': = 'no', 'BOOTPROTO': 'none', 'STP': 'off', 'DEVICE': 'dmz', 'TYPE': = 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': = 'legacy', 'gateway': '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': = False, 'stp': 'off', 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': = '::', 'ports': ['vnet0', 'enp4s0.100']}, 'ovirt-3': {'iface': 'ovirt-3', = 'ipv6autoconf': False, 'addr': '', 'cfg': {'IPV6INIT': 'no', 'DEFROUTE': = 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': = 'none', 'STP': 'off', 'DEVICE': 'ovirt-3', 'TYPE': 'Bridge', 'ONBOOT': = 'yes'}, 'bridged': True, 'ipv6addrs': [], 'switch': 'legacy', 'gateway': = '', 'dhcpv4': False, 'netmask': '', 'dhcpv6': False, 'stp': 'off', = 'ipv4addrs': [], 'mtu': '1500', 'ipv6gateway': '::', 'ports': = ['enp2s0.3']}}}</div><div = class=3D"">MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::92::SuperVdsm.ServerCallback::(wrapper) = call getHardwareInfo with () {}</div><div = class=3D"">MainProcess|jsonrpc.Executor/3::DEBUG::2017-08-28 = 01:21:58,027::supervdsmServer::99::SuperVdsm.ServerCallback::(wrapper) = return getHardwareInfo with {'systemProductName': '', 'systemUUID': = '20DC6410-4F9F-DF11-9A25-7</div></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""></div><div class=3D"" = style=3D"font-family: LucidaGrande;"><br class=3D""><div class=3D""><div = class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;"><font face=3D"Menlo" class=3D"" = style=3D"font-size: 12px;"><div = class=3D"">---------------------------------------------------------------= ---------</div><div class=3D"">Gary Pedretty         =                     =            <a = href=3D"mailto:gary@eraalaska.net" = class=3D"">gary(a)ravnalaska.net</a></div><div class=3D"">Systems Manager =                     =                     =  <a href=3D"http://www.flyravn.com" = class=3D"">www.flyravn.com</a></div><div class=3D"">Ravn Alaska   =                     =     /\                 =    907-450-7251</div><div class=3D"">5245 Airport Industrial = Road         /  \/\         =     907-450-7238 fax</div><div class=3D"">Fairbanks, Alaska =  99709        /\  /    \ \ = Second greatest commandment</div></font><font face=3D"Monaco" = class=3D""><span class=3D"" style=3D"font-size: 12px;">Serving All of = Alaska          /  \/  /\  \ \/\ =   =E2=80=9CLove your neighbor as</span></font><br class=3D"" = style=3D"font-family: Monaco;"><font face=3D"Menlo" class=3D""><span = class=3D"" style=3D"font-size: 12px;">Green, green as far as the eyes = can see             yourself=E2=80=9D Matt = 22:39</span></font><div class=3D"" style=3D"font-family: = Menlo;"></div><font face=3D"Menlo" class=3D"" style=3D"font-size: = 12px;"></font><span class=3D"" style=3D"font-size: 12px;"><font = face=3D"Menlo" class=3D""><div = class=3D"">---------------------------------------------------------------= ---------</div></font></span><div class=3D""><font face=3D"Menlo" = class=3D"" style=3D"font-size: 12px;"><br = class=3D""></font></div></div><span class=3D"" style=3D"font-size: = 12px;"><br class=3D"Apple-interchange-newline"></span></div><span = class=3D"" style=3D"font-size: 12px;"><br = class=3D"Apple-interchange-newline"></span></div><span class=3D"" = style=3D"font-size: 12px;"><br = class=3D"Apple-interchange-newline"></span></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"><br = class=3D"Apple-interchange-newline"></div><br class=3D""><blockquote = type=3D"cite" class=3D"">On Aug 27, 2017, at 11:24 PM, Yaniv Kaul <<a = href=3D"mailto:ykaul@redhat.com" class=3D"">ykaul(a)redhat.com</a>> = wrote:<br class=3D""><br class=3D"">vdsm vds.dispatcher ERROR SSL error = during reading data: unexpected eof</blockquote></div></body></html>= --Apple-Mail=_BF0F8909-F772-4228-ADA6-BEDEE7C22B79--

1 1

Addition of hosts fail at network setup
by Paul-Erik Törrönen 25 Sep '17

25 Sep '17

Hello, I'm attempting to add another host to the cluster, and I'm getting the following error when I add the ovirtmgmt network to the physical network device: Error while executing action HostSetupNetworks: Unexpected exception In the host vdsm.log I have the following: 2017-09-25 19:58:35,060+0300 ERROR (jsonrpc/4) [jsonrpc.JsonRpcServer] Internal server error (__init__:577) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 572, in _handle_request res = method(**params) File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 202, in _dynamicMethod result = fn(*methodArgs) File "/usr/share/vdsm/API.py", line 1575, in setupNetworks supervdsm.getProxy().setupNetworks(networks, bondings, options) File "/usr/lib/python2.7/site-packages/vdsm/supervdsm.py", line 53, in __call__ return callMethod() File "/usr/lib/python2.7/site-packages/vdsm/supervdsm.py", line 51, in <lambda> **kwargs) File "<string>", line 2, in setupNetworks File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in _callmethod raise convert_to_error(kind, result) IOError: [Errno 2] No such file or directory: u'/etc/sysconfig/network-scripts/ifcfg-ovirtmgmt' 2017-09-25 19:58:35,061+0300 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.setupNetworks failed (error -32603) in 0.18 seconds (__init__:539) I thought the ifcfg-ovirtmgmt-file was supposed to be created by the ovirt setup? I'm running the latest ovirt 4.1.6 on CentOS7.4 x86_64 (ovirt-release41-4.1.6-1.el7.centos.noarch). Poltsi

1 0

Clone of VM and copy of disks doubts
by Gianluca Cecchi 25 Sep '17

25 Sep '17

Hello, I have a VM VM1 that I would like to clone. It has 3 disks: 2 of them on storage domain SDA, 1 of them (size 80Gb) on a second storage domain SDB I want the new VM to have all the 3 disks on SDA, because SDB has not enough space to accomodate the cloned disk I power off VM1, select it and then "Clone VM". It seems I have no options at all and that I can only specify the name of the new VM, while oVirt would copy the VM with exactlly the same disks and so I receive error Error while executing action: VM2: - Cannot add VM. Low disk space on Storage Domain SDB. Is this expected? In case it seems not very flexible. So I create a snapshot of VM1 and then "Clone". Inside the "Resource Allocation" section, the drop-down for the 3 disks seems not enabled, in the sense that for every disk it contains only the name of the origin SD, so for 2 disks it contains SDA and no other SD to be chosen, for 1 disk it contains SDB and no other SD to be chosen. See here: https://drive.google.com/file/d/0BwoPbcrMv8mvdFd0RFMzRXhmRzQ/view?usp=shari… Can anyone replicate this in 4.1.5 to see if it is a problem of mine? So as a last resource I decide to copy disk by disk. Apparently my VM1 disk in SDB is preallocated: at least this is what I see if I select VM1, Snapshots, select the "Current" line (it is the only oe as therer are no snapshots), "DIsks" in right subpane See here for screenshot: https://drive.google.com/file/d/0BwoPbcrMv8mvclV5bDdsdE9Ubmc/view?usp=shari… Any more comfortable and correct way from web admin gui to see disk type? When I copy the disk it seems it tries to create a thin provisioned disk and it takes about 4 hours to copy 80Gb of disks from SSD to SAS SD with very few I/O activity on hypervisor in the mean time (I have only one node in this test) when I would expect around 40minutes with a throughput of at elast 40MB/s with a sort of dd as the cemu-img command should be... instead the command I see from command line is kind of /usr/bin/qemu-img convert -p -t none -T none -f qcow2 /rhev/data-center/59b7af54-0155-01c2-0248-000000000195/70411599-c19f-4a6a-80b5-abdeffc1616e/images/3d357b96-57e1-47bd-be65-558252a591d3/77ba5e2b-dfbe-4801-b5ec-dc9ffae2c481 -O qcow2 -o compat=1.1 /rhev/data-center/mnt/blockSD/fad05d79-254d-4f40-8201-360757128ede/images/73292653-f5d9-49ae-8132-f17d288bf822/deb4b841-95cd-4523-9523-f2ffdbb9b4a9 Also, if get this VM and create a snapshot of it I see this: - starting point all the 3 disks seem preallocated (same method as above) - after creating a snapshot, if I select the "Current" line the 3 disks are all thin-provision, if I select the line of the taken snapshot instead the disks are all preallocated. Any comments or suggestions about the points above? Thanks, Gianluca

1 1

Snapshot removal vs selinux enforced
by Lionel Caignec 25 Sep '17

25 Sep '17

Hi, i have a problem with selinux enforced. When i tried to live remove a snapshot the operation failed . After some headache i found the problem source : selinux. When i "setenfore 0" the removal task work, when i "setenforce 1" removal task failed. log from audit.log: vc: denied {write} for pid = 28360 tmptext = system_u: object_r : fixed_disk_device_t: s0 tclass = blk_file I'm with RHEL 7.4 and ovirt 4.1, is it some specific configuration to do?. Thanks for help.

1 1

Failed gdeploy
by Sean McMurray 25 Sep '17

25 Sep '17

My latest attempt to deploy went like this (/tmp/tmpaQJuTG/run-script.yml and /tmp/gdeployConfig.conf are pasted below the gdeploy transcript): # gdeploy -k -vv -c /tmp/gdeployConfig.conf --trace Using /etc/ansible/ansible.cfg as config file PLAYBOOK: run-script.yml ********************************************************************************************************************* 1 plays in /tmp/tmpaQJuTG/run-script.yml PLAY [gluster_servers] *********************************************************************************************************************** META: ran handlers TASK [Run a shell script] ******************************************************************************************************************** task path: /tmp/tmpaQJuTG/run-script.yml:7 changed: [192.168.1.3] => (item=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h 192.168.1.1,192.168.1.2,192.168.1.3) => {"changed": true, "failed": false, "failed_when_result": false, "item": "/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h 192.168.1.1,192.168.1.2,192.168.1.3", "rc": 0, "stderr": "Shared connection to 192.168.1.3 closed.\r\n", "stdout": "", "stdout_lines": []} changed: [192.168.1.2] => (item=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h 192.168.1.1,192.168.1.2,192.168.1.3) => {"changed": true, "failed": false, "failed_when_result": false, "item": "/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h 192.168.1.1,192.168.1.2,192.168.1.3", "rc": 0, "stderr": "Shared connection to 192.168.1.2 closed.\r\n", "stdout": "", "stdout_lines": []} changed: [192.168.1.1] => (item=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h 192.168.1.1,192.168.1.2,192.168.1.3) => {"changed": true, "failed": false, "failed_when_result": false, "item": "/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h 192.168.1.1,192.168.1.2,192.168.1.3", "rc": 0, "stderr": "Shared connection to 192.168.1.1 closed.\r\n", "stdout": "scp: /tmp/*_host_ip_2017_09_22.txt: No such file or directory\r\nscp: /tmp/*_host_ip_2017_09_22.txt: No such file or directory\r\n", "stdout_lines": ["scp: /tmp/*_host_ip_2017_09_22.txt: No such file or directory", "scp: /tmp/*_host_ip_2017_09_22.txt: No such file or directory"]} META: ran handlers META: ran handlers PLAY RECAP *********************************************************************************************************************************** 192.168.1.1 : ok=1 changed=1 unreachable=0 failed=0 192.168.1.2 : ok=1 changed=1 unreachable=0 failed=0 192.168.1.3 : ok=1 changed=1 unreachable=0 failed=0 Using /etc/ansible/ansible.cfg as config file PLAYBOOK: chkconfig_service.yml ************************************************************************************************************** 1 plays in /tmp/tmpaQJuTG/chkconfig_service.yml PLAY [gluster_servers] *********************************************************************************************************************** META: ran handlers TASK [Enable or disable services] ************************************************************************************************************ task path: /tmp/tmpaQJuTG/chkconfig_service.yml:7 ok: [192.168.1.3] => (item=chronyd) => {"changed": false, "enabled": true, "item": "chronyd", "name": "chronyd", "status": {"ActiveEnterTimestamp": "Fri 2017-09-22 08:05:49 PDT", "ActiveEnterTimestampMonotonic": "57218106256", "ActiveExitTimestamp": "Fri 2017-09-22 08:05:49 PDT", "ActiveExitTimestampMonotonic": "57218037256", "ActiveState": "active", "After": "systemd-journald.socket var.mount tmp.mount ntpd.service -.mount system.slice sntp.service basic.target ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2017-09-22 08:05:49 PDT", "AssertTimestampMonotonic": "57218053902", "Before": "multi-user.target imgbase-config-vdsm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2017-09-22 08:05:49 PDT", "ConditionTimestampMonotonic": "57218053870", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "EnvironmentFile": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "7300", "ExecMainStartTimestamp": "Fri 2017-09-22 08:05:49 PDT", "ExecMainStartTimestampMonotonic": "57218077328", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2017-09-22 08:05:49 PDT] ; stop_time=[Fri 2017-09-22 08:05:49 PDT] ; pid=7298 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2017-09-22 08:05:49 PDT] ; stop_time=[Fri 2017-09-22 08:05:49 PDT] ; pid=7302 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2017-09-22 08:05:49 PDT", "InactiveEnterTimestampMonotonic": "57218052782", "InactiveExitTimestamp": "Fri 2017-09-22 08:05:49 PDT", "InactiveExitTimestampMonotonic": "57218054578", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "62043", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "62043", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "7300", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/var/run/chronyd.pid", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "yes", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount var.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2017-09-22 08:05:49 PDT", "WatchdogTimestampMonotonic": "57218077340", "WatchdogUSec": "0"}} ok: [192.168.1.2] => (item=chronyd) => {"changed": false, "enabled": true, "item": "chronyd", "name": "chronyd", "status": {"ActiveEnterTimestamp": "Fri 2017-09-22 15:04:50 PDT", "ActiveEnterTimestampMonotonic": "139348506558", "ActiveExitTimestamp": "Fri 2017-09-22 15:04:50 PDT", "ActiveExitTimestampMonotonic": "139348424046", "ActiveState": "active", "After": "ntpd.service sntp.service systemd-journald.socket tmp.mount ntpdate.service -.mount system.slice basic.target var.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2017-09-22 15:04:50 PDT", "AssertTimestampMonotonic": "139348447946", "Before": "shutdown.target multi-user.target imgbase-config-vdsm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2017-09-22 15:04:50 PDT", "ConditionTimestampMonotonic": "139348447884", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "EnvironmentFile": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "10148", "ExecMainStartTimestamp": "Fri 2017-09-22 15:04:50 PDT", "ExecMainStartTimestampMonotonic": "139348474428", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2017-09-22 15:04:50 PDT] ; stop_time=[Fri 2017-09-22 15:04:50 PDT] ; pid=10146 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2017-09-22 15:04:50 PDT] ; stop_time=[Fri 2017-09-22 15:04:50 PDT] ; pid=10150 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2017-09-22 15:04:50 PDT", "InactiveEnterTimestampMonotonic": "139348445639", "InactiveExitTimestamp": "Fri 2017-09-22 15:04:50 PDT", "InactiveExitTimestampMonotonic": "139348449304", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "62271", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "62271", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "10148", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/var/run/chronyd.pid", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "yes", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount var.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2017-09-22 15:04:50 PDT", "WatchdogTimestampMonotonic": "139348474458", "WatchdogUSec": "0"}} ok: [192.168.1.1] => (item=chronyd) => {"changed": false, "enabled": true, "item": "chronyd", "name": "chronyd", "status": {"ActiveEnterTimestamp": "Fri 2017-09-22 08:05:55 PDT", "ActiveEnterTimestampMonotonic": "64535125522", "ActiveExitTimestamp": "Fri 2017-09-22 08:05:54 PDT", "ActiveExitTimestampMonotonic": "64535042941", "ActiveState": "active", "After": "ntpd.service tmp.mount systemd-journald.socket system.slice sntp.service basic.target var.mount ntpdate.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2017-09-22 08:05:54 PDT", "AssertTimestampMonotonic": "64535053307", "Before": "shutdown.target multi-user.target imgbase-config-vdsm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2017-09-22 08:05:54 PDT", "ConditionTimestampMonotonic": "64535053202", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "EnvironmentFile": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "9436", "ExecMainStartTimestamp": "Fri 2017-09-22 08:05:55 PDT", "ExecMainStartTimestampMonotonic": "64535083184", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2017-09-22 08:05:54 PDT] ; stop_time=[Fri 2017-09-22 08:05:55 PDT] ; pid=9434 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2017-09-22 08:05:55 PDT] ; stop_time=[Fri 2017-09-22 08:05:55 PDT] ; pid=9438 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2017-09-22 08:05:54 PDT", "InactiveEnterTimestampMonotonic": "64535051400", "InactiveExitTimestamp": "Fri 2017-09-22 08:05:54 PDT", "InactiveExitTimestampMonotonic": "64535054635", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "14440", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "14440", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "9436", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/var/run/chronyd.pid", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "yes", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount var.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2017-09-22 08:05:55 PDT", "WatchdogTimestampMonotonic": "64535083221", "WatchdogUSec": "0"}} META: ran handlers META: ran handlers PLAY RECAP *********************************************************************************************************************************** 192.168.1.1 : ok=1 changed=0 unreachable=0 failed=0 192.168.1.2 : ok=1 changed=0 unreachable=0 failed=0 192.168.1.3 : ok=1 changed=0 unreachable=0 failed=0 Using /etc/ansible/ansible.cfg as config file PLAYBOOK: service_management.yml ************************************************************************************************************* 1 plays in /tmp/tmpaQJuTG/service_management.yml PLAY [gluster_servers] *********************************************************************************************************************** META: ran handlers TASK [start/stop/restart/reload services] **************************************************************************************************** task path: /tmp/tmpaQJuTG/service_management.yml:7 changed: [192.168.1.3] => (item=chronyd) => {"changed": true, "item": "chronyd", "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2017-09-22 08:05:49 PDT", "ActiveEnterTimestampMonotonic": "57218106256", "ActiveExitTimestamp": "Fri 2017-09-22 08:05:49 PDT", "ActiveExitTimestampMonotonic": "57218037256", "ActiveState": "active", "After": "systemd-journald.socket var.mount tmp.mount ntpd.service -.mount system.slice sntp.service basic.target ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2017-09-22 08:05:49 PDT", "AssertTimestampMonotonic": "57218053902", "Before": "multi-user.target imgbase-config-vdsm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2017-09-22 08:05:49 PDT", "ConditionTimestampMonotonic": "57218053870", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "EnvironmentFile": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "7300", "ExecMainStartTimestamp": "Fri 2017-09-22 08:05:49 PDT", "ExecMainStartTimestampMonotonic": "57218077328", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2017-09-22 08:05:49 PDT] ; stop_time=[Fri 2017-09-22 08:05:49 PDT] ; pid=7298 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2017-09-22 08:05:49 PDT] ; stop_time=[Fri 2017-09-22 08:05:49 PDT] ; pid=7302 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2017-09-22 08:05:49 PDT", "InactiveEnterTimestampMonotonic": "57218052782", "InactiveExitTimestamp": "Fri 2017-09-22 08:05:49 PDT", "InactiveExitTimestampMonotonic": "57218054578", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "62043", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "62043", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "7300", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/var/run/chronyd.pid", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "yes", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount var.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2017-09-22 08:05:49 PDT", "WatchdogTimestampMonotonic": "57218077340", "WatchdogUSec": "0"}} changed: [192.168.1.2] => (item=chronyd) => {"changed": true, "item": "chronyd", "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2017-09-22 15:04:50 PDT", "ActiveEnterTimestampMonotonic": "139348506558", "ActiveExitTimestamp": "Fri 2017-09-22 15:04:50 PDT", "ActiveExitTimestampMonotonic": "139348424046", "ActiveState": "active", "After": "ntpd.service sntp.service systemd-journald.socket tmp.mount ntpdate.service -.mount system.slice basic.target var.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2017-09-22 15:04:50 PDT", "AssertTimestampMonotonic": "139348447946", "Before": "shutdown.target multi-user.target imgbase-config-vdsm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2017-09-22 15:04:50 PDT", "ConditionTimestampMonotonic": "139348447884", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "EnvironmentFile": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "10148", "ExecMainStartTimestamp": "Fri 2017-09-22 15:04:50 PDT", "ExecMainStartTimestampMonotonic": "139348474428", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2017-09-22 15:04:50 PDT] ; stop_time=[Fri 2017-09-22 15:04:50 PDT] ; pid=10146 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2017-09-22 15:04:50 PDT] ; stop_time=[Fri 2017-09-22 15:04:50 PDT] ; pid=10150 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2017-09-22 15:04:50 PDT", "InactiveEnterTimestampMonotonic": "139348445639", "InactiveExitTimestamp": "Fri 2017-09-22 15:04:50 PDT", "InactiveExitTimestampMonotonic": "139348449304", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "62271", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "62271", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "10148", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/var/run/chronyd.pid", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "yes", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount var.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2017-09-22 15:04:50 PDT", "WatchdogTimestampMonotonic": "139348474458", "WatchdogUSec": "0"}} changed: [192.168.1.1] => (item=chronyd) => {"changed": true, "item": "chronyd", "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2017-09-22 08:05:55 PDT", "ActiveEnterTimestampMonotonic": "64535125522", "ActiveExitTimestamp": "Fri 2017-09-22 08:05:54 PDT", "ActiveExitTimestampMonotonic": "64535042941", "ActiveState": "active", "After": "ntpd.service tmp.mount systemd-journald.socket system.slice sntp.service basic.target var.mount ntpdate.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2017-09-22 08:05:54 PDT", "AssertTimestampMonotonic": "64535053307", "Before": "shutdown.target multi-user.target imgbase-config-vdsm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2017-09-22 08:05:54 PDT", "ConditionTimestampMonotonic": "64535053202", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "EnvironmentFile": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "9436", "ExecMainStartTimestamp": "Fri 2017-09-22 08:05:55 PDT", "ExecMainStartTimestampMonotonic": "64535083184", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2017-09-22 08:05:54 PDT] ; stop_time=[Fri 2017-09-22 08:05:55 PDT] ; pid=9434 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2017-09-22 08:05:55 PDT] ; stop_time=[Fri 2017-09-22 08:05:55 PDT] ; pid=9438 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2017-09-22 08:05:54 PDT", "InactiveEnterTimestampMonotonic": "64535051400", "InactiveExitTimestamp": "Fri 2017-09-22 08:05:54 PDT", "InactiveExitTimestampMonotonic": "64535054635", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "14440", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "14440", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "9436", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/var/run/chronyd.pid", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "yes", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount var.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2017-09-22 08:05:55 PDT", "WatchdogTimestampMonotonic": "64535083221", "WatchdogUSec": "0"}} META: ran handlers META: ran handlers PLAY RECAP *********************************************************************************************************************************** 192.168.1.1 : ok=1 changed=1 unreachable=0 failed=0 192.168.1.2 : ok=1 changed=1 unreachable=0 failed=0 192.168.1.3 : ok=1 changed=1 unreachable=0 failed=0 Using /etc/ansible/ansible.cfg as config file PLAYBOOK: shell_cmd.yml ********************************************************************************************************************** 1 plays in /tmp/tmpaQJuTG/shell_cmd.yml PLAY [gluster_servers] *********************************************************************************************************************** META: ran handlers TASK [Run a command in the shell] ************************************************************************************************************ task path: /tmp/tmpaQJuTG/shell_cmd.yml:7 changed: [192.168.1.3] => (item=vdsm-tool configure --force) => {"changed": true, "cmd": "vdsm-tool configure --force", "delta": "0:00:00.666325", "end": "2017-09-22 08:13:13.528752", "item": "vdsm-tool configure --force", "rc": 0, "start": "2017-09-22 08:13:12.862427", "stderr": "", "stderr_lines": [], "stdout": "\nChecking configuration status...\n\nabrt is already configured for vdsm\nlvm is configured for vdsm\nlibvirt is already configured for vdsm\nSUCCESS: ssl configured to true. No conflicts\nCurrent revision of multipath.conf detected, preserving\n\nRunning configure...\nReconfiguration of abrt is done.\nReconfiguration of passwd is done.\nReconfiguration of libvirt is done.\n\nDone configuring modules to VDSM.", "stdout_lines": ["", "Checking configuration status...", "", "abrt is already configured for vdsm", "lvm is configured for vdsm", "libvirt is already configured for vdsm", "SUCCESS: ssl configured to true. No conflicts", "Current revision of multipath.conf detected, preserving", "", "Running configure...", "Reconfiguration of abrt is done.", "Reconfiguration of passwd is done.", "Reconfiguration of libvirt is done.", "", "Done configuring modules to VDSM."]} changed: [192.168.1.2] => (item=vdsm-tool configure --force) => {"changed": true, "cmd": "vdsm-tool configure --force", "delta": "0:00:02.812365", "end": "2017-09-22 15:12:16.320833", "item": "vdsm-tool configure --force", "rc": 0, "start": "2017-09-22 15:12:13.508468", "stderr": "", "stderr_lines": [], "stdout": "\nChecking configuration status...\n\nabrt is already configured for vdsm\nlvm is configured for vdsm\nlibvirt is already configured for vdsm\nSUCCESS: ssl configured to true. No conflicts\nCurrent revision of multipath.conf detected, preserving\n\nRunning configure...\nReconfiguration of abrt is done.\nReconfiguration of passwd is done.\nReconfiguration of libvirt is done.\n\nDone configuring modules to VDSM.", "stdout_lines": ["", "Checking configuration status...", "", "abrt is already configured for vdsm", "lvm is configured for vdsm", "libvirt is already configured for vdsm", "SUCCESS: ssl configured to true. No conflicts", "Current revision of multipath.conf detected, preserving", "", "Running configure...", "Reconfiguration of abrt is done.", "Reconfiguration of passwd is done.", "Reconfiguration of libvirt is done.", "", "Done configuring modules to VDSM."]} changed: [192.168.1.1] => (item=vdsm-tool configure --force) => {"changed": true, "cmd": "vdsm-tool configure --force", "delta": "0:00:02.004199", "end": "2017-09-22 08:13:18.078810", "item": "vdsm-tool configure --force", "rc": 0, "start": "2017-09-22 08:13:16.074611", "stderr": "", "stderr_lines": [], "stdout": "\nChecking configuration status...\n\nabrt is already configured for vdsm\nlvm is configured for vdsm\nlibvirt is already configured for vdsm\nSUCCESS: ssl configured to true. No conflicts\nCurrent revision of multipath.conf detected, preserving\n\nRunning configure...\nReconfiguration of abrt is done.\nReconfiguration of passwd is done.\nReconfiguration of libvirt is done.\n\nDone configuring modules to VDSM.", "stdout_lines": ["", "Checking configuration status...", "", "abrt is already configured for vdsm", "lvm is configured for vdsm", "libvirt is already configured for vdsm", "SUCCESS: ssl configured to true. No conflicts", "Current revision of multipath.conf detected, preserving", "", "Running configure...", "Reconfiguration of abrt is done.", "Reconfiguration of passwd is done.", "Reconfiguration of libvirt is done.", "", "Done configuring modules to VDSM."]} META: ran handlers META: ran handlers PLAY RECAP *********************************************************************************************************************************** 192.168.1.1 : ok=1 changed=1 unreachable=0 failed=0 192.168.1.2 : ok=1 changed=1 unreachable=0 failed=0 192.168.1.3 : ok=1 changed=1 unreachable=0 failed=0 Using /etc/ansible/ansible.cfg as config file PLAYBOOK: run-script.yml ********************************************************************************************************************* 1 plays in /tmp/tmpaQJuTG/run-script.yml PLAY [gluster_servers] *********************************************************************************************************************** META: ran handlers TASK [Run a shell script] ******************************************************************************************************************** task path: /tmp/tmpaQJuTG/run-script.yml:7 fatal: [192.168.1.3]: FAILED! => {"failed": true, "msg": "The conditional check 'result.rc != 0' failed. The error was: error while evaluating conditional (result.rc != 0): 'dict object' has no attribute 'rc'"} fatal: [192.168.1.2]: FAILED! => {"failed": true, "msg": "The conditional check 'result.rc != 0' failed. The error was: error while evaluating conditional (result.rc != 0): 'dict object' has no attribute 'rc'"} fatal: [192.168.1.1]: FAILED! => {"failed": true, "msg": "The conditional check 'result.rc != 0' failed. The error was: error while evaluating conditional (result.rc != 0): 'dict object' has no attribute 'rc'"} to retry, use: --limit @/tmp/tmpaQJuTG/run-script.retry PLAY RECAP *********************************************************************************************************************************** 192.168.1.1 : ok=0 changed=0 unreachable=0 failed=1 192.168.1.2 : ok=0 changed=0 unreachable=0 failed=1 192.168.1.3 : ok=0 changed=0 unreachable=0 failed=1 You can view the generated configuration files inside /tmp/tmpaQJuTG /tmp/tmpaQJuTG/run-script.yml is: --- - hosts: gluster_servers remote_user: root gather_facts: no tasks: - name: Run a shell script script: "{{ item }}" register: result failed_when: result.rc != 0 with_items: "{{ script }}" /tmp/gdeployConfig.conf is: #gdeploy configuration generated by cockpit-gluster plugin [hosts] 192.168.1.1 192.168.1.2 192.168.1.3 [script1] action=execute ignore_script_errors=no file=/usr/share/gdeploy/scripts/grafton-sanity-check.sh -d sdb -h 192.168.1.1,192.168.1.2,192.168.1.3 [disktype] raid6 [diskcount] 12 [stripesize] 256 [service1] action=enable service=chronyd [service2] action=restart service=chronyd [shell2] action=execute command=vdsm-tool configure --force [script3] action=execute file=/usr/share/gdeploy/scripts/blacklist_all_disks.sh ignore_script_errors=no [pv1] action=create devices=sdb ignore_pv_errors=no [vg1] action=create vgname=gluster_vg_sdb pvname=sdb ignore_vg_errors=no [lv1] action=create poolname=gluster_thinpool_sdb ignore_lv_errors=no vgname=gluster_vg_sdb lvtype=thinpool size=1005GB poolmetadatasize=5GB [lv2] action=create lvname=gluster_lv_engine ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/engine size=100GB lvtype=thick [lv3] action=create lvname=gluster_lv_data ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/data lvtype=thinlv poolname=gluster_thinpool_sdb virtualsize=500GB [lv4] action=create lvname=gluster_lv_vmstore ignore_lv_errors=no vgname=gluster_vg_sdb mount=/gluster_bricks/vmstore lvtype=thinlv poolname=gluster_thinpool_sdb virtualsize=500GB [selinux] yes [service3] action=restart service=glusterd slice_setup=yes [firewalld] action=add ports=111/tcp,2049/tcp,54321/tcp,5900/tcp,5900-6923/tcp,5666/tcp,16514/tcp,54322/tcp services=glusterfs [script2] action=execute file=/usr/share/gdeploy/scripts/disable-gluster-hooks.sh [shell3] action=execute command=usermod -a -G gluster qemu [volume1] action=create volname=engine transport=tcp replica=yes replica_count=3 key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal,features.shard-block-size value=virt,36,36,30,on,off,enable,64MB brick_dirs=192.168.1.1:/gluster_bricks/engine/engine,192.168.1.2:/gluster_bricks/engine/engine,192.168.1.3:/gluster_bricks/engine/engine ignore_volume_errors=no [volume2] action=create volname=data transport=tcp replica=yes replica_count=3 key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal,features.shard-block-size value=virt,36,36,30,on,off,enable,64MB brick_dirs=192.168.1.1:/gluster_bricks/data/data,192.168.1.2:/gluster_bricks/data/data,192.168.1.3:/gluster_bricks/data/data ignore_volume_errors=no [volume3] action=create volname=vmstore transport=tcp replica=yes replica_count=3 key=group,storage.owner-uid,storage.owner-gid,network.ping-timeout,performance.strict-o-direct,network.remote-dio,cluster.granular-entry-heal,features.shard-block-size value=virt,36,36,30,on,off,enable,64MB brick_dirs=192.168.1.1:/gluster_bricks/vmstore/vmstore,192.168.1.2:/gluster_bricks/vmstore/vmstore,192.168.1.3:/gluster_bricks/vmstore/vmstore ignore_volume_errors=no

2 2

API Snapshot removal ending event
by Lionel Caignec 25 Sep '17

25 Sep '17

Hi, For snap creation i use a loop like this to know when task is finished: > snap = snapshots_service.add(types.Snapshot(description=description, persist_memorystate=False)) > snap_service = snapshots_service.snapshot_service(snap.id) > while snap.snapshot_status != types.SnapshotStatus.OK: is it possible to do the same think for snap deletion? i did not find anything in api doc. Thank you -- Lionel

2 1

Restoring from backup
by Tyson Landon 25 Sep '17

25 Sep '17

The final setup in restoring a backup has you run engine-setup. When I try to run engine-setup I get "[ ERROR ] Failed to execute stage 'Setup validation': Hosted Engine setup detected, but Global Maintenance is not set." I am in Global Maintenance mode however. If I exit Global Maintenance the hosted engine reboots every few minutes and it fails liveliness checks. Is there a service i have to stop so that the setup wont think HA is running?

2 1

Re: [ovirt-users] Issues getting agent working on Ubuntu 17.04
by Matthew Pease 24 Sep '17

24 Sep '17

Try https://packages.debian.org/sid/python/python-ethtool This fixed it for me, looks like a bug that's been fixed in debian but not yet ported over to ubuntu Ubuntu was 0.12-1 where as debian has a newer 0.12-1.1

1 0

VM Portal looking for translators
by Jakub Niedermertl 24 Sep '17

24 Sep '17

Hi all, new VM Portal project [1] - a replacement of oVirt userportal - is looking for community translators. If you know any of * Chinese (Simplified) * French * German * Italian * Japanese * Korean * Portuguese * Russian * Spanish and want to join translation effort, please * sign up to Zanata translation environment [2] * request an access to language group of your choice [3] * and join us at [4] Thank you Regards Jakub [1]: https://github.com/oVirt/ovirt-web-ui [2]: https://translate.zanata.org [3]: https://translate.zanata.org/language/list [4]: https://translate.zanata.org/iteration/view/ovirt-web-ui/1.2.0/languages

7 9

update to centos 7.4
by Nathanaël Blanchet 23 Sep '17

23 Sep '17

Hi all, Now centos 7.4 is available, is it recommanted to update nodes (and engine os) knowing that ovirt 4.1 is officially supported for 7.3 or later? -- Nathanaël Blanchet Supervision réseau Pôle Infrastrutures Informatiques 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

3 2

SSLHandshakeException: Received fatal alert: certificate_expired
by Neil 22 Sep '17

22 Sep '17

Hi guys, Please could someone assist, my cluster is down and I can't access my vm's to switch some of them back on. I'm seeing the following error in the engine.log however I've checked my certs on my hosts (as some of the goolge results said to check), but the certs haven't expired... 2017-09-21 15:09:45,077 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDSCommand(HostName = node02.mydomain.za, HostId = d2debdfe-76e7-40cf-a7fd-78a0f50f14d4, vds=Host[node02.mydomain.za]) execution failed. Exception: VDSNetworkException: javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_expired 2017-09-21 15:09:45,086 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) Command GetCapabilitiesVDSCommand(HostName = node01.mydomain.za, HostId = b108549c-1700-11e2-b936-9f5243b8ce13, vds=Host[node01.mydomain.za]) execution failed. Exception: VDSNetworkException: javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_expired 2017-09-21 15:09:48,173 ERROR My engine and host info is below... [root@engine01 ovirt-engine]# rpm -qa | grep -i ovirt ovirt-engine-lib-3.4.0-1.el6.noarch ovirt-engine-restapi-3.4.0-1.el6.noarch ovirt-engine-setup-plugin-ovirt-engine-3.4.0-1.el6.noarch ovirt-engine-3.4.0-1.el6.noarch ovirt-engine-setup-plugin-websocket-proxy-3.4.0-1.el6.noarch ovirt-host-deploy-java-1.2.0-1.el6.noarch ovirt-engine-setup-3.4.0-1.el6.noarch ovirt-host-deploy-1.2.0-1.el6.noarch ovirt-engine-backend-3.4.0-1.el6.noarch ovirt-image-uploader-3.4.0-1.el6.noarch ovirt-engine-tools-3.4.0-1.el6.noarch ovirt-engine-sdk-python-3.4.0.7-1.el6.noarch ovirt-engine-webadmin-portal-3.4.0-1.el6.noarch ovirt-engine-cli-3.4.0.5-1.el6.noarch ovirt-engine-setup-base-3.4.0-1.el6.noarch ovirt-iso-uploader-3.4.0-1.el6.noarch ovirt-engine-userportal-3.4.0-1.el6.noarch ovirt-log-collector-3.4.1-1.el6.noarch ovirt-engine-websocket-proxy-3.4.0-1.el6.noarch ovirt-engine-setup-plugin-ovirt-engine-common-3.4.0-1.el6.noarch ovirt-engine-dbscripts-3.4.0-1.el6.noarch [root@engine01 ovirt-engine]# cat /etc/redhat-release CentOS release 6.5 (Final) [root@node02 ~]# openssl x509 -in /etc/pki/vdsm/certs/vdsmcert.pem -enddate -noout ; date notAfter=May 27 08:36:17 2019 GMT Thu Sep 21 15:18:22 SAST 2017 CentOS release 6.5 (Final) [root@node02 ~]# rpm -qa | grep vdsm vdsm-4.14.6-0.el6.x86_64 vdsm-python-4.14.6-0.el6.x86_64 vdsm-cli-4.14.6-0.el6.noarch vdsm-xmlrpc-4.14.6-0.el6.noarch vdsm-python-zombiereaper-4.14.6-0.el6.noarch [root@node01 ~]# openssl x509 -in /etc/pki/vdsm/certs/vdsmcert.pem -enddate -noout ; date notAfter=Jun 13 16:09:41 2018 GMT Thu Sep 21 15:18:52 SAST 2017 CentOS release 6.5 (Final) [root@node01 ~]# rpm -qa | grep -i vdsm vdsm-4.14.6-0.el6.x86_64 vdsm-xmlrpc-4.14.6-0.el6.noarch vdsm-cli-4.14.6-0.el6.noarch vdsm-python-zombiereaper-4.14.6-0.el6.noarch vdsm-python-4.14.6-0.el6.x86_64 Please could I have some assistance, I'm rater desperate. Thank you. Regards. Neil Wilson

4 14

Task stuck at "Finalizing"
by Wesley Stewart 22 Sep '17

22 Sep '17

Back when I first installed ovirt a couple months ago, I tried importing VMs through my export domain and one of the VM's got "stuck" in the process. Importing VM Server_BACKUP_20170807_010018 to Cluster OVIRT-Cluster Aug 13, 2017 11:59:29 PM N/A 751cb290-7cb8-4ed7-a4e7-e8b9743cf2dc [image: Inline image 4] Validating Aug 13, 2017 11:59:29 PM until Aug 13, 2017 11:59:29 PM [image: Inline image 5] Executing Aug 13, 2017 11:59:29 PM until Aug 13, 2017 11:59:37 PM [image: Inline image 6] Finalizing I tried running taskcleaner.sh: sudo su postgres ./taskcleaner.sh -R -u postgres -d engine -s /tmp (Found in /usr/share/ovirt-engine/setup/dbutils, oddly it would ONLY run with the -s /tmp, so I am not sure if this is actually running on the correct server). Anyone know of what I can do to clear that task?

1 0

Snapshot removal time
by Troels Arvin 22 Sep '17

22 Sep '17

Hello, I have a RHV 4.1 virtualized guest-server with a number of rather large VirtIO virtual disks attached. The virtual disks are allocated from a fibre channel (block) storage domain. The hypervisor servers run RHEL 7.4. When I take a snapshot of the guest, then it takes a long time to remove the snapshots again, when the guest is powered off (a snapshot of a 2 TiB disk takes around 3 hours to remove). However, when the guest is running, then snapshot removal is very quick (perhaps around five minutes per snapshot). The involved disks have not been written much to while they had snapshots. I would expect the opposite: I.e., when the guest is turned off, then I would assume that oVirt can handle snapshot removal in a much more aggressive fashion than when performing a live snapshot removal? When performing offline snapshot removal, then on the hypervisor having the SPM role, I see the following in output from "ps xauw": vdsm 10255 8.3 0.0 389144 27196 ? S<l 13:40 7:04 /usr/bin/qemu-img convert -p -t none -T none -f qcow2 /rhev/data-center/mnt/blockSD/xxx/ images/yyy/zzz -O raw /rhev/data-center/mnt/blockSD/xxx/images/yyy/ zzz_MERGE I don't see the same kind of process running on a guest's hypervisor when online snapshot removal is in progress. I've read most of https://www.ovirt.org/develop/release-management/ features/storage/remove-snapshot/ My interpretation from that document is that I should expect to see "qemu- img commit" commands instead of "qemu-img convert" processes. Or? The RHV system involved is somewhat old, having been upgrade many times from 3.x through 4.1. Could it be that it carries around old left-overs which results in obsolete snapshot removal behavior? -- Regards, Troels Arvin

2 3

trunk port for vm guest
by Charles Kozler 22 Sep '17

22 Sep '17

Hello, I have seen mixed results for this search on this list so I'd like to clear it up I have a VM that I need to configure with a trunk port so that all of my VLANs can be configured on it but not as separate NICs (eth0, eth1, eth2, etc) I have seen on this list about a year ago someone said to setup a network and leave it untagged and ovirt will pass all tagged and untagged packets there. Then attach this to the guest VM and configure the trunk port inside the VM (eth0:<vlan_tag>) However, I saw also about 6 months ago someone suggest something like VLAN tag 4095 so wondering if the support came in for this...or I should use untagged VM network So - how can I configure a trunk port for a guest VM? Thanks

1 1

oVirt repo errors..
by Alexander Witte 22 Sep '17

22 Sep '17

--_000_8EC03937220044548BF0F678C3A71AE4baicanadacom_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SSBzZWVtIHRvIGdldCB0aGlzIGVycm9yIHdpdGggbXVsdGlwbGUgb1ZpcnQgcmVwb3MgKDQuMCwg NC4xKS4gIEnigJltIGp1c3QgdHJ5aW5nIHRvIGluc3RhbGwgdGhlIGhvc3RlZCBlbmdpbmUgb24g YSBmcmVzaCBDZW50b3MgNy40IHNlcnZlci4uLg0KDQpDYW4gc29tZW9uZSBwbGVhc2UgcG9pbnQg bWUgaW4gdGhlIGRpcmVjdGlvbiBvZiB3aGF0IEkgYW0gZG9pbmcgd3Jvbmc/DQoNCg0KW3Jvb3RA bG9jYWxob3N0IH5dIyB5dW0gaW5zdGFsbCBvdmlydC1ob3N0ZWQtZW5naW5lLXNldHVwDQpMb2Fk ZWQgcGx1Z2luczogZmFzdGVzdG1pcnJvcg0KYmFzZSAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHwgMy42IGtCICAwMDowMDowMA0K Y2VudG9zLW9wc3Rvb2xzLXJlbGVhc2UgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgIHwgMi45IGtCICAwMDowMDowMA0KZXh0cmFzICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHwgMy40IGtCICAwMDowMDow MA0Kb3ZpcnQtNC4xICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIHwgMy4wIGtCICAwMDowMDowMA0Kb3ZpcnQtNC4xLWNlbnRvcy1nbHVzdGVy MzggICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHwgMi45IGtCICAwMDow MDowMA0KDQoNCiBPbmUgb2YgdGhlIGNvbmZpZ3VyZWQgcmVwb3NpdG9yaWVzIGZhaWxlZCAoVW5r bm93biksDQogYW5kIHl1bSBkb2Vzbid0IGhhdmUgZW5vdWdoIGNhY2hlZCBkYXRhIHRvIGNvbnRp bnVlLiBBdCB0aGlzIHBvaW50IHRoZSBvbmx5DQogc2FmZSB0aGluZyB5dW0gY2FuIGRvIGlzIGZh aWwuIFRoZXJlIGFyZSBhIGZldyB3YXlzIHRvIHdvcmsgImZpeCIgdGhpczoNCg0KICAgICAxLiBD b250YWN0IHRoZSB1cHN0cmVhbSBmb3IgdGhlIHJlcG9zaXRvcnkgYW5kIGdldCB0aGVtIHRvIGZp eCB0aGUgcHJvYmxlbS4NCg0KICAgICAyLiBSZWNvbmZpZ3VyZSB0aGUgYmFzZXVybC9ldGMuIGZv ciB0aGUgcmVwb3NpdG9yeSwgdG8gcG9pbnQgdG8gYSB3b3JraW5nDQogICAgICAgIHVwc3RyZWFt LiBUaGlzIGlzIG1vc3Qgb2Z0ZW4gdXNlZnVsIGlmIHlvdSBhcmUgdXNpbmcgYSBuZXdlcg0KICAg ICAgICBkaXN0cmlidXRpb24gcmVsZWFzZSB0aGFuIGlzIHN1cHBvcnRlZCBieSB0aGUgcmVwb3Np dG9yeSAoYW5kIHRoZQ0KICAgICAgICBwYWNrYWdlcyBmb3IgdGhlIHByZXZpb3VzIGRpc3RyaWJ1 dGlvbiByZWxlYXNlIHN0aWxsIHdvcmspLg0KDQogICAgIDMuIFJ1biB0aGUgY29tbWFuZCB3aXRo IHRoZSByZXBvc2l0b3J5IHRlbXBvcmFyaWx5IGRpc2FibGVkDQogICAgICAgICAgICB5dW0gLS1k aXNhYmxlcmVwbz08cmVwb2lkPiAuLi4NCg0KICAgICA0LiBEaXNhYmxlIHRoZSByZXBvc2l0b3J5 IHBlcm1hbmVudGx5LCBzbyB5dW0gd29uJ3QgdXNlIGl0IGJ5IGRlZmF1bHQuIFl1bQ0KICAgICAg ICB3aWxsIHRoZW4ganVzdCBpZ25vcmUgdGhlIHJlcG9zaXRvcnkgdW50aWwgeW91IHBlcm1hbmVu dGx5IGVuYWJsZSBpdA0KICAgICAgICBhZ2FpbiBvciB1c2UgLS1lbmFibGVyZXBvIGZvciB0ZW1w b3JhcnkgdXNhZ2U6DQoNCiAgICAgICAgICAgIHl1bS1jb25maWctbWFuYWdlciAtLWRpc2FibGUg PHJlcG9pZD4NCiAgICAgICAgb3INCiAgICAgICAgICAgIHN1YnNjcmlwdGlvbi1tYW5hZ2VyIHJl cG9zIC0tZGlzYWJsZT08cmVwb2lkPg0KDQogICAgIDUuIENvbmZpZ3VyZSB0aGUgZmFpbGluZyBy ZXBvc2l0b3J5IHRvIGJlIHNraXBwZWQsIGlmIGl0IGlzIHVuYXZhaWxhYmxlLg0KICAgICAgICBO b3RlIHRoYXQgeXVtIHdpbGwgdHJ5IHRvIGNvbnRhY3QgdGhlIHJlcG8uIHdoZW4gaXQgcnVucyBt b3N0IGNvbW1hbmRzLA0KICAgICAgICBzbyB3aWxsIGhhdmUgdG8gdHJ5IGFuZCBmYWlsIGVhY2gg dGltZSAoYW5kIHRodXMuIHl1bSB3aWxsIGJlIGJlIG11Y2gNCiAgICAgICAgc2xvd2VyKS4gSWYg aXQgaXMgYSB2ZXJ5IHRlbXBvcmFyeSBwcm9ibGVtIHRob3VnaCwgdGhpcyBpcyBvZnRlbiBhIG5p Y2UNCiAgICAgICAgY29tcHJvbWlzZToNCg0KICAgICAgICAgICAgeXVtLWNvbmZpZy1tYW5hZ2Vy IC0tc2F2ZSAtLXNldG9wdD08cmVwb2lkPi5za2lwX2lmX3VuYXZhaWxhYmxlPXRydWUNCg0KQ2Fu bm90IHJldHJpZXZlIG1ldGFsaW5rIGZvciByZXBvc2l0b3J5OiBvdmlydC00LjEtZXBlbC94ODZf NjQuIFBsZWFzZSB2ZXJpZnkgaXRzIHBhdGggYW5kIHRyeSBhZ2Fpbg0KW3Jvb3RAbG9jYWxob3N0 IH5dIw0KDQpbcm9vdEBsb2NhbGhvc3Qgfl0jIGNhdCAvZXRjL2NlbnRvcy1yZWxlYXNlDQpDZW50 T1MgTGludXggcmVsZWFzZSA3LjQuMTcwOCAoQ29yZSkNCltyb290QGxvY2FsaG9zdCB+XSMNCg0K U29ycnkgaWYgSeKAmW0gZHVtYi4NCg0KQWxleA0KDQo= --_000_8EC03937220044548BF0F678C3A71AE4baicanadacom_ Content-Type: text/html; charset="utf-8" Content-ID: <0D40B4F9DFEBD94FA0A4D3BB65BB22F5(a)baicanada.local> Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsiIGNsYXNzPSIiPg0KPGRpdiBjbGFzcz0iIj5JIHNlZW0g dG8gZ2V0IHRoaXMgZXJyb3Igd2l0aCBtdWx0aXBsZSBvVmlydCByZXBvcyAoNC4wLCA0LjEpLiAm bmJzcDtJ4oCZbSBqdXN0IHRyeWluZyB0byBpbnN0YWxsIHRoZSBob3N0ZWQgZW5naW5lIG9uIGEg ZnJlc2ggQ2VudG9zIDcuNCBzZXJ2ZXIuLi48L2Rpdj4NCjxkaXYgY2xhc3M9IiI+PGJyIGNsYXNz PSIiPg0KPC9kaXY+DQo8ZGl2IGNsYXNzPSIiPkNhbiBzb21lb25lIHBsZWFzZSBwb2ludCBtZSBp biB0aGUgZGlyZWN0aW9uIG9mIHdoYXQgSSBhbSBkb2luZyB3cm9uZz8mbmJzcDs8L2Rpdj4NCjxk aXYgY2xhc3M9IiI+PGJyIGNsYXNzPSIiPg0KPC9kaXY+DQo8ZGl2IGNsYXNzPSIiPjxiciBjbGFz cz0iIj4NCjwvZGl2Pg0KPGRpdiBjbGFzcz0iIj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBs aW5lLWhlaWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJn Yig0MCwgMjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEp OyIgY2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29t bW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+W3Jvb3RAbG9jYWxob3N0IH5dIyB5dW0gaW5zdGFsbCBv dmlydC1ob3N0ZWQtZW5naW5lLXNldHVwPC9zcGFuPjwvZGl2Pg0KPGRpdiBzdHlsZT0ibWFyZ2lu OiAwcHg7IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZvbnQtZmFtaWx5OiAnQW5kYWxlIE1vbm8nOyBj b2xvcjogcmdiKDQwLCAyNTQsIDIwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiYSgwLCAwLCAwLCAw LjkwMTk2MSk7IiBjbGFzcz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LXZhcmlhbnQtbGlnYXR1cmVz OiBuby1jb21tb24tbGlnYXR1cmVzIiBjbGFzcz0iIj5Mb2FkZWQgcGx1Z2luczogZmFzdGVzdG1p cnJvcjwvc3Bhbj48L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDog bm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAy MCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+ DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJl cyIgY2xhc3M9IiI+YmFzZSAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsg Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAm bmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZu YnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5i c3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsg Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAm bmJzcDsgfCAzLjYga0ImbmJzcDsNCiAwMDowMDowMCZuYnNwOyAmbmJzcDsgJm5ic3A7PC9zcGFu PjwvZGl2Pg0KPGRpdiBzdHlsZT0ibWFyZ2luOiAwcHg7IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZv bnQtZmFtaWx5OiAnQW5kYWxlIE1vbm8nOyBjb2xvcjogcmdiKDQwLCAyNTQsIDIwKTsgYmFja2dy b3VuZC1jb2xvcjogcmdiYSgwLCAwLCAwLCAwLjkwMTk2MSk7IiBjbGFzcz0iIj4NCjxzcGFuIHN0 eWxlPSJmb250LXZhcmlhbnQtbGlnYXR1cmVzOiBuby1jb21tb24tbGlnYXR1cmVzIiBjbGFzcz0i Ij5jZW50b3Mtb3BzdG9vbHMtcmVsZWFzZSZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsg Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAm bmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZu YnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5i c3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyB8IDIuOSBrQiZuYnNwOw0KIDAwOjAwOjAwJm5ic3A7ICZuYnNwOyAmbmJzcDs8L3Nw YW4+PC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsg Zm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNr Z3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4g c3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNz PSIiPmV4dHJhcyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsg Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAm bmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZu YnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5i c3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyB8IDMuNCBr QiZuYnNwOw0KIDAwOjAwOjAwJm5ic3A7ICZuYnNwOyAmbmJzcDs8L3NwYW4+PC9kaXY+DQo8ZGl2 IHN0eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdB bmRhbGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiBy Z2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFy aWFudC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPm92aXJ0LTQuMSZu YnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5i c3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsg Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAm bmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZu YnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5i c3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgfCAzLjAga0ImbmJzcDsNCiAwMDowMDowMCZu YnNwOyAmbmJzcDsgJm5ic3A7PC9zcGFuPjwvZGl2Pg0KPGRpdiBzdHlsZT0ibWFyZ2luOiAwcHg7 IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZvbnQtZmFtaWx5OiAnQW5kYWxlIE1vbm8nOyBjb2xvcjog cmdiKDQwLCAyNTQsIDIwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiYSgwLCAwLCAwLCAwLjkwMTk2 MSk7IiBjbGFzcz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LXZhcmlhbnQtbGlnYXR1cmVzOiBuby1j b21tb24tbGlnYXR1cmVzIiBjbGFzcz0iIj5vdmlydC00LjEtY2VudG9zLWdsdXN0ZXIzOCAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsg Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAm bmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZu YnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5i c3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7IHwgMi45IGtCJm5ic3A7DQogMDA6MDA6MDAmbmJzcDsgJm5i c3A7ICZuYnNwOzwvc3Bhbj48L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhl aWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwg MjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyBtaW4t aGVpZ2h0OiAxNHB4OyIgY2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0 dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+PC9zcGFuPjxiciBjbGFzcz0iIj4N CjwvZGl2Pg0KPGRpdiBzdHlsZT0ibWFyZ2luOiAwcHg7IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZv bnQtZmFtaWx5OiAnQW5kYWxlIE1vbm8nOyBjb2xvcjogcmdiKDQwLCAyNTQsIDIwKTsgYmFja2dy b3VuZC1jb2xvcjogcmdiYSgwLCAwLCAwLCAwLjkwMTk2MSk7IG1pbi1oZWlnaHQ6IDE0cHg7IiBj bGFzcz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LXZhcmlhbnQtbGlnYXR1cmVzOiBuby1jb21tb24t bGlnYXR1cmVzIiBjbGFzcz0iIj48L3NwYW4+PGJyIGNsYXNzPSIiPg0KPC9kaXY+DQo8ZGl2IHN0 eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRh bGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2Jh KDAsIDAsIDAsIDAuOTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFu dC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPiZuYnNwO09uZSBvZiB0 aGUgY29uZmlndXJlZCByZXBvc2l0b3JpZXMgZmFpbGVkIChVbmtub3duKSw8L3NwYW4+PC9kaXY+ DQo8ZGl2IHN0eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1p bHk6ICdBbmRhbGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNv bG9yOiByZ2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZv bnQtdmFyaWFudC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPiZuYnNw O2FuZCB5dW0gZG9lc24ndCBoYXZlIGVub3VnaCBjYWNoZWQgZGF0YSB0byBjb250aW51ZS4gQXQg dGhpcyBwb2ludCB0aGUgb25seTwvc3Bhbj48L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4 OyBsaW5lLWhlaWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6 IHJnYig0MCwgMjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5 NjEpOyIgY2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8t Y29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+Jm5ic3A7c2FmZSB0aGluZyB5dW0gY2FuIGRvIGlz IGZhaWwuIFRoZXJlIGFyZSBhIGZldyB3YXlzIHRvIHdvcmsgJnF1b3Q7Zml4JnF1b3Q7IHRoaXM6 PC9zcGFuPjwvZGl2Pg0KPGRpdiBzdHlsZT0ibWFyZ2luOiAwcHg7IGxpbmUtaGVpZ2h0OiBub3Jt YWw7IGZvbnQtZmFtaWx5OiAnQW5kYWxlIE1vbm8nOyBjb2xvcjogcmdiKDQwLCAyNTQsIDIwKTsg YmFja2dyb3VuZC1jb2xvcjogcmdiYSgwLCAwLCAwLCAwLjkwMTk2MSk7IG1pbi1oZWlnaHQ6IDE0 cHg7IiBjbGFzcz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LXZhcmlhbnQtbGlnYXR1cmVzOiBuby1j b21tb24tbGlnYXR1cmVzIiBjbGFzcz0iIj48L3NwYW4+PGJyIGNsYXNzPSIiPg0KPC9kaXY+DQo8 ZGl2IHN0eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6 ICdBbmRhbGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9y OiByZ2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQt dmFyaWFudC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPiZuYnNwOyZu YnNwOyAmbmJzcDsgMS4gQ29udGFjdCB0aGUgdXBzdHJlYW0gZm9yIHRoZSByZXBvc2l0b3J5IGFu ZCBnZXQgdGhlbSB0byBmaXggdGhlIHByb2JsZW0uPC9zcGFuPjwvZGl2Pg0KPGRpdiBzdHlsZT0i bWFyZ2luOiAwcHg7IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZvbnQtZmFtaWx5OiAnQW5kYWxlIE1v bm8nOyBjb2xvcjogcmdiKDQwLCAyNTQsIDIwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiYSgwLCAw LCAwLCAwLjkwMTk2MSk7IG1pbi1oZWlnaHQ6IDE0cHg7IiBjbGFzcz0iIj4NCjxzcGFuIHN0eWxl PSJmb250LXZhcmlhbnQtbGlnYXR1cmVzOiBuby1jb21tb24tbGlnYXR1cmVzIiBjbGFzcz0iIj48 L3NwYW4+PGJyIGNsYXNzPSIiPg0KPC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJnaW46IDBweDsgbGlu ZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNvbG9yOiByZ2Io NDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsi IGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVyZXM6IG5vLWNvbW1v bi1saWdhdHVyZXMiIGNsYXNzPSIiPiZuYnNwOyZuYnNwOyAmbmJzcDsgMi4gUmVjb25maWd1cmUg dGhlIGJhc2V1cmwvZXRjLiBmb3IgdGhlIHJlcG9zaXRvcnksIHRvIHBvaW50IHRvIGEgd29ya2lu Zzwvc3Bhbj48L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDogbm9y bWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAyMCk7 IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+DQo8 c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIg Y2xhc3M9IiI+Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7IHVwc3RyZWFtLiBUaGlzIGlzIG1v c3Qgb2Z0ZW4gdXNlZnVsIGlmIHlvdSBhcmUgdXNpbmcgYSBuZXdlcjwvc3Bhbj48L2Rpdj4NCjxk aXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDogbm9ybWFsOyBmb250LWZhbWlseTog J0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6 IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12 YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+Jm5ic3A7ICZu YnNwOyAmbmJzcDsgJm5ic3A7IGRpc3RyaWJ1dGlvbiByZWxlYXNlIHRoYW4gaXMgc3VwcG9ydGVk IGJ5IHRoZSByZXBvc2l0b3J5IChhbmQgdGhlPC9zcGFuPjwvZGl2Pg0KPGRpdiBzdHlsZT0ibWFy Z2luOiAwcHg7IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZvbnQtZmFtaWx5OiAnQW5kYWxlIE1vbm8n OyBjb2xvcjogcmdiKDQwLCAyNTQsIDIwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiYSgwLCAwLCAw LCAwLjkwMTk2MSk7IiBjbGFzcz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LXZhcmlhbnQtbGlnYXR1 cmVzOiBuby1jb21tb24tbGlnYXR1cmVzIiBjbGFzcz0iIj4mbmJzcDsgJm5ic3A7ICZuYnNwOyAm bmJzcDsgcGFja2FnZXMgZm9yIHRoZSBwcmV2aW91cyBkaXN0cmlidXRpb24gcmVsZWFzZSBzdGls bCB3b3JrKS48L3NwYW4+PC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWln aHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1 NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsgbWluLWhl aWdodDogMTRweDsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVy ZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPjwvc3Bhbj48YnIgY2xhc3M9IiI+DQo8 L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDogbm9ybWFsOyBmb250 LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAyMCk7IGJhY2tncm91 bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+DQo8c3BhbiBzdHls ZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+ Jm5ic3A7Jm5ic3A7ICZuYnNwOyAzLiBSdW4gdGhlIGNvbW1hbmQgd2l0aCB0aGUgcmVwb3NpdG9y eSB0ZW1wb3JhcmlseSBkaXNhYmxlZDwvc3Bhbj48L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjog MHB4OyBsaW5lLWhlaWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29s b3I6IHJnYig0MCwgMjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45 MDE5NjEpOyIgY2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczog bm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgeXVtIC0tZGlzYWJsZXJlcG89Jmx0O3JlcG9pZCZndDsgLi4uPC9zcGFu PjwvZGl2Pg0KPGRpdiBzdHlsZT0ibWFyZ2luOiAwcHg7IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZv bnQtZmFtaWx5OiAnQW5kYWxlIE1vbm8nOyBjb2xvcjogcmdiKDQwLCAyNTQsIDIwKTsgYmFja2dy b3VuZC1jb2xvcjogcmdiYSgwLCAwLCAwLCAwLjkwMTk2MSk7IG1pbi1oZWlnaHQ6IDE0cHg7IiBj bGFzcz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LXZhcmlhbnQtbGlnYXR1cmVzOiBuby1jb21tb24t bGlnYXR1cmVzIiBjbGFzcz0iIj48L3NwYW4+PGJyIGNsYXNzPSIiPg0KPC9kaXY+DQo8ZGl2IHN0 eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRh bGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2Jh KDAsIDAsIDAsIDAuOTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFu dC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPiZuYnNwOyZuYnNwOyAm bmJzcDsgNC4gRGlzYWJsZSB0aGUgcmVwb3NpdG9yeSBwZXJtYW5lbnRseSwgc28geXVtIHdvbid0 IHVzZSBpdCBieSBkZWZhdWx0LiBZdW08L3NwYW4+PC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJnaW46 IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNv bG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAu OTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVyZXM6 IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPiZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyB3aWxsIHRoZW4ganVzdCBpZ25vcmUgdGhlIHJlcG9zaXRvcnkgdW50aWwgeW91IHBlcm1hbmVu dGx5IGVuYWJsZSBpdDwvc3Bhbj48L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5l LWhlaWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0 MCwgMjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIg Y2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9u LWxpZ2F0dXJlcyIgY2xhc3M9IiI+Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7IGFnYWluIG9y IHVzZSAtLWVuYWJsZXJlcG8gZm9yIHRlbXBvcmFyeSB1c2FnZTo8L3NwYW4+PC9kaXY+DQo8ZGl2 IHN0eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdB bmRhbGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiBy Z2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsgbWluLWhlaWdodDogMTRweDsiIGNsYXNzPSIiPg0KPHNw YW4gc3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNs YXNzPSIiPjwvc3Bhbj48YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjog MHB4OyBsaW5lLWhlaWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29s b3I6IHJnYig0MCwgMjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45 MDE5NjEpOyIgY2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczog bm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgeXVtLWNvbmZpZy1tYW5hZ2VyIC0tZGlzYWJsZSAmbHQ7cmVwb2lkJmd0 Ozwvc3Bhbj48L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDogbm9y bWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAyMCk7 IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+DQo8 c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIg Y2xhc3M9IiI+Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7IG9yPC9zcGFuPjwvZGl2Pg0KPGRp diBzdHlsZT0ibWFyZ2luOiAwcHg7IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZvbnQtZmFtaWx5OiAn QW5kYWxlIE1vbm8nOyBjb2xvcjogcmdiKDQwLCAyNTQsIDIwKTsgYmFja2dyb3VuZC1jb2xvcjog cmdiYSgwLCAwLCAwLCAwLjkwMTk2MSk7IiBjbGFzcz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LXZh cmlhbnQtbGlnYXR1cmVzOiBuby1jb21tb24tbGlnYXR1cmVzIiBjbGFzcz0iIj4mbmJzcDsgJm5i c3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyBzdWJzY3JpcHRpb24tbWFuYWdlciByZXBv cyAtLWRpc2FibGU9Jmx0O3JlcG9pZCZndDs8L3NwYW4+PC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJn aW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7 IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAs IDAuOTAxOTYxKTsgbWluLWhlaWdodDogMTRweDsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZv bnQtdmFyaWFudC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPjwvc3Bh bj48YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhl aWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwg MjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xh c3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxp Z2F0dXJlcyIgY2xhc3M9IiI+Jm5ic3A7Jm5ic3A7ICZuYnNwOyA1LiBDb25maWd1cmUgdGhlIGZh aWxpbmcgcmVwb3NpdG9yeSB0byBiZSBza2lwcGVkLCBpZiBpdCBpcyB1bmF2YWlsYWJsZS48L3Nw YW4+PC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJnaW46IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsg Zm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNvbG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNr Z3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4g c3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNz PSIiPiZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyBOb3RlIHRoYXQgeXVtIHdpbGwgdHJ5IHRv IGNvbnRhY3QgdGhlIHJlcG8uIHdoZW4gaXQgcnVucyBtb3N0IGNvbW1hbmRzLDwvc3Bhbj48L2Rp dj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDogbm9ybWFsOyBmb250LWZh bWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAyMCk7IGJhY2tncm91bmQt Y29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0i Zm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+Jm5i c3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7IHNvIHdpbGwgaGF2ZSB0byB0cnkgYW5kIGZhaWwgZWFj aCB0aW1lIChhbmQgdGh1cy4geXVtIHdpbGwgYmUgYmUgbXVjaDwvc3Bhbj48L2Rpdj4NCjxkaXYg c3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0Fu ZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJn YmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJp YW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+Jm5ic3A7ICZuYnNw OyAmbmJzcDsgJm5ic3A7IHNsb3dlcikuIElmIGl0IGlzIGEgdmVyeSB0ZW1wb3JhcnkgcHJvYmxl bSB0aG91Z2gsIHRoaXMgaXMgb2Z0ZW4gYSBuaWNlPC9zcGFuPjwvZGl2Pg0KPGRpdiBzdHlsZT0i bWFyZ2luOiAwcHg7IGxpbmUtaGVpZ2h0OiBub3JtYWw7IGZvbnQtZmFtaWx5OiAnQW5kYWxlIE1v bm8nOyBjb2xvcjogcmdiKDQwLCAyNTQsIDIwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiYSgwLCAw LCAwLCAwLjkwMTk2MSk7IiBjbGFzcz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LXZhcmlhbnQtbGln YXR1cmVzOiBuby1jb21tb24tbGlnYXR1cmVzIiBjbGFzcz0iIj4mbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgY29tcHJvbWlzZTo8L3NwYW4+PC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJnaW46IDBw eDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNvbG9y OiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAuOTAx OTYxKTsgbWluLWhlaWdodDogMTRweDsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFy aWFudC1saWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPjwvc3Bhbj48YnIg Y2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDog bm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAy MCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+ DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJl cyIgY2xhc3M9IiI+Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgeXVt LWNvbmZpZy1tYW5hZ2VyIC0tc2F2ZSAtLXNldG9wdD0mbHQ7cmVwb2lkJmd0Oy5za2lwX2lmX3Vu YXZhaWxhYmxlPXRydWU8L3NwYW4+PC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJnaW46IDBweDsgbGlu ZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNvbG9yOiByZ2Io NDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAuOTAxOTYxKTsg bWluLWhlaWdodDogMTRweDsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFudC1s aWdhdHVyZXM6IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPjwvc3Bhbj48YnIgY2xhc3M9 IiI+DQo8L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDogbm9ybWFs OyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAyMCk7IGJh Y2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+DQo8c3Bh biBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xh c3M9IiI+Q2Fubm90IHJldHJpZXZlIG1ldGFsaW5rIGZvciByZXBvc2l0b3J5OiBvdmlydC00LjEt ZXBlbC94ODZfNjQuIFBsZWFzZSB2ZXJpZnkgaXRzIHBhdGggYW5kIHRyeSBhZ2Fpbjwvc3Bhbj48 L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhlaWdodDogbm9ybWFsOyBmb250 LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwgMjU0LCAyMCk7IGJhY2tncm91 bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xhc3M9IiI+DQo8c3BhbiBzdHls ZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxpZ2F0dXJlcyIgY2xhc3M9IiI+ W3Jvb3RAbG9jYWxob3N0IH5dIzwvc3Bhbj48L2Rpdj4NCjwvZGl2Pg0KPGRpdiBjbGFzcz0iIj48 YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXYgY2xhc3M9IiI+DQo8ZGl2IHN0eWxlPSJtYXJnaW46 IDBweDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNv bG9yOiByZ2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAu OTAxOTYxKTsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVyZXM6 IG5vLWNvbW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPltyb290QGxvY2FsaG9zdCB+XSMgY2F0IC9l dGMvY2VudG9zLXJlbGVhc2U8L3NwYW4+PC9kaXY+DQo8ZGl2IHN0eWxlPSJtYXJnaW46IDBweDsg bGluZS1oZWlnaHQ6IG5vcm1hbDsgZm9udC1mYW1pbHk6ICdBbmRhbGUgTW9ubyc7IGNvbG9yOiBy Z2IoNDAsIDI1NCwgMjApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2JhKDAsIDAsIDAsIDAuOTAxOTYx KTsiIGNsYXNzPSIiPg0KPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVyZXM6IG5vLWNv bW1vbi1saWdhdHVyZXMiIGNsYXNzPSIiPkNlbnRPUyBMaW51eCByZWxlYXNlIDcuNC4xNzA4IChD b3JlKSZuYnNwOzwvc3Bhbj48L2Rpdj4NCjxkaXYgc3R5bGU9Im1hcmdpbjogMHB4OyBsaW5lLWhl aWdodDogbm9ybWFsOyBmb250LWZhbWlseTogJ0FuZGFsZSBNb25vJzsgY29sb3I6IHJnYig0MCwg MjU0LCAyMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYmEoMCwgMCwgMCwgMC45MDE5NjEpOyIgY2xh c3M9IiI+DQo8c3BhbiBzdHlsZT0iZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm8tY29tbW9uLWxp Z2F0dXJlcyIgY2xhc3M9IiI+W3Jvb3RAbG9jYWxob3N0IH5dIyZuYnNwOzwvc3Bhbj48L2Rpdj4N CjwvZGl2Pg0KPGRpdiBjbGFzcz0iIj48YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXYgY2xhc3M9 IiI+U29ycnkgaWYgSeKAmW0gZHVtYi48L2Rpdj4NCjxiciBjbGFzcz0iIj4NCjxkaXYgY2xhc3M9 IiI+DQo8ZGl2IHN0eWxlPSJjb2xvcjogcmdiKDAsIDAsIDApOyBmb250LWZhbWlseTogSGVsdmV0 aWNhOyBmb250LXNpemU6IDEycHg7IGZvbnQtc3R5bGU6IG5vcm1hbDsgZm9udC12YXJpYW50LWNh cHM6IG5vcm1hbDsgZm9udC13ZWlnaHQ6IG5vcm1hbDsgbGV0dGVyLXNwYWNpbmc6IG5vcm1hbDsg b3JwaGFuczogYXV0bzsgdGV4dC1hbGlnbjogc3RhcnQ7IHRleHQtaW5kZW50OiAwcHg7IHRleHQt dHJhbnNmb3JtOiBub25lOyB3aGl0ZS1zcGFjZTogbm9ybWFsOyB3aWRvd3M6IGF1dG87IHdvcmQt c3BhY2luZzogMHB4OyAtd2Via2l0LXRleHQtc2l6ZS1hZGp1c3Q6IGF1dG87IC13ZWJraXQtdGV4 dC1zdHJva2Utd2lkdGg6IDBweDsgd29yZC13cmFwOiBicmVhay13b3JkOyAtd2Via2l0LW5ic3At bW9kZTogc3BhY2U7IC13ZWJraXQtbGluZS1icmVhazogYWZ0ZXItd2hpdGUtc3BhY2U7IiBjbGFz cz0iIj4NCjxkaXYgc3R5bGU9ImNvbG9yOiByZ2IoMCwgMCwgMCk7IGZvbnQtZmFtaWx5OiBIZWx2 ZXRpY2E7IGZvbnQtc2l6ZTogMTJweDsgZm9udC1zdHlsZTogbm9ybWFsOyBmb250LXZhcmlhbnQt Y2Fwczogbm9ybWFsOyBmb250LXdlaWdodDogbm9ybWFsOyBsZXR0ZXItc3BhY2luZzogbm9ybWFs OyB0ZXh0LWFsaWduOiBzdGFydDsgdGV4dC1pbmRlbnQ6IDBweDsgdGV4dC10cmFuc2Zvcm06IG5v bmU7IHdoaXRlLXNwYWNlOiBub3JtYWw7IHdvcmQtc3BhY2luZzogMHB4OyAtd2Via2l0LXRleHQt c3Ryb2tlLXdpZHRoOiAwcHg7Ij4NCkFsZXg8YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjwvZGl2Pg0K PC9kaXY+DQo8YnIgY2xhc3M9IiI+DQo8L2JvZHk+DQo8L2h0bWw+DQo= --_000_8EC03937220044548BF0F678C3A71AE4baicanadacom_--

3 3

How to upgrade self-hosted engine?
by gabriel_skupien＠o2.pl 21 Sep '17

21 Sep '17

In oVirt Engine Web Administration portal I can see option to upgrade the nodes but can't see any option to upgrade hosted-engine itself? What is the recommended procedure for it?

4 9

Cannot change resolution on Ubuntu 16 LTS, using spice
by Филипп Панин 21 Sep '17

21 Sep '17

Hey, i have problem setting resolution higher than 1024x768 on guest using spice xserver-xorg-video - installed spice-vdagent - installed ovirt-guest-agent - installed /var/log/syslog: Sep 21 13:16:48 admin-oVirt-Node kernel: [ 1548.537892] qxl 0000:00:02.0: object_init failed for (8302592, 0x00000002) Sep 21 13:16:48 admin-oVirt-Node kernel: [ 1548.537901] [drm:qxl_gem_object_create [qxl]] *ERROR* Failed to allocate GEM object (8302080, 2, 4096, -12) Sep 21 13:16:48 admin-oVirt-Node kernel: [ 1548.537905] [drm:qxl_alloc_surf_ioctl [qxl]] *ERROR* qxl_alloc_surf_ioctl: failed to create gem ret=-12

1 0

[ANN] oVirt 4.1.7 First Release Candidate is now available
by Sandro Bonazzola 21 Sep '17

21 Sep '17

The oVirt Project is pleased to announce the availability of the First Release Candidate of oVirt 4.1.7, as of September 21st, 2017 This update is the seventh in a series of stabilization updates to the 4.1 series. Starting from 4.1.5 oVirt supports libgfapi [5]. Using libgfapi provides a real performance boost for ovirt when using GlusterFS . Due to a known issue [6], using this will break live storage migration. This is expected to be fixed soon. If you do not use live storage migration you can give it a try. Use [7] for more details on how to enable it. This release is available now for: * Red Hat Enterprise Linux 7.4 or later * CentOS Linux (or similar) 7.4 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.4 or later * CentOS Linux (or similar) 7.4 or later * oVirt Node 4.1 See the release notes draft [3] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available - oVirt Live is already available[4] - oVirt Node is already available[4] Additional Resources: * Read more about the oVirt 4.1.7 release highlights: http://www.ovirt.org/release/4.1.7/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] https://www.ovirt.org/community/ [2] https://bugzilla.redhat.com/enter_bug.cgi?classification=oVirt [3] http://www.ovirt.org/release/4.1.7/ [4] http://resources.ovirt.org/pub/ovirt-4.1-pre/iso/ [5] http://staged-gluster-docs.readthedocs.io/en/release3.7.0beta1/Features/lib… [6] https://bugzilla.redhat.com/show_bug.cgi?id=1306562 [7] http://www.ovirt.org/develop/release-management/features/storage/glusterfs-… -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> <http://www.teraplan.it/redhat-osd-2017/>

1 0

Still running in to problems trying to implement OVN
by Mitchell Smith 20 Sep '17

20 Sep '17

Hi List, I was very happy to see overt added support for OVN recently, and it was a fairly strong factor in choosing overt for our current project, however being a very new feature with very little in the way of publicly available documentation, we are having some difficulties with implementation. I have found a few very good articles on OVN itself and am comfortable with OVN cli for the most part, but translating that in to overt logical networks and NICs is proving to be quite a challenge. As you might remember from one of my earlier posts, we do have some limitations with the current hosting provider also that make our network topology for this project less than ideal, but hopefully with OVN I can get to the desired outcome somehow. So the first fairly big issue we run into relates to the ovirtmgmt network, obviously this is a hard dependency of overt and it can’t be removed. As we only have one physical NIC in each server though, this causes some problems since we can’t also attach OVS to the same NIC as the ovirtmgmt bridge. Ideally we could set up OVN and just plug ovirtmgmt in to that network, but I can’t find any way to do that. Secondly our public IPs each have a specific MAC attached to them, something in the 00:50:56 VMware prefix, I want to add these on OVN and then SNAT them to the VMs internal IP on the 10.x.x.x network, I can work out how to do this on the cli, but not in overt, should I just manually create these interfaces and then get overt to try and import them or similar? As an alternative, am I making this type of network structure to complex by using OVN, and should I think about just creating a private address space using Tinc / PeerVPN / FreeLAN / similar, and then just set up a single VM with multiple interfaces on it acting as a router? To try and explain the network structure a bit better, each server has one physical NIC with a public IP address, each server also has a /29, each individual IP has a MAC associated with it on the vendors firewall. I plan to have a private subnet across the whole cluster managed with OVN, which I will place VMs on. The public IPs will be transparently routed to the private IPs using OVN routers. It’s less than ideal, but those are the constraints we have to work in for this project. My final question is completely off topic for this mostly OVN themed email, but we have also been looking at ScaleIO from EMC, and it looks like a decent solution. We have built our proof of concept environment using Gluster but we are considering ScaleIO for the final implementation, and I was curious if anyone else had tried ScaleIO with overt, and did you find any advantages / disadvantages compared to Gluster? I will end this rather long email here, but if anyone has tried to implement a similar network structure on overt, I would very much appreciate any suggestions you might have for the best way to proceed. Thanks :) Mitch

1 0

Re: [ovirt-users] VM running on multiple hosts
by Yaniv Kaul 20 Sep '17

20 Sep '17

On Sep 20, 2017 9:50 PM, <support(a)jac-properties.com> wrote: This matches about with what we were thinking, thank you! To answer your questions We do not have power management configured due to it causing a cascading failure early in our deployment. The host was not fenced and "confirm host rebooted" was never used. The VMs were powered on via virsh (this shouldn't have happened) The way they were powered on is most likely why they were corrupted is our thought We'd be happy if you could share both engine and host logs, including vdsm.log, engine.log and /var/log/messages from both. Y. Logan On September 20, 2017 at 12:03 PM Michal Skrivanek < michal.skrivanek(a)redhat.com> wrote: On 20 Sep 2017, at 18:06, Logan Kuhn <support(a)jac-properties.com> wrote: We had an incident where a VM hosts' disk filled up, the VMs all went unknown in the web console, but were fully functional if you were to login or use the services of one. Hi, yes, that can happen since the VM’s storage is on NAS whereas the server itself is non-functional as the management and all other local processes are using local resources We couldn't migrate them so we powered them down on that host and powered them up and let ovirt choose the host for it, same as always. that’s a mistake. The host should be fenced in that case, you likely do not have a power management configured, do you? Even when you do not have a fencing device available it should have been resolved manually by rebooting it manually(after fixing the disk problem), or in case of permanent damage (e.g. server needs to be replaced, that takes a week, you need to run those VMs in the meantime elsewhere) it should have been powered off and VM states should be reset by “confirm host has been rebooted” manual action. Normally you should now be able to run those VMs while the status of the host is still Not Responding - was it not the case? How exactly you get to the situation that you were able to power up the VMs? However the disk image on a few of them were corrupted because once we fixed the host with the full disk, it still thought it should be running the VM. Which promptly corrupted the disk, the error seems to be this in the logs: this can only happen for VMs flagged as HA, is it a case? Thanks, michal 2017-09-19 21:59:11,058 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [36c806f6] VM '70cf75c7-0fc2-4bbe-958e-7d0095f70960'(testhub) is running in db and not running on VDS 'ef6dc2a3-af6e-4e00-aa4 0-493b31263417'(vm-int7) We upgraded to 4.1.6 from 4.0.6 earlier in the day, I don't really think it's anything more than coincidence, but it's worrying enough to send to the community. Regards, Logan _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users

2 1

VM running on multiple hosts
by Logan Kuhn 20 Sep '17

20 Sep '17

We had an incident where a VM hosts' disk filled up, the VMs all went unknown in the web console, but were fully functional if you were to login or use the services of one. We couldn't migrate them so we powered them down on that host and powered them up and let ovirt choose the host for it, same as always. However the disk image on a few of them were corrupted because once we fixed the host with the full disk, it still thought it should be running the VM. Which promptly corrupted the disk, the error seems to be this in the logs: 2017-09-19 21:59:11,058 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [36c806f6] VM '70cf75c7-0fc2-4bbe-958e-7d0095f70960'(testhub) is running in db and not running on VDS 'ef6dc2a3-af6e-4e00-aa4 0-493b31263417'(vm-int7) We upgraded to 4.1.6 from 4.0.6 earlier in the day, I don't really think it's anything more than coincidence, but it's worrying enough to send to the community. Regards, Logan

3 2

VM running on multiple hosts
by Logan Kuhn 20 Sep '17

20 Sep '17

--=_0e272b5f-fcd6-4360-b961-925677073066 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit We had an incident where a VM hosts' disk filled up, the VMs all went unknown in the web console, but were fully functional if you were to login or use the services of one. We couldn't migrate them so we powered them down on that host and powered them up and let ovirt choose the host for it, same as always. However the disk image on a few of them were corrupted because once we fixed the host with the full disk, it still thought it should be running the VM. Which promptly corrupted the disk, the error seems to be this in the logs: 2017-09-19 21:59:11,058 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler3) [36c806f6] VM '70cf75c7-0fc2-4bbe-958e-7d0095f70960'(testhub) is running in db and not running on VDS 'ef6dc2a3-af6e-4e00-aa4 0-493b31263417'(vm-int7) We upgraded to 4.1.6 from 4.0.6 earlier in the day, I don't really think it's anything more than coincidence, but it's worrying enough to send to the community. Regards, Logan --=_0e272b5f-fcd6-4360-b961-925677073066 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"font-family: Arial; font-size: 12pt; color: #0000= 00"><div>We had an incident where a VM hosts' disk filled up, the VMs all w= ent unknown in the web console, but were fully functional if you were to lo= gin or use the services of one.  We couldn't migrate them so we powere= d them down on that host and powered them up and let ovirt choose the host = for it, same as always.  However the disk image on a few of them were = corrupted because once we fixed the host with the full disk, it still thoug= ht it should be running the VM.  Which promptly corrupted the disk, th= e error seems to be this in the logs:</div><div><br data-mce-bogus=3D"1"></= div><div><span style=3D"font-family: monospace;" data-mce-style=3D"font-fam= ily: monospace;"><span style=3D"color: #000000; background-color: #ffffff;"= data-mce-style=3D"color: #000000; background-color: #ffffff;">2017-09-19 2= 1:59:11,058 INFO  [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyz= er] (DefaultQuartzScheduler3) [36c806f6] VM '70cf75c7-0fc2-4bbe-958e-7d0095= f70960'(testhub) is </span><span style=3D"font-weight: bold; color: #ff5454= ; background-color: #ffffff;" data-mce-style=3D"font-weight: bold; color: #= ff5454; background-color: #ffffff;">running</span><span style=3D"color: #00= 0000; background-color: #ffffff;" data-mce-style=3D"color: #000000; backgro= und-color: #ffffff;"> in db and not </span><span style=3D"font-weight: bold= ; color: #ff5454; background-color: #ffffff;" data-mce-style=3D"font-weight= : bold; color: #ff5454; background-color: #ffffff;">running</span><span sty= le=3D"color: #000000; background-color: #ffffff;" data-mce-style=3D"color: = #000000; background-color: #ffffff;"> on VDS 'ef6dc2a3-af6e-4e00-aa4</span>= <br>0-493b31263417'(vm-int7)<br></span></div><div><br></div><div>We upgrade= d to 4.1.6 from 4.0.6 earlier in the day, I don't really think it's anythin= g more than coincidence, but it's worrying enough to send to the community.= </div><div><br data-mce-bogus=3D"1"></div><div data-marker=3D"__SIG_PRE__">= Regards,<br>Logan</div></div></body></html> --=_0e272b5f-fcd6-4360-b961-925677073066--

1 0