- Users - oVirt List Archives

Possible vdsmd issues - " WARN Worker blocked"
by Johnson, Tim 31 Aug '18

31 Aug '18

Hi all, We have had a bit of a strange issue with the starting of the self-hosted engine due to the vdsm and ovirt-ha processes having errors and not able to be started. Running Ovirt version 4.2 with Gluster mounts (not hyper converged) gluster 3.12.13 replicated volumes with arbiter brick. The mounts for the storage are mounted on all the Ovirt hosts and able to read/touch files on the mounts. Unfortunately we can not pin a specific timeframe when this started happening. Meaning we don’t know if it started after a specific update or any other event. The vdsmd is throwing errors (bottom – with version numbers) when trying to check the status of the self -hosted engine getting : # hosted-engine --vm-status The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. Thanks for any assistance. systemctl status ovirt-ha-agent -l ● ovirt-ha-agent.service - oVirt Hosted Engine High Availability Monitoring Agent Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-agent.service; enabled; vendor preset: disabled) Active: activating (auto-restart) (Result: exit-code) since Thu 2018-08-30 13:24:40 CDT; 2s ago Process: 17135 ExecStart=/usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent (code=exited, status=157) Main PID: 17135 (code=exited, status=157) systemctl status ovirt-ha-broker -l ● ovirt-ha-broker.service - oVirt Hosted Engine High Availability Communications Broker Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-broker.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2018-08-30 13:10:35 CDT; 14min ago Main PID: 14863 (ovirt-ha-broker) Tasks: 4 CGroup: /system.slice/ovirt-ha-broker.service └─14863 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker Aug 30 13:10:35 rrb-vmhost1.rrc.local systemd[1]: Started oVirt Hosted Engine High Availability Communications Broker. Aug 30 13:10:35 rrb-vmhost1.rrc.local systemd[1]: Starting oVirt Hosted Engine High Availability Communications Broker... Aug 30 13:14:44 rrb-vmhost1.rrc.local ovirt-ha-broker[14863]: ovirt-ha-broker ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker ERROR Failed to start monitoring domain (sd_uuid=d0bfc335-ab6c-4378-9bcb-2f5f833431c2, host_id=1): timeout during domain acquisition Aug 30 13:14:44 rrb-vmhost1.rrc.local ovirt-ha-broker[14863]: ovirt-ha-broker ovirt_hosted_engine_ha.broker.listener.Action.start_domain_monitor ERROR Error in RPC call: Failed to start monitoring domain (sd_uuid=d0bfc335-ab6c-4378-9bcb-2f5f833431c2, host_id=1): timeout during domain acquisition Aug 30 13:19:42 rrb-vmhost1.rrc.local ovirt-ha-broker[14863]: ovirt-ha-broker ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker ERROR Failed to start monitoring domain (sd_uuid=d0bfc335-ab6c-4378-9bcb-2f5f833431c2, host_id=1): timeout during domain acquisition Aug 30 13:19:42 rrb-vmhost1.rrc.local ovirt-ha-broker[14863]: ovirt-ha-broker ovirt_hosted_engine_ha.broker.listener.Action.start_domain_monitor ERROR Error in RPC call: Failed to start monitoring domain (sd_uuid=d0bfc335-ab6c-4378-9bcb-2f5f833431c2, host_id=1): timeout during domain acquisition Aug 30 13:19:42 rrb-vmhost1.rrc.local ovirt-ha-broker[14863]: ovirt-ha-broker ovirt_hosted_engine_ha.broker.status_broker.StatusBroker.Update ERROR Failed to update state. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/status_broker.py", line 82, in run if (self._status_broker._inquire_whiteboard_lock() or File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/status_broker.py", line 190, in _inquire_whiteboard_lock self.host_id, self._lease_file) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/status_broker.py", line 128, in host_id raise ex.HostIdNotLockedError("Host id is not set") HostIdNotLockedError: Host id is not set Aug 30 13:19:42 rrb-vmhost1.rrc.local ovirt-ha-broker[14863]: ovirt-ha-broker ovirt_hosted_engine_ha.broker.status_broker.StatusBroker.Update ERROR Trying to restart the broker Aug 30 13:19:42 rrb-vmhost1.rrc.local python[14863]: detected unhandled Python exception in '/usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker' Aug 30 13:19:48 rrb-vmhost1.rrc.local python[14863]: communication with ABRT daemon failed: timed out glusterfs-api-3.12.13-1.el7.x86_64 glusterfs-server-3.12.13-1.el7.x86_64 glusterfs-fuse-3.12.13-1.el7.x86_64 vdsm-gluster-4.20.35-1.el7.x86_64 centos-release-gluster312-1.0-2.el7.centos.noarch glusterfs-client-xlators-3.12.13-1.el7.x86_64 glusterfs-geo-replication-3.12.13-1.el7.x86_64 glusterfs-libs-3.12.13-1.el7.x86_64 glusterfs-cli-3.12.13-1.el7.x86_64 glusterfs-rdma-3.12.13-1.el7.x86_64 glusterfs-events-3.12.13-1.el7.x86_64 glusterfs-3.12.13-1.el7.x86_64 libvirt-daemon-driver-storage-gluster-3.9.0-14.el7_5.7.x86_64 python2-gluster-3.12.13-1.el7.x86_64 glusterfs-gnfs-3.12.13-1.el7.x86_64 ovirt-setup-lib-1.1.4-1.el7.centos.noarch ovirt-iso-uploader-4.2.0-1.el7.centos.noarch ovirt-engine-setup-base-4.2.5.3-1.el7.noarch ovirt-host-dependencies-4.2.3-1.el7.x86_64 ovirt-guest-agent-common-1.0.14-1.el7.noarch python-ovirt-engine-sdk4-4.2.7-2.el7.x86_64 ovirt-engine-setup-plugin-ovirt-engine-common-4.2.5.3-1.el7.noarch ovirt-vmconsole-1.0.5-4.el7.centos.noarch ovirt-engine-tools-backup-4.2.5.3-1.el7.noarch ovirt-guest-agent-windows-1.0.14-1.el7.centos.noarch cockpit-ovirt-dashboard-0.11.31-1.el7.noarch ovirt-host-deploy-1.7.4-1.el7.noarch ovirt-engine-lib-4.2.5.3-1.el7.noarch ovirt-engine-sdk-python-3.6.9.1-1.el7.noarch ovirt-hosted-engine-ha-2.2.16-1.el7.noarch ovirt-guest-tools-iso-4.2-1.el7.centos.noarch ovirt-imageio-common-1.4.2-0.el7.noarch ovirt-hosted-engine-setup-2.2.25-1.el7.noarch ovirt-imageio-daemon-1.4.2-0.el7.noarch ovirt-vmconsole-host-1.0.5-4.el7.centos.noarch ovirt-provider-ovn-driver-1.2.13-1.el7.noarch ovirt-host-4.2.3-1.el7.x86_64 vdsm-jsonrpc-4.20.35-1.el7.noarch vdsm-hook-ethtool-options-4.20.35-1.el7.noarch vdsm-gluster-4.20.35-1.el7.x86_64 vdsm-api-4.20.35-1.el7.noarch vdsm-yajsonrpc-4.20.35-1.el7.noarch vdsm-client-4.20.35-1.el7.noarch vdsm-hook-fcoe-4.20.35-1.el7.noarch vdsm-network-4.20.35-1.el7.x86_64 vdsm-hook-vmfex-dev-4.20.35-1.el7.noarch vdsm-hook-vhostmd-4.20.35-1.el7.noarch vdsm-http-4.20.35-1.el7.noarch vdsm-hook-openstacknet-4.20.35-1.el7.noarch vdsm-python-4.20.35-1.el7.noarch vdsm-hook-vfio-mdev-4.20.35-1.el7.noarch vdsm-common-4.20.35-1.el7.noarch vdsm-4.20.35-1.el7.x86_64 Aug 30 13:02:42 rrb-vmhost1.rrc.local vdsm[6792]: WARN Worker blocked: <Worker name=periodic/1 running <Task <Operation action=<vdsm.virt.sampling.HostMonitor object at 0x7f713c0b0fd0> at 0x7f713c063050> timeout=15, duration=75 at 0x7f7170698c90> task#=354 at 0x7f713c10ec90>, traceback: File: "/usr/lib64/python2.7/threading.py", line 785, in __bootstrap self.__bootstrap_inner() File: "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner self.run() File: "/usr/lib64/python2.7/threading.py", line 765, in run self.__target(*self.__args, **self.__kwargs) File: "/usr/lib/python2.7/site-packages/vdsm/common/concurrent.py", line 194, in run ret = func(*args, **kwargs) File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 301, in _run self._execute_task() File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 315, in _execute_task task() File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 391, in __call__ self._callable() File: "/usr/lib/python2.7/site-packages/vdsm/virt/periodic.py", line 220, in __call__ self._func() File: "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line 580, in __call__ stats = hostapi.get_stats(self._cif, self._samples.stats()) File: "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 77, in get_stats ret['haStats'] = _getHaInfo() File: "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 182, in _getHaInfo stats = instance.get_all_stats() File: "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 94, in get_all_stats stats = broker.get_stats_from_storage() File: "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 135, in get_stats_from_storage result = self._proxy.get_stats() File: "/usr/lib64/python2.7/xmlrpclib.py", line 1233, in __call__ return self.__send(self.__name, args) File: "/usr/lib64/python2.7/xmlrpclib.py", line 1591, in __request verbose=self.__verbose File: "/usr/lib64/python2.7/xmlrpclib.py", line 1273, in request return self.single_request(host, handler, request_body, verbose) File: "/usr/lib64/python2.7/xmlrpclib.py", line 1303, in single_request response = h.getresponse(buffering=True) File: "/usr/lib64/python2.7/httplib.py", line 1113, in getresponse response.begin() File: "/usr/lib64/python2.7/httplib.py", line 444, in begin version, status, reason = self._read_status() File: "/usr/lib64/python2.7/httplib.py", line 400, in _read_status line = self.fp.readline(_MAXLINE + 1) File: "/usr/lib64/python2.7/socket.py", line 476, in readline data = self._sock.recv(self._rbufsize)

2 1

Hosted Engine, Node, Local Storage, All in One
by Jeremy Tourville 30 Aug '18

30 Aug '18

Can anyone tell me if this can be done? I have read various articles and I'm not sure. http://blog.domb.net/?p=2141 https://www.ovirt.org/develop/release-management/features/integration/allin…<http://blog.domb.net/?p=2141> According to my google search results the ovirt article date is within the last year approximately but I says deprecated after version 3.6 yet the 1st article makes it seem it can be done. I know this goes against standard practice but there is a reason I'm trying to do it. If it is possible, can anyone point me to a guide or give me an overview of the steps needed? Thank you for your help!

2 1

Re: Turn Off Email Alerts
by Douglas Duckworth 30 Aug '18

30 Aug '18

Fixed *THANK YOU!* Thanks, Douglas Duckworth, MSc, LFCS HPC System Administrator Scientific Computing Unit Weill Cornell Medicine 1300 York Avenue New York, NY 10065 E: doug(a)med.cornell.edu O: 212-746-6305 F: 212-746-8690 On Wed, Aug 29, 2018 at 6:09 PM, Martin Sivak <msivak(a)redhat.com> wrote: > Hi, > > > Yes, indeed! > > > > How can I change this internal Python setting? > > The same as the notification regex. Using hosted-engine > --set-shared-config <key> <value> --type=<type> > > Executing hosted-engine --get-shared-config xxx (or anything else that > does not exist) should give you the list of all types and keys you can > change (on 4.2 fo sure and 4.1 very probably too). > > Best regards > > Martin Sivak > > > On Wed, Aug 29, 2018 at 11:56 PM, Douglas Duckworth > <dod2014(a)med.cornell.edu> wrote: > > Yes, indeed! > > > > How can I change this internal Python setting? > > > > On Wed, Aug 29, 2018, 5:43 PM Martin Sivak <msivak(a)redhat.com> wrote: > >> > >> Hi, > >> > >> two clarifications: > >> > >> Hosted engine is sending those emails using built-in Python SMTP > >> client that talks directly yo the SMTP server specified during install > >> time. We default to localhost, but you might have changed it. > >> > >> > notify.state_transition : maintenance|start|stop|migrate|up|down, > type : > >> > broker > >> > >> The value here is a regular expression that is matched against the > >> state transition string in the email. > >> > >> Best regards > >> > >> Martin Sivak > >> > >> On Wed, Aug 29, 2018 at 10:34 PM, Douglas Duckworth > >> <dod2014(a)med.cornell.edu> wrote: > >> > Thanks for sharing > >> > > >> > I may want to do that > >> > > >> > Though first I want to understand how the emails are arriving. > >> > > >> > I stooped ovirt-engine-notifier.service and postfix.service on all > hosts > >> > and > >> > the hosted engine. So how are the email being delivered? They are > not > >> > running senmail so I don't understand what daemon's sending these > >> > messages. > >> > > >> > Thanks, > >> > > >> > Douglas Duckworth, MSc, LFCS > >> > HPC System Administrator > >> > Scientific Computing Unit > >> > Weill Cornell Medicine > >> > 1300 York Avenue > >> > New York, NY 10065 > >> > E: doug(a)med.cornell.edu > >> > O: 212-746-6305 > >> > F: 212-746-8690 > >> > > >> > > >> > > >> > On Wed, Aug 29, 2018 at 3:16 PM, Simone Tiraboschi < > stirabos(a)redhat.com> > >> > wrote: > >> >> > >> >> Hi, > >> >> you can change the list of status you want to be notified about with > >> >> hosted-engine --set-shared-config notify.state_transition > >> >> The default is: > >> >> > >> >> [root@hehost01 ~]# hosted-engine --get-shared-config > >> >> notify.state_transition --type=broker > >> >> > >> >> notify.state_transition : maintenance|start|stop|migrate|up|down, > type > >> >> : > >> >> broker > >> >> > >> >> > >> >> On Wed, Aug 29, 2018 at 7:47 PM Douglas Duckworth > >> >> <dod2014(a)med.cornell.edu> wrote: > >> >>> > >> >>> I agree however we are in testing phase so I make changes a lot. > >> >>> Therefore alerts are not presently needed. > >> >>> > >> >>> So how to I turn them off? > >> >>> > >> >>> These steps do not work on hosted engine: > >> >>> > >> >>> > >> >>> me@ovirt-engine[~]$ sudo systemctl stop postfix.service > >> >>> me@ovirt-engine[~]$ sudo systemctl stop > ovirt-engine-notifier.service > >> >>> me@ovirt-engine[~]$ sudo systemctl status > >> >>> ovirt-engine-notifier.service > >> >>> ● ovirt-engine-notifier.service - oVirt Engine Notifier > >> >>> Loaded: loaded > >> >>> (/usr/lib/systemd/system/ovirt-engine-notifier.service; > >> >>> enabled; vendor preset: disabled) > >> >>> Active: inactive (dead) since Wed 2018-08-29 13:41:55 EDT; 3s ago > >> >>> Process: 1814 > >> >>> > >> >>> ExecStart=/usr/share/ovirt-engine/services/ovirt-engine- > notifier/ovirt-engine-notifier.py > >> >>> --redirect-output --systemd=notify $EXTRA_ARGS start (code=exited, > >> >>> status=0/SUCCESS) > >> >>> Main PID: 1814 (code=exited, status=0/SUCCESS) > >> >>> > >> >>> Aug 25 12:09:31 ovirt-engine.pbtech systemd[1]: Starting oVirt > Engine > >> >>> Notifier... > >> >>> Aug 25 12:09:33 ovirt-engine.pbtech systemd[1]: Started oVirt Engine > >> >>> Notifier. > >> >>> Aug 29 13:41:54 ovirt-engine.pbtech systemd[1]: Stopping oVirt > Engine > >> >>> Notifier... > >> >>> Aug 29 13:41:55 ovirt-engine.pbtech systemd[1]: Stopped oVirt Engine > >> >>> Notifier. > >> >>> > >> >>> I still get an email every time I put a host in maint mode for > >> >>> example. > >> >>> > >> >>> > >> >>> Thanks, > >> >>> > >> >>> Douglas Duckworth, MSc, LFCS > >> >>> HPC System Administrator > >> >>> Scientific Computing Unit > >> >>> Weill Cornell Medicine > >> >>> 1300 York Avenue > >> >>> New York, NY 10065 > >> >>> E: doug(a)med.cornell.edu > >> >>> O: 212-746-6305 > >> >>> F: 212-746-8690 > >> >>> > >> >>> > >> >>> > >> >>> On Tue, Aug 28, 2018 at 4:43 PM, Johan Bernhardsson <johan(a)kafit.se > > > >> >>> wrote: > >> >>>> > >> >>>> Those alerts are also coming from hosted-engine that keeps ovirt > >> >>>> manager > >> >>>> running. > >> >>>> > >> >>>> I would rather have a filter in my email client for them than > >> >>>> disabling > >> >>>> all of the alerting stuff > >> >>>> > >> >>>> /Johan > >> >>>> > >> >>>> On August 28, 2018 22:36:34 Douglas Duckworth > >> >>>> <dod2014(a)med.cornell.edu> > >> >>>> wrote: > >> >>>>> > >> >>>>> Hi > >> >>>>> > >> >>>>> Can someone please help? I keep getting ovirt alerts via email > >> >>>>> despite > >> >>>>> turning off postix and ovirt-engine-notifier.service > >> >>>>> > >> >>>>> Thanks, > >> >>>>> > >> >>>>> Douglas Duckworth, MSc, LFCS > >> >>>>> HPC System Administrator > >> >>>>> Scientific Computing Unit > >> >>>>> Weill Cornell Medicine > >> >>>>> 1300 York Avenue > >> >>>>> New York, NY 10065 > >> >>>>> E: doug(a)med.cornell.edu > >> >>>>> O: 212-746-6305 > >> >>>>> F: 212-746-8690 > >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> On Fri, Aug 24, 2018 at 8:59 AM, Douglas Duckworth > >> >>>>> <dod2014(a)med.cornell.edu> wrote: > >> >>>>>> > >> >>>>>> Hi > >> >>>>>> > >> >>>>>> How do I turn off hosted engine alerts? We are in a testing > phase > >> >>>>>> so > >> >>>>>> these are not needed. I have disabled postfix on all hosts as > well > >> >>>>>> as > >> >>>>>> stopped the ovirt notification daemon on the hosted engine. I > kept > >> >>>>>> it > >> >>>>>> running while putting /dev/null in > >> >>>>>> > >> >>>>>> /usr/share/ovirt-engine/services/ovirt-engine- > notifier/ovirt-engine-notifier.conf > >> >>>>>> for mail server. Yet I still get alerts for every thing done > such > >> >>>>>> as > >> >>>>>> putting hosts in maintenance mode. Very confusing. > >> >>>>> > >> >>>>> > >> >>>>> _______________________________________________ > >> >>>>> Users mailing list -- users(a)ovirt.org > >> >>>>> To unsubscribe send an email to users-leave(a)ovirt.org > >> >>>>> Privacy Statement: > >> >>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www. > ovirt.org_site_privacy-2Dpolicy_&d=DwIFaQ&c=lb62iw4YL4RFalcE2hQUQealT9- > RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e-CbhH6xUjnRkaqPFUS2wTJ2cw&m= > KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s=HNCnpn- > PS346coC2krxJr3kEOccwU9mSnRZNLj3IRok&e= > >> >>>>> oVirt Code of Conduct: > >> >>>>> > >> >>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www. > ovirt.org_community_about_community-2Dguidelines_&d=DwIFaQ&c= > lb62iw4YL4RFalcE2hQUQealT9-RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e- > CbhH6xUjnRkaqPFUS2wTJ2cw&m=KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s= > bLInNmwMa9F4yME1S7vL8Qntn5MypII4kTgMKkZP-5c&e= > >> >>>>> List Archives: > >> >>>>> > >> >>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists. > ovirt.org_archives_list_users-40ovirt.org_message_ > X6YRFWUAKYFY2HQF56HGUK3BPXJL2HBH_&d=DwIFaQ&c=lb62iw4YL4RFalcE2hQUQealT9- > RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e-CbhH6xUjnRkaqPFUS2wTJ2cw&m= > KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s=WW0BX4m6z_ > FG0g68LRhSqZ0w6Chf6mqNuSrYpX0ICds&e= > >> >>>> > >> >>>> > >> >>> > >> >>> _______________________________________________ > >> >>> Users mailing list -- users(a)ovirt.org > >> >>> To unsubscribe send an email to users-leave(a)ovirt.org > >> >>> Privacy Statement: > >> >>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www. > ovirt.org_site_privacy-2Dpolicy_&d=DwIFaQ&c=lb62iw4YL4RFalcE2hQUQealT9- > RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e-CbhH6xUjnRkaqPFUS2wTJ2cw&m= > KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s=HNCnpn- > PS346coC2krxJr3kEOccwU9mSnRZNLj3IRok&e= > >> >>> oVirt Code of Conduct: > >> >>> > >> >>> https://urldefense.proofpoint.com/v2/url?u=https-3A__www. > ovirt.org_community_about_community-2Dguidelines_&d=DwIFaQ&c= > lb62iw4YL4RFalcE2hQUQealT9-RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e- > CbhH6xUjnRkaqPFUS2wTJ2cw&m=KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s= > bLInNmwMa9F4yME1S7vL8Qntn5MypII4kTgMKkZP-5c&e= > >> >>> List Archives: > >> >>> > >> >>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists. > ovirt.org_archives_list_users-40ovirt.org_message_ > LIBA3OSRJUMGAGYOQDQAGLCYOWWNWJQ2_&d=DwIFaQ&c=lb62iw4YL4RFalcE2hQUQealT9- > RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e-CbhH6xUjnRkaqPFUS2wTJ2cw&m= > KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s= > jfhpC57qilLXkNkXrEadoQk9KlDkD4UI7UjTzbyFUlg&e= > >> > > >> > > >> > > >> > _______________________________________________ > >> > Users mailing list -- users(a)ovirt.org > >> > To unsubscribe send an email to users-leave(a)ovirt.org > >> > Privacy Statement: > >> > https://urldefense.proofpoint.com/v2/url?u=https-3A__www. > ovirt.org_site_privacy-2Dpolicy_&d=DwIFaQ&c=lb62iw4YL4RFalcE2hQUQealT9- > RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e-CbhH6xUjnRkaqPFUS2wTJ2cw&m= > KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s=HNCnpn- > PS346coC2krxJr3kEOccwU9mSnRZNLj3IRok&e= > >> > oVirt Code of Conduct: > >> > > >> > https://urldefense.proofpoint.com/v2/url?u=https-3A__www. > ovirt.org_community_about_community-2Dguidelines_&d=DwIFaQ&c= > lb62iw4YL4RFalcE2hQUQealT9-RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e- > CbhH6xUjnRkaqPFUS2wTJ2cw&m=KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s= > bLInNmwMa9F4yME1S7vL8Qntn5MypII4kTgMKkZP-5c&e= > >> > List Archives: > >> > > >> > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists. > ovirt.org_archives_list_users-40ovirt.org_message_ > I7EXHCE43XXSVKFVF5OCZACUCK4WW4UG_&d=DwIFaQ&c=lb62iw4YL4RFalcE2hQUQealT9- > RXrryqt9KZX2qu2s&r=2Fzhh_78OGspKQpl_e-CbhH6xUjnRkaqPFUS2wTJ2cw&m= > KNBFLrOsq9Nau2RNAaX-U7ES91Cg8z5gQzVkdVotcCk&s=AD1Knu9_62ziVk_ > XzUnjoQCT9CIbwnAE27GscnXM0M0&e= > >> > >

1 0

ovirt-engine-extension-aaa-ldap-setup credentials invalid
by Douglas Duckworth 30 Aug '18

30 Aug '18

Hi I am not able to finish ovirt-engine-extension-aaa-ldap-setup due to the error "credentials invalid." My password's correct. Our directory server's OpenLDAP standard schema. Our accounts are under OU=People. We are binding with a service account that has access to the entire DN. Any way to discern more information from attached logs? Thanks, Douglas Duckworth, MSc, LFCS HPC System Administrator Scientific Computing Unit Weill Cornell Medicine 1300 York Avenue New York, NY 10065 E: doug(a)med.cornell.edu O: 212-746-6305 F: 212-746-8690

2 1

Multiple CephFS Monitors cause issues with oVirt
by Stack Korora 30 Aug '18

30 Aug '18

Greetings, My setup is a complete Red Hat install. Manager OS: RHEL 7.5 Hypervisors OS: RHEL 7.5 Running Red Hat CephFS (with their Ceph repos on all of the systems) with Red Hat Virtualization (aka oVirt). Everything is fully patched and updated as of yesterday morning. Yes, I have valid Red Hat support but I figured this was an odd enough problem that the community (and the Red-Hat-ers who hang out on this list) might have a better idea of where to start. (Although I might open a ticket anyway just because that is what support is for, right? :) Quick background: Your /etc/fstab when you mount a nfs should probably look something like this: <your.nfs.ip.addr>:/path/ /mount/point nfs <various options> 0 0 Just one IP is needed. Since part of the redundancy for Ceph is in the monitors, to mount CephFS the fstab should look something like this: <your.ceph.ip.addr1>,<your.ceph.ip.addr2>,<your.ceph.ip.addrX>:/path/ /mount/point ceph <various options> 0 0 Both the Ceph community and Red Hat recommend the comma separator for mounting multiple CephFS monitor nodes. (See section 4.2 point 3) https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/2/html/c… Now to oVirt/RHV. When I mount my Data Domain path as a Posix file system with a path of "<your.ceph.ip.addr1>:/path/" it works splendidly well (especially after the last Red Hat kernel update!). I've done a bunch of stuff to it and it seems to work every time. However, I don't have the redundancy of multiple Ceph Monitors. When I mount my Data Domain path as a Posix file system with a path of "<your.ceph.ip.addr1>,<your.ceph.ip.addr2>,<your.ceph.ip.addrX>:/path/" most things seem to work. But I noticed a higher rate of failures. The only failure that I can trigger 100% of the time though is to mount a second data import domain and attempt to copy a vm disk from the import into the CephFS Data domain. Then I get an error like this: would VDSM ovirt01 command HSMGetAllTasksStatusesVDS failed: low level Image copy failed: (u'Destination volume 7c1bb510-9f35-4456-8d51-0955f788ac3e error: ParamsList: sep , in /rhev/data-center/mnt/<your.ceph.ip.addr1>,<your.ceph.ip.addr2>,<your.ceph.ip.addr3>:_ovirt_data/70fb34ad-e66d-43e6-8412-5e020baa34df/images/23991a68-0c43-433f-b1f9-48b1533da54a',) Uh, oh. It seems that the commas in the mount path are causing the problems. So I went looking through the logs for "sep , in" and found a bunch more hits which makes me think that this is actually the problem message. I've switched back to just one IP address for the time being but I obviously want the Ceph redundancy back. While running on just one IP, the vm disk that refused to copy before had no problem copying. The _only_ change I made was dropping two of the three IP's from the Data Domain path option. Is this a bug, or did I do something wrong? Does anyone have a suggestion for me to try? Thank you! ~Stack~

4 8

Re: Turn Off Email Alerts
by Douglas Duckworth 30 Aug '18

30 Aug '18

Yes, indeed! How can I change this internal Python setting? On Wed, Aug 29, 2018, 5:43 PM Martin Sivak <msivak(a)redhat.com> wrote: > Hi, > > two clarifications: > > Hosted engine is sending those emails using built-in Python SMTP > client that talks directly yo the SMTP server specified during install > time. We default to localhost, but you might have changed it. > > > notify.state_transition : maintenance|start|stop|migrate|up|down, type : > broker > > The value here is a regular expression that is matched against the > state transition string in the email. > > Best regards > > Martin Sivak > > On Wed, Aug 29, 2018 at 10:34 PM, Douglas Duckworth > <dod2014(a)med.cornell.edu> wrote: > > Thanks for sharing > > > > I may want to do that > > > > Though first I want to understand how the emails are arriving. > > > > I stooped ovirt-engine-notifier.service and postfix.service on all hosts > and > > the hosted engine. So how are the email being delivered? They are not > > running senmail so I don't understand what daemon's sending these > messages. > > > > Thanks, > > > > Douglas Duckworth, MSc, LFCS > > HPC System Administrator > > Scientific Computing Unit > > Weill Cornell Medicine > > 1300 York Avenue > > New York, NY 10065 > > E: doug(a)med.cornell.edu > > O: 212-746-6305 > > F: 212-746-8690 > > > > > > > > On Wed, Aug 29, 2018 at 3:16 PM, Simone Tiraboschi <stirabos(a)redhat.com> > > wrote: > >> > >> Hi, > >> you can change the list of status you want to be notified about with > >> hosted-engine --set-shared-config notify.state_transition > >> The default is: > >> > >> [root@hehost01 ~]# hosted-engine --get-shared-config > >> notify.state_transition --type=broker > >> > >> notify.state_transition : maintenance|start|stop|migrate|up|down, type : > >> broker > >> > >> > >> On Wed, Aug 29, 2018 at 7:47 PM Douglas Duckworth > >> <dod2014(a)med.cornell.edu> wrote: > >>> > >>> I agree however we are in testing phase so I make changes a lot. > >>> Therefore alerts are not presently needed. > >>> > >>> So how to I turn them off? > >>> > >>> These steps do not work on hosted engine: > >>> > >>> > >>> me@ovirt-engine[~]$ sudo systemctl stop postfix.service > >>> me@ovirt-engine[~]$ sudo systemctl stop ovirt-engine-notifier.service > >>> me@ovirt-engine[~]$ sudo systemctl status > ovirt-engine-notifier.service > >>> ● ovirt-engine-notifier.service - oVirt Engine Notifier > >>> Loaded: loaded > (/usr/lib/systemd/system/ovirt-engine-notifier.service; > >>> enabled; vendor preset: disabled) > >>> Active: inactive (dead) since Wed 2018-08-29 13:41:55 EDT; 3s ago > >>> Process: 1814 > >>> > ExecStart=/usr/share/ovirt-engine/services/ovirt-engine-notifier/ovirt-engine-notifier.py > >>> --redirect-output --systemd=notify $EXTRA_ARGS start (code=exited, > >>> status=0/SUCCESS) > >>> Main PID: 1814 (code=exited, status=0/SUCCESS) > >>> > >>> Aug 25 12:09:31 ovirt-engine.pbtech systemd[1]: Starting oVirt Engine > >>> Notifier... > >>> Aug 25 12:09:33 ovirt-engine.pbtech systemd[1]: Started oVirt Engine > >>> Notifier. > >>> Aug 29 13:41:54 ovirt-engine.pbtech systemd[1]: Stopping oVirt Engine > >>> Notifier... > >>> Aug 29 13:41:55 ovirt-engine.pbtech systemd[1]: Stopped oVirt Engine > >>> Notifier. > >>> > >>> I still get an email every time I put a host in maint mode for example. > >>> > >>> > >>> Thanks, > >>> > >>> Douglas Duckworth, MSc, LFCS > >>> HPC System Administrator > >>> Scientific Computing Unit > >>> Weill Cornell Medicine > >>> 1300 York Avenue > >>> New York, NY 10065 > >>> E: doug(a)med.cornell.edu > >>> O: 212-746-6305 > >>> F: 212-746-8690 > >>> > >>> > >>> > >>> On Tue, Aug 28, 2018 at 4:43 PM, Johan Bernhardsson <johan(a)kafit.se> > >>> wrote: > >>>> > >>>> Those alerts are also coming from hosted-engine that keeps ovirt > manager > >>>> running. > >>>> > >>>> I would rather have a filter in my email client for them than > disabling > >>>> all of the alerting stuff > >>>> > >>>> /Johan > >>>> > >>>> On August 28, 2018 22:36:34 Douglas Duckworth < > dod2014(a)med.cornell.edu> > >>>> wrote: > >>>>> > >>>>> Hi > >>>>> > >>>>> Can someone please help? I keep getting ovirt alerts via email > despite > >>>>> turning off postix and ovirt-engine-notifier.service > >>>>> > >>>>> Thanks, > >>>>> > >>>>> Douglas Duckworth, MSc, LFCS > >>>>> HPC System Administrator > >>>>> Scientific Computing Unit > >>>>> Weill Cornell Medicine > >>>>> 1300 York Avenue > >>>>> New York, NY 10065 > >>>>> E: doug(a)med.cornell.edu > >>>>> O: 212-746-6305 > >>>>> F: 212-746-8690 > >>>>> > >>>>> > >>>>> > >>>>> On Fri, Aug 24, 2018 at 8:59 AM, Douglas Duckworth > >>>>> <dod2014(a)med.cornell.edu> wrote: > >>>>>> > >>>>>> Hi > >>>>>> > >>>>>> How do I turn off hosted engine alerts? We are in a testing phase > so > >>>>>> these are not needed. I have disabled postfix on all hosts as well > as > >>>>>> stopped the ovirt notification daemon on the hosted engine. I kept > it > >>>>>> running while putting /dev/null in > >>>>>> > /usr/share/ovirt-engine/services/ovirt-engine-notifier/ovirt-engine-notifier.conf > >>>>>> for mail server. Yet I still get alerts for every thing done such > as > >>>>>> putting hosts in maintenance mode. Very confusing. > >>>>> > >>>>> > >>>>> _______________________________________________ > >>>>> Users mailing list -- users(a)ovirt.org > >>>>> To unsubscribe send an email to users-leave(a)ovirt.org > >>>>> Privacy Statement: > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_site_pri… > >>>>> oVirt Code of Conduct: > >>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_communit… > >>>>> List Archives: > >>>>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.ovirt.org_archiv… > >>>> > >>>> > >>> > >>> _______________________________________________ > >>> Users mailing list -- users(a)ovirt.org > >>> To unsubscribe send an email to users-leave(a)ovirt.org > >>> Privacy Statement: > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_site_pri… > >>> oVirt Code of Conduct: > >>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_communit… > >>> List Archives: > >>> > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.ovirt.org_archiv… > > > > > > > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org > > Privacy Statement: > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_site_pri… > > oVirt Code of Conduct: > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_communit… > > List Archives: > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.ovirt.org_archiv… > > >

2 1

Re: Turn Off Email Alerts
by Douglas Duckworth 29 Aug '18

29 Aug '18

Thanks for sharing I may want to do that Though first I want to understand how the emails are arriving. I stooped ovirt-engine-notifier.service and postfix.service on all hosts and the hosted engine. So how are the email being delivered? They are not running senmail so I don't understand what daemon's sending these messages. Thanks, Douglas Duckworth, MSc, LFCS HPC System Administrator Scientific Computing Unit Weill Cornell Medicine 1300 York Avenue New York, NY 10065 E: doug(a)med.cornell.edu O: 212-746-6305 F: 212-746-8690 On Wed, Aug 29, 2018 at 3:16 PM, Simone Tiraboschi <stirabos(a)redhat.com> wrote: > Hi, > you can change the list of status you want to be notified about > with hosted-engine --set-shared-config notify.state_transition > The default is: > > [root@hehost01 ~]# hosted-engine --get-shared-config > notify.state_transition --type=broker > > notify.state_transition : maintenance|start|stop|migrate|up|down, type : > broker > > > On Wed, Aug 29, 2018 at 7:47 PM Douglas Duckworth <dod2014(a)med.cornell.edu> > wrote: > >> I agree however we are in testing phase so I make changes a lot. >> Therefore alerts are not presently needed. >> >> So how to I turn them off? >> >> These steps do not work on hosted engine: >> >> >> me@ovirt-engine[~]$ sudo systemctl stop postfix.service >> me@ovirt-engine[~]$ sudo systemctl stop ovirt-engine-notifier.service >> me@ovirt-engine[~]$ sudo systemctl status ovirt-engine-notifier.service >> ● ovirt-engine-notifier.service - oVirt Engine Notifier >> Loaded: loaded (/usr/lib/systemd/system/ovirt-engine-notifier.service; >> enabled; vendor preset: disabled) >> Active: inactive (dead) since Wed 2018-08-29 13:41:55 EDT; 3s ago >> Process: 1814 ExecStart=/usr/share/ovirt-engine/services/ovirt-engine- >> notifier/ovirt-engine-notifier.py --redirect-output --systemd=notify >> $EXTRA_ARGS start (code=exited, status=0/SUCCESS) >> Main PID: 1814 (code=exited, status=0/SUCCESS) >> >> Aug 25 12:09:31 ovirt-engine.pbtech systemd[1]: Starting oVirt Engine >> Notifier... >> Aug 25 12:09:33 ovirt-engine.pbtech systemd[1]: Started oVirt Engine >> Notifier. >> Aug 29 13:41:54 ovirt-engine.pbtech systemd[1]: Stopping oVirt Engine >> Notifier... >> Aug 29 13:41:55 ovirt-engine.pbtech systemd[1]: Stopped oVirt Engine >> Notifier. >> >> I still get an email every time I put a host in maint mode for example. >> >> >> Thanks, >> >> Douglas Duckworth, MSc, LFCS >> HPC System Administrator >> Scientific Computing Unit >> Weill Cornell Medicine >> 1300 York Avenue >> <https://maps.google.com/?q=1300+York+Avenue+%0D%0A+New+York,+NY+10065&entry…> >> New York, NY 10065 >> <https://maps.google.com/?q=1300+York+Avenue+%0D%0A+New+York,+NY+10065&entry…> >> E: doug(a)med.cornell.edu >> O: 212-746-6305 >> F: 212-746-8690 >> >> >> >> On Tue, Aug 28, 2018 at 4:43 PM, Johan Bernhardsson <johan(a)kafit.se> >> wrote: >> >>> Those alerts are also coming from hosted-engine that keeps ovirt manager >>> running. >>> >>> I would rather have a filter in my email client for them than disabling >>> all of the alerting stuff >>> >>> /Johan >>> >>> On August 28, 2018 22:36:34 Douglas Duckworth <dod2014(a)med.cornell.edu> >>> wrote: >>> >>>> Hi >>>> >>>> Can someone please help? I keep getting ovirt alerts via email despite >>>> turning off postix and ovirt-engine-notifier.service >>>> >>>> Thanks, >>>> >>>> Douglas Duckworth, MSc, LFCS >>>> HPC System Administrator >>>> Scientific Computing Unit >>>> Weill Cornell Medicine >>>> 1300 York Avenue >>>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__maps.google.com_-3Fq-3…> >>>> New York, NY 10065 >>>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__maps.google.com_-3Fq-3…> >>>> E: doug(a)med.cornell.edu >>>> O: 212-746-6305 >>>> F: 212-746-8690 >>>> >>>> >>>> >>>> On Fri, Aug 24, 2018 at 8:59 AM, Douglas Duckworth < >>>> dod2014(a)med.cornell.edu> wrote: >>>> >>>>> Hi >>>>> >>>>> How do I turn off hosted engine alerts? We are in a testing phase so >>>>> these are not needed. I have disabled postfix on all hosts as well as >>>>> stopped the ovirt notification daemon on the hosted engine. I kept it >>>>> running while putting /dev/null in /usr/share/ovirt-engine/ >>>>> services/ovirt-engine-notifier/ovirt-engine-notifier.conf for mail >>>>> server. Yet I still get alerts for every thing done such as putting hosts >>>>> in maintenance mode. Very confusing. >>>>> >>>> >>>> _______________________________________________ >>>> Users mailing list -- users(a)ovirt.org >>>> To unsubscribe send an email to users-leave(a)ovirt.org >>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_site_pri…> >>>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community- >>>> guidelines/ >>>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_communit…> >>>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/ >>>> message/X6YRFWUAKYFY2HQF56HGUK3BPXJL2HBH/ >>>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.ovirt.org_archiv…> >>>> >>> >>> >> _______________________________________________ >> Users mailing list -- users(a)ovirt.org >> To unsubscribe send an email to users-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_site_pri…> >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community- >> guidelines/ >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_communit…> >> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/ >> message/LIBA3OSRJUMGAGYOQDQAGLCYOWWNWJQ2/ >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.ovirt.org_archiv…> >> >

2 1

Re: Turn Off Email Alerts
by Douglas Duckworth 29 Aug '18

29 Aug '18

I agree however we are in testing phase so I make changes a lot. Therefore alerts are not presently needed. So how to I turn them off? These steps do not work on hosted engine: me@ovirt-engine[~]$ sudo systemctl stop postfix.service me@ovirt-engine[~]$ sudo systemctl stop ovirt-engine-notifier.service me@ovirt-engine[~]$ sudo systemctl status ovirt-engine-notifier.service ● ovirt-engine-notifier.service - oVirt Engine Notifier Loaded: loaded (/usr/lib/systemd/system/ovirt-engine-notifier.service; enabled; vendor preset: disabled) Active: inactive (dead) since Wed 2018-08-29 13:41:55 EDT; 3s ago Process: 1814 ExecStart=/usr/share/ovirt-engine/services/ovirt-engine-notifier/ovirt-engine-notifier.py --redirect-output --systemd=notify $EXTRA_ARGS start (code=exited, status=0/SUCCESS) Main PID: 1814 (code=exited, status=0/SUCCESS) Aug 25 12:09:31 ovirt-engine.pbtech systemd[1]: Starting oVirt Engine Notifier... Aug 25 12:09:33 ovirt-engine.pbtech systemd[1]: Started oVirt Engine Notifier. Aug 29 13:41:54 ovirt-engine.pbtech systemd[1]: Stopping oVirt Engine Notifier... Aug 29 13:41:55 ovirt-engine.pbtech systemd[1]: Stopped oVirt Engine Notifier. I still get an email every time I put a host in maint mode for example. Thanks, Douglas Duckworth, MSc, LFCS HPC System Administrator Scientific Computing Unit Weill Cornell Medicine 1300 York Avenue New York, NY 10065 E: doug(a)med.cornell.edu O: 212-746-6305 F: 212-746-8690 On Tue, Aug 28, 2018 at 4:43 PM, Johan Bernhardsson <johan(a)kafit.se> wrote: > Those alerts are also coming from hosted-engine that keeps ovirt manager > running. > > I would rather have a filter in my email client for them than disabling > all of the alerting stuff > > /Johan > > On August 28, 2018 22:36:34 Douglas Duckworth <dod2014(a)med.cornell.edu> > wrote: > >> Hi >> >> Can someone please help? I keep getting ovirt alerts via email despite >> turning off postix and ovirt-engine-notifier.service >> >> Thanks, >> >> Douglas Duckworth, MSc, LFCS >> HPC System Administrator >> Scientific Computing Unit >> Weill Cornell Medicine >> 1300 York Avenue >> <https://maps.google.com/?q=1300+York+Avenue+%0D%0A+New+York,+NY+10065&entry…> >> New York, NY 10065 >> <https://maps.google.com/?q=1300+York+Avenue+%0D%0A+New+York,+NY+10065&entry…> >> E: doug(a)med.cornell.edu >> O: 212-746-6305 >> F: 212-746-8690 >> >> >> >> On Fri, Aug 24, 2018 at 8:59 AM, Douglas Duckworth < >> dod2014(a)med.cornell.edu> wrote: >> >>> Hi >>> >>> How do I turn off hosted engine alerts? We are in a testing phase so >>> these are not needed. I have disabled postfix on all hosts as well as >>> stopped the ovirt notification daemon on the hosted engine. I kept it >>> running while putting /dev/null in /usr/share/ovirt-engine/ser >>> vices/ovirt-engine-notifier/ovirt-engine-notifier.conf for mail >>> server. Yet I still get alerts for every thing done such as putting hosts >>> in maintenance mode. Very confusing. >>> >> >> _______________________________________________ >> Users mailing list -- users(a)ovirt.org >> To unsubscribe send an email to users-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_site_pri…> >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community- >> guidelines/ >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_communit…> >> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/ >> message/X6YRFWUAKYFY2HQF56HGUK3BPXJL2HBH/ >> <https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.ovirt.org_archiv…> >> > >

2 1

Re: Weird Memory Leak Issue
by Robert O'Kane 29 Aug '18

29 Aug '18

Not for me. After restarting the engine,it doesn't matter if I restart the Hypervisors, I only get the "protocol=gluster" when I restart the VMs... migration is not enough. "virsh -r dumpxml <VM-ID>" Cheers, Robert O'Kane On 08/29/2018 06:54 PM, Edward Clay wrote: > Not sure how you're setup. I only had to migrate the VMs off to another hypervisor then put the hypervisor in maintenance which seems to unmount the one gluster volume. After upgrading, rebooting and activating the HV I could migrate VMs back to it. This seemed to work for me. > > ________________________________ > From: Robert O'Kane <okane(a)khm.de> > Sent: Wednesday, August 29, 2018 10:42:56 AM > To: users(a)ovirt.org > Subject: [ovirt-users] Re: Weird Memory Leak Issue > > **Security Notice - This external email is NOT from The Hut Group** > > Ah, the FUSE mounts... I just saw last week that the upgrade to 4.2 removed the "LibgfApiSupported" flag by default. > > That is possibly why the leak simply appeared.... > > OK, I was wondering where this came from. Tomorrow I will upgrade and test. I still will have to eventually reboot the VMs to get the gluster mounts again.... :-/ > > > > On 08/29/2018 05:18 PM, Cole Johnson wrote: >> Great! I'll look for the update. >> >> On Wed, Aug 29, 2018 at 7:50 AM Darrell Budic <budic(a)onholyground.com> wrote: >>> >>> There’s a memory leak in gluster 3.12.9 - 3.12.12 on fuse mounted volumes, sounds like what you’re seeing. >>> >>> The fix is in 3.12.13, which should be showing up today or tomorrow in the centos repos (currently available from the testing repo). I’ve been running it overnight on one host to test, looks like they got it. >>> >>> ________________________________ >>> From: Cole Johnson <sizzlinsaguaro(a)gmail.com> >>> Subject: [ovirt-users] Weird Memory Leak Issue >>> Date: August 29, 2018 at 9:35:39 AM CDT >>> To: users(a)ovirt.org >>> >>> Hello, >>> I have a hyperconverged, self hosted ovirt cluster with three hosts, >>> running 4 VM's. The hosts are running the latest ovirt node. The >>> VM's are Linux, Windows server 2016, and Windows Server 2008r2. The >>> problem is with any host running the 2008r2 VM will run out of memory >>> after 8-10 hours, causing any VM on the host to be paused, and making >>> to host all but unresponsive. This problem seems to only exist with >>> this specific VM. None of the other running VM's have this problem. >>> I can resolve the problem by migrating the VM to a different host, >>> then putting the host into maintenance mode, the activating it back. >>> The leak appears to be in glusterfsd. Is there anything I can do to >>> permanently fix this? > > ______________________________________________ >> Users mailing list -- users(a)ovirt.org >> To unsubscribe send an email to users-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/<https://www.ovirt.org/site/privacy-policy/> >> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/<https://www.ovirt.org/community/about/community-guidelines/> >> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/CLNILVLZ4D3BJ…<https://lists.ovirt.org/archives/list/users@ovirt.org/message/CLNILVLZ4D3BJ…> >> > > -- > Robert O'Kane > Systems Administrator > Kunsthochschule für Medien Köln > Peter-Welter-Platz 2 > 50676 Köln > > fon: +49(221)20189-223 > fax: +49(221)20189-49223 > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/<https://www.ovirt.org/site/privacy-policy/> > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/<https://www.ovirt.org/community/about/community-guidelines/> > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/F7EY4FX7UOBGW…<https://lists.ovirt.org/archives/list/users@ovirt.org/message/F7EY4FX7UOBGW…> > > Edward Clay > Systems Administrator > The Hut Group<http://www.thehutgroup.com/> > > Tel: > Email: edward.clay(a)uk2group.com<mailto:edward.clay@uk2group.com> > > For the purposes of this email, the "company" means The Hut Group Limited, a company registered in England and Wales (company number 6539496) whose registered office is at Fifth Floor, Voyager House, Chicago Avenue, Manchester Airport, M90 3DQ and/or any of its respective subsidiaries. > > Confidentiality Notice > This e-mail is confidential and intended for the use of the named recipient only. If you are not the intended recipient please notify us by telephone immediately on +44(0)1606 811888 or return it to us by e-mail. Please then delete it from your system and note that any use, dissemination, forwarding, printing or copying is strictly prohibited. Any views or opinions are solely those of the author and do not necessarily represent those of the company. > > Encryptions and Viruses > Please note that this e-mail and any attachments have not been encrypted. They may therefore be liable to be compromised. Please also note that it is your responsibility to scan this e-mail and any attachments for viruses. We do not, to the extent permitted by law, accept any liability (whether in contract, negligence or otherwise) for any virus infection and/or external compromise of security and/or confidentiality in relation to transmissions sent by e-mail. > > Monitoring > Activity and use of the company's systems is monitored to secure its effective use and operation and for other lawful business purposes. Communications using these systems will also be monitored and may be recorded to secure effective use and operation and for other lawful business purposes. > > hgvyjuv > -- Robert O'Kane Systems Administrator Kunsthochschule für Medien Köln Peter-Welter-Platz 2 50676 Köln fon: +49(221)20189-223 fax: +49(221)20189-49223

1 0

Weird Memory Leak Issue
by Cole Johnson 29 Aug '18

29 Aug '18

Hello, I have a hyperconverged, self hosted ovirt cluster with three hosts, running 4 VM's. The hosts are running the latest ovirt node. The VM's are Linux, Windows server 2016, and Windows Server 2008r2. The problem is with any host running the 2008r2 VM will run out of memory after 8-10 hours, causing any VM on the host to be paused, and making to host all but unresponsive. This problem seems to only exist with this specific VM. None of the other running VM's have this problem. I can resolve the problem by migrating the VM to a different host, then putting the host into maintenance mode, the activating it back. The leak appears to be in glusterfsd. Is there anything I can do to permanently fix this?

4 4