[ovirt-users] host-deploy on HE hosts failing: Job for vdsmd.service canceled.

Simone Tiraboschi stirabos at redhat.com
Wed Jun 17 16:30:41 UTC 2015 


> Il giorno 17/giu/2015, alle ore 18:21, Daniel Helgenberger <daniel.helgenberger at m-box.de> ha scritto:
> 
> 
> 
>> On 17.06.2015 17:01, Simone Tiraboschi wrote:
>> 
>> 
>> ----- Original Message -----
>>> From: "Daniel Helgenberger" <daniel.helgenberger at m-box.de>
>>> To: "Simone Tiraboschi" <stirabos at redhat.com>
>>> Cc: Users at ovirt.org, "Alon Bar-Lev" <alonbl at redhat.com>
>>> Sent: Wednesday, June 17, 2015 4:49:07 PM
>>> Subject: Re: [ovirt-users] host-deploy on HE hosts failing: Job for    vdsmd.service canceled.
>>> 
>>> 
>>> 
>>>> On 17.06.2015 16:47, Simone Tiraboschi wrote:
>>>> 
>>>> 
>>>> ----- Original Message -----
>>>>> From: "Daniel Helgenberger" <daniel.helgenberger at m-box.de>
>>>>> To: "Simone Tiraboschi" <stirabos at redhat.com>
>>>>> Cc: Users at ovirt.org, "Alon Bar-Lev" <alonbl at redhat.com>
>>>>> Sent: Wednesday, June 17, 2015 4:40:45 PM
>>>>> Subject: Re: [ovirt-users] host-deploy on HE hosts failing: Job for
>>>>>    vdsmd.service canceled.
>>>>> 
>>>>> 
>>>>> 
>>>>>> On 17.06.2015 16:35, Simone Tiraboschi wrote:
>>>>>> 
>>>>>> 
>>>>>> ----- Original Message -----
>>>>>>> From: "Daniel Helgenberger" <daniel.helgenberger at m-box.de>
>>>>>>> To: Users at ovirt.org, "Alon Bar-Lev" <alonbl at redhat.com>
>>>>>>> Sent: Wednesday, June 17, 2015 3:24:35 PM
>>>>>>> Subject: [ovirt-users] host-deploy on HE hosts failing: Job for
>>>>>>>    vdsmd.service canceled.
>>>>>>> 
>>>>>>> Hello,
>>>>>>> 
>>>>>>> I have the following problem with host-deploy on HE hosts:
>>>>>>> 
>>>>>>>> 2015-06-17 13:22:32 DEBUG otopi.plugins.otopi.services.systemd
>>>>>>>> plugin.execute:937 execute-output: ('/bin/systemctl', 'stop',
>>>>>>>> 'vdsmd.service') stderr:
>>>>>>>> Job for vdsmd.service canceled.
>>>>>>>> 
>>>>>>>> 2015-06-17 13:22:32 DEBUG otopi.context context._executeMethod:152
>>>>>>>> method
>>>>>>>> exception
>>>>>>>> Traceback (most recent call last):
>>>>>>>>     File "/tmp/ovirt-1WPaDxJOpX/pythonlib/otopi/context.py", line 142,
>>>>>>>>     in
>>>>>>>>     _executeMethod
>>>>>>>>       method['method']()
>>>>>>>>     File
>>>>>>>>     "/tmp/ovirt-1WPaDxJOpX/otopi-plugins/ovirt-host-deploy/vdsm/packages.py",
>>>>>>>>     line 106, in _packages
>>>>>>>>       self.services.state('vdsmd', False)
>>>>>>>>     File
>>>>>>>>     "/tmp/ovirt-1WPaDxJOpX/otopi-plugins/otopi/services/systemd.py",
>>>>>>>>     line 138, in state
>>>>>>>>       'start' if state else 'stop'
>>>>>>>>     File
>>>>>>>>     "/tmp/ovirt-1WPaDxJOpX/otopi-plugins/otopi/services/systemd.py",
>>>>>>>>     line 77, in _executeServiceCommand
>>>>>>>>       raiseOnError=raiseOnError
>>>>>>>>     File "/tmp/ovirt-1WPaDxJOpX/pythonlib/otopi/plugin.py", line 942,
>>>>>>>>     in
>>>>>>>>     execute
>>>>>>>>       command=args[0],
>>>>>>>> RuntimeError: Command '/bin/systemctl' failed to execute
>>>>>>>> 2015-06-17 13:22:32 ERROR otopi.context context._executeMethod:161
>>>>>>>> Failed
>>>>>>>> to execute stage 'Package installation': Command '/bin/systemctl'
>>>>>>>> failed
>>>>>>>> to execute
>>>>>>>> 2015-06-17 13:22:32 DEBUG otopi.transaction transaction.abort:131
>>>>>>>> aborting
>>>>>>>> 'Yum Transaction'
>>>>>>>> 2015-06-17 13:22:32 INFO otopi.plugins.otopi.packagers.yumpackager
>>>>>>>> yumpackager.info:92 Yum Performing yum transaction rollback
>>>>>>>> Loaded plugins: auto-update-debuginfo, fastestmirror
>>>>>>> 
>>>>>>> 
>>>>>>>     I do not have 'standard' (=non ha) hosts; so I cannot tell for the
>>>>>>> others but suspect it relates to HE.
>>>>>> 
>>>>>> Yes, it's the hosted-engine HA agent which keeps VDSM up so host-deploy
>>>>>> fails on that.
>>>>>> The capability to re-deploy an hosted-engine host from the Web UI is not
>>>>>> available on oVirt 3.5, it will included in 3.6; please help us testing
>>>>>> it
>>>>>> on the first beta in  a few weeks.
>>>>>> 
>>>>>> By the way, why are you trying to re-deploy an host-deploy host from the
>>>>>> web UI?
>>>>> Ok, did not know about that. I use 'Reinstall' from the UI.
>>>>> 
>>>>> Until now, I thought the best way to update the hosts after new engine
>>>>> relases was:
>>>>> 1- update engine
>>>>> 2. set host to maintane
>>>>> 4. yum update on host for latest vdsm
>>>>> 3- Use reinstall from UI.
>>>>> 
>>>>> Please advise!
>>>> 
>>>> Running on your HE host:
>>>> # hosted-engine --set-maintenance=local
>>>> waiting for everything to be migrated if needed
>>>> # yum update
>>>> # hosted-engine --set-maintenance=none
>>>> 
>>>> should do the job
>>> Ok, I see; I think one should restart vdsmd also; IIRC it is not
>>> restarted in the process?
>> 
>> If updated it will be restarted by its rpm postscript.
> 
> Ok. However, I still need reinstall for configuration updates like 
> gluster / firewall etc.

RPM should perform intelligent upgrading of packages with configuration files at least saving them on conf.rpmsave and alerting if not forward compatible. If not, it's a packaging bug.

> Also, hosted-enginge-deploy is using 'reinstall'. How do I work around that?

Sorry, I didn't get it.

> 
>> 
>>>>>>> Steps:
>>>>>>> 1. set the host to maintenance
>>>>>>> At this point, only the HE datacenter is still mounted:
>>>>>>> mount |grep nfs
>>>>>>> nexstor01.sec.int.m-box.de:/volumes/ovirt/engine on
>>>>>>> /rhev/data-center/mnt/nexstor01.sec.int.m-box.de:_volumes_ovirt_engine
>>>>>>> type nfs
>>>>>>> (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,timeo=600,retrans=6,sec=sys,mountaddr=10.11.0.30,mountvers=3,mountport=58144,mountproto=udp,local_lock=none,addr=10.11.0.30)
>>>>>>> 
>>>>>>> 2. Reinstall host
>>>>>>> -> Error, host deactivated (Job for vdsmd.service canceled.)
>>>>>>> 
>>>>>>> 3. A workaround is to shutdown sanlock:
>>>>>>> 
>>>>>>> # systemctl stop vdsmd
>>>>>>> Job for vdsmd.service canceled.
>>>>>>> 
>>>>>>> # sanlock shutdown
>>>>>>> # systemctl stop vdsmd
>>>>>>> 
>>>>>>> 4. Now, host deploy works as expected.
>>>>>>> 
>>>>>>> 
>>>>>>> Versions:
>>>>>>> EL7 centos
>>>>>>> ovirt-3.5.2 -3.5.3
>>>>>>> sanlock-3.2.2-2.el7.x86_64
>>>>>>> vdsm 4.14.14 - 4.14.20
>>>>>>> 
>>>>>>> --
>>>>>>> Daniel Helgenberger
>>>>>>> m box bewegtbild GmbH
>>>>>>> 
>>>>>>> P: +49/30/2408781-22
>>>>>>> F: +49/30/2408781-10
>>>>>>> 
>>>>>>> ACKERSTR. 19
>>>>>>> D-10115 BERLIN
>>>>>>> 
>>>>>>> 
>>>>>>> www.m-box.de  www.monkeymen.tv
>>>>>>> 
>>>>>>> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
>>>>>>> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
>>>>>>> _______________________________________________
>>>>>>> Users mailing list
>>>>>>> Users at ovirt.org
>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>> 
>>>>> --
>>>>> Daniel Helgenberger
>>>>> m box bewegtbild GmbH
>>>>> 
>>>>> P: +49/30/2408781-22
>>>>> F: +49/30/2408781-10
>>>>> 
>>>>> ACKERSTR. 19
>>>>> D-10115 BERLIN
>>>>> 
>>>>> 
>>>>> www.m-box.de  www.monkeymen.tv
>>>>> 
>>>>> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
>>>>> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
>>> 
>>> --
>>> Daniel Helgenberger
>>> m box bewegtbild GmbH
>>> 
>>> P: +49/30/2408781-22
>>> F: +49/30/2408781-10
>>> 
>>> ACKERSTR. 19
>>> D-10115 BERLIN
>>> 
>>> 
>>> www.m-box.de  www.monkeymen.tv
>>> 
>>> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
>>> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
> 
> -- 
> Daniel Helgenberger
> m box bewegtbild GmbH
> 
> P: +49/30/2408781-22
> F: +49/30/2408781-10
> 
> ACKERSTR. 19
> D-10115 BERLIN
> 
> 
> www.m-box.de  www.monkeymen.tv
> 
> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
> Handeslregister: Amtsgericht Charlottenburg / HRB 112767

More information about the Users mailing list