[ovirt-users] host-deploy on HE hosts failing: Job for vdsmd.service canceled.

Wed Jun 17 14:49:07 UTC 2015


On 17.06.2015 16:47, Simone Tiraboschi wrote:
>
>
> ----- Original Message -----
>> From: "Daniel Helgenberger" <daniel.helgenberger at m-box.de>
>> To: "Simone Tiraboschi" <stirabos at redhat.com>
>> Cc: Users at ovirt.org, "Alon Bar-Lev" <alonbl at redhat.com>
>> Sent: Wednesday, June 17, 2015 4:40:45 PM
>> Subject: Re: [ovirt-users] host-deploy on HE hosts failing: Job for	vdsmd.service canceled.
>>
>>
>>
>> On 17.06.2015 16:35, Simone Tiraboschi wrote:
>>>
>>>
>>> ----- Original Message -----
>>>> From: "Daniel Helgenberger" <daniel.helgenberger at m-box.de>
>>>> To: Users at ovirt.org, "Alon Bar-Lev" <alonbl at redhat.com>
>>>> Sent: Wednesday, June 17, 2015 3:24:35 PM
>>>> Subject: [ovirt-users] host-deploy on HE hosts failing: Job for
>>>> 	vdsmd.service canceled.
>>>>
>>>> Hello,
>>>>
>>>> I have the following problem with host-deploy on HE hosts:
>>>>
>>>>> 2015-06-17 13:22:32 DEBUG otopi.plugins.otopi.services.systemd
>>>>> plugin.execute:937 execute-output: ('/bin/systemctl', 'stop',
>>>>> 'vdsmd.service') stderr:
>>>>> Job for vdsmd.service canceled.
>>>>>
>>>>> 2015-06-17 13:22:32 DEBUG otopi.context context._executeMethod:152 method
>>>>> exception
>>>>> Traceback (most recent call last):
>>>>>     File "/tmp/ovirt-1WPaDxJOpX/pythonlib/otopi/context.py", line 142, in
>>>>>     _executeMethod
>>>>>       method['method']()
>>>>>     File
>>>>>     "/tmp/ovirt-1WPaDxJOpX/otopi-plugins/ovirt-host-deploy/vdsm/packages.py",
>>>>>     line 106, in _packages
>>>>>       self.services.state('vdsmd', False)
>>>>>     File "/tmp/ovirt-1WPaDxJOpX/otopi-plugins/otopi/services/systemd.py",
>>>>>     line 138, in state
>>>>>       'start' if state else 'stop'
>>>>>     File "/tmp/ovirt-1WPaDxJOpX/otopi-plugins/otopi/services/systemd.py",
>>>>>     line 77, in _executeServiceCommand
>>>>>       raiseOnError=raiseOnError
>>>>>     File "/tmp/ovirt-1WPaDxJOpX/pythonlib/otopi/plugin.py", line 942, in
>>>>>     execute
>>>>>       command=args[0],
>>>>> RuntimeError: Command '/bin/systemctl' failed to execute
>>>>> 2015-06-17 13:22:32 ERROR otopi.context context._executeMethod:161 Failed
>>>>> to execute stage 'Package installation': Command '/bin/systemctl' failed
>>>>> to execute
>>>>> 2015-06-17 13:22:32 DEBUG otopi.transaction transaction.abort:131
>>>>> aborting
>>>>> 'Yum Transaction'
>>>>> 2015-06-17 13:22:32 INFO otopi.plugins.otopi.packagers.yumpackager
>>>>> yumpackager.info:92 Yum Performing yum transaction rollback
>>>>> Loaded plugins: auto-update-debuginfo, fastestmirror
>>>>
>>>>
>>>>     I do not have 'standard' (=non ha) hosts; so I cannot tell for the
>>>> others but suspect it relates to HE.
>>>
>>> Yes, it's the hosted-engine HA agent which keeps VDSM up so host-deploy
>>> fails on that.
>>> The capability to re-deploy an hosted-engine host from the Web UI is not
>>> available on oVirt 3.5, it will included in 3.6; please help us testing it
>>> on the first beta in  a few weeks.
>>>
>>> By the way, why are you trying to re-deploy an host-deploy host from the
>>> web UI?
>> Ok, did not know about that. I use 'Reinstall' from the UI.
>>
>> Until now, I thought the best way to update the hosts after new engine
>> relases was:
>> 1- update engine
>> 2. set host to maintane
>> 4. yum update on host for latest vdsm
>> 3- Use reinstall from UI.
>>
>> Please advise!
>
> Running on your HE host:
> # hosted-engine --set-maintenance=local
> waiting for everything to be migrated if needed
> # yum update
> # hosted-engine --set-maintenance=none
>
> should do the job
Ok, I see; I think one should restart vdsmd also; IIRC it is not 
restarted in the process?
>
>>>
>>>> Steps:
>>>> 1. set the host to maintenance
>>>> At this point, only the HE datacenter is still mounted:
>>>> mount |grep nfs
>>>> nexstor01.sec.int.m-box.de:/volumes/ovirt/engine on
>>>> /rhev/data-center/mnt/nexstor01.sec.int.m-box.de:_volumes_ovirt_engine
>>>> type nfs
>>>> (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,soft,nosharecache,proto=tcp,timeo=600,retrans=6,sec=sys,mountaddr=10.11.0.30,mountvers=3,mountport=58144,mountproto=udp,local_lock=none,addr=10.11.0.30)
>>>>
>>>> 2. Reinstall host
>>>> -> Error, host deactivated (Job for vdsmd.service canceled.)
>>>>
>>>> 3. A workaround is to shutdown sanlock:
>>>>
>>>> # systemctl stop vdsmd
>>>> Job for vdsmd.service canceled.
>>>>
>>>> # sanlock shutdown
>>>> # systemctl stop vdsmd
>>>>
>>>> 4. Now, host deploy works as expected.
>>>>
>>>>
>>>> Versions:
>>>> EL7 centos
>>>> ovirt-3.5.2 -3.5.3
>>>> sanlock-3.2.2-2.el7.x86_64
>>>> vdsm 4.14.14 - 4.14.20
>>>>
>>>> --
>>>> Daniel Helgenberger
>>>> m box bewegtbild GmbH
>>>>
>>>> P: +49/30/2408781-22
>>>> F: +49/30/2408781-10
>>>>
>>>> ACKERSTR. 19
>>>> D-10115 BERLIN
>>>>
>>>>
>>>> www.m-box.de  www.monkeymen.tv
>>>>
>>>> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
>>>> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users at ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>
>>>
>>
>> --
>> Daniel Helgenberger
>> m box bewegtbild GmbH
>>
>> P: +49/30/2408781-22
>> F: +49/30/2408781-10
>>
>> ACKERSTR. 19
>> D-10115 BERLIN
>>
>>
>> www.m-box.de  www.monkeymen.tv
>>
>> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
>> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
>>
>

-- 
Daniel Helgenberger
m box bewegtbild GmbH

P: +49/30/2408781-22
F: +49/30/2408781-10

ACKERSTR. 19
D-10115 BERLIN


www.m-box.de  www.monkeymen.tv

Geschäftsführer: Martin Retschitzegger / Michaela Göllner
Handeslregister: Amtsgericht Charlottenburg / HRB 112767