This is a multi-part message in MIME format.
--------------CDA73230DD8F18E0500CDFB5
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
On 11/16/2016 03:59 PM, Simone Tiraboschi wrote:
On Wed, Nov 16, 2016 at 11:18 AM, knarra <knarra(a)redhat.com
<mailto:knarra@redhat.com>> wrote:
On 11/16/2016 03:43 PM, knarra wrote:
> On 11/16/2016 03:37 PM, Simone Tiraboschi wrote:
>>
>>
>> On Wed, Nov 16, 2016 at 10:56 AM, knarra <knarra(a)redhat.com
>> <mailto:knarra@redhat.com>> wrote:
>>
>> On 11/16/2016 03:07 PM, Martin Perina wrote:
>>>
>>>
>>> On Wed, Nov 16, 2016 at 9:48 AM, knarra <knarra(a)redhat.com
>>> <mailto:knarra@redhat.com>> wrote:
>>>
>>> On 11/16/2016 01:34 PM, Martin Perina wrote:
>>>> Hi,
>>>>
>>>> could you please share log from engine-setup execution?
>>>>
>>>> But I fear this is caused by [1] as we haven't done
>>>> any changes in aaa-jdbc extension for quite long time.
>>>> Sandro is it possible to remove or fix faulty slf4j
>>>> package from repo [2] as suggested in [1]?
>>>>
>>>> Thanks
>>>>
>>>> Martin
>>>>
>>>> [1]
>>>>
https://bugzilla.redhat.com/show_bug.cgi?id=1394656
>>>> <
https://bugzilla.redhat.com/show_bug.cgi?id=1394656>
>>>> [2]
>>>>
http://cbs.centos.org/repos/virt7-ovirt-common-candidate/x86_64/os/Packages/
>>>>
<
http://cbs.centos.org/repos/virt7-ovirt-common-candidate/x86_64/os/Packag...
>>>>
>>> Hi Martin / simone,
>>>
>>> Below is the link to the log file.
>>>
>>>
http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/upstream/
>>>
<
http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/upstream/>
>>>
>>>
>>> This hosted engine setup log, but we need to get
>>> engine-setup log from engine VM, which is located at
>>>
/var/log/ovirt-engine/setup/ovirt-engine-setup-20161115085421-ee7ksg.log
>>>
>>> to find out the real issue.
>>> Thanks
>>> Martin
>> Hi Martin, I see that hosted engine vm is down and the
>> log you are asking for would be present in the engine vm
>> right. Is there a way that i can bring this up?
>>
>> hosted-engine --vm-start
> Hi Simone,
I tried this but this does not seem to be working.
https://paste.fedoraproject.org/482930/29144814/
<
https://paste.fedoraproject.org/482930/29144814/> Thanks kasturi.
Can you please vdsm logs to understand why it didn't started?
Hi Simone, I
see the following trace back in vdsm logs. But i do see
that my host has enough space. 2016-11-16 15:38:32,111 ERROR
(vm/0428ddce) [virt.vm] (vmId='0428ddce-73cd-4f39-93ac-89906b71cffa')
The vm start process failed (vm:594) Traceback (most recent call last):
File "/usr/share/vdsm/virt/vm.py", line 535, in _startUnderlyingVm
self._run() File "/usr/share/vdsm/virt/vm.py", line 1897, in _run
self._connection.createXML(domxml, flags), File
"/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123,
in wrapper ret = f(*args, **kwargs) File
"/usr/lib/python2.7/site-packages/vdsm/utils.py", line 936, in wrapper
return func(inst, *args, **kwargs) File
"/usr/lib64/python2.7/site-packages/libvirt.py", line 3777, in createXML
if ret is None:raise libvirtError('virDomainCreateXML() failed',
conn=self) libvirtError: Failed to acquire lock: No space left on device
2016-11-16 15:38:32,118 INFO (vm/0428ddce) [virt.vm]
(vmId='0428ddce-73cd-4f39-93ac-89906b71cffa') Changed state to Down:
Failed to acquire lock: No space left on device (c ode=1) (vm:1176) df
-TH on the host: ==================== [root@zod ~]# df -TH
Filesystem Type Size Used Avail
Use% Mounted on /dev/mapper/rhel_zod-root xfs
54G 3.5G 51G 7% / devtmpfs
devtmpfs 51G 0 51G 0% /dev
tmpfs tmpfs 51G 0 51G
0% /dev/shm tmpfs tmpfs 51G
27M 51G 1% /run tmpfs tmpfs
51G 0 51G 0% /sys/fs/cgroup /dev/sda1
xfs 1.1G 149M 916M 14% /boot
/dev/mapper/rhel_zod-home xfs 941G 35M 941G
1% /home tmpfs tmpfs 11G
0 11G 0% /run/user/0 /dev/mapper/RHGS_vg1-engine_lv
xfs 108G 9.0G 99G 9% /rhgs/engine
/dev/mapper/RHGS_vg1-lv_vmrootdisks xfs 1.1T 154M 1.1T
1% /rhgs/brick1 /dev/mapper/RHGS_vg1-lv_vmaddldisks xfs
2.2T 36M 2.2T 1% /rhgs/brick2 10.70.36.76:/engine
fuse.glusterfs 108G 9.0G 99G 9%
/rhev/data-center/mnt/glusterSD/10.70.36.76:_engine
/dev/loop1 ext3 2.1G 3.3M 2.0G
1% /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmppnoQeT
Thanks kasturi
> On Wed, Nov 16, 2016 at 8:03 AM, knarra <knarra(a)redhat.com
> <mailto:knarra@redhat.com>> wrote:
>>
>>>> Hi,
>>>>
>>>> I was installing latest upstream master and i
>>>> am hitting the issue below. Can some one please
>>>> let me know if this a bug ? If yes, is this going
>>>> to be fixed in the next nightly?
>>>>
>>>> [WARNING] OVF does not contain a valid image
>>>> description, using default. [ INFO ] Detecting
>>>> host timezone. Enter ssh public key for
>>>> the root user that will be used for the engine
>>>> appliance (leave it empty to skip):
>>>> //root//.ssh/id_rsa.pub [ ERROR ] The ssh key is
>>>> not valid. Enter ssh public key for the
>>>> root user that will be used for the engine
>>>> appliance (leave it empty to skip): [WARNING]
>>>> Skipping appliance root ssh public key
>>>> Do you want to enable ssh access for the root user
>>>> (yes, no, without-password) [yes]: yes ERROR
>>>> SNIPPET:
>>>>
============================================================
>>>> |- [ ERROR ] Failed to execute stage
>>>> 'Misc configuration': Command
>>>> '/usr/bin/ovirt-aaa-jdbc-tool' failed to execute
>>>> |- [ INFO ] Rolling back database
>>>> schema |- [ INFO ] Clearing Engine
>>>> database engine |- [ INFO ] Rolling
>>>> back DWH database schema |- [ INFO ]
>>>> Clearing DWH database ovirt_engine_history
>>>> |- [ INFO ] Stage: Clean up
>>>> |- Log file is located at
>>>>
/var/log/ovirt-engine/setup/ovirt-engine-setup-20161115140627-er36oa.log
>>>> |- [ INFO ] Generating answer file
>>>>
'/var/lib/ovirt-engine/setup/answers/20161115140829-setup.co
>>>> <
http://20161115140829-setup.co>nf'
|- [
>>>> INFO ] Stage: Pre-termination |- [
>>>> INFO ] Stage: Termination |- [ ERROR ]
>>>> Execution of setup failed |-
>>>> HE_APPLIANCE_ENGINE_SETUP_FAIL [ ERROR ] Engine
>>>> setup failed on the appliance [ ERROR ] Failed to
>>>> execute stage 'Closing up': Engine setup failed
on
>>>> the appliance Please check its log on the
>>>> appliance. [ INFO ] Stage: Clean up [ INFO ]
>>>> Generating answer file
>>>>
'/var/lib/ovirt-hosted-engine-setup/answers/answers-20161115193834.conf'
>>>> [ INFO ] Stage: Pre-termination [ INFO ] Stage:
>>>> Termination [ ERROR ] Hosted Engine deployment
>>>> failed: this system is not reliable, please check
>>>> the issue,fix and redeploy Log file is
>>>> located at
>>>>
/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20161115191145-hr3nat.log
>>>> [root@rhsqa-grafton4 ~]#
>>>>
>>>> Thanks
>>>>
>>>> kasturi.
>>>>
>>>> _______________________________________________
>>>> Users mailing list Users(a)ovirt.org
>>>> <mailto:Users@ovirt.org>
>>>>
http://lists.ovirt.org/mailman/listinfo/users
>>>> <
http://lists.ovirt.org/mailman/listinfo/users>
>>>>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org <mailto:Users@ovirt.org>
>
http://lists.ovirt.org/mailman/listinfo/users
> <
http://lists.ovirt.org/mailman/listinfo/users>
--------------CDA73230DD8F18E0500CDFB5
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=utf-8"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 11/16/2016 03:59 PM, Simone
Tiraboschi wrote:<br>
</div>
<blockquote
cite="mid:CAN8-ONqUBMme-8xwCmg2qbZHjWbk8HoEoed+fzWkbyJ5p+54Sw@mail.gmail.com"
type="cite">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Nov 16, 2016 at 11:18 AM,
knarra <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:knarra@redhat.com"
target="_blank">knarra(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>
<div class="h5">
<div class="m_207876902560414594moz-cite-prefix">On
11/16/2016 03:43 PM, knarra wrote:<br>
</div>
<blockquote type="cite">
<div class="m_207876902560414594moz-cite-prefix">On
11/16/2016 03:37 PM, Simone Tiraboschi wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Nov 16,
2016 at 10:56 AM, knarra <span
dir="ltr"><<a
moz-do-not-send="true"
href="mailto:knarra@redhat.com"
target="_blank">knarra(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote"
style="margin:0 0 0 .8ex;border-left:1px
#ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF"
text="#000000"><span>
<div
class="m_207876902560414594m_-778986439581765789moz-cite-prefix">On
11/16/2016 03:07 PM, Martin Perina
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div
class="gmail_extra"><br>
<div class="gmail_quote">On
Wed, Nov 16, 2016 at 9:48
AM, knarra <span
dir="ltr"><<a
moz-do-not-send="true"
href="mailto:knarra@redhat.com"
target="_blank">knarra(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote
style="margin:0px 0px 0px
0.8ex;border-left:1px
solid
rgb(204,204,204);padding-left:1ex"
class="gmail_quote">
<div bgcolor="#FFFFFF">
<div
class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235moz-cite-prefix">On
11/16/2016 01:34 PM,
Martin Perina wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>Hi,<br>
<br>
</div>
<div>could you
please share log
from engine-setup
execution?<br>
<br>
</div>
<div>But I fear this
is caused by [1]
as we haven't done
any changes in
aaa-jdbc extension
for quite long
time.<br>
</div>
<div>Sandro is it
possible to remove
or fix faulty
slf4j package from
repo [2] as
suggested in [1]?<br>
<br>
</div>
<div>Thanks<br>
<br>
</div>
<div>Martin<br>
</div>
<div><br>
[1] <a
moz-do-not-send="true"
href="https://bugzilla.redhat.com/show_bug.cgi?id=1394656"
target="_blank">https://bugzilla.redhat.com/sh<wbr>ow_...
[2] <a
moz-do-not-send="true"
href="http://cbs.centos.org/repos/virt7-ovirt-common-candidate/x86_6...
target="_blank">http://cbs.centos.org/repos/vi<wbr>rt7...
<br>
</div>
</div>
</blockquote>
Hi Martin / simone,<br>
<br>
Below is the link to
the log file.<br>
<br>
<a
moz-do-not-send="true"
href="http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/upstrea...
class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235moz-txt-link-freetext"
target="_blank">http://rhsqe-repo.lab.eng.blr.<wbr>red...
</blockquote>
<div><br>
<div>This hosted engine
setup log, but we need
to get engine-setup log
from engine VM, which is
located at<br>
<pre>/var/log/ovirt-engine/setup/ov<wbr>irt-engine-setup-2016111508542<wbr>1-ee7ksg.log
<span style="font-family:arial,helvetica,sans-serif">to find out the real
issue.</span>
<span style="font-family:arial,helvetica,sans-serif">
</span></pre>
<pre><span
style="font-family:arial,helvetica,sans-serif">Thanks
</span></pre>
<pre><span
style="font-family:arial,helvetica,sans-serif">Martin
</span></pre>
</div>
</div>
</div>
</div>
</div>
</blockquote></span>
Hi Martin,
I see that hosted engine vm is down and the log you are asking
for would be present in the engine vm right. Is there a way that i
can bring this up?
</div></blockquote><div>
</div><div>hosted-engine
--vm-start</div></div></div></div></blockquote>Hi Simone,
</blockquote></div></div> I tried this but this does not
seem to be working.
<a moz-do-not-send="true"
class="m_207876902560414594moz-txt-link-freetext"
href="https://paste.fedoraproject.org/482930/29144814/"
target="_blank">https://paste.fedoraproject.<wbr>org/482930/29144814/</a>
Thanks
kasturi.</div></blockquote><div>
</div><div>
</div><div>Can you please vdsm logs to understand why it didn't started?
</div></div></div></div></blockquote>Hi Simone,
I see the following trace back in vdsm logs. But i do see that my host has enough
space.
2016-11-16 15:38:32,111 ERROR (vm/0428ddce) [virt.vm]
(vmId='0428ddce-73cd-4f39-93ac-89906b71cffa') The vm start process failed
(vm:594)
Traceback (most recent call last):
File "/usr/share/vdsm/virt/vm.py", line 535, in _startUnderlyingVm
self._run()
File "/usr/share/vdsm/virt/vm.py", line 1897, in _run
self._connection.createXML(domxml, flags),
File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123,
in wrapper
ret = f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 936, in wrapper
return func(inst, *args, **kwargs)
File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3777, in createXML
if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self)
libvirtError: Failed to acquire lock: No space left on device
2016-11-16 15:38:32,118 INFO (vm/0428ddce) [virt.vm]
(vmId='0428ddce-73cd-4f39-93ac-89906b71cffa') Changed state to Down: Failed to
acquire lock: No space left on device (c
ode=1) (vm:1176)
df -TH on the host:
====================
[root@zod ~]# df -TH
Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/rhel_zod-root xfs 54G 3.5G 51G 7% /
devtmpfs devtmpfs 51G 0 51G 0% /dev
tmpfs tmpfs 51G 0 51G 0% /dev/shm
tmpfs tmpfs 51G 27M 51G 1% /run
tmpfs tmpfs 51G 0 51G 0% /sys/fs/cgroup
/dev/sda1 xfs 1.1G 149M 916M 14% /boot
/dev/mapper/rhel_zod-home xfs 941G 35M 941G 1% /home
tmpfs tmpfs 11G 0 11G 0% /run/user/0
/dev/mapper/RHGS_vg1-engine_lv xfs 108G 9.0G 99G 9% /rhgs/engine
/dev/mapper/RHGS_vg1-lv_vmrootdisks xfs 1.1T 154M 1.1T 1% /rhgs/brick1
/dev/mapper/RHGS_vg1-lv_vmaddldisks xfs 2.2T 36M 2.2T 1% /rhgs/brick2
10.70.36.76:/engine fuse.glusterfs 108G 9.0G 99G 9%
/rhev/data-center/mnt/glusterSD/10.70.36.76:_engine
/dev/loop1 ext3 2.1G 3.3M 2.0G 1%
/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmppnoQeT
Thanks
kasturi
<blockquote
cite="mid:CAN8-ONqUBMme-8xwCmg2qbZHjWbk8HoEoed+fzWkbyJ5p+54Sw@mail.gmail.com"
type="cite"><div dir="ltr"><div
class="gmail_extra"><div class="gmail_quote"><blockquote
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc
solid;padding-left:1ex"><div bgcolor="#FFFFFF"
text="#000000">
<span class=""><blockquote type="cite">On Wed, Nov 16,
2016 at
8:03 AM, knarra <span dir="ltr"><<a
moz-do-not-send="true" href="mailto:knarra@redhat.com"
target="_blank">knarra(a)redhat.com</a>&gt;</span>
wrote:
<blockquote type="cite"><div
dir="ltr"><div class="gmail_extra"><div
class="gmail_quote"><blockquote class="gmail_quote"
style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div
bgcolor="#FFFFFF" text="#000000"><div><div
class="m_207876902560414594h5"><blockquote
type="cite"><div dir="ltr"><div
class="gmail_extra"><div class="gmail_quote"><blockquote
style="margin:0px 0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div
bgcolor="#FFFFFF"><blockquote type="cite"><div
class="gmail_extra"><div class="gmail_quote"><blockquote
style="margin:0px 0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex" class="gmail_quote">
<div bgcolor="#FFFFFF">
<p>Hi,</p>
<p> I was installing latest upstream
master and i am hitting the issue below. Can
some one please let me know if this a bug ?
If yes, is this going to be fixed in the
next nightly?
</p>
<p> [WARNING] OVF does not contain a valid
image description, using default.
[ INFO ] Detecting host timezone.
Enter ssh public key for the root
user that will be used for the engine
appliance (leave it empty to skip): <i
class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235m_8133909876847238872moz-txt-slash"><span
class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235m_8133909876847238872moz-txt-tag">/</span>root<span
class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235m_8133909876847238872moz-txt-tag">/</span></i>.ssh/id_rsa.pub
[ ERROR ] The ssh key is not valid.
Enter ssh public key for the root
user that will be used for the engine
appliance (leave it empty to skip):
[WARNING] Skipping appliance root ssh public
key
Do you want to enable ssh access
for the root user (yes, no,
without-password) [yes]: yes
ERROR SNIPPET:
==============================<wbr>==============================
|- [ ERROR ] Failed to execute
stage 'Misc configuration': Command
'/usr/bin/ovirt-aaa-jdbc-tool' failed to
execute
|- [ INFO ] Rolling back database
schema
|- [ INFO ] Clearing Engine
database engine
|- [ INFO ] Rolling back DWH
database schema
|- [ INFO ] Clearing DWH database
ovirt_engine_history
|- [ INFO ] Stage: Clean up
|- Log file is located
at
/var/log/ovirt-engine/setup/ov<wbr>irt-engine-setup-2016111514062<wbr>7-er36oa.log
|- [ INFO ] Generating answer
file '/var/lib/ovirt-engine/setup/a<wbr>nswers/<a
moz-do-not-send="true" href="http://20161115140829-setup.co"
target="_blank">20161115140829-setup.co</a><wbr>nf'
|- [ INFO ] Stage:
Pre-termination
|- [ INFO ] Stage: Termination
|- [ ERROR ] Execution of setup
failed
|- HE_APPLIANCE_ENGINE_SETUP_FAIL
[ ERROR ] Engine setup failed on the
appliance
[ ERROR ] Failed to execute stage 'Closing
up': Engine setup failed on the appliance
Please check its log on the appliance.
[ INFO ] Stage: Clean up
[ INFO ] Generating answer file
'/var/lib/ovirt-hosted-engine-<wbr>setup/answers/answers-20161115<wbr>193834.conf'
[ INFO ] Stage: Pre-termination
[ INFO ] Stage: Termination
[ ERROR ] Hosted Engine deployment failed:
this system is not reliable, please check
the issue,fix and redeploy
Log file is located at
/var/log/ovirt-hosted-engine-s<wbr>etup/ovirt-hosted-engine-setup<wbr>-20161115191145-hr3nat.log
[root@rhsqa-grafton4 ~]#
</p>
<p>Thanks</p>
<p>kasturi.
<span></span></p>
</div>
______________________________<wbr>_________________
Users mailing list
<a moz-do-not-send="true"
href="mailto:Users@ovirt.org"
target="_blank">Users(a)ovirt.org</a>
<a moz-do-not-send="true" rel="noreferrer"
href="http://lists.ovirt.org/mailman/listinfo/users"
target="_blank">http://lists.ovirt.org/mailman<wbr>/li...
</blockquote>
</div>
</div>
</blockquote>
<p>
</p>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
<p>
</p>
</div></div></div>
</blockquote></div>
</div></div>
</blockquote><p>
</p>
<fieldset
class="m_207876902560414594mimeAttachmentHeader"></fieldset>
<pre>______________________________<wbr>_________________
Users mailing list
<a moz-do-not-send="true"
class="m_207876902560414594moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org"
target="_blank">Users(a)ovirt.org</a>
<a moz-do-not-send="true"
class="m_207876902560414594moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users"
target="_blank">http://lists.ovirt.org/<wbr>mailman/li...
</pre>
</blockquote><p>
</p></span></div></blockquote></div>
</div></div>
</blockquote><p>
</p></body></html>
--------------CDA73230DD8F18E0500CDFB5--