This is a multi-part message in MIME format. --------------CDA73230DD8F18E0500CDFB5 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit On 11/16/2016 03:59 PM, Simone Tiraboschi wrote:
On Wed, Nov 16, 2016 at 11:18 AM, knarra <knarra@redhat.com <mailto:knarra@redhat.com>> wrote:
On 11/16/2016 03:43 PM, knarra wrote:
On 11/16/2016 03:37 PM, Simone Tiraboschi wrote:
On Wed, Nov 16, 2016 at 10:56 AM, knarra <knarra@redhat.com <mailto:knarra@redhat.com>> wrote:
On 11/16/2016 03:07 PM, Martin Perina wrote:
On Wed, Nov 16, 2016 at 9:48 AM, knarra <knarra@redhat.com <mailto:knarra@redhat.com>> wrote:
On 11/16/2016 01:34 PM, Martin Perina wrote:
Hi,
could you please share log from engine-setup execution?
But I fear this is caused by [1] as we haven't done any changes in aaa-jdbc extension for quite long time. Sandro is it possible to remove or fix faulty slf4j package from repo [2] as suggested in [1]?
Thanks
Martin
[1] https://bugzilla.redhat.com/show_bug.cgi?id=1394656 <https://bugzilla.redhat.com/show_bug.cgi?id=1394656> [2] http://cbs.centos.org/repos/virt7-ovirt-common-candidate/x86_64/os/Packages/ <http://cbs.centos.org/repos/virt7-ovirt-common-candidate/x86_64/os/Packages/>
Hi Martin / simone,
Below is the link to the log file.
http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/upstream/ <http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/upstream/>
This hosted engine setup log, but we need to get engine-setup log from engine VM, which is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20161115085421-ee7ksg.log
to find out the real issue. Thanks Martin
Hi Martin, I see that hosted engine vm is down and the log you are asking for would be present in the engine vm right. Is there a way that i can bring this up?
hosted-engine --vm-start
Hi Simone,
I tried this but this does not seem to be working. https://paste.fedoraproject.org/482930/29144814/ <https://paste.fedoraproject.org/482930/29144814/> Thanks kasturi.
Can you please vdsm logs to understand why it didn't started?
Hi Simone, I see the following trace back in vdsm logs. But i do see that my host has enough space. 2016-11-16 15:38:32,111 ERROR (vm/0428ddce) [virt.vm] (vmId='0428ddce-73cd-4f39-93ac-89906b71cffa') The vm start process failed (vm:594) Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 535, in _startUnderlyingVm self._run() File "/usr/share/vdsm/virt/vm.py", line 1897, in _run self._connection.createXML(domxml, flags), File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 936, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3777, in createXML if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self) libvirtError: Failed to acquire lock: No space left on device 2016-11-16 15:38:32,118 INFO (vm/0428ddce) [virt.vm] (vmId='0428ddce-73cd-4f39-93ac-89906b71cffa') Changed state to Down: Failed to acquire lock: No space left on device (c ode=1) (vm:1176) df -TH on the host: ==================== [root@zod ~]# df -TH Filesystem Type Size Used Avail Use% Mounted on /dev/mapper/rhel_zod-root xfs 54G 3.5G 51G 7% / devtmpfs devtmpfs 51G 0 51G 0% /dev tmpfs tmpfs 51G 0 51G 0% /dev/shm tmpfs tmpfs 51G 27M 51G 1% /run tmpfs tmpfs 51G 0 51G 0% /sys/fs/cgroup /dev/sda1 xfs 1.1G 149M 916M 14% /boot /dev/mapper/rhel_zod-home xfs 941G 35M 941G 1% /home tmpfs tmpfs 11G 0 11G 0% /run/user/0 /dev/mapper/RHGS_vg1-engine_lv xfs 108G 9.0G 99G 9% /rhgs/engine /dev/mapper/RHGS_vg1-lv_vmrootdisks xfs 1.1T 154M 1.1T 1% /rhgs/brick1 /dev/mapper/RHGS_vg1-lv_vmaddldisks xfs 2.2T 36M 2.2T 1% /rhgs/brick2 10.70.36.76:/engine fuse.glusterfs 108G 9.0G 99G 9% /rhev/data-center/mnt/glusterSD/10.70.36.76:_engine /dev/loop1 ext3 2.1G 3.3M 2.0G 1% /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmppnoQeT Thanks kasturi
On Wed, Nov 16, 2016 at 8:03 AM, knarra <knarra@redhat.com <mailto:knarra@redhat.com>> wrote:
Hi,
I was installing latest upstream master and i am hitting the issue below. Can some one please let me know if this a bug ? If yes, is this going to be fixed in the next nightly?
[WARNING] OVF does not contain a valid image description, using default. [ INFO ] Detecting host timezone. Enter ssh public key for the root user that will be used for the engine appliance (leave it empty to skip): //root//.ssh/id_rsa.pub [ ERROR ] The ssh key is not valid. Enter ssh public key for the root user that will be used for the engine appliance (leave it empty to skip): [WARNING] Skipping appliance root ssh public key Do you want to enable ssh access for the root user (yes, no, without-password) [yes]: yes ERROR SNIPPET: ============================================================ |- [ ERROR ] Failed to execute stage 'Misc configuration': Command '/usr/bin/ovirt-aaa-jdbc-tool' failed to execute |- [ INFO ] Rolling back database schema |- [ INFO ] Clearing Engine database engine |- [ INFO ] Rolling back DWH database schema |- [ INFO ] Clearing DWH database ovirt_engine_history |- [ INFO ] Stage: Clean up |- Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20161115140627-er36oa.log |- [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20161115140829-setup.co <http://20161115140829-setup.co>nf' |- [ INFO ] Stage: Pre-termination |- [ INFO ] Stage: Termination |- [ ERROR ] Execution of setup failed |- HE_APPLIANCE_ENGINE_SETUP_FAIL [ ERROR ] Engine setup failed on the appliance [ ERROR ] Failed to execute stage 'Closing up': Engine setup failed on the appliance Please check its log on the appliance. [ INFO ] Stage: Clean up [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20161115193834.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed: this system is not reliable, please check the issue,fix and redeploy Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20161115191145-hr3nat.log [root@rhsqa-grafton4 ~]#
Thanks
kasturi.
_______________________________________________ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users <http://lists.ovirt.org/mailman/listinfo/users>
_______________________________________________ Users mailing list Users@ovirt.org <mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users <http://lists.ovirt.org/mailman/listinfo/users>
--------------CDA73230DD8F18E0500CDFB5 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 11/16/2016 03:59 PM, Simone Tiraboschi wrote:<br> </div> <blockquote cite="mid:CAN8-ONqUBMme-8xwCmg2qbZHjWbk8HoEoed+fzWkbyJ5p+54Sw@mail.gmail.com" type="cite"> <div dir="ltr"><br> <div class="gmail_extra"><br> <div class="gmail_quote">On Wed, Nov 16, 2016 at 11:18 AM, knarra <span dir="ltr"><<a moz-do-not-send="true" href="mailto:knarra@redhat.com" target="_blank">knarra@redhat.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"> <div> <div class="h5"> <div class="m_207876902560414594moz-cite-prefix">On 11/16/2016 03:43 PM, knarra wrote:<br> </div> <blockquote type="cite"> <div class="m_207876902560414594moz-cite-prefix">On 11/16/2016 03:37 PM, Simone Tiraboschi wrote:<br> </div> <blockquote type="cite"> <div dir="ltr"><br> <div class="gmail_extra"><br> <div class="gmail_quote">On Wed, Nov 16, 2016 at 10:56 AM, knarra <span dir="ltr"><<a moz-do-not-send="true" href="mailto:knarra@redhat.com" target="_blank">knarra@redhat.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"><span> <div class="m_207876902560414594m_-778986439581765789moz-cite-prefix">On 11/16/2016 03:07 PM, Martin Perina wrote:<br> </div> <blockquote type="cite"> <div dir="ltr"> <div><br> </div> <div class="gmail_extra"><br> <div class="gmail_quote">On Wed, Nov 16, 2016 at 9:48 AM, knarra <span dir="ltr"><<a moz-do-not-send="true" href="mailto:knarra@redhat.com" target="_blank">knarra@redhat.com</a>></span> wrote:<br> <blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"> <div bgcolor="#FFFFFF"> <div class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235moz-cite-prefix">On 11/16/2016 01:34 PM, Martin Perina wrote:<br> </div> <blockquote type="cite"> <div dir="ltr"> <div>Hi,<br> <br> </div> <div>could you please share log from engine-setup execution?<br> <br> </div> <div>But I fear this is caused by [1] as we haven't done any changes in aaa-jdbc extension for quite long time.<br> </div> <div>Sandro is it possible to remove or fix faulty slf4j package from repo [2] as suggested in [1]?<br> <br> </div> <div>Thanks<br> <br> </div> <div>Martin<br> </div> <div><br> [1] <a moz-do-not-send="true" href="https://bugzilla.redhat.com/show_bug.cgi?id=1394656" target="_blank">https://bugzilla.redhat.com/sh<wbr>ow_bug.cgi?id=1394656</a><br> [2] <a moz-do-not-send="true" href="http://cbs.centos.org/repos/virt7-ovirt-common-candidate/x86_64/os/Packages/" target="_blank">http://cbs.centos.org/repos/vi<wbr>rt7-ovirt-common-candidate/x86<wbr>_64/os/Packages/</a><br> <br> </div> </div> </blockquote> Hi Martin / simone,<br> <br> Below is the link to the log file.<br> <br> <a moz-do-not-send="true" href="http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/upstream/" class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235moz-txt-link-freetext" target="_blank">http://rhsqe-repo.lab.eng.blr.<wbr>redhat.com/sosreports/HC/upstr<wbr>eam/</a></div> </blockquote> <div><br> <div>This hosted engine setup log, but we need to get engine-setup log from engine VM, which is located at<br> <pre>/var/log/ovirt-engine/setup/ov<wbr>irt-engine-setup-2016111508542<wbr>1-ee7ksg.log <span style="font-family:arial,helvetica,sans-serif">to find out the real issue.</span> <span style="font-family:arial,helvetica,sans-serif"> </span></pre> <pre><span style="font-family:arial,helvetica,sans-serif">Thanks </span></pre> <pre><span style="font-family:arial,helvetica,sans-serif">Martin </span></pre> </div> </div> </div> </div> </div> </blockquote></span> Hi Martin, I see that hosted engine vm is down and the log you are asking for would be present in the engine vm right. Is there a way that i can bring this up? </div></blockquote><div> </div><div>hosted-engine --vm-start</div></div></div></div></blockquote>Hi Simone, </blockquote></div></div> I tried this but this does not seem to be working. <a moz-do-not-send="true" class="m_207876902560414594moz-txt-link-freetext" href="https://paste.fedoraproject.org/482930/29144814/" target="_blank">https://paste.fedoraproject.<wbr>org/482930/29144814/</a> Thanks kasturi.</div></blockquote><div> </div><div> </div><div>Can you please vdsm logs to understand why it didn't started? </div></div></div></div></blockquote>Hi Simone, I see the following trace back in vdsm logs. But i do see that my host has enough space. 2016-11-16 15:38:32,111 ERROR (vm/0428ddce) [virt.vm] (vmId='0428ddce-73cd-4f39-93ac-89906b71cffa') The vm start process failed (vm:594) Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 535, in _startUnderlyingVm self._run() File "/usr/share/vdsm/virt/vm.py", line 1897, in _run self._connection.createXML(domxml, flags), File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 936, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3777, in createXML if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self) libvirtError: Failed to acquire lock: No space left on device 2016-11-16 15:38:32,118 INFO (vm/0428ddce) [virt.vm] (vmId='0428ddce-73cd-4f39-93ac-89906b71cffa') Changed state to Down: Failed to acquire lock: No space left on device (c ode=1) (vm:1176) df -TH on the host: ==================== [root@zod ~]# df -TH Filesystem Type Size Used Avail Use% Mounted on /dev/mapper/rhel_zod-root xfs 54G 3.5G 51G 7% / devtmpfs devtmpfs 51G 0 51G 0% /dev tmpfs tmpfs 51G 0 51G 0% /dev/shm tmpfs tmpfs 51G 27M 51G 1% /run tmpfs tmpfs 51G 0 51G 0% /sys/fs/cgroup /dev/sda1 xfs 1.1G 149M 916M 14% /boot /dev/mapper/rhel_zod-home xfs 941G 35M 941G 1% /home tmpfs tmpfs 11G 0 11G 0% /run/user/0 /dev/mapper/RHGS_vg1-engine_lv xfs 108G 9.0G 99G 9% /rhgs/engine /dev/mapper/RHGS_vg1-lv_vmrootdisks xfs 1.1T 154M 1.1T 1% /rhgs/brick1 /dev/mapper/RHGS_vg1-lv_vmaddldisks xfs 2.2T 36M 2.2T 1% /rhgs/brick2 10.70.36.76:/engine fuse.glusterfs 108G 9.0G 99G 9% /rhev/data-center/mnt/glusterSD/10.70.36.76:_engine /dev/loop1 ext3 2.1G 3.3M 2.0G 1% /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmppnoQeT Thanks kasturi <blockquote cite="mid:CAN8-ONqUBMme-8xwCmg2qbZHjWbk8HoEoed+fzWkbyJ5p+54Sw@mail.gmail.com" type="cite"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div bgcolor="#FFFFFF" text="#000000"> <span class=""><blockquote type="cite">On Wed, Nov 16, 2016 at 8:03 AM, knarra <span dir="ltr"><<a moz-do-not-send="true" href="mailto:knarra@redhat.com" target="_blank">knarra@redhat.com</a>></span> wrote: <blockquote type="cite"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div bgcolor="#FFFFFF" text="#000000"><div><div class="m_207876902560414594h5"><blockquote type="cite"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div bgcolor="#FFFFFF"><blockquote type="cite"><div class="gmail_extra"><div class="gmail_quote"><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"> <div bgcolor="#FFFFFF"> <p>Hi,</p> <p> I was installing latest upstream master and i am hitting the issue below. Can some one please let me know if this a bug ? If yes, is this going to be fixed in the next nightly? </p> <p> [WARNING] OVF does not contain a valid image description, using default. [ INFO ] Detecting host timezone. Enter ssh public key for the root user that will be used for the engine appliance (leave it empty to skip): <i class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235m_8133909876847238872moz-txt-slash"><span class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235m_8133909876847238872moz-txt-tag">/</span>root<span class="m_207876902560414594m_-778986439581765789gmail-m_-3212054950310126235m_8133909876847238872moz-txt-tag">/</span></i>.ssh/id_rsa.pub [ ERROR ] The ssh key is not valid. Enter ssh public key for the root user that will be used for the engine appliance (leave it empty to skip): [WARNING] Skipping appliance root ssh public key Do you want to enable ssh access for the root user (yes, no, without-password) [yes]: yes ERROR SNIPPET: ==============================<wbr>============================== |- [ ERROR ] Failed to execute stage 'Misc configuration': Command '/usr/bin/ovirt-aaa-jdbc-tool' failed to execute |- [ INFO ] Rolling back database schema |- [ INFO ] Clearing Engine database engine |- [ INFO ] Rolling back DWH database schema |- [ INFO ] Clearing DWH database ovirt_engine_history |- [ INFO ] Stage: Clean up |- Log file is located at /var/log/ovirt-engine/setup/ov<wbr>irt-engine-setup-2016111514062<wbr>7-er36oa.log |- [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/a<wbr>nswers/<a moz-do-not-send="true" href="http://20161115140829-setup.co" target="_blank">20161115140829-setup.co</a><wbr>nf' |- [ INFO ] Stage: Pre-termination |- [ INFO ] Stage: Termination |- [ ERROR ] Execution of setup failed |- HE_APPLIANCE_ENGINE_SETUP_FAIL [ ERROR ] Engine setup failed on the appliance [ ERROR ] Failed to execute stage 'Closing up': Engine setup failed on the appliance Please check its log on the appliance. [ INFO ] Stage: Clean up [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-<wbr>setup/answers/answers-20161115<wbr>193834.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed: this system is not reliable, please check the issue,fix and redeploy Log file is located at /var/log/ovirt-hosted-engine-s<wbr>etup/ovirt-hosted-engine-setup<wbr>-20161115191145-hr3nat.log [root@rhsqa-grafton4 ~]# </p> <p>Thanks</p> <p>kasturi. <span></span></p> </div> ______________________________<wbr>_________________ Users mailing list <a moz-do-not-send="true" href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> <a moz-do-not-send="true" rel="noreferrer" href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a> </blockquote> </div> </div> </blockquote> <p> </p> </div> </blockquote> </div> </div> </div> </blockquote> <p> </p> </div></div></div> </blockquote></div> </div></div> </blockquote><p> </p> <fieldset class="m_207876902560414594mimeAttachmentHeader"></fieldset> <pre>______________________________<wbr>_________________ Users mailing list <a moz-do-not-send="true" class="m_207876902560414594moz-txt-link-abbreviated" href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a> <a moz-do-not-send="true" class="m_207876902560414594moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a> </pre> </blockquote><p> </p></span></div></blockquote></div> </div></div> </blockquote><p> </p></body></html> --------------CDA73230DD8F18E0500CDFB5--