<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Aug 20, 2017 at 8:48 AM, Daniel Belenky <span dir="ltr"><<a href="mailto:dbelenky@redhat.com" target="_blank">dbelenky@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div><div><div><div><font face="monospace,monospace">Failed test: basic_suite_master/002_<wbr>bootstrap<br></font></div><font face="monospace,monospace">Version: oVirt Master<br></font></div><font face="monospace,monospace">Link to failed job: <a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/1860/" target="_blank">ovirt-master_change-queue-<wbr>tester/1860/</a><br></font></div><font face="monospace,monospace">Link to logs (Jenkins): <a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/1860/artifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post-002_bootstrap.py/" target="_blank">test logs</a><br></font></div><font face="monospace,monospace">Suspected patch: <a href="https://gerrit.ovirt.org/#/c/80749/3" target="_blank">https://gerrit.ovirt.org/#/c/<wbr>80749/3</a><br><br></font></div><font face="monospace,monospace">From what I was able to find, It seems that for some reason VDSM failed to start on host 1. The VDSM log is empty, and the only error I could find in supervdsm.log is that start of LLDP failed (Not sure if it's related)<br></font></div></div></blockquote><div><br></div><div>Can you check the networking on the hosts? Something's very strange there. For example:</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 NetworkManager[685]: <info> [1503175122.2682] manager: (e7NZWeNDXwIjQia): new Bond device (/org/freedesktop/NetworkManager/Devices/17)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: Setting xmit hash policy to layer2+3 (2)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: Setting xmit hash policy to encap2+3 (3)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: Setting xmit hash policy to encap3+4 (4)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: option xmit_hash_policy: invalid value (5)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: Setting primary_reselect to always (0)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: Setting primary_reselect to better (1)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: Setting primary_reselect to failure (2)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: option primary_reselect: invalid value (3)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: Setting arp_all_targets to any (0)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: Setting arp_all_targets to all (1)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: e7NZWeNDXwIjQia: option arp_all_targets: invalid value (2)</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 kernel: bonding: e7NZWeNDXwIjQia is being deleted...</div><div>Aug 19 16:38:42 lago-basic-suite-master-host0 lldpad: recvfrom(Event interface): No buffer space available </div><div><br></div><div>Y.</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><font face="monospace,monospace"></font></div><div><font face="monospace,monospace"><br></font></div><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/1860/artifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post-002_bootstrap.py/lago-basic-suite-master-engine/_var_log/ovirt-engine/host-deploy/ovirt-host-deploy-20170819163844-lago-basic-suite-master-host0-72c02881.log/*view*/" target="_blank"><font face="monospace,monospace">From host-deploy log:</font></a><br clear="all"><pre>2017-08-19 16:38:41,476-0400 DEBUG otopi.plugins.otopi.services.<wbr>systemd systemd.state:130 starting service vdsmd
2017-08-19 16:38:41,476-0400 DEBUG otopi.plugins.otopi.services.<wbr>systemd plugin.executeRaw:813 execute: ('/bin/systemctl', 'start', 'vdsmd.service'), executable='None', cwd='None', env=None
2017-08-19 16:38:44,628-0400 DEBUG otopi.plugins.otopi.services.<wbr>systemd plugin.executeRaw:863 execute-result: ('/bin/systemctl', 'start', 'vdsmd.service'), rc=1
2017-08-19 16:38:44,630-0400 DEBUG otopi.plugins.otopi.services.<wbr>systemd plugin.execute:921 execute-output: ('/bin/systemctl', 'start', 'vdsmd.service') stdout:
2017-08-19 16:38:44,630-0400 DEBUG otopi.plugins.otopi.services.<wbr>systemd plugin.execute:926 execute-output: ('/bin/systemctl', 'start', 'vdsmd.service') stderr:
Job for vdsmd.service failed because the control process exited with error code. See "systemctl status vdsmd.service" and "journalctl -xe" for details.
2017-08-19 16:38:44,631-0400 DEBUG otopi.context context._executeMethod:142 method exception
Traceback (most recent call last):
File "/tmp/ovirt-dunwHj8Njn/<wbr>pythonlib/otopi/context.py", line 132, in _executeMethod
method['method']()
File "/tmp/ovirt-dunwHj8Njn/otopi-<wbr>plugins/ovirt-host-deploy/<wbr>vdsm/packages.py", line 224, in _start
self.services.state('vdsmd', True)
File "/tmp/ovirt-dunwHj8Njn/otopi-<wbr>plugins/otopi/services/<wbr>systemd.py", line 141, in state
service=name,
RuntimeError: Failed to start service 'vdsmd'<br><br><br></pre><font face="monospace,monospace"></font><div><div><div><div><div><div><div><div><div><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/1860/artifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post-002_bootstrap.py/lago-basic-suite-master-host0/_var_log/messages/*view*/" target="_blank">From /var/log/messages:</a><br></div><div><pre>Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: Error:
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: One of the modules is not configured to work with VDSM.
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: To configure the module use the following:
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: 'vdsm-tool configure [--module module-name]'.
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: If all modules are not configured try to use:
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: 'vdsm-tool configure --force'
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: (The force flag will stop the module's service and start it
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: afterwards automatically to load the new configuration.)
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: abrt is already configured for vdsm
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: lvm is configured for vdsm
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: libvirt is already configured for vdsm
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: multipath requires configuration
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: Modules sanlock, multipath are not configured
Aug 19 16:38:44 lago-basic-suite-master-host0 vdsmd_init_common.sh: vdsm: stopped during execute check_is_configured task (task returned with error code 1).</pre></div><div><br></div><div>Thanks,<span class="gmail-HOEnZb"><font color="#888888"><br></font></span></div><span class="gmail-HOEnZb"><font color="#888888"><div>-- <br><div class="gmail-m_129864207140748541gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>DANIEL</span> <span>BELENKY</span></p><p style="margin:0px;padding:0px"></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>RHV DEVOPS</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">EMEA VIRTUALIZATION R&D</p><table style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/files/brand/email/sig-redhat.png" width="90" height="auto"></a></td></tr></tbody></table></div></div></div></div></div></div></div></div></div></div></div>
</div></font></span></div></div></div></div></div></div></div></div></div>
<br>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br></blockquote></div><br></div></div>