<div dir="auto">Is this 4.1 or 4.0 test? These vdsm logs are in 4.0 format.</div><div class="gmail_extra"><br><div class="gmail_quote">בתאריך 7 במרץ 2017 10:17 לפנה״צ, "Yaniv Kaul" <<a href="mailto:ykaul@redhat.com">ykaul@redhat.com</a>> כתב:<br type="attribution"><blockquote class="quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><br><div class="gmail_quote"><div class="elided-text"><div dir="ltr">On Tue, Mar 7, 2017 at 9:44 AM Daniel Belenky <<a href="mailto:dbelenky@redhat.com" target="_blank">dbelenky@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="m_-2831037023173371668gmail_msg"><b class="m_-2831037023173371668gmail_msg">Test failed:</b> add_secondary_storage_<wbr>domains<div class="m_-2831037023173371668gmail_msg"><br class="m_-2831037023173371668gmail_msg"></div><div class="m_-2831037023173371668gmail_msg"><b class="m_-2831037023173371668gmail_msg">Link to failed Job: </b><a href="http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_experimental_4.1/889" class="m_-2831037023173371668gmail_msg" target="_blank">test-repo_ovirt_<wbr>experimental_4.1/889</a></div><div class="m_-2831037023173371668gmail_msg"><br class="m_-2831037023173371668gmail_msg"></div><div class="m_-2831037023173371668gmail_msg"><b class="m_-2831037023173371668gmail_msg">Link to all logs: </b><a href="http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_experimental_4.1/889/artifact/exported-artifacts/basic-suit-4.1-el7/" class="m_-2831037023173371668gmail_msg" target="_blank">logs from Jenkins</a></div><div class="m_-2831037023173371668gmail_msg"><br class="m_-2831037023173371668gmail_msg"></div><div class="m_-2831037023173371668gmail_msg"><b class="m_-2831037023173371668gmail_msg">Error snippet from log:</b></div><div class="m_-2831037023173371668gmail_msg"><span style="color:rgb(0,0,0)" class="m_-2831037023173371668gmail_msg"><br class="m_-2831037023173371668gmail_msg"></span></div><div class="m_-2831037023173371668gmail_msg"><span style="color:rgb(0,0,0)" class="m_-2831037023173371668gmail_msg">2017-03-07 01:29:03,789::utils.py::_ret_<wbr>via_queue::59::lago.utils::<wbr>ERROR::Error while running thread</span><br class="m_-2831037023173371668gmail_msg"></div><div class="m_-2831037023173371668gmail_msg"><pre style="color:rgb(0,0,0)" class="m_-2831037023173371668gmail_msg">Traceback (most recent call last):
File "/usr/lib/python2.7/site-<wbr>packages/lago/utils.py", line 57, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/test-<wbr>repo_ovirt_experimental_4.1/<wbr>ovirt-system-tests/basic-<wbr>suite-4.1/test-scenarios/002_<wbr>bootstrap.py", line 574, in add_iso_storage_domain
add_generic_nfs_storage_<wbr>domain(prefix, SD_ISO_NAME, SD_ISO_HOST_NAME, SD_ISO_PATH, sd_format='v1', sd_type='iso', nfs_version='v3')
File "/home/jenkins/workspace/test-<wbr>repo_ovirt_experimental_4.1/<wbr>ovirt-system-tests/basic-<wbr>suite-4.1/test-scenarios/002_<wbr>bootstrap.py", line 437, in add_generic_nfs_storage_domain
add_generic_nfs_storage_<wbr>domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version)
File "/home/jenkins/workspace/test-<wbr>repo_ovirt_experimental_4.1/<wbr>ovirt-system-tests/basic-<wbr>suite-4.1/test-scenarios/002_<wbr>bootstrap.py", line 493, in add_generic_nfs_storage_<wbr>domain_4
_add_storage_domain_4(api, p)
File "/home/jenkins/workspace/test-<wbr>repo_ovirt_experimental_4.1/<wbr>ovirt-system-tests/basic-<wbr>suite-4.1/test-scenarios/002_<wbr>bootstrap.py", line 407, in _add_storage_domain_4
id=<a href="http://sd.id" class="m_-2831037023173371668gmail_msg" target="_blank">sd.id</a>,
File "/usr/lib64/python2.7/site-<wbr>packages/ovirtsdk4/services.<wbr>py", line 3488, in add
self._check_fault(response)
File "/usr/lib64/python2.7/site-<wbr>packages/ovirtsdk4/service.py"<wbr>, line 98, in _check_fault
Service._raise_error(response, fault)
File "/usr/lib64/python2.7/site-<wbr>packages/ovirtsdk4/service.py"<wbr>, line 71, in _raise_error
raise Error(msg)
Error: Fault reason is "Operation Failed". Fault detail is "[Storage domain cannot be reached. Please ensure it is accessible from the host(s).]". HTTP response code is 400.</pre></div></div></blockquote><div><br></div></div><div>Looking at <a href="http://jenkins.ovirt.org/view/experimental%20jobs/job/test-repo_ovirt_experimental_4.1/889/artifact/exported-artifacts/basic-suit-4.1-el7/test_logs/basic-suite-4.1/post-002_bootstrap.py/lago-basic-suite-4-1-host1/_var_log/vdsm/supervdsm.log" target="_blank">http://jenkins.ovirt.org/<wbr>view/experimental%20jobs/job/<wbr>test-repo_ovirt_experimental_<wbr>4.1/889/artifact/exported-<wbr>artifacts/basic-suit-4.1-el7/<wbr>test_logs/basic-suite-4.1/<wbr>post-002_bootstrap.py/lago-<wbr>basic-suite-4-1-host1/_var_<wbr>log/vdsm/supervdsm.log</a> :</div><div>I don't see the return of the mount command:</div><div> MainProcess|jsonrpc/3::DEBUG:<wbr>:2017-03-06 20:26:01,872::supervdsmServer:<wbr>:93::SuperVdsm.ServerCallback:<wbr>:(wrapper) call mount with (u'192.168.201.2:/exports/nfs/<wbr>iso', u'/rhev/data-center/mnt/192.<wbr>168.201.2:_exports_nfs_iso') {'vfstype': 'nfs', 'mntOpts': 'soft,nosharecache,timeo=600,<wbr>retrans=6,nfsvers=3', 'timeout': None, 'cgroup': None}</div><div>MainProcess|jsonrpc/3::DEBUG::<wbr>2017-03-06 20:26:01,872::commands::69::<wbr>root::(execCmd) /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,<wbr>retrans=6,nfsvers=3 192.168.201.2:/exports/nfs/iso /rhev/data-center/mnt/192.168.<wbr>201.2:_exports_nfs_iso (cwd None)</div><div>MainProcess|jsonrpc/4::DEBUG::<wbr>2017-03-06 20:29:02,501::supervdsmServer:<wbr>:93::SuperVdsm.ServerCallback:<wbr>:(wrapper) call hbaRescan with () {}</div><div>MainProcess|jsonrpc/4::DEBUG::<wbr>2017-03-06 20:29:02,501::commands::69::<wbr>storage.HBA::(execCmd) /usr/bin/taskset --cpu-list 0-1 /usr/libexec/vdsm/fc-scan (cwd None)</div><div>MainProcess|jsonrpc/4::DEBUG::<wbr>2017-03-06 20:29:02,573::supervdsmServer:<wbr>:100::SuperVdsm.<wbr>ServerCallback::(wrapper) return hbaRescan with None</div><div>...</div><div><br></div><div>(I don't know why we do all those hbaRescan, but that's unrelated)</div><div><br></div><div>Where on host0 it does return:</div><div><pre>MainProcess|jsonrpc/5::DEBUG::<wbr>2017-03-06 20:25:20,369::supervdsmServer:<wbr>:93::SuperVdsm.ServerCallback:<wbr>:(wrapper) call mount with (u'192.168.201.2:/exports/nfs/<wbr>iso', u'/rhev/data-center/mnt/192.<wbr>168.201.2:_exports_nfs_iso') {'vfstype': 'nfs', 'mntOpts': 'soft,nosharecache,timeo=600,<wbr>retrans=6,nfsvers=3', 'timeout': None, 'cgroup': None}
MainProcess|jsonrpc/5::DEBUG::<wbr>2017-03-06 20:25:20,369::commands::69::<wbr>root::(execCmd) /usr/bin/taskset --cpu-list 0-1 /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,<wbr>retrans=6,nfsvers=3 192.168.201.2:/exports/nfs/iso /rhev/data-center/mnt/192.168.<wbr>201.2:_exports_nfs_iso (cwd None)
MainProcess|jsonrpc/5::DEBUG::<wbr>2017-03-06 20:25:20,504::supervdsmServer:<wbr>:100::SuperVdsm.<wbr>ServerCallback::(wrapper) return mount with None</pre><pre><br></pre><pre><br></pre><pre>On the storage server, both requests are seen:</pre><pre>Mar 6 20:25:20 lago-basic-suite-4-1-engine rpc.mountd[4279]: authenticated mount request from <a href="http://192.168.201.4:970" target="_blank">192.168.201.4:970</a> for /exports/nfs/iso (/exports/nfs/iso)
Mar 6 20:26:01 lago-basic-suite-4-1-engine rpc.mountd[4279]: authenticated mount request from <a href="http://192.168.201.3:948" target="_blank">192.168.201.3:948</a> for /exports/nfs/iso (/exports/nfs/iso)<br></pre></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="quoted-text"><div dir="ltr" class="m_-2831037023173371668gmail_msg"><div class="m_-2831037023173371668gmail_msg">-- <br class="m_-2831037023173371668gmail_msg"><div class="m_-2831037023173371668m_-5803255999096166150gmail_signature m_-2831037023173371668gmail_msg"><div dir="ltr" class="m_-2831037023173371668gmail_msg"><div class="m_-2831037023173371668gmail_msg"><div dir="ltr" class="m_-2831037023173371668gmail_msg"><div class="m_-2831037023173371668gmail_msg"><div dir="ltr" class="m_-2831037023173371668gmail_msg"><div class="m_-2831037023173371668gmail_msg"><div class="m_-2831037023173371668gmail_msg"><div class="m_-2831037023173371668gmail_msg"><span style="background-color:rgb(255,255,255)" class="m_-2831037023173371668gmail_msg"><span style="color:rgb(0,0,0)" class="m_-2831037023173371668gmail_msg"><i class="m_-2831037023173371668gmail_msg">Daniel Belenky<br class="m_-2831037023173371668gmail_msg"></i></span></span></div><span style="background-color:rgb(255,255,255)" class="m_-2831037023173371668gmail_msg"><span style="color:rgb(0,0,0)" class="m_-2831037023173371668gmail_msg"><i class="m_-2831037023173371668gmail_msg">RHV DevOps<br class="m_-2831037023173371668gmail_msg"></i></span></span></div><span style="background-color:rgb(255,255,255)" class="m_-2831037023173371668gmail_msg"><span style="color:rgb(0,0,0)" class="m_-2831037023173371668gmail_msg"><i class="m_-2831037023173371668gmail_msg">Red Hat Israel<br class="m_-2831037023173371668gmail_msg"></i></span></span></div></div></div></div></div></div></div>
</div></div></div>
______________________________<wbr>_________________<br class="m_-2831037023173371668gmail_msg">
Devel mailing list<br class="m_-2831037023173371668gmail_msg">
<a href="mailto:Devel@ovirt.org" class="m_-2831037023173371668gmail_msg" target="_blank">Devel@ovirt.org</a><br class="m_-2831037023173371668gmail_msg">
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" class="m_-2831037023173371668gmail_msg" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a></blockquote></div></div>
<br>______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/infra</a><br>
<br></blockquote></div><br></div>