<div dir="ltr">Hi all,<div><br></div><div>I added couple of new lvm tests, creating a vg based on a loop</div><div>device and performing several operations on the lvs.</div><div><br></div><div>All the test pass on my laptop (fedora 24, no special configuration)</div><div>and my rhel host (7.3 beta, configured for vdsm).</div><div><br></div><div>On the CI all the tests fail with the error bellow.</div><div><br></div><div>It seems that the first issue is having use_lvmetad = 1 in /etc/lvm/lvm.conf</div><div>but lvm2-lvmetad.socket is broken.</div><div><br></div><div>The code try to use pvscan --cache only if</div><div><br></div><div> systemctl status lvm2-lvmetad.socket</div><div><br></div><div>succeeds - but later we get:</div><div><br></div><div><pre class="gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:16px">Error: Command ('pvscan', '--cache') failed with rc=5 out='' err=' /run/lvm/lvmetad.socket: connect failed: No such file or directory\n WARNING: Failed to connect to lvmetad. Falling back to internal scanning.\n Cannot proceed since lvmetad is not active.\n'</pre></div><div><br></div><div>This error currently hides previous failure:</div><div><br></div><div><pre class="gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:16px"><span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,632 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 lvcreate -n ovirt-lv-1 -L 128m ovirt-vg (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,714 DEBUG [root] (MainThread) FAILED: <err> = ' /run/lvm/lvmetad.socket: connect failed: No such file or directory\n WARNING: Failed to connect to lvmetad. Falling back to internal scanning.\n /dev/ovirt-vg/ovirt-lv-1: not found: device not cleared\n Aborting. Failed to wipe start of new LV.\n'; <rc> = 5
</pre></div><div><br></div><div>But it looks like they are related.</div><div><br></div><div>Is it possible to change the ci configuration? do we have similar test</div><div>running on the ci?</div><div><br></div><div>See <a href="https://gerrit.ovirt.org/#/c/64367/">https://gerrit.ovirt.org/#/c/64367/</a></div><div>and the next patches in this topic.</div><div><br></div><div>Here are al the tests, all fail in the CI in the same way:</div><div><a href="https://gerrit.ovirt.org/#/c/64370/3/tests/storage_lvm_test.py">https://gerrit.ovirt.org/#/c/64370/3/tests/storage_lvm_test.py</a></div><div><br></div><div>I can filter the tests on the ci, but I like them to run automatically.</div><div><br></div><div>Thanks,</div><div>Nir</div><div><br></div><div><pre class="gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:16px"><span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>======================================================================
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>ERROR: test_deactivate_unused_ovirt_lvs (storage_lvm_test.TestDeactivation)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>----------------------------------------------------------------------
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>Traceback (most recent call last):
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> File "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/testValidation.py", line 97, in wrapper
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> return f(*args, **kwargs)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> File "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/storage_lvm_test.py", line 74, in test_deactivate_unused_ovirt_lvs
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> run("vgchange", "-an", "ovirt-vg")
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> File "/usr/lib64/python2.7/contextlib.py", line 35, in __exit__
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> self.gen.throw(type, value, traceback)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> File "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/storage_lvm_test.py", line 129, in fake_env
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> run("pvscan", "--cache")
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> File "/home/jenkins/workspace/vdsm_master_check-patch-fc24-x86_64/vdsm/tests/storage_lvm_test.py", line 87, in run
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span> raise cmdutils.Error(cmd, rc, out, err)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>Error: Command ('pvscan', '--cache') failed with rc=5 out='' err=' /run/lvm/lvmetad.socket: connect failed: No such file or directory\n WARNING: Failed to connect to lvmetad. Falling back to internal scanning.\n Cannot proceed since lvmetad is not active.\n'
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>-------------------- >> begin captured logging << --------------------
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,386 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 losetup --find --show /var/tmp/tmpRGpRw9/backing_file (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,400 DEBUG [root] (MainThread) SUCCESS: <err> = ''; <rc> = 0
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,400 DEBUG [test] (MainThread) Using loop device /dev/loop0
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,401 DEBUG [test] (MainThread) Creating ovirt lvs
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,401 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 pvcreate -ff /dev/loop0 (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,495 DEBUG [root] (MainThread) SUCCESS: <err> = ' /run/lvm/lvmetad.socket: connect failed: No such file or directory\n WARNING: Failed to connect to lvmetad. Falling back to internal scanning.\n'; <rc> = 0
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,495 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 vgcreate ovirt-vg /dev/loop0 (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,589 DEBUG [root] (MainThread) SUCCESS: <err> = ' /run/lvm/lvmetad.socket: connect failed: No such file or directory\n WARNING: Failed to connect to lvmetad. Falling back to internal scanning.\n'; <rc> = 0
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,589 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 vgchange --addtag RHAT_storage_domain (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,631 DEBUG [root] (MainThread) SUCCESS: <err> = ' /run/lvm/lvmetad.socket: connect failed: No such file or directory\n WARNING: Failed to connect to lvmetad. Falling back to internal scanning.\n'; <rc> = 0
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,632 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 lvcreate -n ovirt-lv-1 -L 128m ovirt-vg (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,714 DEBUG [root] (MainThread) FAILED: <err> = ' /run/lvm/lvmetad.socket: connect failed: No such file or directory\n WARNING: Failed to connect to lvmetad. Falling back to internal scanning.\n /dev/ovirt-vg/ovirt-lv-1: not found: device not cleared\n Aborting. Failed to wipe start of new LV.\n'; <rc> = 5
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,714 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 losetup --detach /dev/loop0 (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,734 DEBUG [root] (MainThread) SUCCESS: <err> = ''; <rc> = 0
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,735 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 /sbin/udevadm settle --timeout=5 (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,746 DEBUG [root] (MainThread) SUCCESS: <err> = ''; <rc> = 0
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,746 DEBUG [root] (MainThread) /usr/bin/taskset --cpu-list 0-3 pvscan --cache (cwd None)
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:30</b> </span>2016-09-25 07:02:55,758 DEBUG [root] (MainThread) FAILED: <err> = ' /run/lvm/lvmetad.socket: connect failed: No such file or directory\n WARNING: Failed to connect to lvmetad. Falling back to internal scanning.\n Cannot proceed since lvmetad is not active.\n'; <rc> = 5
<span class="gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">07:04:43</b> </span>--------------------- >> end captured logging << ---------------------
</pre></div><div><br></div></div>