[ OST Failure Report ] [ oVirt Master (Ovirt-ngine) ] [ 19-03-2018 ] [ 002_bootstrap.verify_notifier ]
8:06 a.m.
Hi,
We had a failure in test 002_bootstrap.verify_notifier.
I can't see anything wrong with the notifier and I don't think it should be
related to the change that was reported.
the test itself is looking for vdc_stop in messages which I do not indeed
see but I am not sure what is the cause and how the reported change related
to the failure.
Can you please take a look?
*Link and headline of suspected patches: *
*core: USB in osinfo configuration depends on chipset -
https://gerrit.ovirt.org/#/c/88777/
<https://gerrit.ovirt.org/#/c/88777/>Link to
Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/>Link
to all
logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/a...
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifa...
error snippet from the log: <error>*
*this is the error from *the api:
Error Message
Failed grep for VDC_STOP with code 1. Output:
-------------------- >> begin captured logging << --------------------
lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get
ssh client for lago-basic-suite-master-engine:
lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh
client for lago-basic-suite-master-engine:
lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine:
grep VDC_STOP /var/log/messages
lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine
returned with 1
--------------------- >> end captured logging << ---------------------
Stacktrace
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line
129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line
59, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File
"/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py",
line 1456, in verify_notifier
'Failed grep for VDC_STOP with code {0}. Output:
{1}'.format(result.code, result.out)
File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in
eq_
raise AssertionError(msg or "%r != %r" % (a, b))
'Failed grep for VDC_STOP with code 1. Output: \n--------------------
> begin captured logging << --------------------\nlago.ssh:
DEBUG:
start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on
lago-basic-suite-master-engine: grep VDC_STOP
/var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on
lago-basic-suite-master-engine returned with 1\n---------------------
> end captured logging << ---------------------'
*</error>*
3:49 a.m.
--Apple-Mail=_194794D6-BF66-424D-AB28-25F526CFF9D3
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
I=E2=80=99m not sure what is that test actually testing, if it depends =
on the previous host action which fails but is not verified it still may =
be relevant to Shmuel=E2=80=99s patch
adding author of the test and the notifier owner
On 19 Mar 2018, at 13:06, Dafna Ron <dron(a)redhat.com> wrote:
=20
Hi,=20
=20
We had a failure in test 002_bootstrap.verify_notifier.
I can't see anything wrong with the notifier and I don't think it =
should
be related to the change that was reported.=20
=20
the test itself is looking for vdc_stop in messages which I do not =
indeed see but
I am not sure what is the cause and how the reported =
change related to the failure.=20
=20
Can you please take a look?=20
=20
=20
=20
Link and headline of suspected patches:=20
core: USB in osinfo configuration depends on chipset - =
https://gerrit.ovirt.org/#/c/88777/ =
<https://gerrit.ovirt.org/#/c/88777/>
=20
Link to Job:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/ =
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/>
=20
Link to all logs:
=
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifac=
ts =
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifa=
cts>
=20
(Relevant) error snippet from the log:=20
<error>
=20
this is the error from the api:=20
=20
=20
Error Message
=20
Failed grep for VDC_STOP with code 1. Output:=20
-------------------- >> begin captured logging << --------------------
lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get =
ssh client
for lago-basic-suite-master-engine:
lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get
ssh =
client for lago-basic-suite-master-engine:
lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine:
=
grep VDC_STOP /var/log/messages
lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine =
returned with 1
--------------------- >> end captured logging <<
---------------------
Stacktrace
=20
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in =
runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line =
129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line =
59, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File =
"/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tes=
ts/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in =
verify_notifier
'Failed grep for VDC_STOP with code {0}. Output: =
{1}'.format(result.code, result.out)
File
"/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line =
29, in
eq_
raise AssertionError(msg or "%r !=3D %r" % (a, b))
'Failed grep for VDC_STOP with code 1. Output: \n-------------------- =
> begin captured logging << --------------------\nlago.ssh: DEBUG: =
start
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for =
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end =
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for =
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on =
lago-basic-suite-master-engine: grep VDC_STOP =
/var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on =
lago-basic-suite-master-engine returned with 1\n--------------------- >> =
end captured logging << ---------------------'
=20
</error>
=20
_______________________________________________
Devel mailing list
Devel(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel
--Apple-Mail=_194794D6-BF66-424D-AB28-25F526CFF9D3
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html; =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; line-break: after-white-space;"
class=3D"">I=E2=80=
=99m not sure what is that test actually testing, if it depends on the =
previous host action which fails but is not verified it still may be =
relevant to Shmuel=E2=80=99s patch<br class=3D"">adding author of the =
test and the notifier owner<div class=3D""><div><br
class=3D""><blockquote=
type=3D"cite" class=3D""><div class=3D"">On 19 Mar
2018, at 13:06, =
Dafna Ron <<a href=3D"mailto:dron@redhat.com" =
class=3D"">dron(a)redhat.com</a>&gt; wrote:</div><br =
class=3D"Apple-interchange-newline"><div class=3D""><div
dir=3D"ltr" =
class=3D""><div class=3D""><div
class=3D"">Hi, <br class=3D""><br =
class=3D""></div>We had a failure in test =
002_bootstrap.verify_notifier.<br class=3D""></div><div
class=3D"">I =
can't see anything wrong with the notifier and I don't think it should =
be related to the change that was reported. <br class=3D""><br =
class=3D""></div><div class=3D"">the test itself is
looking for vdc_stop =
in messages which I do not indeed see but I am not sure what is the =
cause and how the reported change related to the failure. <br =
class=3D""><br class=3D""></div><div
class=3D"">Can you please take a =
look? <br class=3D""><br class=3D""><br
class=3D""><br =
class=3D""></div><div class=3D""><b
style=3D"font-weight:normal" =
id=3D"gmail-docs-internal-guid-e8ba4241-3e25-14f2-4425-ad6f357e2e4a" =
class=3D""><div style=3D"line-height: 1.38; margin-top: 0pt; =
margin-bottom: 0pt;" class=3D""><span style=3D"font-size: 11pt;
=
font-family: Arial; background-color: transparent; font-weight: 400; =
font-style: normal; font-variant-ligatures: normal; font-variant-caps: =
normal; font-variant-east-asian: normal; font-variant-position: normal; =
text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" =
class=3D"">Link and headline of suspected patches:
</span></div></b><b =
style=3D"font-weight:normal" =
id=3D"gmail-docs-internal-guid-e8ba4241-3e25-14f2-4425-ad6f357e2e4a" =
class=3D"">core: USB in osinfo configuration depends on chipset - <a =
href=3D"https://gerrit.ovirt.org/#/c/88777/" =
class=3D"">https://gerrit.ovirt.org/#/c/88777/</a><br
class=3D""><br =
class=3D""><div style=3D"line-height: 1.38; margin-top: 0pt; =
margin-bottom: 0pt;" class=3D""><span style=3D"font-size: 11pt;
=
font-family: Arial; background-color: transparent; font-weight: 400; =
font-style: normal; font-variant-ligatures: normal; font-variant-caps: =
normal; font-variant-east-asian: normal; font-variant-position: normal; =
text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" =
class=3D"">Link to Job:</span></div><a =
href=3D"http://jenkins.ovirt.org/job/ovirt-master_change-queue-teste...
/" =
class=3D"">http://jenkins.ovirt.org/job/ovirt-master_change-...
429/</a><br class=3D""><br class=3D""><div
style=3D"line-height: 1.38; =
margin-top: 0pt; margin-bottom: 0pt;" class=3D""><span
style=3D"font-size:=
11pt; font-family: Arial; background-color: transparent; font-weight: =
400; font-style: normal; font-variant-ligatures: normal; =
font-variant-caps: normal; font-variant-east-asian: normal; =
font-variant-position: normal; text-decoration: none; vertical-align: =
baseline; white-space: pre-wrap;" class=3D"">Link to all =
logs:</span></div><a =
href=3D"http://jenkins.ovirt.org/job/ovirt-master_change-queue-teste...
/artifacts" =
class=3D"">http://jenkins.ovirt.org/job/ovirt-master_change-...
429/artifacts</a><br class=3D""><br
class=3D""><div style=3D"line-height: =
1.38; margin-top: 0pt; margin-bottom: 0pt;" class=3D""><span =
style=3D"font-size: 11pt; font-family: Arial; background-color: =
transparent; font-weight: 400; font-style: normal; =
font-variant-ligatures: normal; font-variant-caps: normal; =
font-variant-east-asian: normal; font-variant-position: normal; =
text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" =
class=3D"">(Relevant) error snippet from the log:
</span></div><div =
style=3D"line-height: 1.38; margin-top: 0pt; margin-bottom: 0pt;" =
class=3D""><span style=3D"font-size: 11pt; font-family: Arial; =
background-color: transparent; font-weight: 400; font-style: normal; =
font-variant-ligatures: normal; font-variant-caps: normal; =
font-variant-east-asian: normal; font-variant-position: normal; =
text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" =
class=3D""><error></span></div><br
class=3D""></b></div><div =
class=3D""><b style=3D"font-weight:normal" =
id=3D"gmail-docs-internal-guid-e8ba4241-3e25-14f2-4425-ad6f357e2e4a" =
class=3D"">this is the error from </b><span
style=3D"font-weight:normal" =
class=3D"">the api: <br class=3D""><br
class=3D""></span><br =
class=3D""><h3 class=3D"">Error Message</h3><pre
class=3D"">Failed grep =
for VDC_STOP with code 1. Output:=20
-------------------- >> begin captured logging << =
--------------------
lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh =
client for lago-basic-suite-master-engine:
lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh =
client for lago-basic-suite-master-engine:
lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: =
grep VDC_STOP /var/log/messages
lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine =
returned with 1
--------------------- >> end captured logging << =
---------------------</pre><h3
class=3D"">Stacktrace</h3><pre class=3D""> =
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in =
runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line =
129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, =
in wrapper
return func(get_test_prefix(), *args, **kwargs)
File =
"/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tes=
ts/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in =
verify_notifier
'Failed grep for VDC_STOP with code {0}. Output: =
{1}'.format(result.code, result.out)
File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line =
29, in eq_
raise AssertionError(msg or "%r !=3D %r" % (a, b))
'Failed grep for VDC_STOP with code 1. Output: \n-------------------- =
>> begin captured logging << --------------------\nlago.ssh:
=
DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client =
for lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end =
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for =
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on =
lago-basic-suite-master-engine: grep VDC_STOP =
/var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on =
lago-basic-suite-master-engine returned with 1\n--------------------- =
>> end captured logging <<
---------------------'</pre><span =
style=3D"font-weight:normal"
class=3D""></span></div><div class=3D""><b =
style=3D"font-weight:normal" =
id=3D"gmail-docs-internal-guid-e8ba4241-3e25-14f2-4425-ad6f357e2e4a" =
class=3D""><br class=3D""><div style=3D"line-height:
1.38; margin-top: =
0pt; margin-bottom: 0pt;" class=3D""><span style=3D"font-size:
11pt; =
font-family: Arial; background-color: transparent; font-weight: 400; =
font-style: normal; font-variant-ligatures: normal; font-variant-caps: =
normal; font-variant-east-asian: normal; font-variant-position: normal; =
text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" =
class=3D""></error></span></div></b><br =
class=3D"gmail-Apple-interchange-newline"></div></div>
_______________________________________________<br class=3D"">Devel =
mailing list<br class=3D""><a href=3D"mailto:Devel@ovirt.org"
=
class=3D"">Devel(a)ovirt.org</a><br =
class=3D"">http://lists.ovirt.org/mailman/listinfo/devel<...
</div><br
class=3D""></div></body></html>=
--Apple-Mail=_194794D6-BF66-424D-AB28-25F526CFF9D3--
5:33 a.m.
On Tue, Mar 20, 2018 at 9:49 AM, Michal Skrivanek <
michal.skrivanek(a)redhat.com> wrote:
I’m not sure what is that test actually testing, if it depends on
the
previous host action which fails but is not verified it still may be
relevant to Shmuel’s patch
adding author of the test and the notifier owner
It is checking that the notifier works - which sends SNMP notifications on
our events. I happen to picked an event which is VDC_STOP - which happens
when the engine is restarted - which happens earlier, when we configure it.
Y.
On 19 Mar 2018, at 13:06, Dafna Ron <dron(a)redhat.com> wrote:
Hi,
We had a failure in test 002_bootstrap.verify_notifier.
I can't see anything wrong with the notifier and I don't think it should
be related to the change that was reported.
the test itself is looking for vdc_stop in messages which I do not indeed
see but I am not sure what is the cause and how the reported change related
to the failure.
Can you please take a look?
*Link and headline of suspected patches: *
*core: USB in osinfo configuration depends on chipset -
https://gerrit.ovirt.org/#/c/88777/
<https://gerrit.ovirt.org/#/c/88777/>Link to
Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/>Link
to all
logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/a...
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifa...
error snippet from the log: <error>*
*this is the error from *the api:
Error Message
Failed grep for VDC_STOP with code 1. Output:
-------------------- >> begin captured logging << --------------------
lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:
lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:
lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: grep VDC_STOP
/var/log/messages
lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine returned with 1
--------------------- >> end captured logging << ---------------------
Stacktrace
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in
wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in
wrapper
return func(get_test_prefix(), *args, **kwargs)
File
"/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py",
line 1456, in verify_notifier
'Failed grep for VDC_STOP with code {0}. Output: {1}'.format(result.code,
result.out)
File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in
eq_
raise AssertionError(msg or "%r != %r" % (a, b))
'Failed grep for VDC_STOP with code 1. Output: \n-------------------- >> begin
captured logging << --------------------\nlago.ssh: DEBUG: start
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on
lago-basic-suite-master-engine: grep VDC_STOP /var/log/messages\nlago.ssh: DEBUG: Command
1cce7c0c on lago-basic-suite-master-engine returned with 1\n--------------------- >>
end captured logging << ---------------------'
*</error>*
_______________________________________________
Devel mailing list
Devel(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/devel
6:28 a.m.
--Apple-Mail=_05EACEC6-6E9B-4159-B8A0-B81CFDB2F32E
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=utf-8
should be related to the change that was reported.=20
indeed see but I am not sure what is the
cause and how the reported =
change related to the failure.=20
https://gerrit.ovirt.org/#/c/88777/ =
<https://gerrit.ovirt.org/#/c/88777/>
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/>
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifac=
ts =
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifa=
cts>
--------------------
<http://lists.ovirt.org/mailman/listinfo/devel>
On 20 Mar 2018, at 10:33, Yaniv Kaul <ykaul(a)redhat.com> wrote:
=20
=20
=20
On Tue, Mar 20, 2018 at 9:49 AM, Michal Skrivanek =
<michal.skrivanek(a)redhat.com
<mailto:michal.skrivanek@redhat.com>> =
wrote:
I=E2=80=99m not sure what is that test actually testing, if it
depends =
on the previous host action which fails but is not verified it still may
=
be relevant to Shmuel=E2=80=99s patch
adding author of the test and the notifier owner
=20
It is checking that the notifier works - which sends SNMP =
notifications on our
events. I happen to picked an event which is =
VDC_STOP - which happens when the engine is restarted - which happens =
earlier, when we configure it.
not sure if that=E2=80=99s reliable then. Doesn=E2=80=99t look related =
to that patch at all. Dafna, does the same error reproduce all the time =
after that exact patch?
Y.
=20
=20
> On 19 Mar 2018, at 13:06, Dafna Ron <dron(a)redhat.com =
<mailto:dron@redhat.com>> wrote:
=20
> Hi,=20
=20
> We had a failure in test
002_bootstrap.verify_notifier.
> I can't see anything wrong with the notifier and I don't think it =
=20
> the test itself is looking
for vdc_stop in messages which I do not = =20
> Can you please take a
look?=20
=20
=20
=20
>
Link and headline of suspected patches:=20
> core: USB in osinfo configuration depends on chipset - =
=20
> Link to all logs:
> = =20
> (Relevant) error snippet
from the log:=20
> <error>
=20
> this is the error from the api:=20
=20
=20
> Error Message
=20
> Failed grep for VDC_STOP with code 1. Output:=20
> -------------------- >> begin captured logging << =
> lago.ssh: DEBUG: start
task:f1231b27-f796-406c-8618-17b0868725bc:Get =
ssh client for
lago-basic-suite-master-engine:
> lago.ssh: DEBUG: end
task:f1231b27-f796-406c-8618-17b0868725bc:Get =
ssh client for
lago-basic-suite-master-engine:
> lago.ssh: DEBUG: Running 1cce7c0c on
lago-basic-suite-master-engine: =
grep VDC_STOP /var/log/messages
> lago.ssh: DEBUG: Command 1cce7c0c on
lago-basic-suite-master-engine =
returned with 1
> --------------------- >> end captured logging << =
---------------------
> Stacktrace
runTest
=20
> File
"/usr/lib64/python2.7/unittest/case.py", line 369, in run
> testMethod()
> File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in =
> self.test(*self.arg)
> File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line =
129, in wrapped_test
> test()
> File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line =
59, in wrapper
> return func(get_test_prefix(), *args, **kwargs)
> File =
"/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tes=
ts/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in =
verify_notifier
> 'Failed grep for VDC_STOP with code {0}. Output: =
{1}'.format(result.code, result.out)
> File
"/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line =
29, in
eq_
> raise AssertionError(msg or "%r !=3D %r" % (a, b))
> 'Failed grep for VDC_STOP with code 1. Output: \n-------------------- =
> begin captured logging << --------------------\nlago.ssh: DEBUG: =
start
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for =
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end =
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for =
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on =
lago-basic-suite-master-engine: grep VDC_STOP =
/var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on =
lago-basic-suite-master-engine returned with 1\n--------------------- >> =
end captured logging << ---------------------'
=20
> </error>
=20
> _______________________________________________
> Devel mailing list
> Devel(a)ovirt.org <mailto:Devel@ovirt.org>
> http://lists.ovirt.org/mailman/listinfo/devel =
=20
--Apple-Mail=_05EACEC6-6E9B-4159-B8A0-B81CFDB2F32E
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=utf-8
<html><head><meta http-equiv=3D"Content-Type"
content=3D"text/html; =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; line-break: after-white-space;"
class=3D""><br =
class=3D""><div><br class=3D""><blockquote
type=3D"cite" class=3D""><div =
class=3D"">On 20 Mar 2018, at 10:33, Yaniv Kaul <<a =
href=3D"mailto:ykaul@redhat.com"
class=3D"">ykaul(a)redhat.com</a>&gt; =
wrote:</div><br class=3D"Apple-interchange-newline"><div
class=3D""><div =
dir=3D"ltr" class=3D""><br class=3D""><div
class=3D"gmail_extra"><br =
class=3D""><div class=3D"gmail_quote">On Tue, Mar 20, 2018 at
9:49 AM, =
Michal Skrivanek <span dir=3D"ltr" class=3D""><<a =
href=3D"mailto:michal.skrivanek@redhat.com" target=3D"_blank" =
class=3D"">michal.skrivanek(a)redhat.com</a>&gt;</span>
wrote:<br =
class=3D""><blockquote class=3D"gmail_quote"
style=3D"margin:0 0 0 =
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div =
style=3D"word-wrap:break-word;line-break:after-white-space" =
class=3D"">I=E2=80=99m not sure what is that test actually testing, if =
it depends on the previous host action which fails but is not verified =
it still may be relevant to Shmuel=E2=80=99s patch<br class=3D"">adding =
author of the test and the notifier owner</div></blockquote><div =
class=3D""><br class=3D""></div><div
class=3D"">It is checking that the =
notifier works - which sends SNMP notifications on our events. I happen =
to picked an event which is VDC_STOP - which happens when the engine is =
restarted - which happens earlier, when we configure =
it.</div></div></div></div></div></blockquote><div><br
=
class=3D""></div>not sure if that=E2=80=99s reliable then.
Doesn=E2=80=99t=
look related to that patch at all. Dafna, does the same error reproduce =
all the time after that exact patch?</div><div><br
class=3D""><blockquote =
type=3D"cite" class=3D""><div class=3D""><div
dir=3D"ltr" class=3D""><div =
class=3D"gmail_extra"><div class=3D"gmail_quote"><div =
class=3D"">Y.</div><div
class=3D""> </div><blockquote =
class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc =
solid;padding-left:1ex"><div =
style=3D"word-wrap:break-word;line-break:after-white-space" =
class=3D""><div class=3D""><div
class=3D""><br class=3D""><blockquote =
type=3D"cite" class=3D""><div class=3D""><div
class=3D"h5"><div =
class=3D"">On 19 Mar 2018, at 13:06, Dafna Ron <<a =
href=3D"mailto:dron@redhat.com" target=3D"_blank" =
class=3D"">dron(a)redhat.com</a>&gt; wrote:</div><br =
class=3D"m_-7487643208740782214Apple-interchange-newline"></div></div><div=
class=3D""><div class=3D""><div
class=3D"h5"><div dir=3D"ltr" =
class=3D""><div class=3D""><div
class=3D"">Hi, <br class=3D""><br =
class=3D""></div>We had a failure in test =
002_bootstrap.verify_notifier.<br class=3D""></div><div
class=3D"">I =
can't see anything wrong with the notifier and I don't think it should =
be related to the change that was reported. <br class=3D""><br =
class=3D""></div><div class=3D"">the test itself is
looking for vdc_stop =
in messages which I do not indeed see but I am not sure what is the =
cause and how the reported change related to the failure. <br =
class=3D""><br class=3D""></div><div
class=3D"">Can you please take a =
look? <br class=3D""><br class=3D""><br
class=3D""><br =
class=3D""></div><div class=3D""><b
style=3D"font-weight:normal" =
id=3D"m_-7487643208740782214gmail-docs-internal-guid-e8ba4241-3e25-14f2-44=
25-ad6f357e2e4a" class=3D""><div =
style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" =
class=3D""><span =
style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon=
t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-=
caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a=
lign:baseline;white-space:pre-wrap" class=3D"">Link and headline of =
suspected patches: </span></div></b><b
style=3D"font-weight:normal" =
id=3D"m_-7487643208740782214gmail-docs-internal-guid-e8ba4241-3e25-14f2-44=
25-ad6f357e2e4a" class=3D"">core: USB in osinfo configuration depends on
=
chipset - <a href=3D"https://gerrit.ovirt.org/#/c/88777/" =
target=3D"_blank" class=3D"">https://gerrit.ovirt.org/#/c/<wbr
=
class=3D"">88777/</a><br class=3D""><br
class=3D""><div =
style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" =
class=3D""><span =
style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon=
t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-=
caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a=
lign:baseline;white-space:pre-wrap" class=3D"">Link to =
Job:</span></div><a =
href=3D"http://jenkins.ovirt.org/job/ovirt-master_change-queue-teste...
/" target=3D"_blank"
class=3D"">http://jenkins.ovirt.org/job/<wbr =
class=3D"">ovirt-master_change-queue-<wbr
class=3D"">tester/6429/</a><br =
class=3D""><br class=3D""><div =
style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" =
class=3D""><span =
style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon=
t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-=
caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a=
lign:baseline;white-space:pre-wrap" class=3D"">Link to all =
logs:</span></div><a =
href=3D"http://jenkins.ovirt.org/job/ovirt-master_change-queue-teste...
/artifacts" target=3D"_blank"
class=3D"">http://jenkins.ovirt.org/job/<wbr=
class=3D"">ovirt-master_change-queue-<wbr =
class=3D"">tester/6429/artifacts</a><br
class=3D""><br class=3D""><div =
style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" =
class=3D""><span =
style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon=
t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-=
caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a=
lign:baseline;white-space:pre-wrap" class=3D"">(Relevant) error snippet
=
from the log: </span></div><div =
style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" =
class=3D""><span =
style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon=
t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-=
caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a=
lign:baseline;white-space:pre-wrap" =
class=3D""><error></span></div><br
class=3D""></b></div><div =
class=3D""><b style=3D"font-weight:normal" =
id=3D"m_-7487643208740782214gmail-docs-internal-guid-e8ba4241-3e25-14f2-44=
25-ad6f357e2e4a" class=3D"">this is the error from </b><span =
style=3D"font-weight:normal" class=3D"">the api: <br
class=3D""><br =
class=3D""></span><br class=3D""><h3
class=3D"">Error Message</h3><pre =
class=3D"">Failed grep for VDC_STOP with code 1. Output:=20
-------------------- >> begin captured logging << =
--------------------
lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-<wbr =
class=3D"">17b0868725bc:Get ssh client for lago-basic-suite-master-<wbr =
class=3D"">engine:
lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-<wbr =
class=3D"">17b0868725bc:Get ssh client for lago-basic-suite-master-<wbr =
class=3D"">engine:
lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-<wbr =
class=3D"">engine: grep VDC_STOP /var/log/messages
lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine =
returned with 1
--------------------- >> end captured logging << =
---------------------</pre><h3
class=3D"">Stacktrace</h3><pre class=3D""> =
File "/usr/lib64/python2.7/<wbr class=3D"">unittest/case.py",
line 369, =
in run
testMethod()
File "/usr/lib/python2.7/site-<wbr
class=3D"">packages/nose/case.py", =
line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-<wbr =
class=3D"">packages/ovirtlago/testlib.py"<wbr
class=3D"">, line 129, in =
wrapped_test
test()
File "/usr/lib/python2.7/site-<wbr =
class=3D"">packages/ovirtlago/testlib.py"<wbr
class=3D"">, line 59, in =
wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/workspace/<wbr =
class=3D"">ovirt-master_change-queue-<wbr =
class=3D"">tester/ovirt-system-tests/<wbr =
class=3D"">basic-suite-master/test-<wbr =
class=3D"">scenarios/002_bootstrap.py", line 1456, in verify_notifier
'Failed grep for VDC_STOP with code {0}. Output: =
{1}'.format(result.code, result.out)
File "/usr/lib/python2.7/site-<wbr =
class=3D"">packages/nose/tools/trivial.<wbr
class=3D"">py", line 29, in =
eq_
raise AssertionError(msg or "%r !=3D %r" % (a, b))
'Failed grep for VDC_STOP with code 1. Output: \n-------------------- =
>> begin captured logging <<
--------------------\nlago.<wbr =
class=3D"">ssh: DEBUG: start task:f1231b27-f796-406c-8618-<wbr =
class=3D"">17b0868725bc:Get ssh client for lago-basic-suite-master-<wbr =
class=3D"">engine:\nlago.ssh: DEBUG: end =
task:f1231b27-f796-406c-8618-<wbr class=3D"">17b0868725bc:Get ssh client
=
for lago-basic-suite-master-<wbr class=3D"">engine:\nlago.ssh: DEBUG: =
Running 1cce7c0c on lago-basic-suite-master-<wbr class=3D"">engine: grep
=
VDC_STOP /var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on =
lago-basic-suite-master-engine returned with 1\n--------------------- =
>> end captured logging <<
---------------------'</pre><span =
style=3D"font-weight:normal"
class=3D""></span></div><div class=3D""><b =
style=3D"font-weight:normal" =
id=3D"m_-7487643208740782214gmail-docs-internal-guid-e8ba4241-3e25-14f2-44=
25-ad6f357e2e4a" class=3D""><br class=3D""><div =
style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" =
class=3D""><span =
style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon=
t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-=
caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a=
lign:baseline;white-space:pre-wrap" =
class=3D""></error></span></div></b><br =
class=3D"m_-7487643208740782214gmail-Apple-interchange-newline"></div></di=
v></div></div>
______________________________<wbr class=3D"">_________________<br =
class=3D"">Devel mailing list<br class=3D""><a =
href=3D"mailto:Devel@ovirt.org" target=3D"_blank" =
class=3D"">Devel(a)ovirt.org</a><br class=3D""><a =
href=3D"http://lists.ovirt.org/mailman/listinfo/devel"
target=3D"_blank" =
class=3D"">http://lists.ovirt.org/<wbr =
class=3D"">mailman/listinfo/devel</a></div></blockquote></div><br
=
class=3D""></div></div></blockquote></div><br
class=3D""></div></div>
</div></blockquote></div><br
class=3D""></body></html>=
--Apple-Mail=_05EACEC6-6E9B-4159-B8A0-B81CFDB2F32E--
7:18 a.m.
The patch was reported to cause 3 different issues but I cannot say for
sure that the notifier error was actually one of them.
I can say that all issues from master and 4.2 were cleared once the fix
from Shmuel was merged and tested in cq.
On Wed, Mar 21, 2018 at 10:28 AM, Michal Skrivanek <
michal.skrivanek(a)redhat.com> wrote:
On 20 Mar 2018, at 10:33, Yaniv Kaul <ykaul(a)redhat.com> wrote:
On Tue, Mar 20, 2018 at 9:49 AM, Michal Skrivanek <
michal.skrivanek(a)redhat.com> wrote:
> I’m not sure what is that test actually testing, if it depends on the
> previous host action which fails but is not verified it still may be
> relevant to Shmuel’s patch
> adding author of the test and the notifier owner
>
It is checking that the notifier works - which sends SNMP notifications on
our events. I happen to picked an event which is VDC_STOP - which happens
when the engine is restarted - which happens earlier, when we configure it.
not sure if that’s reliable then. Doesn’t look related to that patch at
all. Dafna, does the same error reproduce all the time after that exact
patch?
Y.
>
> On 19 Mar 2018, at 13:06, Dafna Ron <dron(a)redhat.com> wrote:
>
> Hi,
>
> We had a failure in test 002_bootstrap.verify_notifier.
> I can't see anything wrong with the notifier and I don't think it should
> be related to the change that was reported.
>
> the test itself is looking for vdc_stop in messages which I do not indeed
> see but I am not sure what is the cause and how the reported change related
> to the failure.
>
> Can you please take a look?
>
>
>
> *Link and headline of suspected patches: *
>
>
>
>
>
>
> *core: USB in osinfo configuration depends on chipset -
> https://gerrit.ovirt.org/#/c/88777/
> <https://gerrit.ovirt.org/#/c/88777/>Link to
> Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/
> <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/>Link
> to all
> logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/a...
>
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifa...
> error snippet from the log: <error>*
> *this is the error from *the api:
>
>
> Error Message
>
> Failed grep for VDC_STOP with code 1. Output:
> -------------------- >> begin captured logging << --------------------
> lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:
> lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:
> lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: grep VDC_STOP
/var/log/messages
> lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine returned with 1
> --------------------- >> end captured logging << ---------------------
>
> Stacktrace
>
> File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
> testMethod()
> File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in
runTest
> self.test(*self.arg)
> File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129,
in wrapped_test
> test()
> File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in
wrapper
> return func(get_test_prefix(), *args, **kwargs)
> File
"/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py",
line 1456, in verify_notifier
> 'Failed grep for VDC_STOP with code {0}. Output: {1}'.format(result.code,
result.out)
> File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29,
in eq_
> raise AssertionError(msg or "%r != %r" % (a, b))
> 'Failed grep for VDC_STOP with code 1. Output: \n-------------------- >>
begin captured logging << --------------------\nlago.ssh: DEBUG: start
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end
task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for
lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on
lago-basic-suite-master-engine: grep VDC_STOP /var/log/messages\nlago.ssh: DEBUG: Command
1cce7c0c on lago-basic-suite-master-engine returned with 1\n--------------------- >>
end captured logging << ---------------------'
>
>
> *</error>*
> _______________________________________________
> Devel mailing list
> Devel(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>
>
>
2470
days inactive
2472
days old
4 comments
3 participants
participants (3)
-
Dafna Ron -
Michal Skrivanek -
Yaniv Kaul