[ OST Failure Report ] [ oVirt Master (Ovirt-ngine) ] [ 19-03-2018 ] [ 002_bootstrap.verify_notifier ]

Hi, We had a failure in test 002_bootstrap.verify_notifier. I can't see anything wrong with the notifier and I don't think it should be related to the change that was reported. the test itself is looking for vdc_stop in messages which I do not indeed see but I am not sure what is the cause and how the reported change related to the failure. Can you please take a look? *Link and headline of suspected patches: * *core: USB in osinfo configuration depends on chipset - https://gerrit.ovirt.org/#/c/88777/ <https://gerrit.ovirt.org/#/c/88777/>Link to Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/>Link to all logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifacts <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifacts>(Relevant) error snippet from the log: <error>* *this is the error from *the api: Error Message Failed grep for VDC_STOP with code 1. Output: -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: grep VDC_STOP /var/log/messages lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine returned with 1 --------------------- >> end captured logging << --------------------- Stacktrace File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in verify_notifier 'Failed grep for VDC_STOP with code {0}. Output: {1}'.format(result.code, result.out) File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_ raise AssertionError(msg or "%r != %r" % (a, b)) 'Failed grep for VDC_STOP with code 1. Output: \n--------------------
begin captured logging << --------------------\nlago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: grep VDC_STOP /var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine returned with 1\n--------------------- end captured logging << ---------------------'
*</error>*

--Apple-Mail=_194794D6-BF66-424D-AB28-25F526CFF9D3 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I=E2=80=99m not sure what is that test actually testing, if it depends = on the previous host action which fails but is not verified it still may = be relevant to Shmuel=E2=80=99s patch adding author of the test and the notifier owner
On 19 Mar 2018, at 13:06, Dafna Ron <dron@redhat.com> wrote: =20 Hi,=20 =20 We had a failure in test 002_bootstrap.verify_notifier. I can't see anything wrong with the notifier and I don't think it = should be related to the change that was reported.=20 =20 the test itself is looking for vdc_stop in messages which I do not = indeed see but I am not sure what is the cause and how the reported = change related to the failure.=20 =20 Can you please take a look?=20 =20 =20 =20 Link and headline of suspected patches:=20 core: USB in osinfo configuration depends on chipset - = https://gerrit.ovirt.org/#/c/88777/ = <https://gerrit.ovirt.org/#/c/88777/> =20 Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/ = <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/> =20 Link to all logs: = http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifac= ts = <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifa= cts> =20 (Relevant) error snippet from the log:=20 <error> =20 this is the error from the api:=20 =20 =20 Error Message =20 Failed grep for VDC_STOP with code 1. Output:=20 -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get = ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh = client for lago-basic-suite-master-engine: lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: = grep VDC_STOP /var/log/messages lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine = returned with 1 --------------------- >> end captured logging << --------------------- Stacktrace =20 File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in = runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line = 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line = 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File = "/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tes= ts/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in = verify_notifier 'Failed grep for VDC_STOP with code {0}. Output: = {1}'.format(result.code, result.out) File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line = 29, in eq_ raise AssertionError(msg or "%r !=3D %r" % (a, b)) 'Failed grep for VDC_STOP with code 1. Output: \n-------------------- =
begin captured logging << --------------------\nlago.ssh: DEBUG: = start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for = lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end = task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for = lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on = lago-basic-suite-master-engine: grep VDC_STOP = /var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on = lago-basic-suite-master-engine returned with 1\n--------------------- >> = end captured logging << ---------------------' =20 </error> =20
Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
--Apple-Mail=_194794D6-BF66-424D-AB28-25F526CFF9D3 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">I=E2=80= =99m not sure what is that test actually testing, if it depends on the = previous host action which fails but is not verified it still may be = relevant to Shmuel=E2=80=99s patch<br class=3D"">adding author of the = test and the notifier owner<div class=3D""><div><br class=3D""><blockquote= type=3D"cite" class=3D""><div class=3D"">On 19 Mar 2018, at 13:06, = Dafna Ron <<a href=3D"mailto:dron@redhat.com" = class=3D"">dron@redhat.com</a>> wrote:</div><br = class=3D"Apple-interchange-newline"><div class=3D""><div dir=3D"ltr" = class=3D""><div class=3D""><div class=3D"">Hi, <br class=3D""><br = class=3D""></div>We had a failure in test = 002_bootstrap.verify_notifier.<br class=3D""></div><div class=3D"">I = can't see anything wrong with the notifier and I don't think it should = be related to the change that was reported. <br class=3D""><br = class=3D""></div><div class=3D"">the test itself is looking for vdc_stop = in messages which I do not indeed see but I am not sure what is the = cause and how the reported change related to the failure. <br = class=3D""><br class=3D""></div><div class=3D"">Can you please take a = look? <br class=3D""><br class=3D""><br class=3D""><br = class=3D""></div><div class=3D""><b style=3D"font-weight:normal" = id=3D"gmail-docs-internal-guid-e8ba4241-3e25-14f2-4425-ad6f357e2e4a" = class=3D""><div style=3D"line-height: 1.38; margin-top: 0pt; = margin-bottom: 0pt;" class=3D""><span style=3D"font-size: 11pt; = font-family: Arial; background-color: transparent; font-weight: 400; = font-style: normal; font-variant-ligatures: normal; font-variant-caps: = normal; font-variant-east-asian: normal; font-variant-position: normal; = text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" = class=3D"">Link and headline of suspected patches: </span></div></b><b = style=3D"font-weight:normal" = id=3D"gmail-docs-internal-guid-e8ba4241-3e25-14f2-4425-ad6f357e2e4a" = class=3D"">core: USB in osinfo configuration depends on chipset - <a = href=3D"https://gerrit.ovirt.org/#/c/88777/" = class=3D"">https://gerrit.ovirt.org/#/c/88777/</a><br class=3D""><br = class=3D""><div style=3D"line-height: 1.38; margin-top: 0pt; = margin-bottom: 0pt;" class=3D""><span style=3D"font-size: 11pt; = font-family: Arial; background-color: transparent; font-weight: 400; = font-style: normal; font-variant-ligatures: normal; font-variant-caps: = normal; font-variant-east-asian: normal; font-variant-position: normal; = text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" = class=3D"">Link to Job:</span></div><a = href=3D"http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429= /" = class=3D"">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6= 429/</a><br class=3D""><br class=3D""><div style=3D"line-height: 1.38; = margin-top: 0pt; margin-bottom: 0pt;" class=3D""><span style=3D"font-size:= 11pt; font-family: Arial; background-color: transparent; font-weight: = 400; font-style: normal; font-variant-ligatures: normal; = font-variant-caps: normal; font-variant-east-asian: normal; = font-variant-position: normal; text-decoration: none; vertical-align: = baseline; white-space: pre-wrap;" class=3D"">Link to all = logs:</span></div><a = href=3D"http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429= /artifacts" = class=3D"">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6= 429/artifacts</a><br class=3D""><br class=3D""><div style=3D"line-height: = 1.38; margin-top: 0pt; margin-bottom: 0pt;" class=3D""><span = style=3D"font-size: 11pt; font-family: Arial; background-color: = transparent; font-weight: 400; font-style: normal; = font-variant-ligatures: normal; font-variant-caps: normal; = font-variant-east-asian: normal; font-variant-position: normal; = text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" = class=3D"">(Relevant) error snippet from the log: </span></div><div = style=3D"line-height: 1.38; margin-top: 0pt; margin-bottom: 0pt;" = class=3D""><span style=3D"font-size: 11pt; font-family: Arial; = background-color: transparent; font-weight: 400; font-style: normal; = font-variant-ligatures: normal; font-variant-caps: normal; = font-variant-east-asian: normal; font-variant-position: normal; = text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" = class=3D""><error></span></div><br class=3D""></b></div><div = class=3D""><b style=3D"font-weight:normal" = id=3D"gmail-docs-internal-guid-e8ba4241-3e25-14f2-4425-ad6f357e2e4a" = class=3D"">this is the error from </b><span style=3D"font-weight:normal" = class=3D"">the api: <br class=3D""><br class=3D""></span><br = class=3D""><h3 class=3D"">Error Message</h3><pre class=3D"">Failed grep = for VDC_STOP with code 1. Output:=20 -------------------- >> begin captured logging << = -------------------- lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh = client for lago-basic-suite-master-engine: lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh = client for lago-basic-suite-master-engine: lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: = grep VDC_STOP /var/log/messages lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine = returned with 1 --------------------- >> end captured logging << = ---------------------</pre><h3 class=3D"">Stacktrace</h3><pre class=3D""> = File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in = runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line = 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, = in wrapper return func(get_test_prefix(), *args, **kwargs) File = "/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tes= ts/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in = verify_notifier 'Failed grep for VDC_STOP with code {0}. Output: = {1}'.format(result.code, result.out) File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line = 29, in eq_ raise AssertionError(msg or "%r !=3D %r" % (a, b)) 'Failed grep for VDC_STOP with code 1. Output: \n-------------------- = >> begin captured logging << --------------------\nlago.ssh: = DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client = for lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end = task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for = lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on = lago-basic-suite-master-engine: grep VDC_STOP = /var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on = lago-basic-suite-master-engine returned with 1\n--------------------- = >> end captured logging << ---------------------'</pre><span = style=3D"font-weight:normal" class=3D""></span></div><div class=3D""><b = style=3D"font-weight:normal" = id=3D"gmail-docs-internal-guid-e8ba4241-3e25-14f2-4425-ad6f357e2e4a" = class=3D""><br class=3D""><div style=3D"line-height: 1.38; margin-top: = 0pt; margin-bottom: 0pt;" class=3D""><span style=3D"font-size: 11pt; = font-family: Arial; background-color: transparent; font-weight: 400; = font-style: normal; font-variant-ligatures: normal; font-variant-caps: = normal; font-variant-east-asian: normal; font-variant-position: normal; = text-decoration: none; vertical-align: baseline; white-space: pre-wrap;" = class=3D""></error></span></div></b><br = class=3D"gmail-Apple-interchange-newline"></div></div> _______________________________________________<br class=3D"">Devel = mailing list<br class=3D""><a href=3D"mailto:Devel@ovirt.org" = class=3D"">Devel@ovirt.org</a><br = class=3D"">http://lists.ovirt.org/mailman/listinfo/devel</div></blockquote=
</div><br class=3D""></div></body></html>=
--Apple-Mail=_194794D6-BF66-424D-AB28-25F526CFF9D3--

On Tue, Mar 20, 2018 at 9:49 AM, Michal Skrivanek < michal.skrivanek@redhat.com> wrote:
I’m not sure what is that test actually testing, if it depends on the previous host action which fails but is not verified it still may be relevant to Shmuel’s patch adding author of the test and the notifier owner
It is checking that the notifier works - which sends SNMP notifications on our events. I happen to picked an event which is VDC_STOP - which happens when the engine is restarted - which happens earlier, when we configure it. Y.
On 19 Mar 2018, at 13:06, Dafna Ron <dron@redhat.com> wrote:
Hi,
We had a failure in test 002_bootstrap.verify_notifier. I can't see anything wrong with the notifier and I don't think it should be related to the change that was reported.
the test itself is looking for vdc_stop in messages which I do not indeed see but I am not sure what is the cause and how the reported change related to the failure.
Can you please take a look?
*Link and headline of suspected patches: *
*core: USB in osinfo configuration depends on chipset - https://gerrit.ovirt.org/#/c/88777/ <https://gerrit.ovirt.org/#/c/88777/>Link to Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/>Link to all logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifacts <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifacts>(Relevant) error snippet from the log: <error>* *this is the error from *the api:
Error Message
Failed grep for VDC_STOP with code 1. Output: -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: grep VDC_STOP /var/log/messages lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine returned with 1 --------------------- >> end captured logging << ---------------------
Stacktrace
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in verify_notifier 'Failed grep for VDC_STOP with code {0}. Output: {1}'.format(result.code, result.out) File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_ raise AssertionError(msg or "%r != %r" % (a, b)) 'Failed grep for VDC_STOP with code 1. Output: \n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: grep VDC_STOP /var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine returned with 1\n--------------------- >> end captured logging << ---------------------'
*</error>* _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel

--Apple-Mail=_05EACEC6-6E9B-4159-B8A0-B81CFDB2F32E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8
On 20 Mar 2018, at 10:33, Yaniv Kaul <ykaul@redhat.com> wrote: =20 =20 =20 On Tue, Mar 20, 2018 at 9:49 AM, Michal Skrivanek = <michal.skrivanek@redhat.com <mailto:michal.skrivanek@redhat.com>> = wrote: I=E2=80=99m not sure what is that test actually testing, if it depends = on the previous host action which fails but is not verified it still may = be relevant to Shmuel=E2=80=99s patch adding author of the test and the notifier owner =20 It is checking that the notifier works - which sends SNMP = notifications on our events. I happen to picked an event which is = VDC_STOP - which happens when the engine is restarted - which happens = earlier, when we configure it.
not sure if that=E2=80=99s reliable then. Doesn=E2=80=99t look related = to that patch at all. Dafna, does the same error reproduce all the time = after that exact patch?
Y. =20 =20
On 19 Mar 2018, at 13:06, Dafna Ron <dron@redhat.com = <mailto:dron@redhat.com>> wrote: =20 Hi,=20 =20 We had a failure in test 002_bootstrap.verify_notifier. I can't see anything wrong with the notifier and I don't think it = should be related to the change that was reported.=20 =20 the test itself is looking for vdc_stop in messages which I do not = indeed see but I am not sure what is the cause and how the reported = change related to the failure.=20 =20 Can you please take a look?=20 =20 =20 =20 Link and headline of suspected patches:=20 core: USB in osinfo configuration depends on chipset - = https://gerrit.ovirt.org/#/c/88777/ = <https://gerrit.ovirt.org/#/c/88777/> =20 Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/ = <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/> =20 Link to all logs: = http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifac= ts = <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifa= cts> =20 (Relevant) error snippet from the log:=20 <error> =20 this is the error from the api:=20 =20 =20 Error Message =20 Failed grep for VDC_STOP with code 1. Output:=20 -------------------- >> begin captured logging << =
lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get = ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get = ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: = grep VDC_STOP /var/log/messages lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine = returned with 1 --------------------- >> end captured logging << =
Stacktrace =20 File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in = runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line = 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line = 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File = "/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tes= ts/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in = verify_notifier 'Failed grep for VDC_STOP with code {0}. Output: = {1}'.format(result.code, result.out) File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line = 29, in eq_ raise AssertionError(msg or "%r !=3D %r" % (a, b)) 'Failed grep for VDC_STOP with code 1. Output: \n-------------------- = begin captured logging << --------------------\nlago.ssh: DEBUG: = start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for = lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end = task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for = lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on = lago-basic-suite-master-engine: grep VDC_STOP = /var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on = lago-basic-suite-master-engine returned with 1\n--------------------- >> = end captured logging << ---------------------' =20 </error> =20 _______________________________________________ Devel mailing list Devel@ovirt.org <mailto:Devel@ovirt.org> http://lists.ovirt.org/mailman/listinfo/devel = <http://lists.ovirt.org/mailman/listinfo/devel> =20
--Apple-Mail=_05EACEC6-6E9B-4159-B8A0-B81CFDB2F32E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D""><br = class=3D""><div><br class=3D""><blockquote type=3D"cite" class=3D""><div = class=3D"">On 20 Mar 2018, at 10:33, Yaniv Kaul <<a = href=3D"mailto:ykaul@redhat.com" class=3D"">ykaul@redhat.com</a>> = wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><div = dir=3D"ltr" class=3D""><br class=3D""><div class=3D"gmail_extra"><br = class=3D""><div class=3D"gmail_quote">On Tue, Mar 20, 2018 at 9:49 AM, = Michal Skrivanek <span dir=3D"ltr" class=3D""><<a = href=3D"mailto:michal.skrivanek@redhat.com" target=3D"_blank" = class=3D"">michal.skrivanek@redhat.com</a>></span> wrote:<br = class=3D""><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 = .8ex;border-left:1px #ccc solid;padding-left:1ex"><div = style=3D"word-wrap:break-word;line-break:after-white-space" = class=3D"">I=E2=80=99m not sure what is that test actually testing, if = it depends on the previous host action which fails but is not verified = it still may be relevant to Shmuel=E2=80=99s patch<br class=3D"">adding = author of the test and the notifier owner</div></blockquote><div = class=3D""><br class=3D""></div><div class=3D"">It is checking that the = notifier works - which sends SNMP notifications on our events. I happen = to picked an event which is VDC_STOP - which happens when the engine is = restarted - which happens earlier, when we configure = it.</div></div></div></div></div></blockquote><div><br = class=3D""></div>not sure if that=E2=80=99s reliable then. Doesn=E2=80=99t= look related to that patch at all. Dafna, does the same error reproduce = all the time after that exact patch?</div><div><br class=3D""><blockquote = type=3D"cite" class=3D""><div class=3D""><div dir=3D"ltr" class=3D""><div = class=3D"gmail_extra"><div class=3D"gmail_quote"><div = class=3D"">Y.</div><div class=3D""> </div><blockquote = class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc = solid;padding-left:1ex"><div = style=3D"word-wrap:break-word;line-break:after-white-space" = class=3D""><div class=3D""><div class=3D""><br class=3D""><blockquote = type=3D"cite" class=3D""><div class=3D""><div class=3D"h5"><div = class=3D"">On 19 Mar 2018, at 13:06, Dafna Ron <<a = href=3D"mailto:dron@redhat.com" target=3D"_blank" = class=3D"">dron@redhat.com</a>> wrote:</div><br = class=3D"m_-7487643208740782214Apple-interchange-newline"></div></div><div= class=3D""><div class=3D""><div class=3D"h5"><div dir=3D"ltr" = class=3D""><div class=3D""><div class=3D"">Hi, <br class=3D""><br = class=3D""></div>We had a failure in test = 002_bootstrap.verify_notifier.<br class=3D""></div><div class=3D"">I = can't see anything wrong with the notifier and I don't think it should = be related to the change that was reported. <br class=3D""><br = class=3D""></div><div class=3D"">the test itself is looking for vdc_stop = in messages which I do not indeed see but I am not sure what is the = cause and how the reported change related to the failure. <br = class=3D""><br class=3D""></div><div class=3D"">Can you please take a = look? <br class=3D""><br class=3D""><br class=3D""><br = class=3D""></div><div class=3D""><b style=3D"font-weight:normal" = id=3D"m_-7487643208740782214gmail-docs-internal-guid-e8ba4241-3e25-14f2-44= 25-ad6f357e2e4a" class=3D""><div = style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" = class=3D""><span = style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon= t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-= caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a= lign:baseline;white-space:pre-wrap" class=3D"">Link and headline of = suspected patches: </span></div></b><b style=3D"font-weight:normal" = id=3D"m_-7487643208740782214gmail-docs-internal-guid-e8ba4241-3e25-14f2-44= 25-ad6f357e2e4a" class=3D"">core: USB in osinfo configuration depends on = chipset - <a href=3D"https://gerrit.ovirt.org/#/c/88777/" = target=3D"_blank" class=3D"">https://gerrit.ovirt.org/#/c/<wbr = class=3D"">88777/</a><br class=3D""><br class=3D""><div = style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" = class=3D""><span = style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon= t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-= caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a= lign:baseline;white-space:pre-wrap" class=3D"">Link to = Job:</span></div><a = href=3D"http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429= /" target=3D"_blank" class=3D"">http://jenkins.ovirt.org/job/<wbr = class=3D"">ovirt-master_change-queue-<wbr class=3D"">tester/6429/</a><br = class=3D""><br class=3D""><div = style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" = class=3D""><span = style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon= t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-= caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a= lign:baseline;white-space:pre-wrap" class=3D"">Link to all = logs:</span></div><a = href=3D"http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429= /artifacts" target=3D"_blank" class=3D"">http://jenkins.ovirt.org/job/<wbr= class=3D"">ovirt-master_change-queue-<wbr = class=3D"">tester/6429/artifacts</a><br class=3D""><br class=3D""><div = style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" = class=3D""><span = style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon= t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-= caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a= lign:baseline;white-space:pre-wrap" class=3D"">(Relevant) error snippet = from the log: </span></div><div = style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" = class=3D""><span = style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon= t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-= caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a= lign:baseline;white-space:pre-wrap" = class=3D""><error></span></div><br class=3D""></b></div><div = class=3D""><b style=3D"font-weight:normal" = id=3D"m_-7487643208740782214gmail-docs-internal-guid-e8ba4241-3e25-14f2-44= 25-ad6f357e2e4a" class=3D"">this is the error from </b><span = style=3D"font-weight:normal" class=3D"">the api: <br class=3D""><br = class=3D""></span><br class=3D""><h3 class=3D"">Error Message</h3><pre = class=3D"">Failed grep for VDC_STOP with code 1. Output:=20 -------------------- >> begin captured logging << = -------------------- lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-<wbr = class=3D"">17b0868725bc:Get ssh client for lago-basic-suite-master-<wbr = class=3D"">engine: lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-<wbr = class=3D"">17b0868725bc:Get ssh client for lago-basic-suite-master-<wbr = class=3D"">engine: lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-<wbr = class=3D"">engine: grep VDC_STOP /var/log/messages lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine = returned with 1 --------------------- >> end captured logging << = ---------------------</pre><h3 class=3D"">Stacktrace</h3><pre class=3D""> = File "/usr/lib64/python2.7/<wbr class=3D"">unittest/case.py", line 369, = in run testMethod() File "/usr/lib/python2.7/site-<wbr class=3D"">packages/nose/case.py", = line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-<wbr = class=3D"">packages/ovirtlago/testlib.py"<wbr class=3D"">, line 129, in = wrapped_test test() File "/usr/lib/python2.7/site-<wbr = class=3D"">packages/ovirtlago/testlib.py"<wbr class=3D"">, line 59, in = wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/<wbr = class=3D"">ovirt-master_change-queue-<wbr = class=3D"">tester/ovirt-system-tests/<wbr = class=3D"">basic-suite-master/test-<wbr = class=3D"">scenarios/002_bootstrap.py", line 1456, in verify_notifier 'Failed grep for VDC_STOP with code {0}. Output: = {1}'.format(result.code, result.out) File "/usr/lib/python2.7/site-<wbr = class=3D"">packages/nose/tools/trivial.<wbr class=3D"">py", line 29, in = eq_ raise AssertionError(msg or "%r !=3D %r" % (a, b)) 'Failed grep for VDC_STOP with code 1. Output: \n-------------------- = >> begin captured logging << --------------------\nlago.<wbr = class=3D"">ssh: DEBUG: start task:f1231b27-f796-406c-8618-<wbr = class=3D"">17b0868725bc:Get ssh client for lago-basic-suite-master-<wbr = class=3D"">engine:\nlago.ssh: DEBUG: end = task:f1231b27-f796-406c-8618-<wbr class=3D"">17b0868725bc:Get ssh client = for lago-basic-suite-master-<wbr class=3D"">engine:\nlago.ssh: DEBUG: = Running 1cce7c0c on lago-basic-suite-master-<wbr class=3D"">engine: grep = VDC_STOP /var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on = lago-basic-suite-master-engine returned with 1\n--------------------- = >> end captured logging << ---------------------'</pre><span = style=3D"font-weight:normal" class=3D""></span></div><div class=3D""><b = style=3D"font-weight:normal" = id=3D"m_-7487643208740782214gmail-docs-internal-guid-e8ba4241-3e25-14f2-44= 25-ad6f357e2e4a" class=3D""><br class=3D""><div = style=3D"line-height:1.38;margin-top:0pt;margin-bottom:0pt" = class=3D""><span = style=3D"font-size:11pt;font-family:Arial;background-color:transparent;fon= t-weight:400;font-style:normal;font-variant-ligatures:normal;font-variant-= caps:normal;font-variant-east-asian:normal;text-decoration:none;vertical-a= lign:baseline;white-space:pre-wrap" = class=3D""></error></span></div></b><br = class=3D"m_-7487643208740782214gmail-Apple-interchange-newline"></div></di= v></div></div> ______________________________<wbr class=3D"">_________________<br = class=3D"">Devel mailing list<br class=3D""><a = href=3D"mailto:Devel@ovirt.org" target=3D"_blank" = class=3D"">Devel@ovirt.org</a><br class=3D""><a = href=3D"http://lists.ovirt.org/mailman/listinfo/devel" target=3D"_blank" = class=3D"">http://lists.ovirt.org/<wbr = class=3D"">mailman/listinfo/devel</a></div></blockquote></div><br = class=3D""></div></div></blockquote></div><br class=3D""></div></div> </div></blockquote></div><br class=3D""></body></html>= --Apple-Mail=_05EACEC6-6E9B-4159-B8A0-B81CFDB2F32E--

The patch was reported to cause 3 different issues but I cannot say for sure that the notifier error was actually one of them. I can say that all issues from master and 4.2 were cleared once the fix from Shmuel was merged and tested in cq. On Wed, Mar 21, 2018 at 10:28 AM, Michal Skrivanek < michal.skrivanek@redhat.com> wrote:
On 20 Mar 2018, at 10:33, Yaniv Kaul <ykaul@redhat.com> wrote:
On Tue, Mar 20, 2018 at 9:49 AM, Michal Skrivanek < michal.skrivanek@redhat.com> wrote:
I’m not sure what is that test actually testing, if it depends on the previous host action which fails but is not verified it still may be relevant to Shmuel’s patch adding author of the test and the notifier owner
It is checking that the notifier works - which sends SNMP notifications on our events. I happen to picked an event which is VDC_STOP - which happens when the engine is restarted - which happens earlier, when we configure it.
not sure if that’s reliable then. Doesn’t look related to that patch at all. Dafna, does the same error reproduce all the time after that exact patch?
Y.
On 19 Mar 2018, at 13:06, Dafna Ron <dron@redhat.com> wrote:
Hi,
We had a failure in test 002_bootstrap.verify_notifier. I can't see anything wrong with the notifier and I don't think it should be related to the change that was reported.
the test itself is looking for vdc_stop in messages which I do not indeed see but I am not sure what is the cause and how the reported change related to the failure.
Can you please take a look?
*Link and headline of suspected patches: *
*core: USB in osinfo configuration depends on chipset - https://gerrit.ovirt.org/#/c/88777/ <https://gerrit.ovirt.org/#/c/88777/>Link to Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/>Link to all logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifacts <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6429/artifacts>(Relevant) error snippet from the log: <error>* *this is the error from *the api:
Error Message
Failed grep for VDC_STOP with code 1. Output: -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine: lago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: grep VDC_STOP /var/log/messages lago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine returned with 1 --------------------- >> end captured logging << ---------------------
Stacktrace
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 1456, in verify_notifier 'Failed grep for VDC_STOP with code {0}. Output: {1}'.format(result.code, result.out) File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_ raise AssertionError(msg or "%r != %r" % (a, b)) 'Failed grep for VDC_STOP with code 1. Output: \n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine:\nlago.ssh: DEBUG: end task:f1231b27-f796-406c-8618-17b0868725bc:Get ssh client for lago-basic-suite-master-engine:\nlago.ssh: DEBUG: Running 1cce7c0c on lago-basic-suite-master-engine: grep VDC_STOP /var/log/messages\nlago.ssh: DEBUG: Command 1cce7c0c on lago-basic-suite-master-engine returned with 1\n--------------------- >> end captured logging << ---------------------'
*</error>* _______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
participants (3)
-
Dafna Ron
-
Michal Skrivanek
-
Yaniv Kaul