[oVirt Jenkins] ovirt-system-tests_he-basic-suite-4.1 - Build # 218 - Failure!

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/218/ Build Number: 218 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:43578f7a-22ad-42d7-9ea9-509c2acda822:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:43578f7a-22ad-42d7-9ea9-509c2acda822:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 6b4bf9ac on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 6b4bf9ac on lago-he-basic-suite-4-1-host0 returned with 2 lago.ssh: DEBUG: Command 6b4bf9ac on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command 6b4bf9ac on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 1036, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:43578f7a-22ad-42d7-9ea9-509c2acda822:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: end task:43578f7a-22ad-42d7-9ea9-509c2acda822:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 6b4bf9ac on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log\nlago.ssh: DEBUG: Command 6b4bf9ac on lago-he-basic-suite-4-1-host0 returned with 2\nlago.ssh: DEBUG: Command 6b4bf9ac on lago-he-basic-suite-4-1-host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n\nlago.ssh: DEBUG: Command 6b4bf9ac on lago-he-basic-suite-4-1-host0 errors:\n grep: denied: No such file or directory\n\n--------------------- >> end captured logging << ---------------------"

------=_Part_300_127721959.1521249631337 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/2= 19/ Build Number: 219 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:c7a1e99f-c0a5-463f-9e99-5dd3c800df37:Get ssh cl= ient for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:c7a1e99f-c0a5-463f-9e99-5dd3c800df37:Get ssh clie= nt for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 53f068c8 on lago-he-basic-suite-4-1-host0: grep Pe= rmission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 53f068c8 on lago-he-basic-suite-4-1-host0 returned= with 2 lago.ssh: DEBUG: Command 53f068c8 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission d= enied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command 53f068c8 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt= -system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 103= 6, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << -----= ---------------\nlago.ssh: DEBUG: start task:c7a1e99f-c0a5-463f-9e99-5dd3c8= 00df37:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: = end task:c7a1e99f-c0a5-463f-9e99-5dd3c800df37:Get ssh client for lago-he-ba= sic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 53f068c8 on lago-he-basic-su= ite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent= .log\nlago.ssh: DEBUG: Command 53f068c8 on lago-he-basic-suite-4-1-host0 re= turned with 2\nlago.ssh: DEBUG: Command 53f068c8 on lago-he-basic-suite-4-1= -host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno = 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/= ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/v= ar/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/age= nt.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine= -ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13]= Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovi= rt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/= run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.= log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha= /vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Pe= rmission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-= hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run= /ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log= :IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm= .conf'\n\nlago.ssh: DEBUG: Command 53f068c8 on lago-he-basic-suite-4-1-host= 0 errors:\n grep: denied: No such file or directory\n\n-------------------= -- >> end captured logging << ---------------------" ------=_Part_300_127721959.1521249631337--

------=_Part_314_608512246.1521278366156 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/2= 20/ Build Number: 220 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any() ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:0d0347d2-472c-4040-94ba-7a817708c595:Get ssh cl= ient for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:0d0347d2-472c-4040-94ba-7a817708c595:Get ssh clie= nt for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 3bbddf04 on lago-he-basic-suite-4-1-host0: grep Pe= rmission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 3bbddf04 on lago-he-basic-suite-4-1-host0 returned= with 2 lago.ssh: DEBUG: Command 3bbddf04 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission d= enied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command 3bbddf04 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt= -system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 103= 6, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << -----= ---------------\nlago.ssh: DEBUG: start task:0d0347d2-472c-4040-94ba-7a8177= 08c595:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: = end task:0d0347d2-472c-4040-94ba-7a817708c595:Get ssh client for lago-he-ba= sic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 3bbddf04 on lago-he-basic-su= ite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent= .log\nlago.ssh: DEBUG: Command 3bbddf04 on lago-he-basic-suite-4-1-host0 re= turned with 2\nlago.ssh: DEBUG: Command 3bbddf04 on lago-he-basic-suite-4-1= -host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno = 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/= ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/v= ar/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/age= nt.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine= -ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13]= Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovi= rt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/= run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.= log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha= /vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Pe= rmission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-= hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run= /ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log= :IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm= .conf'\n\nlago.ssh: DEBUG: Command 3bbddf04 on lago-he-basic-suite-4-1-host= 0 errors:\n grep: denied: No such file or directory\n\n-------------------= -- >> end captured logging << ---------------------" ------=_Part_314_608512246.1521278366156--

------=_Part_324_395650805.1521307218638 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/2= 21/ Build Number: 221 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any() ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:dd7759ff-8a4a-43b5-b773-b6bc1ba81d67:Get ssh cl= ient for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:dd7759ff-8a4a-43b5-b773-b6bc1ba81d67:Get ssh clie= nt for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 68af0a0e on lago-he-basic-suite-4-1-host0: grep Pe= rmission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 68af0a0e on lago-he-basic-suite-4-1-host0 returned= with 2 lago.ssh: DEBUG: Command 68af0a0e on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission d= enied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command 68af0a0e on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt= -system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 103= 6, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << -----= ---------------\nlago.ssh: DEBUG: start task:dd7759ff-8a4a-43b5-b773-b6bc1b= a81d67:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: = end task:dd7759ff-8a4a-43b5-b773-b6bc1ba81d67:Get ssh client for lago-he-ba= sic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 68af0a0e on lago-he-basic-su= ite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent= .log\nlago.ssh: DEBUG: Command 68af0a0e on lago-he-basic-suite-4-1-host0 re= turned with 2\nlago.ssh: DEBUG: Command 68af0a0e on lago-he-basic-suite-4-1= -host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno = 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/= ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/v= ar/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/age= nt.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine= -ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13]= Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovi= rt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/= run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.= log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha= /vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Pe= rmission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-= hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run= /ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log= :IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm= .conf'\n\nlago.ssh: DEBUG: Command 68af0a0e on lago-he-basic-suite-4-1-host= 0 errors:\n grep: denied: No such file or directory\n\n-------------------= -- >> end captured logging << ---------------------" ------=_Part_324_395650805.1521307218638--

------=_Part_334_256946378.1521335995547 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/2= 22/ Build Number: 222 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any() ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:2cfa7de3-aecf-4af2-ae1e-c7f27a348411:Get ssh cl= ient for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:2cfa7de3-aecf-4af2-ae1e-c7f27a348411:Get ssh clie= nt for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 69445bca on lago-he-basic-suite-4-1-host0: grep Pe= rmission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 69445bca on lago-he-basic-suite-4-1-host0 returned= with 2 lago.ssh: DEBUG: Command 69445bca on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission d= enied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command 69445bca on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt= -system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 103= 6, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << -----= ---------------\nlago.ssh: DEBUG: start task:2cfa7de3-aecf-4af2-ae1e-c7f27a= 348411:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: = end task:2cfa7de3-aecf-4af2-ae1e-c7f27a348411:Get ssh client for lago-he-ba= sic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 69445bca on lago-he-basic-su= ite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent= .log\nlago.ssh: DEBUG: Command 69445bca on lago-he-basic-suite-4-1-host0 re= turned with 2\nlago.ssh: DEBUG: Command 69445bca on lago-he-basic-suite-4-1= -host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno = 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/= ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/v= ar/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/age= nt.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine= -ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13]= Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovi= rt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/= run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.= log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha= /vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Pe= rmission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-= hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run= /ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log= :IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm= .conf'\n\nlago.ssh: DEBUG: Command 69445bca on lago-he-basic-suite-4-1-host= 0 errors:\n grep: denied: No such file or directory\n\n-------------------= -- >> end captured logging << ---------------------" ------=_Part_334_256946378.1521335995547--

------=_Part_344_1764479154.1521364806813 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/2= 23/ Build Number: 223 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any() ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh cl= ient for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh clie= nt for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Pe= rmission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned= with 2 lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission d= enied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt= -system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 103= 6, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << -----= ---------------\nlago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c= 0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: = end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-ba= sic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-su= ite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent= .log\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 re= turned with 2\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1= -host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno = 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/= ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/v= ar/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/age= nt.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine= -ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13]= Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovi= rt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/= run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.= log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha= /vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Pe= rmission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-= hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run= /ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log= :IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm= .conf'\n\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host= 0 errors:\n grep: denied: No such file or directory\n\n-------------------= -- >> end captured logging << ---------------------" ------=_Part_344_1764479154.1521364806813--

On Sun, Mar 18, 2018 at 11:20 AM, <jenkins@jenkins.phx.ovirt.org> wrote:
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/223/ Build Number: 223 Build Status: Still Failing Triggered By: Started by timer
It was broken by: [1] https://gerrit.ovirt.org/88483 It should be fixed by: [2] https://bugzilla.redhat.com/show_bug.cgi?id=1554283 [2] is on modified, no idea about its status other than that. I didn't intend to merge [1] before [2] is fixed, not sure if Sandro didn't notice my comment there, or thought that [2] is fixed. If it's annoying we can revert [1] and re-merge when [2] is fixed.
------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any()
----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent
Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned with 2 lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'
lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 1036, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned with 2\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors:\n grep: denied: No such file or directory\n\n--------------------- >> end captured logging << ---------------------"
-- Didi

On Sun, Mar 18, 2018 at 1:45 PM, Yedidyah Bar David <didi@redhat.com> wrote:
On Sun, Mar 18, 2018 at 11:20 AM, <jenkins@jenkins.phx.ovirt.org> wrote:
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/223/ Build Number: 223 Build Status: Still Failing Triggered By: Started by timer
It was broken by:
[1] https://gerrit.ovirt.org/88483
It should be fixed by:
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1554283
[2] is on modified, no idea about its status other than that.
I didn't intend to merge [1] before [2] is fixed, not sure if Sandro didn't notice my comment there, or thought that [2] is fixed.
If it's annoying we can revert [1] and re-merge when [2] is fixed.
Talked with Gal, and pushed this, which should hopefully fix: https://gerrit.ovirt.org/89136
------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any()
----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent
Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned with 2 lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'
lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 1036, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned with 2\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors:\n grep: denied: No such file or directory\n\n--------------------- >> end captured logging << ---------------------"
-- Didi
-- Didi

On Sun, Mar 18, 2018 at 2:48 PM, Yedidyah Bar David <didi@redhat.com> wrote:
On Sun, Mar 18, 2018 at 1:45 PM, Yedidyah Bar David <didi@redhat.com> wrote:
On Sun, Mar 18, 2018 at 11:20 AM, <jenkins@jenkins.phx.ovirt.org> wrote:
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/223/ Build Number: 223 Build Status: Still Failing Triggered By: Started by timer
It was broken by:
[1] https://gerrit.ovirt.org/88483
It should be fixed by:
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1554283
[2] is on modified, no idea about its status other than that.
I didn't intend to merge [1] before [2] is fixed, not sure if Sandro didn't notice my comment there, or thought that [2] is fixed.
If it's annoying we can revert [1] and re-merge when [2] is fixed.
Talked with Gal, and pushed this, which should hopefully fix:
It indeed seems to fix [1][2]: 13:13:24 # he_get_shared_config: 13:13:26 # he_get_shared_config: Success (in 0:00:01) 13:13:26 # sleep: 13:15:26 # sleep: Success (in 0:02:00) 13:15:26 # add_he_hosts: 13:16:18 # add_he_hosts: Success (in 0:00:52) 13:16:18 # he_check_ha_agent: 13:16:19 # he_check_ha_agent: Success (in 0:00:00) But later fails: 13:16:20 # add_secondary_storage_domains: 13:19:30 Error while running thread 13:19:30 Traceback (most recent call last): 13:19:30 File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue 13:19:30 queue.put({'return': func()}) 13:19:30 File "/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 491, in add_nfs_storage_domain 13:19:30 add_generic_nfs_storage_domain(prefix, SD_NFS_NAME, SD_NFS_HOST_NAME, SD_NFS_PATH) 13:19:30 File "/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 496, in add_generic_nfs_storage_domain 13:19:30 add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version) 13:19:30 File "/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 552, in add_generic_nfs_storage_domain_4 13:19:30 _add_storage_domain_4(api, p) 13:19:30 File "/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 466, in _add_storage_domain_4 13:19:30 id=sd.id, 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 2219, in add 13:19:30 return self._internal_add(storage_domain, headers, query, wait) 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 223, in _internal_add 13:19:30 return future.wait() if wait else future 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 53, in wait 13:19:30 return self._code(response) 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 220, in callback 13:19:30 self._check_fault(response) 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 123, in _check_fault 13:19:30 self._raise_error(response, body) 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 109, in _raise_error 13:19:30 raise error 13:19:30 Error: Fault reason is "Operation Failed". Fault detail is "[Storage domain cannot be reached. Please ensure it is accessible from the host(s).]". HTTP response code is 400. 13:19:30 Error while running thread I'll retrigger now, but perhaps someone from storage wants to check. vdsm log has[3]: 2018-03-18 08:59:52,918-0400 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getHardwareInfo succeeded in 0.00 seconds (__init__:539) 2018-03-18 08:59:52,924-0400 INFO (jsonrpc/4) [vdsm.api] START prepareImage(sdUUID=u'424e809d-b7ad-4ed5-b6a1-5426d373a5d2', spUUID=u'8509c64f-cdd7-4713-9e09-a79d90ba26ed', imgUUID=u'718090ba-b36e-45cc-bcd6-597c16a766b9', leafUUID=u'23ee843b-20e0-4afe-98dc-e165334ac710', allowIllegal=False) from=::1,36020, task_id=92aeabf2-084a-4c98-a6e5-03efae38e7b3 (api:46) 2018-03-18 08:59:52,928-0400 INFO (jsonrpc/4) [vdsm.api] FINISH prepareImage error=Volume does not exist: (u'23ee843b-20e0-4afe-98dc-e165334ac710',) from=::1,36020, task_id=92aeabf2-084a-4c98-a6e5-03efae38e7b3 (api:50) 2018-03-18 08:59:52,928-0400 ERROR (jsonrpc/4) [storage.TaskManager.Task] (Task='92aeabf2-084a-4c98-a6e5-03efae38e7b3') Unexpected error (task:872) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 879, in _run return fn(*args, **kargs) File "<string>", line 2, in prepareImage File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method ret = func(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 3137, in prepareImage raise se.VolumeDoesNotExist(leafUUID) VolumeDoesNotExist: Volume does not exist: (u'23ee843b-20e0-4afe-98dc-e165334ac710',) [1] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_6... [2] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_6... [3] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_6...
------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any()
----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent
Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned with 2 lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'
lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 1036, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned with 2\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors:\n grep: denied: No such file or directory\n\n--------------------- >> end captured logging << ---------------------"
-- Didi
-- Didi
-- Didi

On Sun, Mar 18, 2018 at 4:21 PM Yedidyah Bar David <didi@redhat.com> wrote:
On Sun, Mar 18, 2018 at 2:48 PM, Yedidyah Bar David <didi@redhat.com> wrote:
On Sun, Mar 18, 2018 at 1:45 PM, Yedidyah Bar David <didi@redhat.com> wrote:
On Sun, Mar 18, 2018 at 11:20 AM, <jenkins@jenkins.phx.ovirt.org> wrote:
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/223/ Build Number: 223 Build Status: Still Failing Triggered By: Started by timer
It was broken by:
[1] https://gerrit.ovirt.org/88483
It should be fixed by:
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1554283
[2] is on modified, no idea about its status other than that.
I didn't intend to merge [1] before [2] is fixed, not sure if Sandro didn't notice my comment there, or thought that [2] is fixed.
If it's annoying we can revert [1] and re-merge when [2] is fixed.
Talked with Gal, and pushed this, which should hopefully fix:
It indeed seems to fix [1][2]:
13:13:24 # he_get_shared_config: 13:13:26 # he_get_shared_config: Success (in 0:00:01) 13:13:26 # sleep: 13:15:26 # sleep: Success (in 0:02:00) 13:15:26 # add_he_hosts: 13:16:18 # add_he_hosts: Success (in 0:00:52) 13:16:18 # he_check_ha_agent: 13:16:19 # he_check_ha_agent: Success (in 0:00:00)
But later fails:
13:16:20 # add_secondary_storage_domains: 13:19:30 Error while running thread 13:19:30 Traceback (most recent call last): 13:19:30 File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue 13:19:30 queue.put({'return': func()}) 13:19:30 File
"/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 491, in add_nfs_storage_domain 13:19:30 add_generic_nfs_storage_domain(prefix, SD_NFS_NAME, SD_NFS_HOST_NAME, SD_NFS_PATH) 13:19:30 File
"/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 496, in add_generic_nfs_storage_domain 13:19:30 add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version) 13:19:30 File
"/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 552, in add_generic_nfs_storage_domain_4 13:19:30 _add_storage_domain_4(api, p) 13:19:30 File
"/home/jenkins/workspace/ovirt-system-tests_master_check-patch-el7-x86_64/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 466, in _add_storage_domain_4 13:19:30 id=sd.id, 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 2219, in add 13:19:30 return self._internal_add(storage_domain, headers, query, wait) 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 223, in _internal_add 13:19:30 return future.wait() if wait else future 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 53, in wait 13:19:30 return self._code(response) 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 220, in callback 13:19:30 self._check_fault(response) 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 123, in _check_fault 13:19:30 self._raise_error(response, body) 13:19:30 File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 109, in _raise_error 13:19:30 raise error 13:19:30 Error: Fault reason is "Operation Failed". Fault detail is "[Storage domain cannot be reached. Please ensure it is accessible from the host(s).]". HTTP response code is 400. 13:19:30 Error while running thread
I'll retrigger now, but perhaps someone from storage wants to check. vdsm log has[3]:
2018-03-18 08:59:52,918-0400 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getHardwareInfo succeeded in 0.00 seconds (__init__:539) 2018-03-18 08:59:52,924-0400 INFO (jsonrpc/4) [vdsm.api] START prepareImage(sdUUID=u'424e809d-b7ad-4ed5-b6a1-5426d373a5d2', spUUID=u'8509c64f-cdd7-4713-9e09-a79d90ba26ed', imgUUID=u'718090ba-b36e-45cc-bcd6-597c16a766b9', leafUUID=u'23ee843b-20e0-4afe-98dc-e165334ac710', allowIllegal=False) from=::1,36020, task_id=92aeabf2-084a-4c98-a6e5-03efae38e7b3 (api:46) 2018-03-18 08:59:52,928-0400 INFO (jsonrpc/4) [vdsm.api] FINISH prepareImage error=Volume does not exist: (u'23ee843b-20e0-4afe-98dc-e165334ac710',) from=::1,36020, task_id=92aeabf2-084a-4c98-a6e5-03efae38e7b3 (api:50) 2018-03-18 08:59:52,928-0400 ERROR (jsonrpc/4) [storage.TaskManager.Task] (Task='92aeabf2-084a-4c98-a6e5-03efae38e7b3') Unexpected error (task:872) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 879, in _run return fn(*args, **kargs) File "<string>", line 2, in prepareImage File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method ret = func(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 3137, in prepareImage raise se.VolumeDoesNotExist(leafUUID) VolumeDoesNotExist: Volume does not exist: (u'23ee843b-20e0-4afe-98dc-e165334ac710',)
Immediately after this failed prepare, we see: 2018-03-18 08:59:52,941-0400 INFO (jsonrpc/7) [vdsm.api] START createVolume(sdUUID=u'424e809d-b7ad-4ed5-b6a1-5426d373a5d2', spUUID=u'8509c64f-cdd7-4713-9e09-a79d90ba26ed', imgUUID=u'718090ba-b36e-45cc-bcd6-597c16a766b9', size=u'1048576', volFormat=5, preallocate=1, diskType=2, volUUID=u'23ee843b-20e0-4afe-98dc-e165334ac710', desc=u'hosted-engine.lockspace', srcImgUUID=u'00000000-0000-0000-0000-000000000000', srcVolUUID=u'00000000-0000-0000-0000-000000000000', initialSize=None) from=::1,36020, task_id=c4c73314-ee10-419a-8265-b8b87763e99f (api:46) So that volume really did not exit when it was prepared, which means it is a client error, not vdsm error. The caller (hosted engine agent?) should use Volume.getInfo to check if a volume exits. Non existing volume is considered expected error in this call and will be logged as with INFO log level. See https://github.com/oVirt/vdsm/blob/f286cf7825578d8997ca6abc0801a823dee247ef/...
[1] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_6... [2] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_6... [3] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_6...
------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any()
Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any()
----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent
Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get
lago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned with 2 lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'
lago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt-system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py",
ssh client for lago-he-basic-suite-4-1-host0: line 1036, in he_check_ha_agent
'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging <<
--------------------\nlago.ssh: DEBUG: start task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: end task:cb75d7f3-e333-47f1-b3e9-76ff9c0b4b21:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 7e67a956 on lago-he-basic-suite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent.log\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 returned with 2\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf '\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n\nlago.ssh: DEBUG: Command 7e67a956 on lago-he-basic-suite-4-1-host0 errors:\n grep: denied: No such file or directory\n\n--------------------- >> end captured logging << ---------------------"
-- Didi
-- Didi
-- Didi _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra

------=_Part_354_982316722.1521393631490 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/2= 24/ Build Number: 224 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #224 [Martin Sivak] Cleanup of test code - next() replaced with any() [Daniel Belenky] Remove fc25 jobs [Daniel Belenky] Remove fc24 packages ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:573d40d1-4e9d-4d21-973a-801e4d899e07:Get ssh cl= ient for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:573d40d1-4e9d-4d21-973a-801e4d899e07:Get ssh clie= nt for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running 9af2a420 on lago-he-basic-suite-4-1-host0: grep Pe= rmission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command 9af2a420 on lago-he-basic-suite-4-1-host0 returned= with 2 lago.ssh: DEBUG: Command 9af2a420 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission d= enied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command 9af2a420 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt= -system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 103= 6, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << -----= ---------------\nlago.ssh: DEBUG: start task:573d40d1-4e9d-4d21-973a-801e4d= 899e07:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: = end task:573d40d1-4e9d-4d21-973a-801e4d899e07:Get ssh client for lago-he-ba= sic-suite-4-1-host0:\nlago.ssh: DEBUG: Running 9af2a420 on lago-he-basic-su= ite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent= .log\nlago.ssh: DEBUG: Command 9af2a420 on lago-he-basic-suite-4-1-host0 re= turned with 2\nlago.ssh: DEBUG: Command 9af2a420 on lago-he-basic-suite-4-1= -host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno = 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/= ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/v= ar/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/age= nt.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine= -ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13]= Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovi= rt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/= run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.= log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha= /vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Pe= rmission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-= hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run= /ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log= :IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm= .conf'\n\nlago.ssh: DEBUG: Command 9af2a420 on lago-he-basic-suite-4-1-host= 0 errors:\n grep: denied: No such file or directory\n\n-------------------= -- >> end captured logging << ---------------------" ------=_Part_354_982316722.1521393631490--

------=_Part_364_524752017.1521422430692 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/2= 25/ Build Number: 225 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #224 [Martin Sivak] Cleanup of test code - next() replaced with any() [Daniel Belenky] Remove fc25 jobs [Daniel Belenky] Remove fc24 packages Changes for Build #225 [Martin Sivak] Cleanup of test code - next() replaced with any() ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:9ee8055d-796e-4b25-ab58-8ae7c7fc3e82:Get ssh cl= ient for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:9ee8055d-796e-4b25-ab58-8ae7c7fc3e82:Get ssh clie= nt for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running a8cdcb5e on lago-he-basic-suite-4-1-host0: grep Pe= rmission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command a8cdcb5e on lago-he-basic-suite-4-1-host0 returned= with 2 lago.ssh: DEBUG: Command a8cdcb5e on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission d= enied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command a8cdcb5e on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt= -system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 103= 6, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << -----= ---------------\nlago.ssh: DEBUG: start task:9ee8055d-796e-4b25-ab58-8ae7c7= fc3e82:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: = end task:9ee8055d-796e-4b25-ab58-8ae7c7fc3e82:Get ssh client for lago-he-ba= sic-suite-4-1-host0:\nlago.ssh: DEBUG: Running a8cdcb5e on lago-he-basic-su= ite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent= .log\nlago.ssh: DEBUG: Command a8cdcb5e on lago-he-basic-suite-4-1-host0 re= turned with 2\nlago.ssh: DEBUG: Command a8cdcb5e on lago-he-basic-suite-4-1= -host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno = 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/= ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/v= ar/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/age= nt.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine= -ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13]= Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovi= rt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/= run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.= log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha= /vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Pe= rmission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-= hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run= /ovirt-hosted-engine-ha/vm.conf'\n\nlago.ssh: DEBUG: Command a8cdcb5e on la= go-he-basic-suite-4-1-host0 errors:\n grep: denied: No such file or direct= ory\n\n--------------------- >> end captured logging << -------------------= --" ------=_Part_364_524752017.1521422430692--

------=_Part_371_201907804.1521451343451 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/2= 26/ Build Number: 226 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #224 [Martin Sivak] Cleanup of test code - next() replaced with any() [Daniel Belenky] Remove fc25 jobs [Daniel Belenky] Remove fc24 packages Changes for Build #225 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #226 [Martin Sivak] Cleanup of test code - next() replaced with any() [Daniel Belenky] Align standard-stage with normalized DSL output [Daniel Belenky] Add python-pluggy to .packages ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.he_check_ha_agent Error Message: False is not true -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:af290335-000e-4c52-a1b1-ab784c002193:Get ssh cl= ient for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: end task:af290335-000e-4c52-a1b1-ab784c002193:Get ssh clie= nt for lago-he-basic-suite-4-1-host0: lago.ssh: DEBUG: Running f993e846 on lago-he-basic-suite-4-1-host0: grep Pe= rmission denied /var/log/ovirt-hosted-engine-ha/agent.log lago.ssh: DEBUG: Command f993e846 on lago-he-basic-suite-4-1-host0 returned= with 2 lago.ssh: DEBUG: Command f993e846 on lago-he-basic-suite-4-1-host0 output: /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission d= enied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission de= nied: '/var/run/ovirt-hosted-engine-ha/vm.conf' lago.ssh: DEBUG: Command f993e846 on lago-he-basic-suite-4-1-host0 errors: grep: denied: No such file or directory --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.1/ovirt= -system-tests/he-basic-suite-4.1/test-scenarios/002_bootstrap.py", line 103= 6, in he_check_ha_agent 'Permission denied' not in result.out File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue raise self.failureException(msg) "False is not true\n-------------------- >> begin captured logging << -----= ---------------\nlago.ssh: DEBUG: start task:af290335-000e-4c52-a1b1-ab784c= 002193:Get ssh client for lago-he-basic-suite-4-1-host0:\nlago.ssh: DEBUG: = end task:af290335-000e-4c52-a1b1-ab784c002193:Get ssh client for lago-he-ba= sic-suite-4-1-host0:\nlago.ssh: DEBUG: Running f993e846 on lago-he-basic-su= ite-4-1-host0: grep Permission denied /var/log/ovirt-hosted-engine-ha/agent= .log\nlago.ssh: DEBUG: Command f993e846 on lago-he-basic-suite-4-1-host0 re= turned with 2\nlago.ssh: DEBUG: Command f993e846 on lago-he-basic-suite-4-1= -host0 output:\n /var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno = 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/= ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/v= ar/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/age= nt.log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine= -ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13]= Permission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovi= rt-hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/= run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.= log:IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha= /vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log:IOError: [Errno 13] Pe= rmission denied: '/var/run/ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-= hosted-engine-ha/agent.log:IOError: [Errno 13] Permission denied: '/var/run= /ovirt-hosted-engine-ha/vm.conf'\n/var/log/ovirt-hosted-engine-ha/agent.log= :IOError: [Errno 13] Permission denied: '/var/run/ovirt-hosted-engine-ha/vm= .conf'\n\nlago.ssh: DEBUG: Command f993e846 on lago-he-basic-suite-4-1-host= 0 errors:\n grep: denied: No such file or directory\n\n-------------------= -- >> end captured logging << ---------------------" ------=_Part_371_201907804.1521451343451--

------=_Part_378_1404650523.1521458221054 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.1/227/ Build Number: 227 Build Status: Fixed Triggered By: Started by user Sandro Bonazzola ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #218 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #219 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #220 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #221 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #222 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #223 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #224 [Martin Sivak] Cleanup of test code - next() replaced with any() [Daniel Belenky] Remove fc25 jobs [Daniel Belenky] Remove fc24 packages Changes for Build #225 [Martin Sivak] Cleanup of test code - next() replaced with any() Changes for Build #226 [Martin Sivak] Cleanup of test code - next() replaced with any() [Daniel Belenky] Align standard-stage with normalized DSL output [Daniel Belenky] Add python-pluggy to .packages Changes for Build #227 [Yedidyah Bar David] he-basic-suite-4.1: Use 4.1-snapshot ----------------- Failed Tests: ----------------- All tests passed ------=_Part_378_1404650523.1521458221054--
participants (3)
-
jenkins@jenkins.phx.ovirt.org
-
Nir Soffer
-
Yedidyah Bar David