[oVirt Jenkins] ovirt-system-tests_he-basic-suite-master - Build #
743 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/743/
Build Number: 743
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #743
[Milan Zamazal] ovf_import test
[Eyal Edri] adding kubevirt/containerized-data-importer to stdci v2
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 002_bootstrap.add_he_hosts
Error Message:
Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.
-------------------- >> begin captured logging << --------------------
lago.utils: ERROR: Error while running thread
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4
deploy_hosted_engine=True,
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11530, in add
return self._internal_add(host, headers, query, wait)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add
return future.wait() if wait else future
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait
return self._code(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback
self._check_fault(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault
self._raise_error(response, body)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error
raise error
Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 358, in add_he_hosts
add_he_hosts_4(prefix)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 400, in add_he_hosts_4
nt.assert_true(all(vt.join_all()))
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4
deploy_hosted_engine=True,
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11530, in add
return self._internal_add(host, headers, query, wait)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add
return future.wait() if wait else future
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait
return self._code(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback
self._check_fault(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault
self._raise_error(response, body)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error
raise error
'Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.\n-------------------- >> begin captured logging << --------------------\nlago.utils: ERROR: Error while running thread\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4\n deploy_hosted_engine=True,\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11530, in add\n return self._internal_add(host, headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault\n self._raise_error(response, body)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error\n raise error\nError: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.\n--------------------- >> end captured logging << ---------------------'
6 years
[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-4.2 - Build
# 269 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/...
Build Number: 269
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #269
[Anton Marchukov] Removed /root/fluentd from collected artifacts.
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 002_bootstrap.add_he_hosts
Error Message:
Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.
-------------------- >> begin captured logging << --------------------
lago.utils: ERROR: Error while running thread
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4
deploy_hosted_engine=True,
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11615, in add
return self._internal_add(host, headers, query, wait)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add
return future.wait() if wait else future
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait
return self._code(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback
self._check_fault(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault
self._raise_error(response, body)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error
raise error
Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/002_bootstrap.py", line 358, in add_he_hosts
add_he_hosts_4(prefix)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/002_bootstrap.py", line 400, in add_he_hosts_4
nt.assert_true(all(vt.join_all()))
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4
deploy_hosted_engine=True,
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11615, in add
return self._internal_add(host, headers, query, wait)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add
return future.wait() if wait else future
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait
return self._code(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback
self._check_fault(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault
self._raise_error(response, body)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error
raise error
'Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.\n-------------------- >> begin captured logging << --------------------\nlago.utils: ERROR: Error while running thread\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4\n deploy_hosted_engine=True,\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11615, in add\n return self._internal_add(host, headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault\n self._raise_error(response, body)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error\n raise error\nError: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.\n--------------------- >> end captured logging << ---------------------'
6 years
[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-master -
Build # 469 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-master/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-mast...
Build Number: 469
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #469
[Milan Zamazal] ovf_import test
[Eyal Edri] adding kubevirt/containerized-data-importer to stdci v2
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 002_bootstrap.add_he_hosts
Error Message:
Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.
-------------------- >> begin captured logging << --------------------
lago.utils: ERROR: Error while running thread
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4
deploy_hosted_engine=True,
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11530, in add
return self._internal_add(host, headers, query, wait)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add
return future.wait() if wait else future
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait
return self._code(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback
self._check_fault(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault
self._raise_error(response, body)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error
raise error
Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 358, in add_he_hosts
add_he_hosts_4(prefix)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 400, in add_he_hosts_4
nt.assert_true(all(vt.join_all()))
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4
deploy_hosted_engine=True,
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11530, in add
return self._internal_add(host, headers, query, wait)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add
return future.wait() if wait else future
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait
return self._code(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback
self._check_fault(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault
self._raise_error(response, body)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error
raise error
'Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.\n-------------------- >> begin captured logging << --------------------\nlago.utils: ERROR: Error while running thread\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4\n deploy_hosted_engine=True,\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11530, in add\n return self._internal_add(host, headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault\n self._raise_error(response, body)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error\n raise error\nError: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.\n--------------------- >> end captured logging << ---------------------'
6 years
[oVirt Jenkins] ovirt-system-tests_he-basic-suite-4.2 - Build # 526
- Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.2/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.2/526/
Build Number: 526
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #526
[Anton Marchukov] Removed /root/fluentd from collected artifacts.
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 002_bootstrap.add_he_hosts
Error Message:
Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.
-------------------- >> begin captured logging << --------------------
lago.utils: ERROR: Error while running thread
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.2/ovirt-system-tests/he-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4
deploy_hosted_engine=True,
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11615, in add
return self._internal_add(host, headers, query, wait)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add
return future.wait() if wait else future
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait
return self._code(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback
self._check_fault(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault
self._raise_error(response, body)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error
raise error
Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.2/ovirt-system-tests/he-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 358, in add_he_hosts
add_he_hosts_4(prefix)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.2/ovirt-system-tests/he-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 400, in add_he_hosts_4
nt.assert_true(all(vt.join_all()))
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.2/ovirt-system-tests/he-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4
deploy_hosted_engine=True,
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11615, in add
return self._internal_add(host, headers, query, wait)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add
return future.wait() if wait else future
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait
return self._code(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback
self._check_fault(response)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault
self._raise_error(response, body)
File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error
raise error
'Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.\n-------------------- >> begin captured logging << --------------------\nlago.utils: ERROR: Error while running thread\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-4.2/ovirt-system-tests/he-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 379, in _add_he_host_4\n deploy_hosted_engine=True,\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 11615, in add\n return self._internal_add(host, headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault\n self._raise_error(response, body)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error\n raise error\nError: Fault reason is "Operation Failed". Fault detail is "[Cannot add Host. You are using an unmanaged hosted engine VM. Please add the first storage domain in order to start the hosted engine import process.]". HTTP response code is 409.\n--------------------- >> end captured logging << ---------------------'
6 years
[oVirt Jenkins] ovirt-system-tests_compat-3.6-suite-master - Build
# 23 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-3.6-suite-master/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-3.6-suite-master/23/
Build Number: 23
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #23
[Gal Ben Haim] compat: Set "ex" bash flags
[Daniel Belenky] Move Git specific code from pusher.py
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 004_basic_sanity.verify_backup_snapshot_removed_36
Error Message:
False != True after 600 seconds
Stack Trace:
Traceback (most recent call last):
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 78, in wrapper
prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs
File "/home/jenkins/workspace/ovirt-system-tests_compat-3.6-suite-master/ovirt-system-tests/compat-3.6-suite-master/test-scenarios/004_basic_sanity.py", line 327, in verify_backup_snapshot_removed
lambda: len(vm2_snapshots_service.list()) == 1
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 271, in assert_true_within_long
assert_equals_within_long(func, True, allowed_exceptions)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 258, in assert_equals_within_long
func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 237, in assert_equals_within
'%s != %s after %s seconds' % (res, value, timeout)
AssertionError: False != True after 600 seconds
6 years, 1 month
[oVirt Jenkins] ovirt-system-tests_compat-4.1-suite-master - Build
# 13 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.1-suite-master/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.1-suite-master/13/
Build Number: 13
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #13
[Gal Ben Haim] compat: Set "ex" bash flags
[Daniel Belenky] dsl: add runtimereqs normalization
[Daniel Belenky] Add support for dsl's isolation to label selection
[Daniel Belenky] Run poll upstream sources @midnight
[Barak Korren] Add compat suits to OST manual job selection
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 002_bootstrap.list_glance_images_41
Error Message:
global name 'list_glance_images_4' is not defined
Stack Trace:
Traceback (most recent call last):
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 78, in wrapper
prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs
File "/home/jenkins/workspace/ovirt-system-tests_compat-4.1-suite-master/ovirt-system-tests/compat-4.1-suite-master/test-scenarios/002_bootstrap.py", line 633, in list_glance_images
raise SkipTest('%s: GLANCE connectivity test failed' % list_glance_images_4.__name__ )
NameError: global name 'list_glance_images_4' is not defined
6 years, 1 month
[oVirt Jenkins] ovirt-system-tests_compat-4.0-suite-master - Build
# 13 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.0-suite-master/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.0-suite-master/13/
Build Number: 13
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #13
[Gal Ben Haim] compat: Set "ex" bash flags
[Daniel Belenky] dsl: add runtimereqs normalization
[Daniel Belenky] Add support for dsl's isolation to label selection
[Daniel Belenky] Run poll upstream sources @midnight
[Barak Korren] Add compat suits to OST manual job selection
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 002_bootstrap.list_glance_images_40
Error Message:
global name 'list_glance_images_4' is not defined
Stack Trace:
Traceback (most recent call last):
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 78, in wrapper
prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs
File "/home/jenkins/workspace/ovirt-system-tests_compat-4.0-suite-master/ovirt-system-tests/compat-4.0-suite-master/test-scenarios/002_bootstrap.py", line 633, in list_glance_images
raise SkipTest('%s: GLANCE connectivity test failed' % list_glance_images_4.__name__ )
NameError: global name 'list_glance_images_4' is not defined
6 years, 1 month
[ OST Failure Report ] [ oVirt Master (ovirt-engine) ] [ 14-09-2018 ]
[ 002_bootstrap.add_hosts ]
by Dafna Ron
Hi,
The previous regression was resolved and we now have a new regression.
I don't think that the reported change is related so can someone from
ovirt-engine take a look?
The failure is add host on the upgrade suite.
Please note that we have not had an engine-ovirt build for over 10 days due
to several consecutive regressions and I would ask you to stop merging
until we can stabilize the project and have a new package of engine.
error:
2018-09-14 05:51:07,670-04 INFO
[org.ovirt.engine.core.uutils.ssh.SSHDialog]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] SSH execute
'root@lago-upgrade-from-release-suite-master-host-0' 'umask 0077;
MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap
"chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" >
/dev/null 2>&1" 0; tar -b1 --warning=no-timestamp -C "${MYTMP}" -x &&
"${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine
DIALOG/customization=bool:True'
2018-09-14 05:51:08,550-04 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(VdsDeploy) [5c91fcbd] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing
Host lago-upgrade-from-release-suite-master-host-0. Stage: Initializing.
2018-09-14 05:51:08,565-04 INFO
[org.ovirt.engine.core.utils.transaction.TransactionSupport] (VdsDeploy)
[5c91fcbd] transaction rolled back
2018-09-14 05:51:08,574-04 ERROR
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [5c91fcbd]
Error during deploy dialog
2018-09-14 05:51:08,578-04 ERROR
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Error during host
lago-upgrade-from-release-suite-master-host-0 install
2018-09-14 05:51:08,586-04 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] EVENT_ID:
VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during
installation of Host lago-upgrade-from-release-suite-master-host-0:
CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?,
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00; nested
exception is org.postgresql.util.PSQLException: ERROR: invalid byte
sequence for encoding "UTF8": 0x00.
2018-09-14 05:51:08,586-04 ERROR
[org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Error during host
lago-upgrade-from-release-suite-master-host-0 install, preferring first
exception: CallableStatementCallback; SQL [{call insertauditlog(?, ?, ?, ?,
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
?, ?, ?, ?, ?)}ERROR: invalid byte sequence for encoding "UTF8": 0x00;
nested exception is org.postgresql.util.PSQLException: ERROR: invalid byte
sequence for encoding "UTF8": 0x00
2018-09-14 05:51:08,586-04 ERROR
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Host installation
failed for host 'e475e93a-63b3-4573-b242-162c2ed864f0',
'lago-upgrade-from-release-suite-master-host-0': CallableStatementCallback;
SQL [{call insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte
sequence for encoding "UTF8": 0x00; nested exception is
org.postgresql.util.PSQLException: ERROR: invalid byte sequence for
encoding "UTF8": 0x00
2018-09-14 05:51:08,615-04 INFO
[org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] START,
SetVdsStatusVDSCommand(HostName =
lago-upgrade-from-release-suite-master-host-0,
SetVdsStatusVDSCommandParameters:{hostId='e475e93a-63b3-4573-b242-162c2ed864f0',
status='InstallFailed', nonOperationalReason='NONE',
stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 146cdc08
2018-09-14 05:51:08,626-04 INFO
[org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] FINISH,
SetVdsStatusVDSCommand, return: , log id: 146cdc08
2018-09-14 05:51:08,639-04 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] EVENT_ID:
VDS_INSTALL_FAILED(505), Host lago-upgrade-from-release-suite-master-host-0
installation failed. CallableStatementCallback; SQL [{call
insertauditlog(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)}ERROR: invalid byte sequence for
encoding "UTF8": 0x00; nested exception is
org.postgresql.util.PSQLException: ERROR: invalid byte sequence for
encoding "UTF8": 0x00.
2018-09-14 05:51:08,652-04 INFO
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1) [5c91fcbd] Lock freed to object
'EngineLock:{exclusiveLocks='[e475e93a-63b3-4573-b242-162c2ed864f0=VDS]',
sharedLocks=''}'
2018-09-14 05:51:37,996-04 INFO
[org.ovirt.engine.core.bll.quota.QuotaManager]
(EE-ManagedThreadFactory-engineScheduled-Thread-44) [] Quota Cache updated.
(19 msec)
(END)
Thanks,
Dafna
6 years, 1 month
[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-4.2 - Build #
347 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/347/
Build Number: 347
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #347
[Dafna Ron] ovirt-4.2: block external links from running in ost
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 010_local_maintenance_cli.local_maintenance
Error Message:
143
-------------------- >> begin captured logging << --------------------
root: INFO: * Waiting For System Stability...
lago.ssh: DEBUG: start task:90555ac6-a749-4c6d-97d0-ca20f9ee7e56:Get ssh client for lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: end task:90555ac6-a749-4c6d-97d0-ca20f9ee7e56:Get ssh client for lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: Running 4d4a6eae on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 4d4a6eae on lago-he-node-ng-suite-4-2-host-1 returned with 0
lago.ssh: DEBUG: Command 4d4a6eae on lago-he-node-ng-suite-4-2-host-1 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4241 (Wed Sep 26 17:40:36 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4241 (Wed Sep 26 17:40:36 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "49ba6ea7", "local_conf_timestamp": 4241, "host-ts": 4241}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4247 (Wed Sep 26 17:40:41 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4247 (Wed Sep 26 17:40:41 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e8286b5a", "local_conf_timestamp": 4247, "host-ts": 4247}, "global_maintenance": false}
lago.ssh: DEBUG: start task:cdd8bc8a-3f38-4e62-9699-7ef8e4864f9a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:cdd8bc8a-3f38-4e62-9699-7ef8e4864f9a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 4e65c50e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local
lago.ssh: DEBUG: Command 4e65c50e on lago-he-node-ng-suite-4-2-host-0 returned with 0
root: INFO: * Waiting for engine to migrate...
lago.ssh: DEBUG: start task:cdb61607-0d9d-4531-931e-e2a2c02f6b15:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:cdb61607-0d9d-4531-931e-e2a2c02f6b15:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 4fac57de on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 4fac57de on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 4fac57de on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4251 (Wed Sep 26 17:40:46 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4251 (Wed Sep 26 17:40:46 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "95dd2e98", "local_conf_timestamp": 4251, "host-ts": 4251}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4247 (Wed Sep 26 17:40:41 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4247 (Wed Sep 26 17:40:41 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e8286b5a", "local_conf_timestamp": 4247, "host-ts": 4247}, "global_maintenance": false}
lago.ssh: DEBUG: start task:1fc0139b-3d03-4e0a-8168-69c54559563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:1fc0139b-3d03-4e0a-8168-69c54559563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 56ec62dc on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 56ec62dc on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 56ec62dc on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4262 (Wed Sep 26 17:40:56 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4262 (Wed Sep 26 17:40:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "01cda987", "local_conf_timestamp": 4262, "host-ts": 4262}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4257 (Wed Sep 26 17:40:51 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4257 (Wed Sep 26 17:40:52 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ec6e945f", "local_conf_timestamp": 4257, "host-ts": 4257}, "global_maintenance": false}
lago.ssh: DEBUG: start task:12189e9a-68f8-42d0-ba7a-126282d28b98:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:12189e9a-68f8-42d0-ba7a-126282d28b98:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 5aec01a8 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 5aec01a8 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 5aec01a8 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4272 (Wed Sep 26 17:41:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4272 (Wed Sep 26 17:41:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "03cc6058", "local_conf_timestamp": 4272, "host-ts": 4272}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4267 (Wed Sep 26 17:41:02 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4267 (Wed Sep 26 17:41:02 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e0a59550", "local_conf_timestamp": 4267, "host-ts": 4267}, "global_maintenance": false}
lago.ssh: DEBUG: start task:6e63e48d-6a63-41da-92db-73b872e79e0a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:6e63e48d-6a63-41da-92db-73b872e79e0a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4272 (Wed Sep 26 17:41:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4272 (Wed Sep 26 17:41:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "03cc6058", "local_conf_timestamp": 4272, "host-ts": 4272}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4267 (Wed Sep 26 17:41:02 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4267 (Wed Sep 26 17:41:02 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e0a59550", "local_conf_timestamp": 4267, "host-ts": 4267}, "global_maintenance": false}
lago.ssh: DEBUG: start task:b30d6158-ccd3-4752-8b2f-cad0c236e420:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:b30d6158-ccd3-4752-8b2f-cad0c236e420:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 6147daf4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6147daf4 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 6147daf4 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4282 (Wed Sep 26 17:41:17 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4283 (Wed Sep 26 17:41:17 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f97e01d5", "local_conf_timestamp": 4283, "host-ts": 4282}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4277 (Wed Sep 26 17:41:12 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4277 (Wed Sep 26 17:41:12 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "93de5fcd", "local_conf_timestamp": 4277, "host-ts": 4277}, "global_maintenance": false}
lago.ssh: DEBUG: start task:634c9638-320f-4848-ad7f-30ba5f612b08:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:634c9638-320f-4848-ad7f-30ba5f612b08:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 6443f238 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6443f238 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 6443f238 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4292 (Wed Sep 26 17:41:26 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4292 (Wed Sep 26 17:41:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "204a0f81", "local_conf_timestamp": 4292, "host-ts": 4292}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4287 (Wed Sep 26 17:41:21 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4287 (Wed Sep 26 17:41:21 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac395afe", "local_conf_timestamp": 4287, "host-ts": 4287}, "global_maintenance": false}
lago.ssh: DEBUG: start task:e6c602be-6983-4556-98c4-4b57f63c7006:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:e6c602be-6983-4556-98c4-4b57f63c7006:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 674f8cc6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 674f8cc6 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 674f8cc6 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4292 (Wed Sep 26 17:41:26 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4292 (Wed Sep 26 17:41:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "204a0f81", "local_conf_timestamp": 4292, "host-ts": 4292}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4287 (Wed Sep 26 17:41:21 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4287 (Wed Sep 26 17:41:21 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac395afe", "local_conf_timestamp": 4287, "host-ts": 4287}, "global_maintenance": false}
lago.ssh: DEBUG: start task:4beec84d-e882-43d6-9fab-667e4e81cbda:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:4beec84d-e882-43d6-9fab-667e4e81cbda:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 6a680c80 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6a680c80 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 6a680c80 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4297 (Wed Sep 26 17:41:31 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4297 (Wed Sep 26 17:41:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a87fa5fb", "local_conf_timestamp": 4297, "host-ts": 4297}, "global_maintenance": false}
lago.ssh: DEBUG: start task:7cd1cc45-58d8-4c69-92e3-62a2d08a6904:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:7cd1cc45-58d8-4c69-92e3-62a2d08a6904:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4297 (Wed Sep 26 17:41:31 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4297 (Wed Sep 26 17:41:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a87fa5fb", "local_conf_timestamp": 4297, "host-ts": 4297}, "global_maintenance": false}
lago.ssh: DEBUG: start task:a81b0359-b525-41fa-9906-7f21f0f27dd6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:a81b0359-b525-41fa-9906-7f21f0f27dd6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 704b805a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 704b805a on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 704b805a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4307 (Wed Sep 26 17:41:42 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4307 (Wed Sep 26 17:41:42 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4d44c828", "local_conf_timestamp": 4307, "host-ts": 4307}, "global_maintenance": false}
lago.ssh: DEBUG: start task:e51f9ed4-1717-44c9-b0ee-37ea5e05676a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:e51f9ed4-1717-44c9-b0ee-37ea5e05676a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 7349afde on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 7349afde on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 7349afde on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4312 (Wed Sep 26 17:41:47 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4313 (Wed Sep 26 17:41:47 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "53474a62", "local_conf_timestamp": 4313, "host-ts": 4312}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4307 (Wed Sep 26 17:41:42 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4307 (Wed Sep 26 17:41:42 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4d44c828", "local_conf_timestamp": 4307, "host-ts": 4307}, "global_maintenance": false}
lago.ssh: DEBUG: start task:243d2486-a3ca-4ca5-8fff-878978118a3d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:243d2486-a3ca-4ca5-8fff-878978118a3d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 76684004 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 76684004 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 76684004 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4322 (Wed Sep 26 17:41:56 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4322 (Wed Sep 26 17:41:57 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0d643ff3", "local_conf_timestamp": 4322, "host-ts": 4322}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4317 (Wed Sep 26 17:41:52 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4317 (Wed Sep 26 17:41:52 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4902372d", "local_conf_timestamp": 4317, "host-ts": 4317}, "global_maintenance": false}
lago.ssh: DEBUG: start task:c1b8be35-3faa-4959-8a52-56991f4fa241:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:c1b8be35-3faa-4959-8a52-56991f4fa241:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 7999ef0c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 7999ef0c on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 7999ef0c on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4322 (Wed Sep 26 17:41:56 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4322 (Wed Sep 26 17:41:57 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0d643ff3", "local_conf_timestamp": 4322, "host-ts": 4322}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4317 (Wed Sep 26 17:41:52 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4317 (Wed Sep 26 17:41:52 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4902372d", "local_conf_timestamp": 4317, "host-ts": 4317}, "global_maintenance": false}
lago.ssh: DEBUG: start task:c6947cc4-e42c-4461-a2ca-e144eed75f88:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:c6947cc4-e42c-4461-a2ca-e144eed75f88:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 7c7e5744 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 7c7e5744 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 7c7e5744 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4332 (Wed Sep 26 17:42:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4332 (Wed Sep 26 17:42:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c23b8814", "local_conf_timestamp": 4332, "host-ts": 4332}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4327 (Wed Sep 26 17:42:01 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4327 (Wed Sep 26 17:42:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4488c592", "local_conf_timestamp": 4327, "host-ts": 4327}, "global_maintenance": false}
lago.ssh: DEBUG: start task:25677b7b-0a3f-4018-9a2d-399570c4f390:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:25677b7b-0a3f-4018-9a2d-399570c4f390:Get ssh client for lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 7d97c89a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 7d97c89a on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 7d97c89a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4332 (Wed Sep 26 17:42:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4332 (Wed Sep 26 17:42:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c23b8814", "local_conf_timestamp": 4332, "host-ts": 4332}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4327 (Wed Sep 26 17:42:01 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4327 (Wed Sep 26 17:42:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4488c592", "local_conf_timestamp": 4327, "host-ts": 4327}, "global_maintenance": false}
root: INFO: * Engine has migrated.
root: INFO: * Waiting For System Stability...
cli: DEBUG: signal 15 was caught
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py", line 125, in local_maintenance
_wait_for_engine_migration(host, he_index, "bad", "Migration Destination")
File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py", line 45, in _wait_for_engine_migration
time.sleep(wait_value)
File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler
sys.exit(128 + signum)
'143\n-------------------- >> begin captured logging << --------------------\nroot: INFO: * Waiting For System Stability...\nlago.ssh: DEBUG: start task:90555ac6-a749-4c6d-97d0-ca20f9ee7e56:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:90555ac6-a749-4c6d-97d0-ca20f9ee7e56:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 4d4a6eae on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4d4a6eae on lago-he-node-ng-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 4d4a6eae on lago-he-node-ng-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4241 (Wed Sep 26 17:40:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4241 (Wed Sep 26 17:40:36 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "49ba6ea7", "local_conf_timestamp": 4241, "host-ts": 4241}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4247 (Wed Sep 26 17:40:41 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4247 (Wed Sep 26 17:40:41 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e8286b5a", "local_conf_timestamp": 4247, "host-ts": 4247}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:cdd8bc8a-3f38-4e62-9699-7ef8e4864f9a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:cdd8bc8a-3f38-4e62-9699-7ef8e4864f9a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4e65c50e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local\nlago.ssh: DEBUG: Command 4e65c50e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Waiting for engine to migrate...\nlago.ssh: DEBUG: start task:cdb61607-0d9d-4531-931e-e2a2c02f6b15:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:cdb61607-0d9d-4531-931e-e2a2c02f6b15:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4fac57de on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4fac57de on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 4fac57de on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4251 (Wed Sep 26 17:40:46 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4251 (Wed Sep 26 17:40:46 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "95dd2e98", "local_conf_timestamp": 4251, "host-ts": 4251}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4247 (Wed Sep 26 17:40:41 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4247 (Wed Sep 26 17:40:41 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e8286b5a", "local_conf_timestamp": 4247, "host-ts": 4247}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:1fc0139b-3d03-4e0a-8168-69c54559563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:1fc0139b-3d03-4e0a-8168-69c54559563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 56ec62dc on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 56ec62dc on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 56ec62dc on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4262 (Wed Sep 26 17:40:56 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4262 (Wed Sep 26 17:40:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "01cda987", "local_conf_timestamp": 4262, "host-ts": 4262}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4257 (Wed Sep 26 17:40:51 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4257 (Wed Sep 26 17:40:52 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ec6e945f", "local_conf_timestamp": 4257, "host-ts": 4257}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:12189e9a-68f8-42d0-ba7a-126282d28b98:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:12189e9a-68f8-42d0-ba7a-126282d28b98:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5aec01a8 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5aec01a8 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 5aec01a8 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4272 (Wed Sep 26 17:41:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4272 (Wed Sep 26 17:41:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "03cc6058", "local_conf_timestamp": 4272, "host-ts": 4272}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4267 (Wed Sep 26 17:41:02 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4267 (Wed Sep 26 17:41:02 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e0a59550", "local_conf_timestamp": 4267, "host-ts": 4267}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:6e63e48d-6a63-41da-92db-73b872e79e0a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:6e63e48d-6a63-41da-92db-73b872e79e0a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4272 (Wed Sep 26 17:41:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4272 (Wed Sep 26 17:41:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "03cc6058", "local_conf_timestamp": 4272, "host-ts": 4272}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4267 (Wed Sep 26 17:41:02 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4267 (Wed Sep 26 17:41:02 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e0a59550", "local_conf_timestamp": 4267, "host-ts": 4267}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:b30d6158-ccd3-4752-8b2f-cad0c236e420:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:b30d6158-ccd3-4752-8b2f-cad0c236e420:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6147daf4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6147daf4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6147daf4 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4282 (Wed Sep 26 17:41:17 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4283 (Wed Sep 26 17:41:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f97e01d5", "local_conf_timestamp": 4283, "host-ts": 4282}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4277 (Wed Sep 26 17:41:12 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4277 (Wed Sep 26 17:41:12 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "93de5fcd", "local_conf_timestamp": 4277, "host-ts": 4277}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:634c9638-320f-4848-ad7f-30ba5f612b08:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:634c9638-320f-4848-ad7f-30ba5f612b08:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6443f238 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6443f238 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6443f238 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4292 (Wed Sep 26 17:41:26 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4292 (Wed Sep 26 17:41:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "204a0f81", "local_conf_timestamp": 4292, "host-ts": 4292}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4287 (Wed Sep 26 17:41:21 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4287 (Wed Sep 26 17:41:21 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac395afe", "local_conf_timestamp": 4287, "host-ts": 4287}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:e6c602be-6983-4556-98c4-4b57f63c7006:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:e6c602be-6983-4556-98c4-4b57f63c7006:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 674f8cc6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 674f8cc6 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 674f8cc6 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4292 (Wed Sep 26 17:41:26 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4292 (Wed Sep 26 17:41:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "204a0f81", "local_conf_timestamp": 4292, "host-ts": 4292}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4287 (Wed Sep 26 17:41:21 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4287 (Wed Sep 26 17:41:21 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac395afe", "local_conf_timestamp": 4287, "host-ts": 4287}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:4beec84d-e882-43d6-9fab-667e4e81cbda:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:4beec84d-e882-43d6-9fab-667e4e81cbda:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6a680c80 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6a680c80 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6a680c80 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4297 (Wed Sep 26 17:41:31 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4297 (Wed Sep 26 17:41:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a87fa5fb", "local_conf_timestamp": 4297, "host-ts": 4297}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:7cd1cc45-58d8-4c69-92e3-62a2d08a6904:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:7cd1cc45-58d8-4c69-92e3-62a2d08a6904:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4297 (Wed Sep 26 17:41:31 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4297 (Wed Sep 26 17:41:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a87fa5fb", "local_conf_timestamp": 4297, "host-ts": 4297}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:a81b0359-b525-41fa-9906-7f21f0f27dd6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:a81b0359-b525-41fa-9906-7f21f0f27dd6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 704b805a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 704b805a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 704b805a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4307 (Wed Sep 26 17:41:42 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4307 (Wed Sep 26 17:41:42 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4d44c828", "local_conf_timestamp": 4307, "host-ts": 4307}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:e51f9ed4-1717-44c9-b0ee-37ea5e05676a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:e51f9ed4-1717-44c9-b0ee-37ea5e05676a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7349afde on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7349afde on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7349afde on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4312 (Wed Sep 26 17:41:47 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4313 (Wed Sep 26 17:41:47 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "53474a62", "local_conf_timestamp": 4313, "host-ts": 4312}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4307 (Wed Sep 26 17:41:42 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4307 (Wed Sep 26 17:41:42 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4d44c828", "local_conf_timestamp": 4307, "host-ts": 4307}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:243d2486-a3ca-4ca5-8fff-878978118a3d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:243d2486-a3ca-4ca5-8fff-878978118a3d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 76684004 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 76684004 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 76684004 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4322 (Wed Sep 26 17:41:56 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4322 (Wed Sep 26 17:41:57 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0d643ff3", "local_conf_timestamp": 4322, "host-ts": 4322}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4317 (Wed Sep 26 17:41:52 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4317 (Wed Sep 26 17:41:52 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4902372d", "local_conf_timestamp": 4317, "host-ts": 4317}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:c1b8be35-3faa-4959-8a52-56991f4fa241:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:c1b8be35-3faa-4959-8a52-56991f4fa241:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7999ef0c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7999ef0c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7999ef0c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4322 (Wed Sep 26 17:41:56 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4322 (Wed Sep 26 17:41:57 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0d643ff3", "local_conf_timestamp": 4322, "host-ts": 4322}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4317 (Wed Sep 26 17:41:52 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4317 (Wed Sep 26 17:41:52 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4902372d", "local_conf_timestamp": 4317, "host-ts": 4317}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:c6947cc4-e42c-4461-a2ca-e144eed75f88:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:c6947cc4-e42c-4461-a2ca-e144eed75f88:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7c7e5744 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7c7e5744 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7c7e5744 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4332 (Wed Sep 26 17:42:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4332 (Wed Sep 26 17:42:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c23b8814", "local_conf_timestamp": 4332, "host-ts": 4332}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4327 (Wed Sep 26 17:42:01 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4327 (Wed Sep 26 17:42:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4488c592", "local_conf_timestamp": 4327, "host-ts": 4327}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:25677b7b-0a3f-4018-9a2d-399570c4f390:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:25677b7b-0a3f-4018-9a2d-399570c4f390:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7d97c89a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7d97c89a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7d97c89a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4332 (Wed Sep 26 17:42:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4332 (Wed Sep 26 17:42:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c23b8814", "local_conf_timestamp": 4332, "host-ts": 4332}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4327 (Wed Sep 26 17:42:01 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4327 (Wed Sep 26 17:42:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4488c592", "local_conf_timestamp": 4327, "host-ts": 4327}, "global_maintenance": false}\n\nroot: INFO: * Engine has migrated.\nroot: INFO: * Waiting For System Stability...\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'
6 years, 2 months