2018-02-27 12:47:08,676+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf'. 2018-02-27 12:47:08,677+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] The file '/etc/ovirt-engine/engine.conf' doesn't exist or isn't readable. Will return an empty set of properties. 2018-02-27 12:47:08,677+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-scl-postgres-95.conf'. 2018-02-27 12:47:08,677+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-database.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-dwh-database.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-java.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/11-setup-sso.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/20-setup-jboss-overlay.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/50-ovirt-engine-api-explorer.conf'. 2018-02-27 12:47:08,678+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/50-ovirt-engine-extension-aaa-jdbc.conf'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Loaded file '/etc/ovirt-engine/engine.conf.d/50-ovirt-web-ui.conf'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'AAA_JAAS_KEYTAB_FILE' is ''. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'AAA_JAAS_PRINCIPAL_NAME' is ''. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'AAA_JAAS_TICKET_CACHE_FILE' is ''. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'AAA_JAAS_USE_KEYTAB' is 'false'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'AAA_JAAS_USE_TICKET_CACHE' is 'false'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'AAA_KRB5_CONF_FILE' is ''. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ANSIBLE_PLAYBOOK_EXEC_DEFAULT_TIMEOUT' is '30'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ANSIBLE_PLAYBOOK_VERBOSITY_LEVEL' is '1'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'COMMAND_COORDINATOR_THREAD_POOL_SIZE' is '10'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DASHBOARD_CACHE_UPDATE' is 'true'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DASHBOARD_INVENTORY_CACHE_UPDATE_INTERVAL' is '60'. 2018-02-27 12:47:08,679+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DASHBOARD_UTILIZATION_CACHE_UPDATE_INTERVAL' is '300'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_DATABASE' is 'ovirt_engine_history'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_DRIVER' is 'org.postgresql.Driver'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_HOST' is 'localhost'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_PASSWORD' is '***'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_PORT' is '5432'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_SECURED' is 'False'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_SECURED_VALIDATION' is 'False'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_URL' is 'jdbc:postgresql://localhost:5432/ovirt_engine_history?sslfactory=org.postgresql.ssl.NonValidatingFactory'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'DWH_DB_USER' is 'ovirt_engine_history'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENFORCE_ENGINE_HEAP_PARAMS' is 'false'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_AJP_ENABLED' is 'true'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_AJP_PORT' is '8702'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_API_DEFAULT_VERSION' is '4'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_API_DEPRECATED_VERSIONS' is '3:4.0:4.3'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_API_EXPLORER_DIRECTORY' is '/usr/share/ovirt-engine-api-explorer'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_API_FILTER_BY_DEFAULT' is 'true'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_API_SUPPORTED_VERSIONS' is '3, 4'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_APPS' is 'engine.ear restapi.war apidoc.war ovirt-web-ui.war'. 2018-02-27 12:47:08,680+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_CACHE' is '/var/cache/ovirt-engine'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_CHECK_INTERVAL' is '1000'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_CONNECTION_TIMEOUT' is '300000'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_DATABASE' is 'engine'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_DRIVER' is 'org.postgresql.Driver'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_HOST' is 'localhost'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_MAX_CONNECTIONS' is '100'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_MIN_CONNECTIONS' is '1'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_PASSWORD' is '***'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_PORT' is '5432'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_SECURED' is 'False'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_SECURED_VALIDATION' is 'False'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_URL' is 'jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DB_USER' is 'engine'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DEBUG_ADDRESS' is ''. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DEPLOYMENT_SCANNER' is 'false'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_DOC' is '/usr/share/doc/ovirt-engine'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_ETC' is '/etc/ovirt-engine'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_EXTENSIONS_IGNORED' is '.*?(Authz)'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_EXTENSION_PATH' is '/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE' is '/var/lib/ovirt-engine/external_truststore'. 2018-02-27 12:47:08,681+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD' is '***'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_TYPE' is 'JKS'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_FQDN' is 'ovirt.uoi.edu.pk'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_GROUP' is 'ovirt'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HEAP_MAX' is '1024M'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HEAP_MIN' is '1024M'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HTTPS_ENABLED' is 'false'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HTTPS_PKI_TRUST_STORE' is '/etc/pki/ovirt-engine/.truststore'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HTTPS_PKI_TRUST_STORE_PASSWORD' is '***'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HTTPS_PKI_TRUST_STORE_TYPE' is 'JKS'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HTTPS_PORT' is 'None'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HTTPS_PROTOCOLS' is 'TLSv1.1,TLSv1.2'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HTTP_ENABLED' is 'false'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_HTTP_PORT' is 'None'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_JAVA_MODULEPATH' is '/usr/share/ovirt-engine-wildfly-overlay/modules:/usr/share/ovirt-engine/modules/common:/usr/share/ovirt-engine-extension-aaa-jdbc/modules'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_JMX_INTERFACE' is 'loopback'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_JVM_ARGS' is ' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_LOG' is '/var/log/ovirt-engine'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_LOG_TO_CONSOLE' is 'false'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_MALLOC_ARENA_MAX' is '1'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_MANUAL' is '/usr/share/ovirt-engine/manual'. 2018-02-27 12:47:08,682+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_NON_JTA_DB_MAX_CONNECTIONS' is '10'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_NON_JTA_DB_MIN_CONNECTIONS' is '1'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI' is '/etc/pki/ovirt-engine'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_CA' is '/etc/pki/ovirt-engine/ca.pem'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_ENGINE_CERT' is '/etc/pki/ovirt-engine/certs/engine.cer'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_ENGINE_STORE' is '/etc/pki/ovirt-engine/keys/engine.p12'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_ENGINE_STORE_ALIAS' is '1'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_ENGINE_STORE_PASSWORD' is '***'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_ENGINE_STORE_TYPE' is 'PKCS12'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_TRUST_STORE' is '/etc/pki/ovirt-engine/.truststore'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_TRUST_STORE_PASSWORD' is '***'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PKI_TRUST_STORE_TYPE' is 'JKS'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PROPERTIES' is ' java.awt.headless=true sun.rmi.dgc.client.gcInterval=3600000 sun.rmi.dgc.server.gcInterval=3600000 jsse.enableSNIExtension=false'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PROXY_ENABLED' is 'true'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PROXY_HTTPS_PORT' is '443'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_PROXY_HTTP_PORT' is '80'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_RESTAPI_NEGO' is 'true'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SCHEDULED_THREAD_POOL_SIZE' is '100'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SCHEDULER_POOL_CLASS' is 'org.ovirt.engine.core.utils.timer.SchedulerThreadPool'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SCHEDULER_POOL_QUEUE_SIZE' is '350'. 2018-02-27 12:47:08,683+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SCHEDULER_POOL_REJECT_POLICY' is 'false'. 2018-02-27 12:47:08,684+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SCHEDULER_POOL_THREAD_SIZE' is '100'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_AUTH_SEQUENCE_webadmin' is '~'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_AUTH_SEQUENCE_webui' is '~'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_AUTH_SEQUENCE_welcome' is '~'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_AUTH_URL' is 'https://ovirt.uoi.edu.pk:443/ovirt-engine/sso'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_CLIENT_ID' is 'ovirt-engine-core'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_CLIENT_SECRET' is '***'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_INSTALLED_ON_ENGINE_HOST' is 'true'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_SERVICE_CLIENT_POOL_SIZE' is '10'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_SERVICE_CONNECTION_RETRY_COUNT' is '3'. 2018-02-27 12:47:08,778+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_SERVICE_CONNECTION_VALIDATE_AFTER_INACTIVITY' is '100'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_SERVICE_SSL_PROTOCOL' is 'TLS'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_SERVICE_SSL_VERIFY_CHAIN' is 'true'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_SERVICE_SSL_VERIFY_HOST' is 'false'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_SERVICE_URI' is '/ovirt-engine/sso'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_SSO_SERVICE_URL' is 'https://ovirt.uoi.edu.pk:443/ovirt-engine/sso'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_STOP_INTERVAL' is '1'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_STOP_TIME' is '10'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_THREAD_POOL_MAX_SIZE' is '500'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_THREAD_POOL_MIN_SIZE' is '50'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_THREAD_POOL_QUEUE_SIZE' is '100'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_TMP' is '/var/tmp/ovirt-engine'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_UP_MARK' is '/var/lib/ovirt-engine/engine.up'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_URI' is '/ovirt-engine'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_USER' is 'ovirt'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_USR' is '/usr/share/ovirt-engine'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_VAR' is '/var/lib/ovirt-engine'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'ENGINE_VERBOSE_GC' is 'false'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'HOST_CHECK_FOR_UPDATES_THREAD_POOL_SIZE' is '5'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'JBOSS_HOME' is '/usr/share/ovirt-engine-wildfly'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'JBOSS_RUNTIME' is '/var/lib/ovirt-engine/jboss_runtime'. 2018-02-27 12:47:08,779+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'PACKAGE_DISPLAY_VERSION' is '4.2.1.7-1.el7.centos'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'PACKAGE_NAME' is 'ovirt-engine'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'PACKAGE_VERSION' is '4.2.1.7'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SENSITIVE_KEYS' is ',ENGINE_DB_PASSWORD,DWH_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD,ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD,ENGINE_HTTPS_PKI_TRUST_STORE_PASSWORD,ENGINE_SSO_CLIENT_SECRET'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_ALTERNATE_ENGINE_FQDNS' is ''. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_AUTH_LOGIN_SEQUENCE' is 'NI'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_CALLBACK_CLIENT_POOL_SIZE' is '10'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_CALLBACK_CONNECTION_RETRY_COUNT' is '3'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_CALLBACK_CONNECTION_VALIDATE_AFTER_INACTIVITY' is '100'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_CALLBACK_CONNECT_TIMEOUT' is '0'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_CALLBACK_PREFIX_CHECK' is 'true'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_CALLBACK_READ_TIMEOUT' is '0'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_ENGINE_URL' is 'https://ovirt.uoi.edu.pk:443/ovirt-engine/'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_HOUSE_KEEPING_INTERVAL' is '60'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_TOKEN_HTTP_LOGIN_SEQUENCE' is 'Nb'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'SSO_TOKEN_TIMEOUT' is '360000'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'THREAD_POOL_MONITORING_INTERVAL_IN_SECONDS' is '600'. 2018-02-27 12:47:08,780+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 56) [] Value of property 'sclenv' is 'rh-postgresql95'. 2018-02-27 12:47:08,728+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf'. 2018-02-27 12:47:08,783+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] The file '/etc/ovirt-engine/engine.conf' doesn't exist or isn't readable. Will return an empty set of properties. 2018-02-27 12:47:08,783+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-scl-postgres-95.conf'. 2018-02-27 12:47:08,783+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-database.conf'. 2018-02-27 12:47:08,783+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-dwh-database.conf'. 2018-02-27 12:47:08,783+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-java.conf'. 2018-02-27 12:47:08,783+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf'. 2018-02-27 12:47:08,783+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/11-setup-sso.conf'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/20-setup-jboss-overlay.conf'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/50-ovirt-engine-api-explorer.conf'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/50-ovirt-engine-extension-aaa-jdbc.conf'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Loaded file '/etc/ovirt-engine/engine.conf.d/50-ovirt-web-ui.conf'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'AAA_JAAS_KEYTAB_FILE' is ''. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'AAA_JAAS_PRINCIPAL_NAME' is ''. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'AAA_JAAS_TICKET_CACHE_FILE' is ''. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'AAA_JAAS_USE_KEYTAB' is 'false'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'AAA_JAAS_USE_TICKET_CACHE' is 'false'. 2018-02-27 12:47:08,784+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'AAA_KRB5_CONF_FILE' is ''. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ANSIBLE_PLAYBOOK_EXEC_DEFAULT_TIMEOUT' is '30'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ANSIBLE_PLAYBOOK_VERBOSITY_LEVEL' is '1'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'COMMAND_COORDINATOR_THREAD_POOL_SIZE' is '10'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DASHBOARD_CACHE_UPDATE' is 'true'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DASHBOARD_INVENTORY_CACHE_UPDATE_INTERVAL' is '60'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DASHBOARD_UTILIZATION_CACHE_UPDATE_INTERVAL' is '300'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_DATABASE' is 'ovirt_engine_history'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_DRIVER' is 'org.postgresql.Driver'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_HOST' is 'localhost'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_PASSWORD' is '***'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_PORT' is '5432'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_SECURED' is 'False'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_SECURED_VALIDATION' is 'False'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_URL' is 'jdbc:postgresql://localhost:5432/ovirt_engine_history?sslfactory=org.postgresql.ssl.NonValidatingFactory'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'DWH_DB_USER' is 'ovirt_engine_history'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENFORCE_ENGINE_HEAP_PARAMS' is 'false'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_AJP_ENABLED' is 'true'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_AJP_PORT' is '8702'. 2018-02-27 12:47:08,785+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_API_DEFAULT_VERSION' is '4'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_API_DEPRECATED_VERSIONS' is '3:4.0:4.3'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_API_EXPLORER_DIRECTORY' is '/usr/share/ovirt-engine-api-explorer'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_API_FILTER_BY_DEFAULT' is 'true'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_API_SUPPORTED_VERSIONS' is '3, 4'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_APPS' is 'engine.ear restapi.war apidoc.war ovirt-web-ui.war'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_CACHE' is '/var/cache/ovirt-engine'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_CHECK_INTERVAL' is '1000'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_CONNECTION_TIMEOUT' is '300000'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_DATABASE' is 'engine'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_DRIVER' is 'org.postgresql.Driver'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_HOST' is 'localhost'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_MAX_CONNECTIONS' is '100'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_MIN_CONNECTIONS' is '1'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_PASSWORD' is '***'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_PORT' is '5432'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_SECURED' is 'False'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_SECURED_VALIDATION' is 'False'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_URL' is 'jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DB_USER' is 'engine'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DEBUG_ADDRESS' is ''. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DEPLOYMENT_SCANNER' is 'false'. 2018-02-27 12:47:08,786+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_DOC' is '/usr/share/doc/ovirt-engine'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_ETC' is '/etc/ovirt-engine'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_EXTENSIONS_IGNORED' is '.*?(Authz)'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_EXTENSION_PATH' is '/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE' is '/var/lib/ovirt-engine/external_truststore'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD' is '***'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_TYPE' is 'JKS'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_FQDN' is 'ovirt.uoi.edu.pk'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_GROUP' is 'ovirt'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HEAP_MAX' is '1024M'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HEAP_MIN' is '1024M'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HTTPS_ENABLED' is 'false'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HTTPS_PKI_TRUST_STORE' is '/etc/pki/ovirt-engine/.truststore'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HTTPS_PKI_TRUST_STORE_PASSWORD' is '***'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HTTPS_PKI_TRUST_STORE_TYPE' is 'JKS'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HTTPS_PORT' is 'None'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HTTPS_PROTOCOLS' is 'TLSv1.1,TLSv1.2'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HTTP_ENABLED' is 'false'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_HTTP_PORT' is 'None'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_JAVA_MODULEPATH' is '/usr/share/ovirt-engine-wildfly-overlay/modules:/usr/share/ovirt-engine/modules/common:/usr/share/ovirt-engine-extension-aaa-jdbc/modules'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_JMX_INTERFACE' is 'loopback'. 2018-02-27 12:47:08,787+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_JVM_ARGS' is ' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_LOG' is '/var/log/ovirt-engine'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_LOG_TO_CONSOLE' is 'false'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_MALLOC_ARENA_MAX' is '1'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_MANUAL' is '/usr/share/ovirt-engine/manual'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_NON_JTA_DB_MAX_CONNECTIONS' is '10'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_NON_JTA_DB_MIN_CONNECTIONS' is '1'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI' is '/etc/pki/ovirt-engine'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_CA' is '/etc/pki/ovirt-engine/ca.pem'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_ENGINE_CERT' is '/etc/pki/ovirt-engine/certs/engine.cer'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_ENGINE_STORE' is '/etc/pki/ovirt-engine/keys/engine.p12'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_ENGINE_STORE_ALIAS' is '1'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_ENGINE_STORE_PASSWORD' is '***'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_ENGINE_STORE_TYPE' is 'PKCS12'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_TRUST_STORE' is '/etc/pki/ovirt-engine/.truststore'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_TRUST_STORE_PASSWORD' is '***'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PKI_TRUST_STORE_TYPE' is 'JKS'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PROPERTIES' is ' java.awt.headless=true sun.rmi.dgc.client.gcInterval=3600000 sun.rmi.dgc.server.gcInterval=3600000 jsse.enableSNIExtension=false'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PROXY_ENABLED' is 'true'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PROXY_HTTPS_PORT' is '443'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_PROXY_HTTP_PORT' is '80'. 2018-02-27 12:47:08,788+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_RESTAPI_NEGO' is 'true'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SCHEDULED_THREAD_POOL_SIZE' is '100'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SCHEDULER_POOL_CLASS' is 'org.ovirt.engine.core.utils.timer.SchedulerThreadPool'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SCHEDULER_POOL_QUEUE_SIZE' is '350'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SCHEDULER_POOL_REJECT_POLICY' is 'false'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SCHEDULER_POOL_THREAD_SIZE' is '100'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_AUTH_SEQUENCE_webadmin' is '~'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_AUTH_SEQUENCE_webui' is '~'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_AUTH_SEQUENCE_welcome' is '~'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_AUTH_URL' is 'https://ovirt.uoi.edu.pk:443/ovirt-engine/sso'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_CLIENT_ID' is 'ovirt-engine-core'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_CLIENT_SECRET' is '***'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_INSTALLED_ON_ENGINE_HOST' is 'true'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_SERVICE_CLIENT_POOL_SIZE' is '10'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_SERVICE_CONNECTION_RETRY_COUNT' is '3'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_SERVICE_CONNECTION_VALIDATE_AFTER_INACTIVITY' is '100'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_SERVICE_SSL_PROTOCOL' is 'TLS'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_SERVICE_SSL_VERIFY_CHAIN' is 'true'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_SERVICE_SSL_VERIFY_HOST' is 'false'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_SERVICE_URI' is '/ovirt-engine/sso'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_SSO_SERVICE_URL' is 'https://ovirt.uoi.edu.pk:443/ovirt-engine/sso'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_STOP_INTERVAL' is '1'. 2018-02-27 12:47:08,789+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_STOP_TIME' is '10'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_THREAD_POOL_MAX_SIZE' is '500'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_THREAD_POOL_MIN_SIZE' is '50'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_THREAD_POOL_QUEUE_SIZE' is '100'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_TMP' is '/var/tmp/ovirt-engine'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_UP_MARK' is '/var/lib/ovirt-engine/engine.up'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_URI' is '/ovirt-engine'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_USER' is 'ovirt'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_USR' is '/usr/share/ovirt-engine'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_VAR' is '/var/lib/ovirt-engine'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'ENGINE_VERBOSE_GC' is 'false'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'HOST_CHECK_FOR_UPDATES_THREAD_POOL_SIZE' is '5'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'JBOSS_HOME' is '/usr/share/ovirt-engine-wildfly'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'JBOSS_RUNTIME' is '/var/lib/ovirt-engine/jboss_runtime'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'PACKAGE_DISPLAY_VERSION' is '4.2.1.7-1.el7.centos'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'PACKAGE_NAME' is 'ovirt-engine'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'PACKAGE_VERSION' is '4.2.1.7'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SENSITIVE_KEYS' is ',ENGINE_DB_PASSWORD,DWH_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD,ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD,ENGINE_HTTPS_PKI_TRUST_STORE_PASSWORD,ENGINE_SSO_CLIENT_SECRET'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_ALTERNATE_ENGINE_FQDNS' is ''. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_AUTH_LOGIN_SEQUENCE' is 'NI'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_CALLBACK_CLIENT_POOL_SIZE' is '10'. 2018-02-27 12:47:08,790+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_CALLBACK_CONNECTION_RETRY_COUNT' is '3'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_CALLBACK_CONNECTION_VALIDATE_AFTER_INACTIVITY' is '100'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_CALLBACK_CONNECT_TIMEOUT' is '0'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_CALLBACK_PREFIX_CHECK' is 'true'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_CALLBACK_READ_TIMEOUT' is '0'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_ENGINE_URL' is 'https://ovirt.uoi.edu.pk:443/ovirt-engine/'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_HOUSE_KEEPING_INTERVAL' is '60'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_TOKEN_HTTP_LOGIN_SEQUENCE' is 'Nb'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'SSO_TOKEN_TIMEOUT' is '360000'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'THREAD_POOL_MONITORING_INTERVAL_IN_SECONDS' is '600'. 2018-02-27 12:47:08,791+05 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (ServerService Thread Pool -- 57) [] Value of property 'sclenv' is 'rh-postgresql95'. 2018-02-27 12:47:08,813+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Loading extension 'internal-authn' 2018-02-27 12:47:08,816+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Extension 'internal-authn' loaded 2018-02-27 12:47:08,818+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Loading extension 'internal-authz' 2018-02-27 12:47:08,819+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Extension 'internal-authz' loaded 2018-02-27 12:47:08,819+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Initializing extension 'internal-authn' 2018-02-27 12:47:09,279+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Extension 'internal-authn' initialized 2018-02-27 12:47:09,280+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Initializing extension 'internal-authz' 2018-02-27 12:47:09,336+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Extension 'internal-authz' initialized 2018-02-27 12:47:09,337+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Start of enabled extensions list 2018-02-27 12:47:09,337+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Instance name: 'internal-authn', Extension name: '"ovirt-engine-extension-aaa-jdbc".authn', Version: '"1.1.6"', Notes: 'Display name: "ovirt-engine-extension-aaa-jdbc"', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: '/etc/ovirt-engine/extensions.d/internal-authn.properties', Initialized: 'true' 2018-02-27 12:47:09,337+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] Instance name: 'internal-authz', Extension name: '"ovirt-engine-extension-aaa-jdbc".authz', Version: '"1.1.6"', Notes: 'Display name: "ovirt-engine-extension-aaa-jdbc"', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: '/etc/ovirt-engine/extensions.d/internal-authz.properties', Initialized: 'true' 2018-02-27 12:47:09,337+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 57) [] End of enabled extensions list 2018-02-27 12:47:10,083+05 INFO [org.ovirt.engine.core.sso.utils.LocalizationUtils] (ServerService Thread Pool -- 57) [] Start initializing LocalizationUtils 2018-02-27 12:47:10,086+05 INFO [org.ovirt.engine.core.sso.utils.LocalizationUtils] (ServerService Thread Pool -- 57) [] Finished initializing LocalizationUtils 2018-02-27 12:47:10,140+05 INFO [org.ovirt.engine.core.dal.dbbroker.DbFacade] (ServerService Thread Pool -- 47) [] Initializing the DbFacade 2018-02-27 12:47:10,261+05 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 47) [] Start initializing TagsDirector 2018-02-27 12:47:10,268+05 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 47) [] Tag 'root' added to tree 2018-02-27 12:47:10,454+05 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 47) [] Finished initializing TagsDirector 2018-02-27 12:47:10,489+05 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) [] Start initializing Backend 2018-02-27 12:47:10,489+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.common.utils.EngineThreadPools@48bd86d7 2018-02-27 12:47:10,490+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (ServerService Thread Pool -- 47) [] Initializing Thread Monitoring Service 2018-02-27 12:47:10,528+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 1 tasks are waiting in the queue. 2018-02-27 12:47:10,528+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 12:47:10,502+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (ServerService Thread Pool -- 47) [] Thread Monitoring Service initialized 2018-02-27 12:47:10,529+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService@f1a548a 2018-02-27 12:47:10,806+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.hostedengine.PreviousHostedEngineHost@26457912 2018-02-27 12:47:10,835+05 INFO [org.ovirt.engine.ui.frontend.server.dashboard.DashboardDataServlet] (ServerService Thread Pool -- 58) [] Dashboard utilization cache updater initialized (update interval 300s) 2018-02-27 12:47:10,893+05 INFO [org.ovirt.engine.ui.frontend.server.dashboard.DashboardDataServlet] (ServerService Thread Pool -- 58) [] Dashboard inventory cache updater initialized (update interval 60s) 2018-02-27 12:47:11,248+05 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) [] Started task scheduler org.ovirt.engine.core.utils.timer.DBSchedulerUtilQuartzImpl@262da03a 2018-02-27 12:47:11,291+05 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) [] Started task scheduler org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl@71c1925b 2018-02-27 12:47:11,296+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.dal.utils.CacheManager@26cf5773 2018-02-27 12:47:11,420+05 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 47) [] Could not find enum value for option: 'DbJustRestored' 2018-02-27 12:47:11,421+05 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 47) [] Could not find enum value for option: 'ConfigDir' 2018-02-27 12:47:11,423+05 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 47) [] Could not find enum value for option: 'DbJustRestored' 2018-02-27 12:47:11,423+05 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 47) [] Could not find enum value for option: 'ConfigDir' 2018-02-27 12:47:11,481+05 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 47) [] Could not find enum value for option: 'DbJustRestored' 2018-02-27 12:47:11,483+05 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 47) [] Could not find enum value for option: 'ConfigDir' 2018-02-27 12:47:11,489+05 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 47) [] Loading file '/etc/ovirt-engine/osinfo.conf.d/00-defaults.properties' 2018-02-27 12:47:11,703+05 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 47) [] Start initializing ResourceManager$Proxy$_$$_WeldSubclass 2018-02-27 12:47:11,812+05 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 47) [] Finished initializing ResourceManager$Proxy$_$$_WeldSubclass 2018-02-27 12:47:11,819+05 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 47) [] Start initializing dictionaries 2018-02-27 12:47:11,822+05 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 47) [] Finished initializing dictionaries 2018-02-27 12:47:11,946+05 INFO [org.ovirt.engine.core.bll.network.macpool.MacPoolUsingRanges] (ServerService Thread Pool -- 47) [] Initializing MacPoolUsingRanges:{id='58ca604b-017d-0374-0220-00000000014e'} 2018-02-27 12:47:11,950+05 INFO [org.ovirt.engine.core.bll.network.macpool.MacPoolUsingRanges] (ServerService Thread Pool -- 47) [] Finished initializing MacPoolUsingRanges:{id='58ca604b-017d-0374-0220-00000000014e'}. Available MACs in pool: 1024 2018-02-27 12:47:11,950+05 INFO [org.ovirt.engine.core.bll.network.macpool.MacPoolPerCluster] (ServerService Thread Pool -- 47) [] Successfully initialized 2018-02-27 12:47:11,961+05 INFO [org.ovirt.engine.core.bll.network.macpool.MacPoolPerCluster] (ServerService Thread Pool -- 47) [] Mac pool 58ca604b-017d-0374-0220-00000000014e has 1024 available free macs 2018-02-27 12:47:12,000+05 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) [] Running ovirt-engine 4.2.1.7-1.el7.centos 2018-02-27 12:47:12,000+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.CpuFlagsManagerHandler@6b843c6a 2018-02-27 12:47:12,001+05 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 47) [] Start initializing AuditLogCleanupManager 2018-02-27 12:47:12,001+05 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 47) [] Setting audit cleanup manager to run at '35 35 3 * * ?' 2018-02-27 12:47:12,017+05 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 47) [] Finished initializing AuditLogCleanupManager 2018-02-27 12:47:12,017+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.AuditLogCleanupManager@3cf67a3 2018-02-27 12:47:12,017+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.TagsDirector@30a6f67d 2018-02-27 12:47:12,018+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.storage.domain.IsoDomainListSynchronizer@5b898ea4 2018-02-27 12:47:12,025+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.VmHandler@3ddda82b 2018-02-27 12:47:12,026+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.VdsHandler@6c9f4c0f 2018-02-27 12:47:12,067+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.VmTemplateHandler@13f513fb 2018-02-27 12:47:12,067+05 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) [] Completed initializing handlers 2018-02-27 12:47:12,175+05 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) [] Start initializing ErrorTranslatorImpl 2018-02-27 12:47:12,208+05 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) [] Finished initializing ErrorTranslatorImpl 2018-02-27 12:47:12,208+05 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) [] Start initializing ErrorTranslatorImpl 2018-02-27 12:47:12,208+05 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 47) [] Finished initializing ErrorTranslatorImpl 2018-02-27 12:47:12,208+05 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 47) [] Mark incomplete jobs as UNKNOWN 2018-02-27 12:47:12,265+05 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 47) [] Start initializing JobRepositoryCleanupManager 2018-02-27 12:47:12,294+05 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 47) [] Finished initializing JobRepositoryCleanupManager 2018-02-27 12:47:12,294+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager@3c8d8d2a 2018-02-27 12:47:12,294+05 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 47) [] Start initializing AutoRecoveryManager 2018-02-27 12:47:12,309+05 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 47) [] Finished initializing AutoRecoveryManager 2018-02-27 12:47:12,310+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.AutoRecoveryManager@5f3668cf 2018-02-27 12:47:12,319+05 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 47) [] Start initializing ExecutionMessageDirector 2018-02-27 12:47:12,320+05 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 47) [] Finished initializing ExecutionMessageDirector 2018-02-27 12:47:12,361+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.VmPoolHandler@6ad618de 2018-02-27 12:47:12,371+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.VmPoolMonitor@6d3f4ba1 2018-02-27 12:47:12,428+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.HaAutoStartVmsRunner@aa6d115 2018-02-27 12:47:12,431+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.quota.QuotaManager@580126aa 2018-02-27 12:47:12,456+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.vdsbroker.monitoring.VmMigrationProgressMonitoring@1b64801d 2018-02-27 12:47:12,831+05 WARN [org.ovirt.engine.core.bll.IconLoader] (ServerService Thread Pool -- 47) [] java.lang.RuntimeException: Icon for rhel_6_9_plus_ppc64 was not found in /usr/share/ovirt-engine/icons/small 2018-02-27 12:47:12,831+05 WARN [org.ovirt.engine.core.bll.IconLoader] (ServerService Thread Pool -- 47) [] java.lang.RuntimeException: Icon for rhel_6_9_plus_ppc64 was not found in /usr/share/ovirt-engine/icons/large 2018-02-27 12:47:12,996+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.IconLoader@285f5e28 2018-02-27 12:47:13,001+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Loading extension 'internal-authn' 2018-02-27 12:47:13,001+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Extension 'internal-authn' loaded 2018-02-27 12:47:13,002+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Loading extension 'internal-authz' 2018-02-27 12:47:13,002+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Extension 'internal-authz' loaded 2018-02-27 12:47:13,003+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Initializing extension 'internal-authn' 2018-02-27 12:47:13,030+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Extension 'internal-authn' initialized 2018-02-27 12:47:13,031+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Start of enabled extensions list 2018-02-27 12:47:13,031+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Instance name: 'internal-authn', Extension name: '"ovirt-engine-extension-aaa-jdbc".authn', Version: '"1.1.6"', Notes: 'Display name: "ovirt-engine-extension-aaa-jdbc"', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: '/etc/ovirt-engine/extensions.d/internal-authn.properties', Initialized: 'true' 2018-02-27 12:47:13,031+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] Instance name: 'internal-authz', Extension name: '"ovirt-engine-extension-aaa-jdbc".authz', Version: '"1.1.6"', Notes: 'Display name: "ovirt-engine-extension-aaa-jdbc"', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: '/etc/ovirt-engine/extensions.d/internal-authz.properties', Initialized: 'false' 2018-02-27 12:47:13,031+05 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 47) [] End of enabled extensions list 2018-02-27 12:47:13,107+05 INFO [org.ovirt.engine.core.bll.pm.PmHealthCheckManager] (ServerService Thread Pool -- 47) [] Finished initializing PmHealthCheckManager 2018-02-27 12:47:13,107+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.pm.PmHealthCheckManager@742c6dd1 2018-02-27 12:47:13,108+05 INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (ServerService Thread Pool -- 47) [] Start initializing EngineBackupAwarenessManager 2018-02-27 12:47:13,109+05 INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (ServerService Thread Pool -- 47) [] Finished initializing EngineBackupAwarenessManager 2018-02-27 12:47:13,109+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.EngineBackupAwarenessManager@c298baf 2018-02-27 12:47:13,110+05 INFO [org.ovirt.engine.core.bll.DataCenterCompatibilityChecker] (ServerService Thread Pool -- 47) [] Start initializing DataCenterCompatibilityChecker 2018-02-27 12:47:13,111+05 INFO [org.ovirt.engine.core.bll.DataCenterCompatibilityChecker] (ServerService Thread Pool -- 47) [] Finished initializing DataCenterCompatibilityChecker 2018-02-27 12:47:13,111+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.DataCenterCompatibilityChecker@694e914d 2018-02-27 12:47:13,111+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass@29fa0b38 2018-02-27 12:47:13,171+05 INFO [org.ovirt.engine.core.bll.PrevalidatingMultipleActionsRunner] (ServerService Thread Pool -- 47) [] PrevalidatingMultipleActionsRunner of type 'RefreshHostDevices' invoked with no actions 2018-02-27 12:47:13,190+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.hostdev.HostDeviceManager@da3fb64 2018-02-27 12:47:13,191+05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyManager] (ServerService Thread Pool -- 47) [] Start initializing IrsProxyManager 2018-02-27 12:47:13,227+05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyManager] (ServerService Thread Pool -- 47) [] Start initializing IrsProxyManager 2018-02-27 12:47:13,228+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyManager@20bf48bd 2018-02-27 12:47:13,230+05 INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (ServerService Thread Pool -- 47) [] Initialization of OvfDataUpdater completed successfully. 2018-02-27 12:47:13,230+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater@3d95e933 2018-02-27 12:47:13,306+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.gluster.GlusterJobsManager@2576cb67 2018-02-27 12:47:13,308+05 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 47) [] Init VM custom properties utilities 2018-02-27 12:47:13,309+05 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 47) [] Init device custom properties utilities 2018-02-27 12:47:13,337+05 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 47) [] Initializing Scheduling manager 2018-02-27 12:47:13,547+05 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 47) [] External scheduler disabled, discovery skipped 2018-02-27 12:47:13,548+05 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 47) [] Start scheduling to enable vds load balancer 2018-02-27 12:47:13,559+05 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 47) [] Finished scheduling to enable vds load balancer 2018-02-27 12:47:13,559+05 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 47) [] Start HA Reservation check 2018-02-27 12:47:13,615+05 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 47) [] Finished HA Reservation check 2018-02-27 12:47:13,615+05 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 47) [] Initialized Scheduling manager 2018-02-27 12:47:13,615+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.scheduling.SchedulingManager@7b883d4a 2018-02-27 12:47:13,622+05 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 47) [] Initializing DWH Heart Beat 2018-02-27 12:47:13,633+05 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 47) [] DWH Heart Beat initialized 2018-02-27 12:47:13,633+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.dwh.DwhHeartBeat@689cd41a 2018-02-27 12:47:13,679+05 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ServerService Thread Pool -- 47) [] Initialization of AsyncTaskManager completed successfully. 2018-02-27 12:47:13,679+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.tasks.AsyncTaskManager@39a34977 2018-02-27 12:47:13,680+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.tasks.CommandCoordinatorUtil@217265b8 2018-02-27 12:47:13,680+05 INFO [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (ServerService Thread Pool -- 47) [] Start initializing CommandCallbacksPoller 2018-02-27 12:47:13,683+05 INFO [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (ServerService Thread Pool -- 47) [] Finished initializing CommandCallbacksPoller 2018-02-27 12:47:13,683+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller@72fd831 2018-02-27 12:47:13,684+05 INFO [org.ovirt.engine.core.bll.CommandEntityCleanupManager] (ServerService Thread Pool -- 47) [] Start initializing CommandEntityCleanupManager 2018-02-27 12:47:13,684+05 INFO [org.ovirt.engine.core.bll.CommandEntityCleanupManager] (ServerService Thread Pool -- 47) [] Setting command entity cleanup manager to run at: 35 35 3 * * ? 2018-02-27 12:47:13,686+05 INFO [org.ovirt.engine.core.bll.CommandEntityCleanupManager] (ServerService Thread Pool -- 47) [] Finished initializing CommandEntityCleanupManager 2018-02-27 12:47:13,686+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.CommandEntityCleanupManager@1db45914 2018-02-27 12:47:13,718+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 47) [] EVENT_ID: AFFINITY_RULES_ENFORCEMENT_MANAGER_START(10,780), Affinity Rules Enforcement Manager started. 2018-02-27 12:47:13,720+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.scheduling.AffinityRulesEnforcementManager@557dd947 2018-02-27 12:47:13,723+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.CertificationValidityChecker@2c7147b1 2018-02-27 12:47:13,726+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.hostdeploy.HostUpdatesCheckerService@986cf1b 2018-02-27 12:47:13,727+05 INFO [org.ovirt.engine.core.bll.IPTablesDeprecationNotifier] (ServerService Thread Pool -- 47) [] Start initializing IPTablesDeprecationNotifier 2018-02-27 12:47:13,758+05 INFO [org.ovirt.engine.core.bll.IPTablesDeprecationNotifier] (ServerService Thread Pool -- 47) [] Finished initializing IPTablesDeprecationNotifier 2018-02-27 12:47:13,758+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.IPTablesDeprecationNotifier@50094ce8 2018-02-27 12:47:13,786+05 INFO [org.ovirt.engine.core.bll.ServiceLoader] (ServerService Thread Pool -- 47) [] Start org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService@3ad0a354 2018-02-27 12:52:13,968+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-18) [7f68dab0] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 12:52:14,046+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-18) [7f68dab0] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 12:52:14,885+05 INFO [org.ovirt.engine.extension.aaa.jdbc.core.Tasks] (default task-6) [] (house keeping) deleting failed logins prior to 2018-02-20 07:52:14Z. 2018-02-27 12:52:15,139+05 INFO [org.ovirt.engine.extension.aaa.jdbc.core.Tasks] (default task-6) [] (house keeping) deleting failed logins prior to 2018-02-20 07:52:15Z. 2018-02-27 12:52:15,256+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-6) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 12:52:16,328+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-18) [7f68dab0] EVENT_ID: PROVIDER_SYNCHRONIZED(215), Networks of Provider ovirt-provider-ovn were successfully synchronized. 2018-02-27 12:52:16,330+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-18) [7f68dab0] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 12:52:34,726+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-11) [] User admin@internal successfully logged in with scopes: ovirt-app-admin ovirt-app-api ovirt-app-portal ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 12:52:34,895+05 INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-13) [7bcf264] Running command: CreateUserSessionCommand internal: false. 2018-02-27 12:52:34,995+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-13) [7bcf264] EVENT_ID: USER_VDC_LOGIN(30), User admin@internal-authz connecting from '192.168.30.13' using session 'jt9VxvME3XMaK40DQx5HliEl6E+fL7hbQfnuDUvAmP/qZ88yMVNke5CQ77DMATDcfofT+bKScULWOKeutIvKTQ==' logged in. 2018-02-27 12:52:35,024+05 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (default task-12) [] Reading UI plugin descriptor '/usr/share/ovirt-engine/ui-plugins/dashboard.json' 2018-02-27 12:52:35,026+05 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (default task-12) [] Reading UI plugin configuration '/etc/ovirt-engine/ui-plugins/dashboard-config.json' 2018-02-27 12:52:39,496+05 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (default task-6) [] Can't read file '/usr/share/ovirt-engine/files/spice/SpiceVersion.txt' for request '/ovirt-engine/services/files/spice/SpiceVersion.txt', will send a 404 error response. 2018-02-27 12:52:41,569+05 WARN [org.ovirt.engine.core.utils.servlet.ServletUtils] (default task-9) [] File '/usr/share/ovirt-engine/ui-plugins/dashboard-resources/css/main-tab.d3769419.css' is 2839039 bytes long. Please reconsider using this servlet for files larger than 1048576 bytes. 2018-02-27 12:53:00,869+05 INFO [org.ovirt.engine.core.bll.storage.pool.RemoveStoragePoolCommand] (EE-ManagedThreadFactory-engine-Thread-1) [87789bf4-c90f-4f75-a5c7-527d7f35949e] Running command: RemoveStoragePoolCommand internal: false. Entities affected : ID: 32709b66-1b92-11e8-9f71-000c29065519 Type: StoragePoolAction group DELETE_STORAGE_POOL with role type ADMIN 2018-02-27 12:53:03,096+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [87789bf4-c90f-4f75-a5c7-527d7f35949e] EVENT_ID: USER_REMOVE_STORAGE_POOL(954), Data Center Default was removed by admin@internal-authz 2018-02-27 12:53:17,266+05 INFO [org.ovirt.engine.core.bll.storage.pool.AddEmptyStoragePoolCommand] (default task-7) [17a37926-423d-480d-9492-822f1e563c75] Running command: AddEmptyStoragePoolCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_POOL with role type ADMIN 2018-02-27 12:53:17,430+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-7) [17a37926-423d-480d-9492-822f1e563c75] EVENT_ID: USER_ADD_STORAGE_POOL(950), Data Center uoi_datcenter, Compatibility Version 4.2 and Quota Type DISABLED was added by admin@internal-authz 2018-02-27 12:53:56,279+05 INFO [org.ovirt.engine.core.bll.AddClusterCommand] (default task-6) [8f2a7a3d-acf2-425b-aefd-f79a772fad94] Running command: AddClusterCommand internal: false. Entities affected : ID: d277bdc4-93c4-4602-a166-f45a7f92c18c Type: StoragePoolAction group CREATE_CLUSTER with role type ADMIN, ID: 58ca604b-017d-0374-0220-00000000014e Type: MacPoolAction group CONFIGURE_MAC_POOL with role type ADMIN 2018-02-27 12:53:56,442+05 INFO [org.ovirt.engine.core.bll.profiles.AddCpuProfileCommand] (default task-6) [34e6f4a9] Running command: AddCpuProfileCommand internal: false. Entities affected : ID: 733e7985-3d4f-454e-8765-df1100b3d17b Type: ClusterAction group CREATE_CPU_PROFILE with role type ADMIN 2018-02-27 12:53:56,523+05 INFO [org.ovirt.engine.core.bll.AddPermissionCommand] (default task-6) [1b02070e] Running command: AddPermissionCommand internal: false. Entities affected : ID: feebadd9-687b-4577-b845-321a6acc7fa2 Type: CpuProfileAction group MANIPULATE_PERMISSIONS with role type USER 2018-02-27 12:53:56,589+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-6) [1b02070e] EVENT_ID: USER_ADD_PERMISSION(850), User/Group Everyone, Namespace *, Authorization provider: N/A was granted permission for Role CpuProfileOperator on Cpu Profile uoi_cluster, by admin@internal-authz. 2018-02-27 12:53:56,607+05 INFO [org.ovirt.engine.core.bll.AddPermissionCommand] (default task-6) [d75d74a] Running command: AddPermissionCommand internal: false. Entities affected : ID: feebadd9-687b-4577-b845-321a6acc7fa2 Type: CpuProfileAction group MANIPULATE_PERMISSIONS with role type USER 2018-02-27 12:53:56,667+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-6) [d75d74a] EVENT_ID: USER_ADD_PERMISSION(850), User/Group admin, Namespace *, Authorization provider: internal-authz was granted permission for Role CpuProfileCreator on Cpu Profile uoi_cluster, by admin@internal-authz. 2018-02-27 12:53:56,708+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-6) [] EVENT_ID: USER_ADDED_CPU_PROFILE(10,130), CPU Profile uoi_cluster was successfully added (User: admin@internal-authz). 2018-02-27 12:53:56,760+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-6) [] EVENT_ID: USER_ADD_CLUSTER(809), Cluster uoi_cluster was added by admin@internal-authz 2018-02-27 12:54:53,087+05 INFO [org.ovirt.engine.core.bll.hostdeploy.AddVdsCommand] (default task-15) [20c406b6-f68f-476d-a4c8-5e8418faf1fa] Running command: AddVdsCommand internal: false. Entities affected : ID: 733e7985-3d4f-454e-8765-df1100b3d17b Type: ClusterAction group CREATE_HOST with role type ADMIN 2018-02-27 12:54:53,327+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-15) [c6b1d45] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 12:54:53,328+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-15) [c6b1d45] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 12:54:53,330+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-15) [c6b1d45] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 12:54:53,376+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-15) [c6b1d45] Lock freed to object 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 12:54:53,460+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-15) [c6b1d45] START, RemoveVdsVDSCommand(HostName = uoi_node2, RemoveVdsVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf'}), log id: 11a4593b 2018-02-27 12:54:53,461+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-15) [c6b1d45] FINISH, RemoveVdsVDSCommand, log id: 11a4593b 2018-02-27 12:54:53,506+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-15) [c6b1d45] START, AddVdsVDSCommand(HostName = uoi_node2, AddVdsVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf'}), log id: 1b2a6eb0 2018-02-27 12:54:53,506+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-15) [c6b1d45] AddVds - entered , starting logic to add VDS '4dc3ea41-bf09-415c-964f-4e5801eb0aaf' 2018-02-27 12:54:53,540+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-15) [c6b1d45] AddVds - VDS '4dc3ea41-bf09-415c-964f-4e5801eb0aaf' was added, will try to add it to the resource manager 2018-02-27 12:54:53,541+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-15) [c6b1d45] Entered VdsManager constructor 2018-02-27 12:54:53,596+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-15) [c6b1d45] Initialize vdsBroker '192.168.20.20:54321' 2018-02-27 12:54:53,762+05 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (default task-15) [c6b1d45] VDS '4dc3ea41-bf09-415c-964f-4e5801eb0aaf' was added to the Resource Manager 2018-02-27 12:54:53,763+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-15) [c6b1d45] FINISH, AddVdsVDSCommand, log id: 1b2a6eb0 2018-02-27 12:54:53,821+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-15) [c6b1d45] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 12:54:53,876+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-15) [c6b1d45] EVENT_ID: USER_ADD_VDS(42), Host uoi_node2 was added by admin@internal-authz. 2018-02-27 12:54:53,924+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 12:54:54,136+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 12:54:54,144+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] Before Installation host 4dc3ea41-bf09-415c-964f-4e5801eb0aaf, uoi_node2 2018-02-27 12:54:54,184+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 42f66b7f 2018-02-27 12:54:54,203+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] FINISH, SetVdsStatusVDSCommand, log id: 42f66b7f 2018-02-27 12:54:54,379+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 12:54:54,475+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 12:54:54,475+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 12:54:54,756+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 12:54:56,591+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Initializing. 2018-02-27 12:54:56,696+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment setup. 2018-02-27 12:54:56,784+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment packages setup. 2018-02-27 12:54:56,909+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Yum Cannot queue package dmidecode: Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 12:54:56,929+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Failed to execute stage 'Environment packages setup': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 12:54:56,943+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Yum Performing yum transaction rollback. 2018-02-27 12:54:57,003+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Clean up. 2018-02-27 12:54:57,020+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Pre-termination. 2018-02-27 12:54:57,081+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227125457-192.168.20.20-719d5f5d.log'. 2018-02-27 12:54:57,344+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [719d5f5d] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Termination. 2018-02-27 12:54:57,525+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 12:54:57,525+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] Error during host 192.168.20.20 install 2018-02-27 12:54:57,538+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] Host installation failed for host '4dc3ea41-bf09-415c-964f-4e5801eb0aaf', 'uoi_node2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 12:54:57,546+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 248a3835 2018-02-27 12:54:57,601+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] FINISH, SetVdsStatusVDSCommand, log id: 248a3835 2018-02-27 12:54:57,616+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] EVENT_ID: VDS_INSTALL_FAILED(505), Host uoi_node2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 12:54:57,622+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-2) [719d5f5d] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 12:56:00,137+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-14) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Running command: InstallVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 12:56:00,227+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-14) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 12:56:00,245+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 12:56:00,299+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: USER_UPDATE_VDS(43), Host uoi_node2 configuration was updated by admin@internal-authz. 2018-02-27 12:56:00,318+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 12:56:00,318+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Before Installation host 4dc3ea41-bf09-415c-964f-4e5801eb0aaf, uoi_node2 2018-02-27 12:56:00,336+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 6f5a09e7 2018-02-27 12:56:00,353+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] FINISH, SetVdsStatusVDSCommand, log id: 6f5a09e7 2018-02-27 12:56:00,619+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 12:56:00,698+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 12:56:00,698+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 12:56:00,807+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 12:56:02,381+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Initializing. 2018-02-27 12:56:02,462+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment setup. 2018-02-27 12:56:02,524+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment packages setup. 2018-02-27 12:56:02,570+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Yum Cannot queue package dmidecode: Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 12:56:02,590+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Failed to execute stage 'Environment packages setup': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 12:56:02,601+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Yum Performing yum transaction rollback. 2018-02-27 12:56:02,640+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Clean up. 2018-02-27 12:56:02,645+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Pre-termination. 2018-02-27 12:56:02,669+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227125602-192.168.20.20-17da70cf-a4e2-4895-9c0f-b92a2e49f10a.log'. 2018-02-27 12:56:02,890+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Termination. 2018-02-27 12:56:03,012+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 12:56:03,012+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Error during host 192.168.20.20 install 2018-02-27 12:56:03,015+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Host installation failed for host '4dc3ea41-bf09-415c-964f-4e5801eb0aaf', 'uoi_node2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 12:56:03,019+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 5fe32f18 2018-02-27 12:56:03,045+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] FINISH, SetVdsStatusVDSCommand, log id: 5fe32f18 2018-02-27 12:56:03,054+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] EVENT_ID: VDS_INSTALL_FAILED(505), Host uoi_node2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 12:56:03,067+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-3) [17da70cf-a4e2-4895-9c0f-b92a2e49f10a] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 12:57:10,531+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 12:57:10,531+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 12:57:10,531+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 12:57:16,363+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-19) [48084e01] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 12:57:16,377+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-19) [48084e01] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 12:57:16,589+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-4) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 12:57:16,897+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-19) [48084e01] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 12:57:16,897+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-19) [48084e01] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 12:57:16,924+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-19) [48084e01] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 12:57:16,925+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-19) [48084e01] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 12:59:25,602+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-13) [6725970b-d351-4969-a3e4-4f57f34454ef] Running command: InstallVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 12:59:25,625+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-13) [6725970b-d351-4969-a3e4-4f57f34454ef] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 12:59:25,637+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-13) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 12:59:25,673+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-13) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: USER_UPDATE_VDS(43), Host uoi_node2 configuration was updated by admin@internal-authz. 2018-02-27 12:59:25,677+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 12:59:25,677+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] Before Installation host 4dc3ea41-bf09-415c-964f-4e5801eb0aaf, uoi_node2 2018-02-27 12:59:25,695+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: c520aba 2018-02-27 12:59:25,736+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] FINISH, SetVdsStatusVDSCommand, log id: c520aba 2018-02-27 12:59:25,962+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 12:59:26,035+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 12:59:26,035+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 12:59:26,055+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 12:59:27,876+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Initializing. 2018-02-27 12:59:27,981+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment setup. 2018-02-27 12:59:28,039+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment packages setup. 2018-02-27 12:59:28,108+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Yum Cannot queue package dmidecode: Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 12:59:28,122+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Failed to execute stage 'Environment packages setup': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 12:59:28,136+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Yum Performing yum transaction rollback. 2018-02-27 12:59:28,175+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Clean up. 2018-02-27 12:59:28,188+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Pre-termination. 2018-02-27 12:59:28,230+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227125928-192.168.20.20-6725970b-d351-4969-a3e4-4f57f34454ef.log'. 2018-02-27 12:59:28,450+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Termination. 2018-02-27 12:59:28,556+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 12:59:28,557+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] Error during host 192.168.20.20 install 2018-02-27 12:59:28,561+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] Host installation failed for host '4dc3ea41-bf09-415c-964f-4e5801eb0aaf', 'uoi_node2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 12:59:28,571+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 2934909f 2018-02-27 12:59:28,584+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] FINISH, SetVdsStatusVDSCommand, log id: 2934909f 2018-02-27 12:59:28,589+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] EVENT_ID: VDS_INSTALL_FAILED(505), Host uoi_node2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 12:59:28,593+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-4) [6725970b-d351-4969-a3e4-4f57f34454ef] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:01:54,837+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-14) [f635d1a4-157a-4643-8b23-e271dedb7c23] Running command: InstallVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 13:01:54,860+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-14) [f635d1a4-157a-4643-8b23-e271dedb7c23] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:01:54,869+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 13:01:54,897+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: USER_UPDATE_VDS(43), Host uoi_node2 configuration was updated by admin@internal-authz. 2018-02-27 13:01:54,914+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 13:01:54,914+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] Before Installation host 4dc3ea41-bf09-415c-964f-4e5801eb0aaf, uoi_node2 2018-02-27 13:01:54,921+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 33d3ee34 2018-02-27 13:01:54,946+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] FINISH, SetVdsStatusVDSCommand, log id: 33d3ee34 2018-02-27 13:01:55,160+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 13:01:55,245+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 13:01:55,245+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 13:01:55,300+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 13:01:56,987+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Initializing. 2018-02-27 13:01:57,092+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment setup. 2018-02-27 13:01:57,164+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment packages setup. 2018-02-27 13:01:57,208+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Yum Cannot queue package dmidecode: Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:01:57,220+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Failed to execute stage 'Environment packages setup': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:01:57,223+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Yum Performing yum transaction rollback. 2018-02-27 13:01:57,268+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Clean up. 2018-02-27 13:01:57,274+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Pre-termination. 2018-02-27 13:01:57,305+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227130157-192.168.20.20-f635d1a4-157a-4643-8b23-e271dedb7c23.log'. 2018-02-27 13:01:57,487+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Termination. 2018-02-27 13:01:57,612+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:01:57,613+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] Error during host 192.168.20.20 install 2018-02-27 13:01:57,616+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] Host installation failed for host '4dc3ea41-bf09-415c-964f-4e5801eb0aaf', 'uoi_node2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:01:57,627+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 34eef300 2018-02-27 13:01:57,631+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] FINISH, SetVdsStatusVDSCommand, log id: 34eef300 2018-02-27 13:01:57,635+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] EVENT_ID: VDS_INSTALL_FAILED(505), Host uoi_node2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 13:01:57,640+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-5) [f635d1a4-157a-4643-8b23-e271dedb7c23] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:02:16,957+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-63) [253b1012] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:02:16,968+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-63) [253b1012] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:02:17,117+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-16) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:02:17,268+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-63) [253b1012] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:02:17,268+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-63) [253b1012] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:02:17,309+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-63) [253b1012] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:02:17,310+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-63) [253b1012] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:05:01,898+05 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-4) [993fd8c0-6c51-490e-b01c-3d9b2447ed7d] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:05:01,903+05 WARN [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-4) [993fd8c0-6c51-490e-b01c-3d9b2447ed7d] Validation of action 'ActivateVds' failed for user admin@internal-authz. Reasons: VAR__ACTION__ACTIVATE,VAR__TYPE__HOST,VDS_NO_UUID 2018-02-27 13:05:01,904+05 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-4) [993fd8c0-6c51-490e-b01c-3d9b2447ed7d] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:06:59,034+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-10) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Running command: InstallVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 13:06:59,069+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-10) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:06:59,076+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-10) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 13:06:59,107+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-10) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: USER_UPDATE_VDS(43), Host uoi_node2 configuration was updated by admin@internal-authz. 2018-02-27 13:06:59,127+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 13:06:59,128+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Before Installation host 4dc3ea41-bf09-415c-964f-4e5801eb0aaf, uoi_node2 2018-02-27 13:06:59,142+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 2fe4db5c 2018-02-27 13:06:59,154+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] FINISH, SetVdsStatusVDSCommand, log id: 2fe4db5c 2018-02-27 13:06:59,406+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 13:06:59,456+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 13:06:59,457+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 13:06:59,487+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 13:07:01,317+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Initializing. 2018-02-27 13:07:01,419+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment setup. 2018-02-27 13:07:01,476+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment packages setup. 2018-02-27 13:07:01,532+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Yum Cannot queue package dmidecode: Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:07:01,536+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Failed to execute stage 'Environment packages setup': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:07:01,539+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Yum Performing yum transaction rollback. 2018-02-27 13:07:01,601+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Clean up. 2018-02-27 13:07:01,612+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Pre-termination. 2018-02-27 13:07:01,635+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227130701-192.168.20.20-ee09e99a-2c1f-4275-a0d8-d6c20cec6f85.log'. 2018-02-27 13:07:01,852+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Termination. 2018-02-27 13:07:01,934+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:07:01,934+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Error during host 192.168.20.20 install 2018-02-27 13:07:01,937+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Host installation failed for host '4dc3ea41-bf09-415c-964f-4e5801eb0aaf', 'uoi_node2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:07:01,940+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 2611365f 2018-02-27 13:07:01,947+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] FINISH, SetVdsStatusVDSCommand, log id: 2611365f 2018-02-27 13:07:01,950+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] EVENT_ID: VDS_INSTALL_FAILED(505), Host uoi_node2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 13:07:01,973+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-7) [ee09e99a-2c1f-4275-a0d8-d6c20cec6f85] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:07:10,538+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 13:07:10,538+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engine' is using 0 threads out of 500, 1 threads waiting for tasks and 0 tasks in queue. 2018-02-27 13:07:10,539+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 13:07:10,539+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 13:07:17,339+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-50) [39f6fb6e] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:07:17,349+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-50) [39f6fb6e] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:07:17,500+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-1) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:07:17,681+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-50) [39f6fb6e] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:07:17,681+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-50) [39f6fb6e] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:07:17,691+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-50) [39f6fb6e] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:07:17,691+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-50) [39f6fb6e] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:09:02,097+05 INFO [org.ovirt.engine.core.bll.network.dc.UpdateNetworkCommand] (default task-15) [e7166805-3b80-43a4-bf56-b90b88276c95] Running command: UpdateNetworkCommand internal: false. Entities affected : ID: f42a50d6-ad88-4caf-8533-10d2cad1ef5d Type: NetworkAction group CONFIGURE_STORAGE_POOL_NETWORK with role type ADMIN 2018-02-27 13:09:02,158+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-15) [e7166805-3b80-43a4-bf56-b90b88276c95] EVENT_ID: NETWORK_UPDATE_NETWORK(1,114), Network ovirtmgmt was updated on Data Center: uoi_datcenter 2018-02-27 13:10:20,628+05 INFO [org.ovirt.engine.core.bll.network.dc.UpdateNetworkCommand] (default task-9) [945b9e5f-f97f-4491-978e-c7608256dd81] Running command: UpdateNetworkCommand internal: false. Entities affected : ID: f42a50d6-ad88-4caf-8533-10d2cad1ef5d Type: NetworkAction group CONFIGURE_STORAGE_POOL_NETWORK with role type ADMIN 2018-02-27 13:10:20,643+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-9) [945b9e5f-f97f-4491-978e-c7608256dd81] EVENT_ID: NETWORK_UPDATE_NETWORK(1,114), Network ovirtmgmt was updated on Data Center: uoi_datcenter 2018-02-27 13:12:17,706+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-26) [65ddde1c] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:12:17,723+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-26) [65ddde1c] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:12:17,838+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-8) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:12:17,990+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-26) [65ddde1c] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:12:17,990+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-26) [65ddde1c] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:12:18,005+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-26) [65ddde1c] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:12:18,005+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-26) [65ddde1c] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:17:10,546+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 13:17:10,547+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 13:17:10,547+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 13:17:18,054+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-27) [3f42c6f] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:17:18,067+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-27) [3f42c6f] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:17:18,212+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-12) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:17:18,383+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-27) [3f42c6f] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:17:18,383+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-27) [3f42c6f] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:17:18,443+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-27) [3f42c6f] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:17:18,444+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-27) [3f42c6f] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:22:18,483+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-80) [e1cc343] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:22:18,496+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-80) [e1cc343] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:22:18,618+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-7) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:22:18,851+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-80) [e1cc343] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:22:18,851+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-80) [e1cc343] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:22:18,869+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-80) [e1cc343] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:22:18,869+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-80) [e1cc343] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:27:10,558+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 13:27:10,558+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 13:27:10,558+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 13:27:18,896+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [54e99277] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:27:18,904+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [54e99277] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:27:19,011+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-11) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:27:19,173+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [54e99277] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:27:19,173+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [54e99277] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:27:19,183+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [54e99277] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:27:19,183+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [54e99277] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:32:19,198+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [6eaaae9] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:32:19,206+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [6eaaae9] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:32:19,325+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-5) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:32:19,510+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [6eaaae9] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:32:19,510+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [6eaaae9] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:32:19,517+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [6eaaae9] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:32:19,518+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [6eaaae9] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:37:10,561+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 13:37:10,561+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 13:37:10,561+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 13:37:19,550+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [46d82646] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:37:19,565+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [46d82646] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:37:19,682+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-11) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:37:19,870+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [46d82646] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:37:19,870+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [46d82646] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:37:19,878+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [46d82646] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:37:19,879+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-53) [46d82646] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:41:10,244+05 INFO [org.ovirt.engine.core.sso.servlets.OAuthRevokeServlet] (default task-5) [] User admin@internal successfully logged out 2018-02-27 13:41:10,281+05 INFO [org.ovirt.engine.core.bll.aaa.TerminateSessionsForTokenCommand] (default task-10) [2f219c48] Running command: TerminateSessionsForTokenCommand internal: true. 2018-02-27 13:42:19,907+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-36) [5c840e19] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:42:19,925+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-36) [5c840e19] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:42:20,056+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-15) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:42:20,257+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-36) [5c840e19] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:42:20,257+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-36) [5c840e19] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:42:20,267+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-36) [5c840e19] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:42:20,268+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-36) [5c840e19] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:47:10,566+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 13:47:10,567+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 13:47:10,567+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 13:47:13,234+05 INFO [org.ovirt.engine.core.bll.storage.ovfstore.OvfDataUpdater] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [] Attempting to update VMs/Templates Ovf. 2018-02-27 13:47:20,283+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-91) [360e87dc] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:47:20,291+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-91) [360e87dc] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:47:20,432+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-12) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:47:20,606+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-91) [360e87dc] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:47:20,606+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-91) [360e87dc] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:47:20,613+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-91) [360e87dc] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:47:20,615+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-91) [360e87dc] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:48:43,460+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-8) [] User admin@internal successfully logged in with scopes: ovirt-app-admin ovirt-app-api ovirt-app-portal ovirt-ext=auth:sequence-priority=~ ovirt-ext=revoke:revoke-all ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:48:43,548+05 INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-14) [16f46965] Running command: CreateUserSessionCommand internal: false. 2018-02-27 13:48:43,559+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-14) [16f46965] EVENT_ID: USER_VDC_LOGIN(30), User admin@internal-authz connecting from '192.168.30.13' using session '8Cbz3pJ9DUHBSBg2/ufMaA1J2CMYT5r8EZRzopJPNzXt4vXHGlew8Ivl/9Zzi8rFt1tHGbsXUpQ4IYtfaPkPXg==' logged in. 2018-02-27 13:48:44,876+05 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (default task-16) [] Can't read file '/usr/share/ovirt-engine/files/spice/SpiceVersion.txt' for request '/ovirt-engine/services/files/spice/SpiceVersion.txt', will send a 404 error response. 2018-02-27 13:48:46,427+05 WARN [org.ovirt.engine.core.utils.servlet.ServletUtils] (default task-11) [] File '/usr/share/ovirt-engine/ui-plugins/dashboard-resources/css/main-tab.d3769419.css' is 2839039 bytes long. Please reconsider using this servlet for files larger than 1048576 bytes. 2018-02-27 13:49:10,343+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-15) [48706bf5-1834-4223-a178-382c7b052991] Running command: InstallVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 13:49:10,387+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-15) [48706bf5-1834-4223-a178-382c7b052991] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:49:10,404+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-15) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 13:49:10,455+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-15) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: USER_UPDATE_VDS(43), Host uoi_node2 configuration was updated by admin@internal-authz. 2018-02-27 13:49:10,470+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 13:49:10,470+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] Before Installation host 4dc3ea41-bf09-415c-964f-4e5801eb0aaf, uoi_node2 2018-02-27 13:49:10,478+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 7e90eefd 2018-02-27 13:49:10,519+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] FINISH, SetVdsStatusVDSCommand, log id: 7e90eefd 2018-02-27 13:49:10,773+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 13:49:10,833+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 13:49:10,833+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 13:49:11,034+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 13:49:12,576+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Initializing. 2018-02-27 13:49:12,695+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment setup. 2018-02-27 13:49:12,732+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment packages setup. 2018-02-27 13:49:12,949+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Programs detection. 2018-02-27 13:49:13,063+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment customization. 2018-02-27 13:49:13,123+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Yum Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:49:13,131+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Failed to execute stage 'Environment customization': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:49:13,145+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Clean up. 2018-02-27 13:49:13,151+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Pre-termination. 2018-02-27 13:49:13,200+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227134913-192.168.20.20-48706bf5-1834-4223-a178-382c7b052991.log'. 2018-02-27 13:49:13,418+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Termination. 2018-02-27 13:49:13,560+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:49:13,560+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] Error during host 192.168.20.20 install 2018-02-27 13:49:13,567+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] Host installation failed for host '4dc3ea41-bf09-415c-964f-4e5801eb0aaf', 'uoi_node2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:49:13,573+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: ea599e1 2018-02-27 13:49:13,584+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] FINISH, SetVdsStatusVDSCommand, log id: ea599e1 2018-02-27 13:49:13,596+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] EVENT_ID: VDS_INSTALL_FAILED(505), Host uoi_node2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 13:49:13,599+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-8) [48706bf5-1834-4223-a178-382c7b052991] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:49:32,650+05 INFO [org.ovirt.engine.core.bll.ClearAllAuditLogAlertsCommand] (default task-9) [9d358b5c-ebb8-4db0-8973-1bcb120bbcc9] Running command: ClearAllAuditLogAlertsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group AUDIT_LOG_MANAGEMENT with role type ADMIN 2018-02-27 13:49:32,764+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.MessageBundler] (default task-9) [9d358b5c-ebb8-4db0-8973-1bcb120bbcc9] Key 'USER_CLEAR_ALL_AUDIT_LOG' is not translated in 'bundles/AuditLogMessages' 2018-02-27 13:49:32,764+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-9) [9d358b5c-ebb8-4db0-8973-1bcb120bbcc9] Unable to create AuditLog 2018-02-27 13:49:44,286+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-12) [6e757552-60c0-4da3-9107-3e3790e51b88] Running command: InstallVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 13:49:44,302+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-12) [6e757552-60c0-4da3-9107-3e3790e51b88] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:49:44,317+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-12) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 13:49:44,360+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-12) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: USER_UPDATE_VDS(43), Host uoi_node2 configuration was updated by admin@internal-authz. 2018-02-27 13:49:44,369+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 13:49:44,370+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] Before Installation host 4dc3ea41-bf09-415c-964f-4e5801eb0aaf, uoi_node2 2018-02-27 13:49:44,376+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 2cc0e175 2018-02-27 13:49:44,398+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] FINISH, SetVdsStatusVDSCommand, log id: 2cc0e175 2018-02-27 13:49:44,606+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 13:49:44,686+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 13:49:44,686+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 13:49:44,760+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 13:49:46,411+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Initializing. 2018-02-27 13:49:46,509+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment setup. 2018-02-27 13:49:46,549+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment packages setup. 2018-02-27 13:49:46,698+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Programs detection. 2018-02-27 13:49:46,807+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment customization. 2018-02-27 13:49:46,874+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Yum Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:49:46,879+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Failed to execute stage 'Environment customization': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:49:46,884+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Clean up. 2018-02-27 13:49:46,909+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Pre-termination. 2018-02-27 13:49:46,959+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227134946-192.168.20.20-6e757552-60c0-4da3-9107-3e3790e51b88.log'. 2018-02-27 13:49:47,180+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Termination. 2018-02-27 13:49:47,304+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:49:47,304+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] Error during host 192.168.20.20 install 2018-02-27 13:49:47,307+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] Host installation failed for host '4dc3ea41-bf09-415c-964f-4e5801eb0aaf', 'uoi_node2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:49:47,319+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 38355ef 2018-02-27 13:49:47,325+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] FINISH, SetVdsStatusVDSCommand, log id: 38355ef 2018-02-27 13:49:47,329+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] EVENT_ID: VDS_INSTALL_FAILED(505), Host uoi_node2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 13:49:47,333+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-9) [6e757552-60c0-4da3-9107-3e3790e51b88] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:50:05,748+05 WARN [org.ovirt.engine.core.bll.hostdeploy.UpdateVdsCommand] (default task-5) [ad979c31-de7a-461b-abfb-790f29547fd3] Validation of action 'UpdateVds' failed for user admin@internal-authz. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__HOST,ACTION_TYPE_FAILED_PM_ENABLED_WITHOUT_AGENT 2018-02-27 13:50:22,084+05 WARN [org.ovirt.engine.core.bll.hostdeploy.UpdateVdsCommand] (default task-4) [cd1696e7-786c-41c2-a966-525f99bb5530] Validation of action 'UpdateVds' failed for user admin@internal-authz. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__HOST,ACTION_TYPE_FAILED_PM_ENABLED_WITHOUT_AGENT 2018-02-27 13:50:32,058+05 WARN [org.ovirt.engine.core.bll.hostdeploy.UpdateVdsCommand] (default task-11) [8001d9cf-313e-42ed-9eb4-8334ba1d8fce] Validation of action 'UpdateVds' failed for user admin@internal-authz. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__HOST,ACTION_TYPE_FAILED_PM_ENABLED_WITHOUT_AGENT 2018-02-27 13:50:47,318+05 INFO [org.ovirt.engine.core.bll.hostdeploy.UpdateVdsCommand] (default task-5) [700cdcd2-3383-4fee-a2ac-7d80b7efa545] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 13:50:47,328+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [700cdcd2-3383-4fee-a2ac-7d80b7efa545] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 13:50:47,337+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [700cdcd2-3383-4fee-a2ac-7d80b7efa545] EVENT_ID: USER_UPDATE_VDS(43), Host uoi_node2 configuration was updated by admin@internal-authz. 2018-02-27 13:50:56,479+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-1) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Running command: InstallVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 13:50:56,493+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-1) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:50:56,504+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-1) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host uoi_node2. 2018-02-27 13:50:56,529+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-1) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: USER_UPDATE_VDS(43), Host uoi_node2 configuration was updated by admin@internal-authz. 2018-02-27 13:50:56,535+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDS 2018-02-27 13:50:56,535+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Before Installation host 4dc3ea41-bf09-415c-964f-4e5801eb0aaf, uoi_node2 2018-02-27 13:50:56,544+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 19794126 2018-02-27 13:50:56,567+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] FINISH, SetVdsStatusVDSCommand, log id: 19794126 2018-02-27 13:50:56,785+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 13:50:56,851+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 13:50:56,851+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 13:50:56,868+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 13:50:58,625+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Initializing. 2018-02-27 13:50:58,728+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment setup. 2018-02-27 13:50:58,786+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment packages setup. 2018-02-27 13:50:58,934+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Programs detection. 2018-02-27 13:50:59,048+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Environment customization. 2018-02-27 13:50:59,122+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Yum Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:50:59,125+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host uoi_node2: Failed to execute stage 'Environment customization': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:50:59,130+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Clean up. 2018-02-27 13:50:59,135+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Pre-termination. 2018-02-27 13:50:59,175+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227135059-192.168.20.20-bb6c5aef-0117-4fc0-bca0-d258effc0af6.log'. 2018-02-27 13:50:59,396+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host uoi_node2. Stage: Termination. 2018-02-27 13:50:59,536+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:50:59,538+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Error during host 192.168.20.20 install 2018-02-27 13:50:59,541+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Host installation failed for host '4dc3ea41-bf09-415c-964f-4e5801eb0aaf', 'uoi_node2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:50:59,553+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] START, SetVdsStatusVDSCommand(HostName = uoi_node2, SetVdsStatusVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 4b8e69f5 2018-02-27 13:50:59,558+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] FINISH, SetVdsStatusVDSCommand, log id: 4b8e69f5 2018-02-27 13:50:59,562+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] EVENT_ID: VDS_INSTALL_FAILED(505), Host uoi_node2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 13:50:59,566+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-10) [bb6c5aef-0117-4fc0-bca0-d258effc0af6] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:51:08,243+05 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-12) [971a671b-5481-4742-901d-1a82db5e694f] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:51:08,247+05 WARN [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-12) [971a671b-5481-4742-901d-1a82db5e694f] Validation of action 'ActivateVds' failed for user admin@internal-authz. Reasons: VAR__ACTION__ACTIVATE,VAR__TYPE__HOST,VDS_NO_UUID 2018-02-27 13:51:08,247+05 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-12) [971a671b-5481-4742-901d-1a82db5e694f] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:51:14,941+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (default task-8) [c3a09de2-8378-429a-a1af-67b451cb5f29] Lock Acquired to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:51:14,964+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 4dc3ea41-bf09-415c-964f-4e5801eb0aaf Type: VDSAction group DELETE_HOST with role type ADMIN 2018-02-27 13:51:15,100+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] START, RemoveVdsVDSCommand( RemoveVdsVDSCommandParameters:{hostId='4dc3ea41-bf09-415c-964f-4e5801eb0aaf'}), log id: 2c190beb 2018-02-27 13:51:15,100+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] vdsManager::disposing 2018-02-27 13:51:15,103+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] FINISH, RemoveVdsVDSCommand, log id: 2c190beb 2018-02-27 13:51:15,155+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] EVENT_ID: VDS_ANSIBLE_HOST_REMOVE_STARTED(562), Ansible host-remove playbook execution started on host uoi_node2. 2018-02-27 13:51:15,194+05 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) [] Exception thrown during message processing 2018-02-27 13:51:15,206+05 INFO [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] Executing Ansible command: [/usr/bin/ansible-playbook, -v, --private-key=/etc/pki/ovirt-engine/keys/engine_id_rsa, --inventory=/tmp/ansible-inventory5281856554490930522, /usr/share/ovirt-engine/playbooks/ovirt-host-remove.yml] [Logfile: /var/log/ovirt-engine/ansible/ansible-20180227135115-ovirt-host-remove_yml.log] 2018-02-27 13:51:21,395+05 INFO [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] Ansible playbook command has exited with value: 4 2018-02-27 13:51:21,398+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] EVENT_ID: VDS_ANSIBLE_HOST_REMOVE_FAILED(564), Ansible host-remove playbook execution failed on host uoi_node2. For more details please check log /var/log/ovirt-engine/ansible/ansible-20180227135115-ovirt-host-remove_yml.log 2018-02-27 13:51:21,413+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] EVENT_ID: USER_REMOVE_VDS(44), Host uoi_node2 was removed by admin@internal-authz. 2018-02-27 13:51:21,413+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (EE-ManagedThreadFactory-engine-Thread-12) [c3a09de2-8378-429a-a1af-67b451cb5f29] Lock freed to object 'EngineLock:{exclusiveLocks='[4dc3ea41-bf09-415c-964f-4e5801eb0aaf=VDS]', sharedLocks=''}' 2018-02-27 13:51:43,355+05 INFO [org.ovirt.engine.core.bll.hostdeploy.AddVdsCommand] (default task-6) [83acef70-c7b1-44d0-9670-23a3a46e23da] Running command: AddVdsCommand internal: false. Entities affected : ID: 733e7985-3d4f-454e-8765-df1100b3d17b Type: ClusterAction group CREATE_HOST with role type ADMIN 2018-02-27 13:51:43,372+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-6) [1adc806d] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 13:51:43,372+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-6) [1adc806d] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 13:51:43,374+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-6) [1adc806d] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 418d5b49-1c25-4e95-808f-67579a9f9ae1 Type: VDS 2018-02-27 13:51:43,396+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-6) [1adc806d] Lock freed to object 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 13:51:43,400+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-6) [1adc806d] START, RemoveVdsVDSCommand(HostName = node_2, RemoveVdsVDSCommandParameters:{hostId='418d5b49-1c25-4e95-808f-67579a9f9ae1'}), log id: 1ccc85d0 2018-02-27 13:51:43,401+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-6) [1adc806d] FINISH, RemoveVdsVDSCommand, log id: 1ccc85d0 2018-02-27 13:51:43,405+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-6) [1adc806d] START, AddVdsVDSCommand(HostName = node_2, AddVdsVDSCommandParameters:{hostId='418d5b49-1c25-4e95-808f-67579a9f9ae1'}), log id: 78fde0af 2018-02-27 13:51:43,405+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-6) [1adc806d] AddVds - entered , starting logic to add VDS '418d5b49-1c25-4e95-808f-67579a9f9ae1' 2018-02-27 13:51:43,406+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-6) [1adc806d] AddVds - VDS '418d5b49-1c25-4e95-808f-67579a9f9ae1' was added, will try to add it to the resource manager 2018-02-27 13:51:43,406+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-6) [1adc806d] Entered VdsManager constructor 2018-02-27 13:51:43,424+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-6) [1adc806d] Initialize vdsBroker '192.168.20.20:54321' 2018-02-27 13:51:43,435+05 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (default task-6) [1adc806d] VDS '418d5b49-1c25-4e95-808f-67579a9f9ae1' was added to the Resource Manager 2018-02-27 13:51:43,435+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-6) [1adc806d] FINISH, AddVdsVDSCommand, log id: 78fde0af 2018-02-27 13:51:43,465+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-6) [1adc806d] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host node_2. 2018-02-27 13:51:43,476+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-6) [1adc806d] EVENT_ID: USER_ADD_VDS(42), Host node_2 was added by admin@internal-authz. 2018-02-27 13:51:43,487+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] Lock Acquired to object 'EngineLock:{exclusiveLocks='[418d5b49-1c25-4e95-808f-67579a9f9ae1=VDS]', sharedLocks=''}' 2018-02-27 13:51:43,533+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 418d5b49-1c25-4e95-808f-67579a9f9ae1 Type: VDS 2018-02-27 13:51:43,533+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] Before Installation host 418d5b49-1c25-4e95-808f-67579a9f9ae1, node_2 2018-02-27 13:51:43,537+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] START, SetVdsStatusVDSCommand(HostName = node_2, SetVdsStatusVDSCommandParameters:{hostId='418d5b49-1c25-4e95-808f-67579a9f9ae1', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 292c5e2f 2018-02-27 13:51:43,555+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] FINISH, SetVdsStatusVDSCommand, log id: 292c5e2f 2018-02-27 13:51:43,752+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 13:51:43,837+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 13:51:43,837+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 13:51:43,878+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 13:51:45,590+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Initializing. 2018-02-27 13:51:45,659+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Environment setup. 2018-02-27 13:51:45,702+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Environment packages setup. 2018-02-27 13:51:45,855+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Programs detection. 2018-02-27 13:51:45,982+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Environment customization. 2018-02-27 13:51:46,045+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host node_2: Yum Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:51:46,051+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host node_2: Failed to execute stage 'Environment customization': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 13:51:46,056+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Clean up. 2018-02-27 13:51:46,065+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Pre-termination. 2018-02-27 13:51:46,113+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227135146-192.168.20.20-5e7a86c2.log'. 2018-02-27 13:51:46,334+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [5e7a86c2] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Termination. 2018-02-27 13:51:46,446+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:51:46,446+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] Error during host 192.168.20.20 install 2018-02-27 13:51:46,452+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] Host installation failed for host '418d5b49-1c25-4e95-808f-67579a9f9ae1', 'node_2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 13:51:46,461+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] START, SetVdsStatusVDSCommand(HostName = node_2, SetVdsStatusVDSCommandParameters:{hostId='418d5b49-1c25-4e95-808f-67579a9f9ae1', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 61e6d165 2018-02-27 13:51:46,466+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] FINISH, SetVdsStatusVDSCommand, log id: 61e6d165 2018-02-27 13:51:46,470+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] EVENT_ID: VDS_INSTALL_FAILED(505), Host node_2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 13:51:46,474+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-13) [5e7a86c2] Lock freed to object 'EngineLock:{exclusiveLocks='[418d5b49-1c25-4e95-808f-67579a9f9ae1=VDS]', sharedLocks=''}' 2018-02-27 13:52:20,632+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-97) [13320776] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:52:20,640+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-97) [13320776] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:52:20,775+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-6) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:52:20,926+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-97) [13320776] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:52:20,926+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-97) [13320776] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:52:20,936+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-97) [13320776] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:52:20,937+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-97) [13320776] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:57:10,571+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 13:57:10,571+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 13:57:10,571+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 13:57:20,956+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-86) [7b96143f] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 13:57:20,964+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-86) [7b96143f] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 13:57:21,102+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-11) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 13:57:21,281+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-86) [7b96143f] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 13:57:21,281+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-86) [7b96143f] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 13:57:21,288+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-86) [7b96143f] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 13:57:21,289+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-86) [7b96143f] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:02:21,323+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-2) [68c26ca] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:02:21,331+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-2) [68c26ca] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 14:02:21,441+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-14) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 14:02:21,623+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-2) [68c26ca] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 14:02:21,623+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-2) [68c26ca] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 14:02:21,629+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-2) [68c26ca] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 14:02:21,630+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-2) [68c26ca] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:07:10,576+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 14:07:10,576+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 14:07:10,576+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 14:07:21,643+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-76) [259c3c92] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:07:21,650+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-76) [259c3c92] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 14:07:21,770+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-11) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 14:07:21,941+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-76) [259c3c92] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 14:07:21,941+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-76) [259c3c92] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.GeneratedMethodAccessor176.invoke(Unknown Source) [:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.GeneratedMethodAccessor175.invoke(Unknown Source) [:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 14:07:21,949+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-76) [259c3c92] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 14:07:21,950+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-76) [259c3c92] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:12:21,964+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [7ec72848] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:12:21,972+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [7ec72848] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 14:12:22,095+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-14) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 14:12:22,252+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [7ec72848] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 14:12:22,252+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [7ec72848] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.GeneratedMethodAccessor176.invoke(Unknown Source) [:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.GeneratedMethodAccessor175.invoke(Unknown Source) [:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 14:12:22,276+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [7ec72848] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 14:12:22,276+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [7ec72848] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:15:25,253+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsCommand] (default task-7) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] Running command: InstallVdsCommand internal: false. Entities affected : ID: 418d5b49-1c25-4e95-808f-67579a9f9ae1 Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2018-02-27 14:15:25,272+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (default task-7) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] Lock Acquired to object 'EngineLock:{exclusiveLocks='[418d5b49-1c25-4e95-808f-67579a9f9ae1=VDS]', sharedLocks=''}' 2018-02-27 14:15:25,281+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-7) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host node_2. 2018-02-27 14:15:25,307+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-7) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] EVENT_ID: USER_UPDATE_VDS(43), Host node_2 configuration was updated by admin@internal-authz. 2018-02-27 14:15:25,314+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 418d5b49-1c25-4e95-808f-67579a9f9ae1 Type: VDS 2018-02-27 14:15:25,315+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] Before Installation host 418d5b49-1c25-4e95-808f-67579a9f9ae1, node_2 2018-02-27 14:15:25,322+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] START, SetVdsStatusVDSCommand(HostName = node_2, SetVdsStatusVDSCommandParameters:{hostId='418d5b49-1c25-4e95-808f-67579a9f9ae1', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 6566018e 2018-02-27 14:15:25,376+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] FINISH, SetVdsStatusVDSCommand, log id: 6566018e 2018-02-27 14:15:25,572+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 14:15:27,181+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] Error during host 192.168.20.20 install 2018-02-27 14:15:27,183+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] Host installation failed for host '418d5b49-1c25-4e95-808f-67579a9f9ae1', 'node_2': SSH authentication to 'root@192.168.20.20' failed. Please verify provided credentials. Make sure host is configured for password authentication 2018-02-27 14:15:27,186+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] START, SetVdsStatusVDSCommand(HostName = node_2, SetVdsStatusVDSCommandParameters:{hostId='418d5b49-1c25-4e95-808f-67579a9f9ae1', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 3d16bb75 2018-02-27 14:15:27,190+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] FINISH, SetVdsStatusVDSCommand, log id: 3d16bb75 2018-02-27 14:15:27,193+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] EVENT_ID: VDS_INSTALL_FAILED(505), Host node_2 installation failed. SSH authentication to 'root@192.168.20.20' failed. Please verify provided credentials. Make sure host is configured for password authentication. 2018-02-27 14:15:27,196+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-14) [e0310e7f-4bea-4b4c-a8f9-9baa2b8ad7d1] Lock freed to object 'EngineLock:{exclusiveLocks='[418d5b49-1c25-4e95-808f-67579a9f9ae1=VDS]', sharedLocks=''}' 2018-02-27 14:16:39,929+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (default task-2) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] Lock Acquired to object 'EngineLock:{exclusiveLocks='[418d5b49-1c25-4e95-808f-67579a9f9ae1=VDS]', sharedLocks=''}' 2018-02-27 14:16:39,938+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 418d5b49-1c25-4e95-808f-67579a9f9ae1 Type: VDSAction group DELETE_HOST with role type ADMIN 2018-02-27 14:16:39,995+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] START, RemoveVdsVDSCommand( RemoveVdsVDSCommandParameters:{hostId='418d5b49-1c25-4e95-808f-67579a9f9ae1'}), log id: ab0a8e4 2018-02-27 14:16:39,996+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] vdsManager::disposing 2018-02-27 14:16:39,996+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] FINISH, RemoveVdsVDSCommand, log id: ab0a8e4 2018-02-27 14:16:39,999+05 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) [] Exception thrown during message processing 2018-02-27 14:16:40,002+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] EVENT_ID: VDS_ANSIBLE_HOST_REMOVE_STARTED(562), Ansible host-remove playbook execution started on host node_2. 2018-02-27 14:16:40,003+05 INFO [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] Executing Ansible command: [/usr/bin/ansible-playbook, -v, --private-key=/etc/pki/ovirt-engine/keys/engine_id_rsa, --inventory=/tmp/ansible-inventory4377767729486530693, /usr/share/ovirt-engine/playbooks/ovirt-host-remove.yml] [Logfile: /var/log/ovirt-engine/ansible/ansible-20180227141640-ovirt-host-remove_yml.log] 2018-02-27 14:16:42,267+05 INFO [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] Ansible playbook command has exited with value: 4 2018-02-27 14:16:42,281+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] EVENT_ID: VDS_ANSIBLE_HOST_REMOVE_FAILED(564), Ansible host-remove playbook execution failed on host node_2. For more details please check log /var/log/ovirt-engine/ansible/ansible-20180227141640-ovirt-host-remove_yml.log 2018-02-27 14:16:42,299+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] EVENT_ID: USER_REMOVE_VDS(44), Host node_2 was removed by admin@internal-authz. 2018-02-27 14:16:42,300+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (EE-ManagedThreadFactory-engine-Thread-15) [9fad3b8b-446b-4f01-8ddb-2dec0f103d38] Lock freed to object 'EngineLock:{exclusiveLocks='[418d5b49-1c25-4e95-808f-67579a9f9ae1=VDS]', sharedLocks=''}' 2018-02-27 14:17:10,503+05 INFO [org.ovirt.engine.core.bll.hostdeploy.AddVdsCommand] (default task-10) [56194b59-f9d1-4435-a013-7fab64d9d85f] Running command: AddVdsCommand internal: false. Entities affected : ID: 733e7985-3d4f-454e-8765-df1100b3d17b Type: ClusterAction group CREATE_HOST with role type ADMIN 2018-02-27 14:17:10,519+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-10) [75ff50fd] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 14:17:10,519+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-10) [75ff50fd] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 14:17:10,523+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-10) [75ff50fd] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 577991f7-8f5f-4921-b358-ef27de6b4cf4 Type: VDS 2018-02-27 14:17:10,528+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-10) [75ff50fd] Lock freed to object 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 14:17:10,534+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-10) [75ff50fd] START, RemoveVdsVDSCommand(HostName = node, RemoveVdsVDSCommandParameters:{hostId='577991f7-8f5f-4921-b358-ef27de6b4cf4'}), log id: 2f4251fd 2018-02-27 14:17:10,534+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-10) [75ff50fd] FINISH, RemoveVdsVDSCommand, log id: 2f4251fd 2018-02-27 14:17:10,540+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-10) [75ff50fd] START, AddVdsVDSCommand(HostName = node, AddVdsVDSCommandParameters:{hostId='577991f7-8f5f-4921-b358-ef27de6b4cf4'}), log id: 3adfa754 2018-02-27 14:17:10,540+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-10) [75ff50fd] AddVds - entered , starting logic to add VDS '577991f7-8f5f-4921-b358-ef27de6b4cf4' 2018-02-27 14:17:10,551+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-10) [75ff50fd] AddVds - VDS '577991f7-8f5f-4921-b358-ef27de6b4cf4' was added, will try to add it to the resource manager 2018-02-27 14:17:10,552+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-10) [75ff50fd] Entered VdsManager constructor 2018-02-27 14:17:10,561+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-10) [75ff50fd] Initialize vdsBroker '192.168.20.20:54321' 2018-02-27 14:17:10,567+05 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (default task-10) [75ff50fd] VDS '577991f7-8f5f-4921-b358-ef27de6b4cf4' was added to the Resource Manager 2018-02-27 14:17:10,567+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-10) [75ff50fd] FINISH, AddVdsVDSCommand, log id: 3adfa754 2018-02-27 14:17:10,573+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-10) [75ff50fd] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host node. 2018-02-27 14:17:10,577+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'default' is using 0 threads out of 1 and 5 tasks are waiting in the queue. 2018-02-27 14:17:10,577+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engine' is using 0 threads out of 500, 1 threads waiting for tasks and 0 tasks in queue. 2018-02-27 14:17:10,577+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineScheduled' is using 0 threads out of 100 and 100 tasks are waiting in the queue. 2018-02-27 14:17:10,577+05 INFO [org.ovirt.engine.core.bll.utils.ThreadPoolMonitoringService] (EE-ManagedThreadFactory-engineThreadMonitoring-Thread-1) [] Thread pool 'engineThreadMonitoring' is using 1 threads out of 1 and 0 tasks are waiting in the queue. 2018-02-27 14:17:10,584+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-10) [75ff50fd] EVENT_ID: USER_ADD_VDS(42), Host node was added by admin@internal-authz. 2018-02-27 14:17:10,592+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] Lock Acquired to object 'EngineLock:{exclusiveLocks='[577991f7-8f5f-4921-b358-ef27de6b4cf4=VDS]', sharedLocks=''}' 2018-02-27 14:17:10,607+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 577991f7-8f5f-4921-b358-ef27de6b4cf4 Type: VDS 2018-02-27 14:17:10,607+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] Before Installation host 577991f7-8f5f-4921-b358-ef27de6b4cf4, node 2018-02-27 14:17:10,615+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] START, SetVdsStatusVDSCommand(HostName = node, SetVdsStatusVDSCommandParameters:{hostId='577991f7-8f5f-4921-b358-ef27de6b4cf4', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 788387e0 2018-02-27 14:17:10,620+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] FINISH, SetVdsStatusVDSCommand, log id: 788387e0 2018-02-27 14:17:10,827+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 14:17:10,901+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 14:17:10,901+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 14:17:10,938+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 14:17:12,665+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Stage: Initializing. 2018-02-27 14:17:12,734+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Stage: Environment setup. 2018-02-27 14:17:12,793+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Stage: Environment packages setup. 2018-02-27 14:17:12,919+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Stage: Programs detection. 2018-02-27 14:17:13,043+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Stage: Environment customization. 2018-02-27 14:17:13,106+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host node: Yum Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 14:17:13,113+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host node: Failed to execute stage 'Environment customization': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 14:17:13,131+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Stage: Clean up. 2018-02-27 14:17:13,142+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Stage: Pre-termination. 2018-02-27 14:17:13,165+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227141713-192.168.20.20-3d0e3c2b.log'. 2018-02-27 14:17:13,348+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [3d0e3c2b] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node. Stage: Termination. 2018-02-27 14:17:13,484+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 14:17:13,485+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] Error during host 192.168.20.20 install 2018-02-27 14:17:13,493+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] Host installation failed for host '577991f7-8f5f-4921-b358-ef27de6b4cf4', 'node': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 14:17:13,501+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] START, SetVdsStatusVDSCommand(HostName = node, SetVdsStatusVDSCommandParameters:{hostId='577991f7-8f5f-4921-b358-ef27de6b4cf4', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 4cb44a77 2018-02-27 14:17:13,506+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] FINISH, SetVdsStatusVDSCommand, log id: 4cb44a77 2018-02-27 14:17:13,512+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] EVENT_ID: VDS_INSTALL_FAILED(505), Host node installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 14:17:13,517+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-16) [3d0e3c2b] Lock freed to object 'EngineLock:{exclusiveLocks='[577991f7-8f5f-4921-b358-ef27de6b4cf4=VDS]', sharedLocks=''}' 2018-02-27 14:17:22,292+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-88) [3a8869e] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:17:22,306+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-88) [3a8869e] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 14:17:22,881+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-1) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 14:17:23,026+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-88) [3a8869e] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 14:17:23,026+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-88) [3a8869e] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.GeneratedMethodAccessor176.invoke(Unknown Source) [:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.GeneratedMethodAccessor175.invoke(Unknown Source) [:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 14:17:23,033+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-88) [3a8869e] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 14:17:23,034+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-88) [3a8869e] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:18:08,168+05 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-7) [308e5a14-27fa-4f56-a9ce-93b29ec63573] Lock Acquired to object 'EngineLock:{exclusiveLocks='[577991f7-8f5f-4921-b358-ef27de6b4cf4=VDS]', sharedLocks=''}' 2018-02-27 14:18:08,172+05 WARN [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-7) [308e5a14-27fa-4f56-a9ce-93b29ec63573] Validation of action 'ActivateVds' failed for user admin@internal-authz. Reasons: VAR__ACTION__ACTIVATE,VAR__TYPE__HOST,VDS_NO_UUID 2018-02-27 14:18:08,173+05 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (default task-7) [308e5a14-27fa-4f56-a9ce-93b29ec63573] Lock freed to object 'EngineLock:{exclusiveLocks='[577991f7-8f5f-4921-b358-ef27de6b4cf4=VDS]', sharedLocks=''}' 2018-02-27 14:22:23,067+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [24640e13] Lock Acquired to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:22:23,079+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [24640e13] Running command: SyncNetworkProviderCommand internal: true. 2018-02-27 14:22:23,231+05 INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-13) [] User admin@internal successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access 2018-02-27 14:22:23,373+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [24640e13] Command 'org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand' failed: null 2018-02-27 14:22:23,374+05 ERROR [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [24640e13] Exception: java.lang.NullPointerException at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.lambda$executeCommand$3(SyncNetworkProviderCommand.java:145) [bll.jar:] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand.executeCommand(SyncNetworkProviderCommand.java:147) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1285) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1934) [bll.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1345) [bll.jar:] at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:400) [bll.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:468) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:450) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:393) [bll.jar:] at sun.reflect.GeneratedMethodAccessor176.invoke(Unknown Source) [:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:78) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:379) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar:11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:609) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view4.runInternalAction(Unknown Source) [bll.jar:] at sun.reflect.GeneratedMethodAccessor175.invoke(Unknown Source) [:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:127) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.InjectionPointPropagatingEnterpriseTargetBeanInstance.invoke(InjectionPointPropagatingEnterpriseTargetBeanInstance.java:67) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) [weld-core-impl-2.4.3.Final.jar:2.4.3.Final] at org.ovirt.engine.core.bll.BackendCommandObjectsHandler$BackendInternal$BackendLocal$2049259618$Proxy$_$$_Weld$EnterpriseProxy$.runInternalAction(Unknown Source) [bll.jar:] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.lambda$synchronize$1(ExternalNetworkSyncService.java:60) [bll.jar:] at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.DistinctOps$1$2.accept(DistinctOps.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.network.cluster.ExternalNetworkSyncService.synchronize(ExternalNetworkSyncService.java:59) [bll.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) [javax.enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) 2018-02-27 14:22:23,384+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [24640e13] EVENT_ID: PROVIDER_SYNCHRONIZED_FAILED(216), Failed to synchronize networks of Provider ovirt-provider-ovn. 2018-02-27 14:22:23,385+05 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-24) [24640e13] Lock freed to object 'EngineLock:{exclusiveLocks='[04163ab8-ddec-4355-99fe-15ada3c369bc=PROVIDER]', sharedLocks=''}' 2018-02-27 14:25:08,497+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (default task-13) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] Lock Acquired to object 'EngineLock:{exclusiveLocks='[577991f7-8f5f-4921-b358-ef27de6b4cf4=VDS]', sharedLocks=''}' 2018-02-27 14:25:08,511+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 577991f7-8f5f-4921-b358-ef27de6b4cf4 Type: VDSAction group DELETE_HOST with role type ADMIN 2018-02-27 14:25:08,579+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] START, RemoveVdsVDSCommand( RemoveVdsVDSCommandParameters:{hostId='577991f7-8f5f-4921-b358-ef27de6b4cf4'}), log id: 3785795e 2018-02-27 14:25:08,580+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] vdsManager::disposing 2018-02-27 14:25:08,580+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] FINISH, RemoveVdsVDSCommand, log id: 3785795e 2018-02-27 14:25:08,582+05 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) [] Exception thrown during message processing 2018-02-27 14:25:08,605+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] EVENT_ID: VDS_ANSIBLE_HOST_REMOVE_STARTED(562), Ansible host-remove playbook execution started on host node. 2018-02-27 14:25:08,607+05 INFO [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] Executing Ansible command: [/usr/bin/ansible-playbook, -v, --private-key=/etc/pki/ovirt-engine/keys/engine_id_rsa, --inventory=/tmp/ansible-inventory1682240169152066445, /usr/share/ovirt-engine/playbooks/ovirt-host-remove.yml] [Logfile: /var/log/ovirt-engine/ansible/ansible-20180227142508-ovirt-host-remove_yml.log] 2018-02-27 14:25:10,872+05 INFO [org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] Ansible playbook command has exited with value: 4 2018-02-27 14:25:10,875+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] EVENT_ID: VDS_ANSIBLE_HOST_REMOVE_FAILED(564), Ansible host-remove playbook execution failed on host node. For more details please check log /var/log/ovirt-engine/ansible/ansible-20180227142508-ovirt-host-remove_yml.log 2018-02-27 14:25:10,879+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] EVENT_ID: USER_REMOVE_VDS(44), Host node was removed by admin@internal-authz. 2018-02-27 14:25:10,879+05 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (EE-ManagedThreadFactory-engine-Thread-18) [9d9c5a8a-6dbc-4a21-b99a-d7618e2ea51a] Lock freed to object 'EngineLock:{exclusiveLocks='[577991f7-8f5f-4921-b358-ef27de6b4cf4=VDS]', sharedLocks=''}' 2018-02-27 14:25:34,279+05 INFO [org.ovirt.engine.core.bll.hostdeploy.AddVdsCommand] (default task-8) [4249f247-7c67-4651-8106-880c8d5ee55f] Running command: AddVdsCommand internal: false. Entities affected : ID: 733e7985-3d4f-454e-8765-df1100b3d17b Type: ClusterAction group CREATE_HOST with role type ADMIN 2018-02-27 14:25:34,298+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-8) [63a4ffee] Before acquiring and wait lock 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 14:25:34,298+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-8) [63a4ffee] Lock-wait acquired to object 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 14:25:34,300+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-8) [63a4ffee] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: bd8d007a-be92-4075-bba9-6cbeb890a1e5 Type: VDS 2018-02-27 14:25:34,308+05 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default task-8) [63a4ffee] Lock freed to object 'EngineLock:{exclusiveLocks='[d277bdc4-93c4-4602-a166-f45a7f92c18c=REGISTER_VDS]', sharedLocks=''}' 2018-02-27 14:25:34,312+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-8) [63a4ffee] START, RemoveVdsVDSCommand(HostName = node_2, RemoveVdsVDSCommandParameters:{hostId='bd8d007a-be92-4075-bba9-6cbeb890a1e5'}), log id: 4a659394 2018-02-27 14:25:34,313+05 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (default task-8) [63a4ffee] FINISH, RemoveVdsVDSCommand, log id: 4a659394 2018-02-27 14:25:34,318+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-8) [63a4ffee] START, AddVdsVDSCommand(HostName = node_2, AddVdsVDSCommandParameters:{hostId='bd8d007a-be92-4075-bba9-6cbeb890a1e5'}), log id: 5cc3018e 2018-02-27 14:25:34,318+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-8) [63a4ffee] AddVds - entered , starting logic to add VDS 'bd8d007a-be92-4075-bba9-6cbeb890a1e5' 2018-02-27 14:25:34,320+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-8) [63a4ffee] AddVds - VDS 'bd8d007a-be92-4075-bba9-6cbeb890a1e5' was added, will try to add it to the resource manager 2018-02-27 14:25:34,320+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-8) [63a4ffee] Entered VdsManager constructor 2018-02-27 14:25:34,328+05 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default task-8) [63a4ffee] Initialize vdsBroker '192.168.20.20:54321' 2018-02-27 14:25:34,336+05 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (default task-8) [63a4ffee] VDS 'bd8d007a-be92-4075-bba9-6cbeb890a1e5' was added to the Resource Manager 2018-02-27 14:25:34,336+05 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (default task-8) [63a4ffee] FINISH, AddVdsVDSCommand, log id: 5cc3018e 2018-02-27 14:25:34,348+05 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-8) [63a4ffee] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power Management configuration for Host node_2. 2018-02-27 14:25:34,414+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-8) [63a4ffee] EVENT_ID: USER_ADD_VDS(42), Host node_2 was added by admin@internal-authz. 2018-02-27 14:25:34,417+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] Lock Acquired to object 'EngineLock:{exclusiveLocks='[bd8d007a-be92-4075-bba9-6cbeb890a1e5=VDS]', sharedLocks=''}' 2018-02-27 14:25:34,429+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: bd8d007a-be92-4075-bba9-6cbeb890a1e5 Type: VDS 2018-02-27 14:25:34,429+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] Before Installation host bd8d007a-be92-4075-bba9-6cbeb890a1e5, node_2 2018-02-27 14:25:34,436+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] START, SetVdsStatusVDSCommand(HostName = node_2, SetVdsStatusVDSCommandParameters:{hostId='bd8d007a-be92-4075-bba9-6cbeb890a1e5', status='Installing', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 1d3781eb 2018-02-27 14:25:34,440+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] FINISH, SetVdsStatusVDSCommand, log id: 1d3781eb 2018-02-27 14:25:34,621+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Connected to host 192.168.20.20 with SSH key fingerprint: SHA256:uMxVQxSB2GzhVnMLSHhq9TaKkBWYFXfiIoiIdNu2h6Q. 2018-02-27 14:25:34,703+05 INFO [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] Installation of 192.168.20.20. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2018-02-27 14:25:34,704+05 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2018-02-27 14:25:34,735+05 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] SSH execute 'root@192.168.20.20' 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2018-02-27 14:25:36,460+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Initializing. 2018-02-27 14:25:36,589+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Environment setup. 2018-02-27 14:25:36,606+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Environment packages setup. 2018-02-27 14:25:36,749+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Programs detection. 2018-02-27 14:25:36,883+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Environment customization. 2018-02-27 14:25:36,937+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host node_2: Yum Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 14:25:36,949+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host node_2: Failed to execute stage 'Environment customization': Cannot retrieve metalink for repository: ovirt-4.2-epel/x86_64. Please verify its path and try again. 2018-02-27 14:25:36,952+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Clean up. 2018-02-27 14:25:36,955+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Pre-termination. 2018-02-27 14:25:37,033+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-host-deploy-20180227142536-192.168.20.20-52669850.log'. 2018-02-27 14:25:37,266+05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) [52669850] EVENT_ID: VDS_INSTALL_IN_PROGRESS(509), Installing Host node_2. Stage: Termination. 2018-02-27 14:25:37,392+05 ERROR [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] SSH error running command root@192.168.20.20:'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALOG/customization=bool:True': IOException: Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 14:25:37,393+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] Error during host 192.168.20.20 install 2018-02-27 14:25:37,410+05 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] Host installation failed for host 'bd8d007a-be92-4075-bba9-6cbeb890a1e5', 'node_2': Command returned failure code 1 during SSH session 'root@192.168.20.20' 2018-02-27 14:25:37,416+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] START, SetVdsStatusVDSCommand(HostName = node_2, SetVdsStatusVDSCommandParameters:{hostId='bd8d007a-be92-4075-bba9-6cbeb890a1e5', status='InstallFailed', nonOperationalReason='NONE', stopSpmFailureLogged='false', maintenanceReason='null'}), log id: 2b138e87 2018-02-27 14:25:37,423+05 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] FINISH, SetVdsStatusVDSCommand, log id: 2b138e87 2018-02-27 14:25:37,429+05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] EVENT_ID: VDS_INSTALL_FAILED(505), Host node_2 installation failed. Command returned failure code 1 during SSH session 'root@192.168.20.20'. 2018-02-27 14:25:37,433+05 INFO [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-19) [52669850] Lock freed to object 'EngineLock:{exclusiveLocks='[bd8d007a-be92-4075-bba9-6cbeb890a1e5=VDS]', sharedLocks=''}'