2017-02-27 15:35:33,220 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". 2017-02-27 15:35:33,221 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. 2017-02-27 15:35:33,222 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". 2017-02-27 15:35:33,222 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-java.conf". 2017-02-27 15:35:33,226 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". 2017-02-27 15:35:33,226 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". 2017-02-27 15:35:33,227 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". 2017-02-27 15:35:33,228 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_AJP_ENABLED" is "true". 2017-02-27 15:35:33,228 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_AJP_PORT" is "8702". 2017-02-27 15:35:33,228 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_APPS" is "engine.ear restapi.war legacy_restapi.war". 2017-02-27 15:35:33,229 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". 2017-02-27 15:35:33,229 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". 2017-02-27 15:35:33,230 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". 2017-02-27 15:35:33,230 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_DATABASE" is "engine". 2017-02-27 15:35:33,237 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". 2017-02-27 15:35:33,237 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_HOST" is "localhost". 2017-02-27 15:35:33,238 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". 2017-02-27 15:35:33,238 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". 2017-02-27 15:35:33,238 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_PASSWORD" is "***". 2017-02-27 15:35:33,239 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_PORT" is "5432". 2017-02-27 15:35:33,239 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_SECURED" is "False". 2017-02-27 15:35:33,240 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". 2017-02-27 15:35:33,240 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". 2017-02-27 15:35:33,241 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DB_USER" is "engine". 2017-02-27 15:35:33,241 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DEBUG_ADDRESS" is "". 2017-02-27 15:35:33,242 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". 2017-02-27 15:35:33,242 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". 2017-02-27 15:35:33,256 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_EXTENSION_PATH" is "/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d". 2017-02-27 15:35:33,257 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE" is "/var/lib/ovirt-engine/external_truststore". 2017-02-27 15:35:33,258 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD" is "***". 2017-02-27 15:35:33,258 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_TYPE" is "JKS". 2017-02-27 15:35:33,258 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_FQDN" is "engine.dev1.api-digital.com". 2017-02-27 15:35:33,263 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_GROUP" is "ovirt". 2017-02-27 15:35:33,264 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_HEAP_MAX" is "2000M". 2017-02-27 15:35:33,264 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_HEAP_MIN" is "2000M". 2017-02-27 15:35:33,265 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_HTTPS_ENABLED" is "false". 2017-02-27 15:35:33,265 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_HTTPS_PORT" is "None". 2017-02-27 15:35:33,266 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". 2017-02-27 15:35:33,266 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_HTTP_ENABLED" is "false". 2017-02-27 15:35:33,266 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_HTTP_PORT" is "None". 2017-02-27 15:35:33,267 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". 2017-02-27 15:35:33,267 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". 2017-02-27 15:35:33,268 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". 2017-02-27 15:35:33,268 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". 2017-02-27 15:35:33,269 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_MANUAL" is "/usr/share/ovirt-engine/manual". 2017-02-27 15:35:33,269 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PERM_MAX" is "256m". 2017-02-27 15:35:33,276 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PERM_MIN" is "256m". 2017-02-27 15:35:33,276 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". 2017-02-27 15:35:33,277 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". 2017-02-27 15:35:33,277 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". 2017-02-27 15:35:33,278 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". 2017-02-27 15:35:33,278 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". 2017-02-27 15:35:33,279 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". 2017-02-27 15:35:33,279 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". 2017-02-27 15:35:33,279 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". 2017-02-27 15:35:33,280 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PROPERTIES" is " java.awt.headless=true sun.rmi.dgc.client.gcInterval=3600000 sun.rmi.dgc.server.gcInterval=3600000 jsse.enableSNIExtension=false "java.security.krb5.conf=/etc/ovirt-engine/krb5.conf"". 2017-02-27 15:35:33,281 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PROXY_ENABLED" is "true". 2017-02-27 15:35:33,281 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". 2017-02-27 15:35:33,282 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". 2017-02-27 15:35:33,282 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_REPORTS_BASE_URL" is "". 2017-02-27 15:35:33,282 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_REPORTS_DASHBOARD_URL" is "/flow.html?viewAsDashboardFrame=true". 2017-02-27 15:35:33,283 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_REPORTS_NOT_INSTALLED_URL" is "/ovirt-engine/ReportsNotInstalled.html". 2017-02-27 15:35:33,283 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_REPORTS_PROXY_URL" is "/ovirt/reports-interface". 2017-02-27 15:35:33,284 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_REPORTS_READ_TIMEOUT" is "". 2017-02-27 15:35:33,284 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_REPORTS_RIGHTCLICK_URL" is "". 2017-02-27 15:35:33,285 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_REPORTS_VERIFY_CHAIN" is "true". 2017-02-27 15:35:33,285 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_REPORTS_VERIFY_HOST" is "true". 2017-02-27 15:35:33,286 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_STOP_INTERVAL" is "1". 2017-02-27 15:35:33,286 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_STOP_TIME" is "10". 2017-02-27 15:35:33,287 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". 2017-02-27 15:35:33,287 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". 2017-02-27 15:35:33,287 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_URI" is "/ovirt-engine". 2017-02-27 15:35:33,288 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_USER" is "ovirt". 2017-02-27 15:35:33,288 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". 2017-02-27 15:35:33,289 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". 2017-02-27 15:35:33,289 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "ENGINE_VERBOSE_GC" is "false". 2017-02-27 15:35:33,290 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "JBOSS_HOME" is "/usr/share/ovirt-engine-jboss-as". 2017-02-27 15:35:33,290 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". 2017-02-27 15:35:33,291 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-3) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD,ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD". 2017-02-27 15:35:33,844 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Start initializing Backend 2017-02-27 15:35:34,258 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (MSC service thread 1-2) Loading file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties 2017-02-27 15:35:34,426 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Running ovirt-engine 3.5.6.2-1.el6 2017-02-27 15:35:34,426 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-2) Start initializing dictionaries 2017-02-27 15:35:34,429 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-2) Finished initializing dictionaries 2017-02-27 15:35:34,429 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Start initializing AuditLogCleanupManager 2017-02-27 15:35:34,430 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting audit cleanup manager to run at: 35 35 3 * * ? 2017-02-27 15:35:34,454 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Finished initializing AuditLogCleanupManager 2017-02-27 15:35:34,454 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Start initializing CommandEntityCleanupManager 2017-02-27 15:35:34,455 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting command entity cleanup manager to run at: 35 35 3 * * ? 2017-02-27 15:35:34,459 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Finished initializing CommandEntityCleanupManager 2017-02-27 15:35:34,461 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Start initializing TagsDirector 2017-02-27 15:35:34,481 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Tag root added to tree 2017-02-27 15:35:34,493 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Finished initializing TagsDirector 2017-02-27 15:35:34,493 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-2) Start initializing IsoDomainListSyncronizer 2017-02-27 15:35:34,503 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-2) Finished initializing IsoDomainListSyncronizer 2017-02-27 15:35:34,606 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Completed initializing handlers 2017-02-27 15:35:34,636 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Start initializing ErrorTranslatorImpl 2017-02-27 15:35:34,658 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. 2017-02-27 15:35:34,659 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Finished initializing ErrorTranslatorImpl 2017-02-27 15:35:34,659 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Start initializing ErrorTranslatorImpl 2017-02-27 15:35:34,660 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Finished initializing ErrorTranslatorImpl 2017-02-27 15:35:34,668 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Mark incomplete jobs as UNKNOWN 2017-02-27 15:35:34,694 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-2) Start initializing JobRepositoryCleanupManager 2017-02-27 15:35:34,695 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-2) Finished initializing JobRepositoryCleanupManager 2017-02-27 15:35:34,695 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-2) Start initializing AutoRecoveryManager 2017-02-27 15:35:34,696 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-2) Finished initializing AutoRecoveryManager 2017-02-27 15:35:34,698 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-2) Start initializing ExecutionMessageDirector 2017-02-27 15:35:34,700 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-2) Finished initializing ExecutionMessageDirector 2017-02-27 15:35:34,737 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Loading extension 'builtin-authn-internal' 2017-02-27 15:35:34,739 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'builtin-authn-internal' loaded 2017-02-27 15:35:34,741 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Loading extension 'internal' 2017-02-27 15:35:34,745 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'internal' loaded 2017-02-27 15:35:34,746 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Initializing extension 'builtin-authn-internal' 2017-02-27 15:35:34,746 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'builtin-authn-internal' initialized 2017-02-27 15:35:34,747 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Initializing extension 'internal' 2017-02-27 15:35:34,748 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'internal' initialized 2017-02-27 15:35:34,748 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Start of enabled extensions list 2017-02-27 15:35:34,749 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Instance name: 'builtin-authn-internal', Extension name: 'Internal Authn (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-27 15:35:34,750 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Instance name: 'internal', Extension name: 'Internal Authz (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-27 15:35:34,751 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) End of enabled extensions list 2017-02-27 15:35:34,840 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (MSC service thread 1-2) Initialization of AsyncTaskManager completed successfully. 2017-02-27 15:35:34,842 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) Start initializing ResourceManager 2017-02-27 15:35:34,924 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) Finished initializing ResourceManager 2017-02-27 15:35:34,925 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (MSC service thread 1-2) Initialization of OvfDataUpdater completed successfully. 2017-02-27 15:35:34,926 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Start scheduling to enable vds load balancer 2017-02-27 15:35:34,926 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Finished scheduling to enable vds load balancer 2017-02-27 15:35:34,927 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Start HA Reservation check 2017-02-27 15:35:34,927 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Finished HA Reservation check 2017-02-27 15:35:34,945 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Start initializing MacPoolManagerRanges 2017-02-27 15:35:34,945 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) Init VM custom properties utilities 2017-02-27 15:35:34,947 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) Init device custom properties utilities 2017-02-27 15:35:34,952 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Initializing Scheduling manager 2017-02-27 15:35:34,971 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Finished initializing. Available MACs in pool: 256 2017-02-27 15:35:35,000 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) External scheduler disabled, discovery skipped 2017-02-27 15:35:35,001 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Initialized Scheduling manager 2017-02-27 15:35:35,001 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-2) Initializing DWH Heart Beat 2017-02-27 15:35:35,003 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-2) DWH Heart Beat initialized 2017-02-27 15:36:07,668 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp--127.0.0.1-8702-4) Running command: LoginUserCommand internal: false. 2017-02-27 15:36:07,677 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: UNASSIGNED not exist in string table 2017-02-27 15:36:07,677 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table 2017-02-27 15:36:07,678 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table 2017-02-27 15:36:07,679 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table 2017-02-27 15:36:07,680 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table 2017-02-27 15:36:07,681 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table 2017-02-27 15:36:07,681 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_ADDED_DISK_PROFILE not exist in string table 2017-02-27 15:36:07,682 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_FAILED_TO_ADD_DISK_PROFILE not exist in string table 2017-02-27 15:36:07,682 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_REMOVED_DISK_PROFILE not exist in string table 2017-02-27 15:36:07,683 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_FAILED_TO_REMOVE_DISK_PROFILE not exist in string table 2017-02-27 15:36:07,683 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_UPDATED_DISK_PROFILE not exist in string table 2017-02-27 15:36:07,684 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_FAILED_TO_UPDATE_DISK_PROFILE not exist in string table 2017-02-27 15:36:07,685 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_ADDED_CPU_PROFILE not exist in string table 2017-02-27 15:36:07,685 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_FAILED_TO_ADD_CPU_PROFILE not exist in string table 2017-02-27 15:36:07,686 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_REMOVED_CPU_PROFILE not exist in string table 2017-02-27 15:36:07,686 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_FAILED_TO_REMOVE_CPU_PROFILE not exist in string table 2017-02-27 15:36:07,687 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_UPDATED_CPU_PROFILE not exist in string table 2017-02-27 15:36:07,687 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) AuditLogType: USER_FAILED_TO_UPDATE_CPU_PROFILE not exist in string table 2017-02-27 15:36:07,876 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-27 15:36:11,984 INFO [org.ovirt.engine.core.bll.network.cluster.UpdateNetworkOnClusterCommand] (ajp--127.0.0.1-8702-8) [332262cf] Running command: UpdateNetworkOnClusterCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group CONFIGURE_CLUSTER_NETWORK with role type ADMIN, ID: 00000000-0000-0000-0000-000000000009 Type: NetworkAction group ASSIGN_CLUSTER_NETWORK with role type ADMIN 2017-02-27 15:36:12,065 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-8) [332262cf] Correlation ID: 332262cf, Call Stack: null, Custom Event ID: -1, Message: Network ovirtmgmt on Cluster Default updated. 2017-02-27 15:36:13,185 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp--127.0.0.1-8702-1) [648b22b9] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group CREATE_HOST with role type ADMIN 2017-02-27 15:36:13,287 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8702-1) [648072ca] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-27 15:36:13,318 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8702-1) [648072ca] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: REGISTER_VDS , sharedLocks= ] 2017-02-27 15:36:13,328 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp--127.0.0.1-8702-1) [648072ca] START, RemoveVdsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 29d30111 2017-02-27 15:36:13,329 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp--127.0.0.1-8702-1) [648072ca] FINISH, RemoveVdsVDSCommand, log id: 29d30111 2017-02-27 15:36:13,335 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8702-1) [648072ca] START, AddVdsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 26cea5ec 2017-02-27 15:36:13,335 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8702-1) [648072ca] AddVds - entered , starting logic to add VDS eb2aea6e-7de9-4a29-86de-1d43f52fc92a 2017-02-27 15:36:13,339 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8702-1) [648072ca] AddVds - VDS eb2aea6e-7de9-4a29-86de-1d43f52fc92a was added, will try to add it to the resource manager 2017-02-27 15:36:13,346 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp--127.0.0.1-8702-1) [648072ca] Entered VdsManager constructor 2017-02-27 15:36:13,373 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp--127.0.0.1-8702-1) [648072ca] Initialize vdsBroker (node1.dev1.api-digital.com,54,321) 2017-02-27 15:36:13,500 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8702-1) [648072ca] VDS eb2aea6e-7de9-4a29-86de-1d43f52fc92a was added to the Resource Manager 2017-02-27 15:36:13,503 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8702-1) [648072ca] FINISH, AddVdsVDSCommand, log id: 26cea5ec 2017-02-27 15:36:13,513 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-1) [648072ca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_1. 2017-02-27 15:36:13,613 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-1) [648072ca] Correlation ID: 648b22b9, Job ID: 9c8a3fde-8737-4ead-b607-6eef59fe4a9f, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was added by admin@internal. 2017-02-27 15:36:13,622 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Lock Acquired to object EngineLock [exclusiveLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS , sharedLocks= ] 2017-02-27 15:36:13,636 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-27 15:36:13,647 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Before Installation host eb2aea6e-7de9-4a29-86de-1d43f52fc92a, hosted_engine_1 2017-02-27 15:36:13,677 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 438de51a 2017-02-27 15:36:13,695 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] FINISH, SetVdsStatusVDSCommand, log id: 438de51a 2017-02-27 15:36:13,730 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Installation node1.dev1.api-digital.com: Connected to host node1.dev1.api-digital.com with SSH key fingerprint: 52:1a:ae:35:37:d4:7e:1f:3c:fe:ca:ec:32:3e:00:2f 2017-02-27 15:36:13,739 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Connected to host node1.dev1.api-digital.com with SSH key fingerprint: 52:1a:ae:35:37:d4:7e:1f:3c:fe:ca:ec:32:3e:00:2f. 2017-02-27 15:36:13,808 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Installation of node1.dev1.api-digital.com. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-27 15:36:13,809 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-8-thread-3) Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-27 15:36:13,884 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-8-thread-3) SSH execute root@node1.dev1.api-digital.com 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-27 15:36:14,994 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Initializing 2017-02-27 15:36:15,020 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Initializing. 2017-02-27 15:36:15,038 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Environment setup 2017-02-27 15:36:15,052 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Environment setup. 2017-02-27 15:36:15,054 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Environment packages setup 2017-02-27 15:36:15,064 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Environment packages setup. 2017-02-27 15:36:16,503 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-59) Initializing Host: hosted_engine_1 2017-02-27 15:36:18,164 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Programs detection 2017-02-27 15:36:18,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Programs detection. 2017-02-27 15:36:18,216 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Environment customization 2017-02-27 15:36:18,225 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Environment customization. 2017-02-27 15:36:18,226 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Kdump unsupported 2017-02-27 15:36:18,233 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Kdump unsupported. 2017-02-27 15:36:18,243 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Logs at host located at: '/tmp/ovirt-host-deploy-20170227153614-wlc1ql.log' 2017-02-27 15:36:18,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Logs at host located at: '/tmp/ovirt-host-deploy-20170227153614-wlc1ql.log'. 2017-02-27 15:36:18,284 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host node1.dev1.api-digital.com reports unique id 4C4C4544-0039-4310-804A-C7C04F4E5131 2017-02-27 15:36:18,288 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0039-4310-804A-C7C04F4E5131 to Host node1.dev1.api-digital.com 2017-02-27 15:36:18,356 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Disabling Kdump integration 2017-02-27 15:36:18,365 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Disabling Kdump integration. 2017-02-27 15:36:18,380 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Setup validation 2017-02-27 15:36:18,389 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Setup validation. 2017-02-27 15:36:18,498 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Hardware supports virtualization 2017-02-27 15:36:18,508 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Hardware supports virtualization. 2017-02-27 15:36:19,228 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Transaction setup 2017-02-27 15:36:19,251 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Transaction setup. 2017-02-27 15:36:19,314 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Misc configuration 2017-02-27 15:36:19,329 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Misc configuration. 2017-02-27 15:36:19,330 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Package installation 2017-02-27 15:36:19,339 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Package installation. 2017-02-27 15:36:27,641 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Yum Status: Downloading Packages 2017-02-27 15:36:27,667 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Yum Status: Downloading Packages. 2017-02-27 15:36:27,839 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Yum Download/Verify: 10:qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64 2017-02-27 15:36:27,850 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Yum Download/Verify: 10:qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64. 2017-02-27 15:36:27,851 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Yum Status: Check Package Signatures 2017-02-27 15:36:27,862 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Yum Status: Check Package Signatures. 2017-02-27 15:36:27,863 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Yum Status: Running Test Transaction 2017-02-27 15:36:27,874 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Yum Status: Running Test Transaction. 2017-02-27 15:36:27,875 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Yum Status: Running Transaction 2017-02-27 15:36:27,882 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Yum Status: Running Transaction. 2017-02-27 15:36:27,954 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Yum install: 1/1: 10:qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64 2017-02-27 15:36:27,966 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Yum install: 1/1: 10:qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64. 2017-02-27 15:36:28,053 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Yum Verify: 1/1: qemu-kvm-tools-ev.x86_64 10:2.6.0-28.el7_3.3.1 - u 2017-02-27 15:36:28,065 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Yum Verify: 1/1: qemu-kvm-tools-ev.x86_64 10:2.6.0-28.el7_3.3.1 - u. 2017-02-27 15:36:28,257 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Misc configuration 2017-02-27 15:36:28,269 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Misc configuration. 2017-02-27 15:36:30,026 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Enrolling certificate 2017-02-27 15:36:30,051 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Enrolling certificate. 2017-02-27 15:36:31,208 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Transaction commit 2017-02-27 15:36:31,243 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Transaction commit. 2017-02-27 15:36:31,408 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Closing up 2017-02-27 15:36:31,423 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Closing up. 2017-02-27 15:36:34,033 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stopping libvirtd 2017-02-27 15:36:34,060 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stopping libvirtd. 2017-02-27 15:36:34,188 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Starting vdsm 2017-02-27 15:36:34,203 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Starting vdsm. 2017-02-27 15:36:37,322 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Pre-termination 2017-02-27 15:36:37,349 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Pre-termination. 2017-02-27 15:36:37,359 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20170227153637-node1.dev1.api-digital.com-2dc1132f.log' 2017-02-27 15:36:37,367 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20170227153637-node1.dev1.api-digital.com-2dc1132f.log'. 2017-02-27 15:36:37,694 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node1.dev1.api-digital.com: Stage: Termination 2017-02-27 15:36:37,717 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2dc1132f, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_1. Stage: Termination. 2017-02-27 15:36:37,757 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-27 15:36:38,042 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Engine managed to communicate with VDSM agent on host hosted_engine_1 2017-02-27 15:36:39,820 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1's following network(s) are not synchronized with their Logical Network configuration: ovirtmgmt. 2017-02-27 15:36:39,831 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] The management network ovirtmgmt is already configured on host hosted_engine_1 2017-02-27 15:36:39,834 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 49c30074 2017-02-27 15:36:39,843 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] FINISH, SetVdsStatusVDSCommand, log id: 49c30074 2017-02-27 15:36:39,844 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] After Installation host hosted_engine_1, VDS 2017-02-27 15:36:39,855 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Correlation ID: 2dc1132f, Job ID: 9c8a3fde-8737-4ead-b607-6eef59fe4a9f, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 installed 2017-02-27 15:36:39,868 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-3) [2dc1132f] Lock freed to object EngineLock [exclusiveLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS , sharedLocks= ] 2017-02-27 15:36:40,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]), log id: 3d33f2d2 2017-02-27 15:36:40,686 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GetHardwareInfoVDSCommand, log id: 3d33f2d2 2017-02-27 15:36:40,746 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1's following network(s) are not synchronized with their Logical Network configuration: ovirtmgmt. 2017-02-27 15:36:40,763 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-4) [4545dbc4] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-27 15:36:40,834 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] Running command: UpdateVdsGroupCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group EDIT_CLUSTER_CONFIGURATION with role type ADMIN 2017-02-27 15:36:40,864 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] Correlation ID: 63ac5a4a, Call Stack: null, Custom Event ID: -1, Message: Host cluster Default was updated by system 2017-02-27 15:36:40,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]), log id: 57f7319f 2017-02-27 15:36:40,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] FINISH, GetHardwareInfoVDSCommand, log id: 57f7319f 2017-02-27 15:36:41,201 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1's following network(s) are not synchronized with their Logical Network configuration: ovirtmgmt. 2017-02-27 15:36:41,227 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: 5dfe292c 2017-02-27 15:36:41,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] FINISH, FullListVdsCommand, return: [{guestFQDN=, username=Unknown, emulatedMachine=pc, nicModel=rtl8139,pv, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=6000, clientIp=, devices=[Ljava.lang.Object;@5832f8dd, guestDiskMapping={}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, displayIp=0, status=Paused, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, guestIPs=, smp=2, vmName=HostedEngine, display=vnc}], log id: 5dfe292c 2017-02-27 15:36:41,241 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] Importing VM HostedEngine as HostedEngine, as it is running on the on Host, but does not exist in the engine. 2017-02-27 15:36:41,282 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-4) [63ac5a4a] VDS::UpdateVmRunTimeInfo Error: found VM on a VDS that is not in the database! 2017-02-27 15:36:41,291 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-4) [10b6f7be] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 15:36:41,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-4) [10b6f7be] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 6388379 2017-02-27 15:36:41,426 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-4) [10b6f7be] FINISH, SetMOMPolicyParametersVDSCommand, log id: 6388379 2017-02-27 15:36:41,460 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [10b6f7be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host hosted_engine_1 was set to Up. 2017-02-27 15:36:41,465 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [10b6f7be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_1. 2017-02-27 15:36:41,652 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (DefaultQuartzScheduler_Worker-4) [4f4f043a] Lock Acquired to object EngineLock [exclusiveLocks= key: HostedEngine value: VM_NAME , sharedLocks= ] 2017-02-27 15:36:41,757 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (DefaultQuartzScheduler_Worker-4) [4f4f043a] Running command: AddVmFromScratchCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group CREATE_VM with role type USER 2017-02-27 15:36:41,971 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [4f4f043a] Correlation ID: 4f4f043a, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine was created by SYSTEM. 2017-02-27 15:36:41,972 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (DefaultQuartzScheduler_Worker-4) [4f4f043a] Lock freed to object EngineLock [exclusiveLocks= key: HostedEngine value: VM_NAME , sharedLocks= ] 2017-02-27 15:36:41,986 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-4) [284d429f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-27 15:36:41,991 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-4) [10cefe1b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-27 15:36:42,829 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (ajp--127.0.0.1-8702-3) [2087c837] Running command: UpdateVdsGroupCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group EDIT_CLUSTER_CONFIGURATION with role type ADMIN 2017-02-27 15:36:42,884 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) [2087c837] Correlation ID: 2087c837, Call Stack: null, Custom Event ID: -1, Message: Host cluster Default was updated by admin@internal 2017-02-27 15:36:43,124 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp--127.0.0.1-8702-5) Running command: LoginUserCommand internal: false. 2017-02-27 15:36:43,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-27 15:36:43,490 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp--127.0.0.1-8702-7) [7c0f62fb] Running command: AddDiskCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_DISK with role type USER, ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CONFIGURE_SCSI_GENERIC_IO with role type ADMIN 2017-02-27 15:36:43,570 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [7c0f62fb] Correlation ID: 7c0f62fb, Job ID: 1c1306be-c3a8-4632-9562-4ef1540efb5e, Call Stack: null, Custom Event ID: -1, Message: The disk 'hosted_engine' was successfully added. 2017-02-27 15:36:45,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-14) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: a83fdac 2017-02-27 15:36:45,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-14) FINISH, FullListVdsCommand, return: [{guestFQDN=, username=Unknown, emulatedMachine=pc, nicModel=rtl8139,pv, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=6000, clientIp=, devices=[Ljava.lang.Object;@1ce4e025, guestDiskMapping={}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, displayIp=0, status=Paused, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, guestIPs=, smp=2, vmName=HostedEngine, display=vnc}], log id: a83fdac 2017-02-27 15:36:45,073 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Received a console Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {alias=console0, specParams={}, deviceType=console, deviceId=aa0b7357-8cdd-410d-8119-97fb727670eb, device=console, type=console} 2017-02-27 15:36:45,074 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Received a memballoon Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-27 15:36:45,075 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Received a vnc Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=vnc, specParams={spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, displayIp=0}, deviceType=graphics, type=graphics, port=5900} 2017-02-27 15:36:45,076 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-14) Empty or NULL values were passed for a VM 4a035efd-a041-4e46-84db-01cf79400913 device, Device is skipped 2017-02-27 15:39:15,697 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". 2017-02-27 15:39:15,703 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. 2017-02-27 15:39:15,704 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". 2017-02-27 15:39:15,705 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-java.conf". 2017-02-27 15:39:15,705 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". 2017-02-27 15:39:15,706 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". 2017-02-27 15:39:15,706 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". 2017-02-27 15:39:15,707 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_AJP_ENABLED" is "true". 2017-02-27 15:39:15,708 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_AJP_PORT" is "8702". 2017-02-27 15:39:15,708 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_APPS" is "engine.ear restapi.war legacy_restapi.war". 2017-02-27 15:39:15,715 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". 2017-02-27 15:39:15,715 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". 2017-02-27 15:39:15,716 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". 2017-02-27 15:39:15,716 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_DATABASE" is "engine". 2017-02-27 15:39:15,716 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". 2017-02-27 15:39:15,717 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_HOST" is "localhost". 2017-02-27 15:39:15,717 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". 2017-02-27 15:39:15,718 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". 2017-02-27 15:39:15,718 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_PASSWORD" is "***". 2017-02-27 15:39:15,718 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_PORT" is "5432". 2017-02-27 15:39:15,719 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_SECURED" is "False". 2017-02-27 15:39:15,719 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". 2017-02-27 15:39:15,719 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". 2017-02-27 15:39:15,720 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DB_USER" is "engine". 2017-02-27 15:39:15,720 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DEBUG_ADDRESS" is "". 2017-02-27 15:39:15,721 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". 2017-02-27 15:39:15,721 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". 2017-02-27 15:39:15,722 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_EXTENSION_PATH" is "/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d". 2017-02-27 15:39:15,722 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE" is "/var/lib/ovirt-engine/external_truststore". 2017-02-27 15:39:15,723 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD" is "***". 2017-02-27 15:39:15,723 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_TYPE" is "JKS". 2017-02-27 15:39:15,723 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_FQDN" is "engine.dev1.api-digital.com". 2017-02-27 15:39:15,724 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_GROUP" is "ovirt". 2017-02-27 15:39:15,724 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HEAP_MAX" is "2000M". 2017-02-27 15:39:15,725 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HEAP_MIN" is "2000M". 2017-02-27 15:39:15,725 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTPS_ENABLED" is "false". 2017-02-27 15:39:15,725 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTPS_PORT" is "None". 2017-02-27 15:39:15,726 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". 2017-02-27 15:39:15,726 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTP_ENABLED" is "false". 2017-02-27 15:39:15,727 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_HTTP_PORT" is "None". 2017-02-27 15:39:15,727 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". 2017-02-27 15:39:15,727 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". 2017-02-27 15:39:15,728 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". 2017-02-27 15:39:15,728 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". 2017-02-27 15:39:15,729 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_MANUAL" is "/usr/share/ovirt-engine/manual". 2017-02-27 15:39:15,729 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PERM_MAX" is "256m". 2017-02-27 15:39:15,730 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PERM_MIN" is "256m". 2017-02-27 15:39:15,730 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". 2017-02-27 15:39:15,730 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". 2017-02-27 15:39:15,731 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". 2017-02-27 15:39:15,731 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". 2017-02-27 15:39:15,732 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". 2017-02-27 15:39:15,732 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". 2017-02-27 15:39:15,733 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". 2017-02-27 15:39:15,733 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". 2017-02-27 15:39:15,733 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PROPERTIES" is " java.awt.headless=true sun.rmi.dgc.client.gcInterval=3600000 sun.rmi.dgc.server.gcInterval=3600000 jsse.enableSNIExtension=false "java.security.krb5.conf=/etc/ovirt-engine/krb5.conf"". 2017-02-27 15:39:15,734 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PROXY_ENABLED" is "true". 2017-02-27 15:39:15,735 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". 2017-02-27 15:39:15,735 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". 2017-02-27 15:39:15,735 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_BASE_URL" is "". 2017-02-27 15:39:15,736 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_DASHBOARD_URL" is "/flow.html?viewAsDashboardFrame=true". 2017-02-27 15:39:15,736 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_NOT_INSTALLED_URL" is "/ovirt-engine/ReportsNotInstalled.html". 2017-02-27 15:39:15,737 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_PROXY_URL" is "/ovirt/reports-interface". 2017-02-27 15:39:15,737 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_READ_TIMEOUT" is "". 2017-02-27 15:39:15,738 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_RIGHTCLICK_URL" is "". 2017-02-27 15:39:15,738 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_VERIFY_CHAIN" is "true". 2017-02-27 15:39:15,738 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_REPORTS_VERIFY_HOST" is "true". 2017-02-27 15:39:15,739 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_STOP_INTERVAL" is "1". 2017-02-27 15:39:15,739 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_STOP_TIME" is "10". 2017-02-27 15:39:15,739 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". 2017-02-27 15:39:15,740 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". 2017-02-27 15:39:15,740 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_URI" is "/ovirt-engine". 2017-02-27 15:39:15,741 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_USER" is "ovirt". 2017-02-27 15:39:15,741 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". 2017-02-27 15:39:15,741 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". 2017-02-27 15:39:15,742 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "ENGINE_VERBOSE_GC" is "false". 2017-02-27 15:39:15,742 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "JBOSS_HOME" is "/usr/share/ovirt-engine-jboss-as". 2017-02-27 15:39:15,743 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". 2017-02-27 15:39:15,743 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-1) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD,ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD". 2017-02-27 15:39:16,458 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Start initializing Backend 2017-02-27 15:39:17,090 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (MSC service thread 1-2) Loading file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties 2017-02-27 15:39:17,351 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Running ovirt-engine 3.5.6.2-1.el6 2017-02-27 15:39:17,352 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-2) Start initializing dictionaries 2017-02-27 15:39:17,359 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-2) Finished initializing dictionaries 2017-02-27 15:39:17,360 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Start initializing AuditLogCleanupManager 2017-02-27 15:39:17,360 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting audit cleanup manager to run at: 35 35 3 * * ? 2017-02-27 15:39:17,382 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Finished initializing AuditLogCleanupManager 2017-02-27 15:39:17,386 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Start initializing CommandEntityCleanupManager 2017-02-27 15:39:17,386 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting command entity cleanup manager to run at: 35 35 3 * * ? 2017-02-27 15:39:17,388 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Finished initializing CommandEntityCleanupManager 2017-02-27 15:39:17,389 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Start initializing TagsDirector 2017-02-27 15:39:17,398 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Tag root added to tree 2017-02-27 15:39:17,443 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Finished initializing TagsDirector 2017-02-27 15:39:17,444 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-2) Start initializing IsoDomainListSyncronizer 2017-02-27 15:39:17,450 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-2) Finished initializing IsoDomainListSyncronizer 2017-02-27 15:39:17,544 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Completed initializing handlers 2017-02-27 15:39:17,575 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Start initializing ErrorTranslatorImpl 2017-02-27 15:39:17,591 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. 2017-02-27 15:39:17,592 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Finished initializing ErrorTranslatorImpl 2017-02-27 15:39:17,592 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Start initializing ErrorTranslatorImpl 2017-02-27 15:39:17,593 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Finished initializing ErrorTranslatorImpl 2017-02-27 15:39:17,593 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Mark incomplete jobs as UNKNOWN 2017-02-27 15:39:17,644 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-2) Start initializing JobRepositoryCleanupManager 2017-02-27 15:39:17,645 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-2) Finished initializing JobRepositoryCleanupManager 2017-02-27 15:39:17,645 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-2) Start initializing AutoRecoveryManager 2017-02-27 15:39:17,646 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-2) Finished initializing AutoRecoveryManager 2017-02-27 15:39:17,653 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-2) Start initializing ExecutionMessageDirector 2017-02-27 15:39:17,655 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-2) Finished initializing ExecutionMessageDirector 2017-02-27 15:39:17,763 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Loading extension 'builtin-authn-internal' 2017-02-27 15:39:17,768 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'builtin-authn-internal' loaded 2017-02-27 15:39:17,770 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Loading extension 'internal' 2017-02-27 15:39:17,772 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'internal' loaded 2017-02-27 15:39:17,785 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Initializing extension 'builtin-authn-internal' 2017-02-27 15:39:17,785 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'builtin-authn-internal' initialized 2017-02-27 15:39:17,787 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Initializing extension 'internal' 2017-02-27 15:39:17,787 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'internal' initialized 2017-02-27 15:39:17,788 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Start of enabled extensions list 2017-02-27 15:39:17,788 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Instance name: 'builtin-authn-internal', Extension name: 'Internal Authn (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-27 15:39:17,789 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Instance name: 'internal', Extension name: 'Internal Authz (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-27 15:39:17,790 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) End of enabled extensions list 2017-02-27 15:39:17,925 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (MSC service thread 1-4) Initialization of AsyncTaskManager completed successfully. 2017-02-27 15:39:17,926 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-4) Start initializing ResourceManager 2017-02-27 15:39:18,000 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-4) Entered VdsManager constructor 2017-02-27 15:39:18,054 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-4) Initialize vdsBroker (node1.dev1.api-digital.com,54,321) 2017-02-27 15:39:18,337 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-4) VDS eb2aea6e-7de9-4a29-86de-1d43f52fc92a was added to the Resource Manager 2017-02-27 15:39:18,363 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-4) Finished initializing ResourceManager 2017-02-27 15:39:18,364 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (MSC service thread 1-4) Initialization of OvfDataUpdater completed successfully. 2017-02-27 15:39:18,365 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Start scheduling to enable vds load balancer 2017-02-27 15:39:18,365 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Finished scheduling to enable vds load balancer 2017-02-27 15:39:18,366 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Start HA Reservation check 2017-02-27 15:39:18,367 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Finished HA Reservation check 2017-02-27 15:39:18,373 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-4) Init VM custom properties utilities 2017-02-27 15:39:18,374 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-4) Init device custom properties utilities 2017-02-27 15:39:18,381 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Initializing Scheduling manager 2017-02-27 15:39:18,384 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Start initializing MacPoolManagerRanges 2017-02-27 15:39:18,421 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Finished initializing. Available MACs in pool: 256 2017-02-27 15:39:18,436 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) External scheduler disabled, discovery skipped 2017-02-27 15:39:18,436 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Initialized Scheduling manager 2017-02-27 15:39:18,437 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-4) Initializing DWH Heart Beat 2017-02-27 15:39:18,444 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-4) DWH Heart Beat initialized 2017-02-27 15:39:21,448 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-27 15:39:21,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]), log id: 606a5bb4 2017-02-27 15:39:22,004 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GetHardwareInfoVDSCommand, log id: 606a5bb4 2017-02-27 15:39:22,082 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: UNASSIGNED not exist in string table 2017-02-27 15:39:22,083 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table 2017-02-27 15:39:22,083 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table 2017-02-27 15:39:22,084 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table 2017-02-27 15:39:22,085 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table 2017-02-27 15:39:22,085 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table 2017-02-27 15:39:22,086 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_ADDED_DISK_PROFILE not exist in string table 2017-02-27 15:39:22,086 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_ADD_DISK_PROFILE not exist in string table 2017-02-27 15:39:22,087 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_REMOVED_DISK_PROFILE not exist in string table 2017-02-27 15:39:22,087 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_REMOVE_DISK_PROFILE not exist in string table 2017-02-27 15:39:22,088 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_UPDATED_DISK_PROFILE not exist in string table 2017-02-27 15:39:22,088 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_UPDATE_DISK_PROFILE not exist in string table 2017-02-27 15:39:22,089 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_ADDED_CPU_PROFILE not exist in string table 2017-02-27 15:39:22,089 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_ADD_CPU_PROFILE not exist in string table 2017-02-27 15:39:22,090 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_REMOVED_CPU_PROFILE not exist in string table 2017-02-27 15:39:22,096 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_REMOVE_CPU_PROFILE not exist in string table 2017-02-27 15:39:22,096 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_UPDATED_CPU_PROFILE not exist in string table 2017-02-27 15:39:22,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_UPDATE_CPU_PROFILE not exist in string table 2017-02-27 15:39:22,135 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1's following network(s) are not synchronized with their Logical Network configuration: ovirtmgmt. 2017-02-27 15:39:22,185 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM HostedEngine 4a035efd-a041-4e46-84db-01cf79400913 moved from Paused --> Up 2017-02-27 15:39:22,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-5) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: 7041343d 2017-02-27 15:39:22,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-5) FINISH, FullListVdsCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=24566, clientIp=, devices=[Ljava.lang.Object;@376f0802, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 7041343d 2017-02-27 15:39:22,265 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) Received a console Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {alias=console0, specParams={}, deviceType=console, deviceId=aa0b7357-8cdd-410d-8119-97fb727670eb, device=console, type=console} 2017-02-27 15:39:22,266 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) Received a memballoon Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-27 15:39:22,267 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) Received a vnc Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=vnc, specParams={spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, displayIp=0}, deviceType=graphics, type=graphics, port=5900} 2017-02-27 15:39:22,269 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) Empty or NULL values were passed for a VM 4a035efd-a041-4e46-84db-01cf79400913 device, Device is skipped 2017-02-27 15:39:22,269 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=63fecc05-bc31-4113-829e-c8d2588ca6cb, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-27 15:39:22,270 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=a8c31e80-8de1-47a1-8628-ca1f19267a76, device=cdrom, type=DISK, bootOrder=0, specParams={path=}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-27 15:39:22,272 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=df179798-d691-420d-8293-3582a8aaf74c, device=ich6, type=SOUND, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-27 15:39:22,273 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=eab19219-d581-4bb4-99de-6cc5afa8c700, device=qxl, type=VIDEO, bootOrder=0, specParams={vram=32768, heads=1}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-27 15:39:22,274 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=edddf45e-2c79-4c00-9dd5-8a46974c1d08, device=virtio-scsi, type=CONTROLLER, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-27 15:39:22,490 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-5) Initializing Host: hosted_engine_1 2017-02-27 15:39:22,557 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-5) [6c425eab] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-27 15:40:10,519 INFO [org.ovirt.engine.docs.utils.servlet.ContextSensitiveHelpMappingServlet] (ajp--127.0.0.1-8702-2) Context-sensitive help is not installed. Manual directory doesn't exist: /usr/share/ovirt-engine/manual 2017-02-27 15:40:28,978 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp--127.0.0.1-8702-7) Running command: LoginAdminUserCommand internal: false. 2017-02-27 15:40:29,252 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-27 15:40:56,909 INFO [org.ovirt.engine.core.bll.network.dc.UpdateNetworkCommand] (ajp--127.0.0.1-8702-3) [150185ec] Running command: UpdateNetworkCommand internal: false. Entities affected : ID: 00000000-0000-0000-0000-000000000009 Type: NetworkAction group CONFIGURE_STORAGE_POOL_NETWORK with role type ADMIN 2017-02-27 15:40:57,011 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) Correlation ID: 150185ec, Call Stack: null, Custom Event ID: -1, Message: Network ovirtmgmt was updated on Data Center: Default 2017-02-27 15:41:11,055 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-9) [40862345] Lock Acquired to object EngineLock [exclusiveLocks= key: iscsi1 value: NETWORK , sharedLocks= ] 2017-02-27 15:41:11,062 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-9) [40862345] Running command: AddNetworkCommand internal: false. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePoolAction group CREATE_STORAGE_POOL_NETWORK with role type ADMIN 2017-02-27 15:41:11,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) [40862345] Correlation ID: 40862345, Call Stack: null, Custom Event ID: -1, Message: Network iscsi1 was added to Data Center: Default 2017-02-27 15:41:11,119 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-9) [40862345] Lock freed to object EngineLock [exclusiveLocks= key: iscsi1 value: NETWORK , sharedLocks= ] 2017-02-27 15:41:11,192 INFO [org.ovirt.engine.core.bll.network.cluster.AttachNetworkToVdsGroupCommand] (org.ovirt.thread.pool-8-thread-41) [58e9ba5a] Running command: AttachNetworkToVdsGroupCommand internal: false. Entities affected : ID: 30499168-f824-4ec9-b70e-041d38aa3ca9 Type: NetworkAction group ASSIGN_CLUSTER_NETWORK with role type ADMIN 2017-02-27 15:41:11,266 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-41) Correlation ID: 58e9ba5a, Call Stack: null, Custom Event ID: -1, Message: Network iscsi1 attached to Cluster Default 2017-02-27 15:41:19,919 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-5) [7508f029] Lock Acquired to object EngineLock [exclusiveLocks= key: iscsi2 value: NETWORK , sharedLocks= ] 2017-02-27 15:41:19,922 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-5) [7508f029] Running command: AddNetworkCommand internal: false. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePoolAction group CREATE_STORAGE_POOL_NETWORK with role type ADMIN 2017-02-27 15:41:19,957 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-5) [7508f029] Correlation ID: 7508f029, Call Stack: null, Custom Event ID: -1, Message: Network iscsi2 was added to Data Center: Default 2017-02-27 15:41:19,958 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-5) [7508f029] Lock freed to object EngineLock [exclusiveLocks= key: iscsi2 value: NETWORK , sharedLocks= ] 2017-02-27 15:41:20,040 INFO [org.ovirt.engine.core.bll.network.cluster.AttachNetworkToVdsGroupCommand] (org.ovirt.thread.pool-8-thread-45) [488da87f] Running command: AttachNetworkToVdsGroupCommand internal: false. Entities affected : ID: 43b5510d-2881-4f24-a5c1-75d963d270f7 Type: NetworkAction group ASSIGN_CLUSTER_NETWORK with role type ADMIN 2017-02-27 15:41:20,073 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-45) Correlation ID: 488da87f, Call Stack: null, Custom Event ID: -1, Message: Network iscsi2 attached to Cluster Default 2017-02-27 15:41:29,556 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-50) [181c22e3] Start running CanDoAction for command number 2/2 (Command type: UpdateNetworkOnCluster) 2017-02-27 15:41:29,549 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-49) [7315bcc4] Start running CanDoAction for command number 1/2 (Command type: UpdateNetworkOnCluster) 2017-02-27 15:41:29,566 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-49) [7315bcc4] Finish handling CanDoAction for command number 1/2 (Command type: UpdateNetworkOnCluster) 2017-02-27 15:41:29,575 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-50) [181c22e3] Finish handling CanDoAction for command number 2/2 (Command type: UpdateNetworkOnCluster) 2017-02-27 15:41:29,578 INFO [org.ovirt.engine.core.bll.network.cluster.UpdateNetworkOnClusterCommand] (org.ovirt.thread.pool-8-thread-1) [7315bcc4] Running command: UpdateNetworkOnClusterCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group CONFIGURE_CLUSTER_NETWORK with role type ADMIN, ID: 30499168-f824-4ec9-b70e-041d38aa3ca9 Type: NetworkAction group ASSIGN_CLUSTER_NETWORK with role type ADMIN 2017-02-27 15:41:29,642 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-1) [7315bcc4] Correlation ID: 7315bcc4, Call Stack: null, Custom Event ID: -1, Message: Network iscsi1 on Cluster Default updated. 2017-02-27 15:41:29,643 INFO [org.ovirt.engine.core.bll.network.cluster.UpdateNetworkOnClusterCommand] (org.ovirt.thread.pool-8-thread-1) [181c22e3] Running command: UpdateNetworkOnClusterCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group CONFIGURE_CLUSTER_NETWORK with role type ADMIN, ID: 43b5510d-2881-4f24-a5c1-75d963d270f7 Type: NetworkAction group ASSIGN_CLUSTER_NETWORK with role type ADMIN 2017-02-27 15:41:29,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-1) [181c22e3] Correlation ID: 181c22e3, Call Stack: null, Custom Event ID: -1, Message: Network iscsi2 on Cluster Default updated. 2017-02-27 15:41:46,638 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (ajp--127.0.0.1-8702-3) [ed59347] Running command: SetupNetworksCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:41:46,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-3) [ed59347] START, SetupNetworksVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, force=false, checkConnectivity=true, conectivityTimeout=120, networks=[iscsi1 {id=30499168-f824-4ec9-b70e-041d38aa3ca9, description=iSCSI only, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=00000002-0002-0002-0002-00000000002b, mtu=0, vmNetwork=false, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=false, migration=false}, providedBy=null, label=null, qosId=null}, iscsi2 {id=43b5510d-2881-4f24-a5c1-75d963d270f7, description=iSCSI only, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=00000002-0002-0002-0002-00000000002b, mtu=0, vmNetwork=false, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=false, migration=false}, providedBy=null, label=null, qosId=null}], bonds=[], interfaces=[bond0 {id=a60b3029-10ec-4d5d-bb8f-a822e7cadd83, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=bond0, macAddress=84:2b:2b:fd:33:35, networkName=null, bondOptions=mode=802.3ad xmit_hash_policy=layer2+3 lacp_rate=1, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, type=2, networkImplementationDetails=null}, bond0.1612 {id=7f610ebf-eb69-4af5-9749-d70420de1aa3, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=bond0.1612, networkName=ovirtmgmt, vlanId=1612, bootProtocol=STATIC_IP, address=74.51.121.119, subnet=255.255.255.224, gateway=74.51.121.126, mtu=1500, bridged=true, type=2, networkImplementationDetails={inSync=true, managed=true}}, em2 {id=d868c7ea-6430-49d7-9146-ab86e99ce670, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=em2, macAddress=84:2b:2b:fd:33:37, networkName=null, bondName=bond0, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em3 {id=bacf1483-5048-4ad6-8f1e-043fd5fcfdac, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=em3, macAddress=84:2b:2b:fd:33:39, networkName=iscsi1, bondName=null, bootProtocol=STATIC_IP, address=10.43.0.10, subnet=255.255.255.0, gateway=null, mtu=0, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em1 {id=c731e77a-91d4-4e7e-bc38-07a79efb419e, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=em1, macAddress=84:2b:2b:fd:33:35, networkName=null, bondName=bond0, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em4 {id=b1a7dddb-2ab3-40ce-956a-87b94b9085a6, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=em4, macAddress=84:2b:2b:fd:33:3b, networkName=iscsi2, bondName=null, bootProtocol=STATIC_IP, address=10.43.0.11, subnet=255.255.255.0, gateway=null, mtu=0, bridged=false, speed=1000, type=0, networkImplementationDetails=null}], removedNetworks=[], removedBonds=[]), log id: 739e51a6 2017-02-27 15:41:46,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-3) [ed59347] FINISH, SetupNetworksVDSCommand, log id: 739e51a6 2017-02-27 15:41:46,663 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-27 15:41:46,672 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp--127.0.0.1-8702-3) [ed59347] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Policy reset 2017-02-27 15:41:46,691 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp--127.0.0.1-8702-3) [ed59347] Command PollVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Policy reset 2017-02-27 15:41:56,534 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 has network interface which exceeded the defined threshold [95%] (em3: transmit rate[100%], receive rate [100%]) 2017-02-27 15:41:56,543 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 has network interface which exceeded the defined threshold [95%] (em4: transmit rate[100%], receive rate [100%]) 2017-02-27 15:41:56,704 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-27 15:41:56,704 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-27 15:41:57,063 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (ajp--127.0.0.1-8702-4) [2b9a3343] Running command: CommitNetworkChangesCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:41:57,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (ajp--127.0.0.1-8702-4) [2b9a3343] START, SetSafeNetworkConfigVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 157d841d 2017-02-27 15:41:57,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (ajp--127.0.0.1-8702-4) [2b9a3343] FINISH, SetSafeNetworkConfigVDSCommand, log id: 157d841d 2017-02-27 15:41:57,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [2b9a3343] Correlation ID: 2b9a3343, Job ID: a5ef08fc-ff09-4261-91c8-bc3dc65feb4e, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host hosted_engine_1 2017-02-27 15:42:11,828 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Interface em3 on host hosted_engine_1, changed state to up 2017-02-27 15:42:25,355 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): ovirt-image-repository (All file type) 2017-02-27 15:42:31,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-14) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: 5d543865 2017-02-27 15:42:31,806 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-14) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 5d543865 2017-02-27 15:42:45,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8702-34) START, DiscoverSendTargetsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, connection={ id: null, connection: 10.43.0.1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };), log id: 4e80f841 2017-02-27 15:42:45,619 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8702-34) FINISH, DiscoverSendTargetsVDSCommand, return: [{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], log id: 4e80f841 2017-02-27 15:42:51,136 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8702-14) [833ccd2] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:42:51,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-14) [833ccd2] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4673c444 2017-02-27 15:42:51,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-14) [833ccd2] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 4673c444 2017-02-27 15:42:51,518 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-18) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: 1aa9d3cf 2017-02-27 15:42:51,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-18) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=E3JaJp-ptRC-sEIJ-mMic-gSE8-1wAj-YmnQW6, volumeGroupId=6Fn4Z4-bW1J-FSfU-f3R7-ZuLA-dNyu-YrnRLy, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 1aa9d3cf 2017-02-27 15:43:04,848 INFO [org.ovirt.engine.core.bll.storage.AddSANStorageDomainCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] Running command: AddSANStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:43:04,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] START, CreateVGVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, deviceList=[3600140568946636764f4c968b8d38f40], force=true), log id: 7d99c11 2017-02-27 15:43:05,508 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVGVDSCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] FINISH, CreateVGVDSCommand, return: E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, log id: 7d99c11 2017-02-27 15:43:05,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] START, CreateStorageDomainVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomain=StorageDomainStatic[vms, 831fd677-2894-48e7-8a0d-fd5c084a08e6], args=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq), log id: 1a24a0a0 2017-02-27 15:43:09,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] FINISH, CreateStorageDomainVDSCommand, log id: 1a24a0a0 2017-02-27 15:43:09,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] START, GetStorageDomainStatsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6), log id: 7ec925a8 2017-02-27 15:43:09,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, 831fd677-2894-48e7-8a0d-fd5c084a08e6], log id: 7ec925a8 2017-02-27 15:43:09,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] START, GetVGInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, VGID=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq), log id: 1c73403e 2017-02-27 15:43:09,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-19) [2cfd2f29] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, storageDomainName=null]], log id: 1c73403e 2017-02-27 15:43:09,572 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-19) [2cfd2f29] Correlation ID: 2cfd2f29, Job ID: 33b1216f-1474-4aab-bcea-e8b7e8827906, Call Stack: null, Custom Event ID: -1, Message: Storage Domain vms was added by admin@internal 2017-02-27 15:43:09,690 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-38) [2e3635f7] Lock Acquired to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:43:09,736 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-38) [2e3635f7] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:43:09,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-38) [6e850c11] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 637dcea3 2017-02-27 15:43:09,969 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-38) [6e850c11] FINISH, ConnectStorageServerVDSCommand, return: {1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 637dcea3 2017-02-27 15:43:09,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-38) [6e850c11] START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6), log id: 22179329 2017-02-27 15:43:10,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-38) [6e850c11] FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 22179329 2017-02-27 15:43:10,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-38) [6e850c11] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: defe083 2017-02-27 15:43:10,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-38) [6e850c11] FINISH, DisconnectStorageServerVDSCommand, return: {1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: defe083 2017-02-27 15:43:10,601 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8702-38) Running command: AddStoragePoolWithStoragesCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePoolAction group CREATE_STORAGE_POOL with role type ADMIN 2017-02-27 15:43:10,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-38) START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3cc6880c 2017-02-27 15:43:10,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-38) FINISH, ConnectStorageServerVDSCommand, return: {1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 3cc6880c 2017-02-27 15:43:10,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp--127.0.0.1-8702-38) START, CreateStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId=00000002-0002-0002-0002-00000000002b, storagePoolName=Default, masterDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, domainsIdList=[831fd677-2894-48e7-8a0d-fd5c084a08e6], masterVersion=1), log id: 1638a8a8 2017-02-27 15:43:36,337 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (ajp--127.0.0.1-8702-38) FINISH, CreateStoragePoolVDSCommand, log id: 1638a8a8 2017-02-27 15:43:36,342 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-38) START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, sdUUID = 831fd677-2894-48e7-8a0d-fd5c084a08e6), log id: 34f73932 2017-02-27 15:43:36,357 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (ajp--127.0.0.1-8702-38) [60ce8930] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 15:43:36,406 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-38) [60ce8930] Correlation ID: 60ce8930, Call Stack: null, Custom Event ID: -1, Message: Data Center is being initialized, please wait for initialization to complete. 2017-02-27 15:43:36,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 17b1a029 2017-02-27 15:43:36,805 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] FINISH, ConnectStoragePoolVDSCommand, log id: 17b1a029 2017-02-27 15:43:36,829 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp--127.0.0.1-8702-38) [60ce8930] hostFromVds::selectedVds - hosted_engine_1, spmStatus Free, storage pool Default, storage pool version 3.5 2017-02-27 15:43:36,849 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp--127.0.0.1-8702-38) [60ce8930] starting spm on vds hosted_engine_1, storage pool Default, prevId -1, LVER -1 2017-02-27 15:43:36,853 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] START, SpmStartVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 61b7dc88 2017-02-27 15:43:36,866 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] spmStart polling started: taskId = e0897b26-b10e-48f8-9b9d-d4bf411504eb 2017-02-27 15:43:50,860 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-28) [96b56bb] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/isos value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:43:50,883 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-28) [96b56bb] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:43:50,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-28) [96b56bb] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4bae9aa1 2017-02-27 15:43:59,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] spmStart polling ended: taskId = e0897b26-b10e-48f8-9b9d-d4bf411504eb task status = finished 2017-02-27 15:43:59,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] spmStart polling ended, spm status: SPM 2017-02-27 15:43:59,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=e0897b26-b10e-48f8-9b9d-d4bf411504eb), log id: 3e7a4eea 2017-02-27 15:43:59,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] FINISH, HSMClearTaskVDSCommand, log id: 3e7a4eea 2017-02-27 15:43:59,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@75eb0498, log id: 61b7dc88 2017-02-27 15:43:59,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (ajp--127.0.0.1-8702-38) [60ce8930] Initialize Irs proxy from vds: node1.dev1.api-digital.com 2017-02-27 15:43:59,206 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-38) [60ce8930] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_1 (Address: node1.dev1.api-digital.com). 2017-02-27 15:43:59,209 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-27 15:43:59,379 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-38) [60ce8930] FINISH, GetImagesListVDSCommand, return: [], log id: 34f73932 2017-02-27 15:43:59,389 WARN [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8702-38) There are no OVF_STORE disks on storage domain id 831fd677-2894-48e7-8a0d-fd5c084a08e6 2017-02-27 15:43:59,409 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-38) Correlation ID: 6e850c11, Job ID: d84ca1d2-da78-477b-a7e4-4e5542a251c0, Call Stack: null, Custom Event ID: -1, Message: The Storage Domain does not contain any OVF_STORE disks. Usually the Storage Domain does not contain OVF_STORE disks when the Storage Domain has been previously managed with a Data Center version lower then 3.5. 2017-02-27 15:43:59,416 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp--127.0.0.1-8702-38) Lock freed to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:43:59,419 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-38) [3efd75b0] Lock Acquired to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:43:59,424 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-38) [3efd75b0] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:43:59,440 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-38) [3efd75b0] Lock freed to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:43:59,441 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-38) [3efd75b0] ActivateStorage Domain. Before Connect all hosts to pool. Time:2/27/17 3:43 PM 2017-02-27 15:43:59,481 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [3efd75b0] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2e81ae36 2017-02-27 15:43:59,716 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [3efd75b0] FINISH, ConnectStorageServerVDSCommand, return: {1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 2e81ae36 2017-02-27 15:43:59,719 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (ajp--127.0.0.1-8702-38) [1bc5fe8b] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:43:59,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-38) [1bc5fe8b] START, GetVGInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, VGID=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq), log id: 39c022b0 2017-02-27 15:43:59,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (ajp--127.0.0.1-8702-38) [1bc5fe8b] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, storageDomainName=null]], log id: 39c022b0 2017-02-27 15:43:59,830 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-38) [1bc5fe8b] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6), log id: 559e29a1 2017-02-27 15:44:00,091 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-38) [1bc5fe8b] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 559e29a1 2017-02-27 15:44:00,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-38) [1bc5fe8b] ActivateStorage Domain. After Connect all hosts to pool. Time:2/27/17 3:44 PM 2017-02-27 15:44:00,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-13) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 6cfaef29 2017-02-27 15:44:00,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-13) FINISH, ConnectStoragePoolVDSCommand, log id: 6cfaef29 2017-02-27 15:44:00,481 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-38) [1bc5fe8b] ActivateStorage Domain. After change storage pool status in vds. Time:2/27/17 3:44 PM 2017-02-27 15:44:00,513 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-38) [1bc5fe8b] Correlation ID: 3efd75b0, Call Stack: null, Custom Event ID: -1, Message: Storage Domain vms (Data Center Default) was activated by admin@internal 2017-02-27 15:44:00,521 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-38) [1bc5fe8b] Correlation ID: 6e850c11, Job ID: d84ca1d2-da78-477b-a7e4-4e5542a251c0, Call Stack: null, Custom Event ID: -1, Message: Storage Domains were attached to Data Center Default by admin@internal 2017-02-27 15:44:00,537 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-38) [1bc5fe8b] Correlation ID: 2e3635f7, Job ID: d84ca1d2-da78-477b-a7e4-4e5542a251c0, Call Stack: null, Custom Event ID: -1, Message: Storage Domain vms was attached to Data Center Default by admin@internal 2017-02-27 15:44:00,546 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (ajp--127.0.0.1-8702-38) [1bc5fe8b] Trying to release exclusive lock which does not exist, lock key: 831fd677-2894-48e7-8a0d-fd5c084a08e6STORAGE 2017-02-27 15:44:00,547 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-38) [1bc5fe8b] Lock freed to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:46:01,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-28) [96b56bb] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=477}, log id: 4bae9aa1 2017-02-27 15:46:01,204 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-28) [96b56bb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection nfs.dev1.api-digital.com:/srv/nfs/isos returned by VDSM was: Problem while trying to mount target 2017-02-27 15:46:01,205 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (ajp--127.0.0.1-8702-28) [96b56bb] The connection with details nfs.dev1.api-digital.com:/srv/nfs/isos failed because of error code 477 and error message is: problem while trying to mount target 2017-02-27 15:46:01,206 ERROR [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-28) [96b56bb] Command org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand throw Vdc Bll exception. With error message VdcBLLException: ProblemWhileTryingToMountTarget (Failed with error ProblemWhileTryingToMountTarget and code 477) 2017-02-27 15:46:01,214 ERROR [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-28) [96b56bb] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand. 2017-02-27 15:46:01,240 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-28) [96b56bb] Lock freed to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/isos value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:46:01,320 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp--127.0.0.1-8702-3) [7f2e5933] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:46:01,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-3) [7f2e5933] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6073b76a 2017-02-27 15:46:01,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-3) [7f2e5933] FINISH, DisconnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=477}, log id: 6073b76a 2017-02-27 15:46:05,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-40) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: 6487b29a 2017-02-27 15:46:06,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-40) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 6487b29a 2017-02-27 15:46:06,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-40) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: 6fa470cd 2017-02-27 15:46:06,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-40) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 6fa470cd 2017-02-27 15:46:29,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8702-37) START, DiscoverSendTargetsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, connection={ id: null, connection: 10.43.0.1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };), log id: 2960ddef 2017-02-27 15:46:29,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DiscoverSendTargetsVDSCommand] (ajp--127.0.0.1-8702-37) FINISH, DiscoverSendTargetsVDSCommand, return: [{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], log id: 2960ddef 2017-02-27 15:46:34,111 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (ajp--127.0.0.1-8702-26) [28c8f330] Running command: ConnectStorageToVdsCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:46:34,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-26) [28c8f330] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3fdc10e5 2017-02-27 15:46:34,396 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-26) [28c8f330] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 3fdc10e5 2017-02-27 15:46:34,493 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-7) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: 4ab7f7b5 2017-02-27 15:46:34,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-7) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 4ab7f7b5 2017-02-27 15:46:40,274 INFO [org.ovirt.engine.core.bll.storage.UpdateStorageDomainCommand] (ajp--127.0.0.1-8702-11) [20eeb4cf] Running command: UpdateStorageDomainCommand internal: false. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group EDIT_STORAGE_DOMAIN_CONFIGURATION with role type ADMIN 2017-02-27 15:46:40,302 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-11) [20eeb4cf] Correlation ID: 20eeb4cf, Call Stack: null, Custom Event ID: -1, Message: Storage Domain vms was updated by admin@internal 2017-02-27 15:46:57,246 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (ajp--127.0.0.1-8702-24) [73a2d786] Lock Acquired to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE key: 00000002-0002-0002-0002-00000000002b value: POOL , sharedLocks= ] 2017-02-27 15:46:57,350 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-44) [73a2d786] Running command: DeactivateStorageDomainWithOvfUpdateCommand internal: false. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:46:57,368 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (org.ovirt.thread.pool-8-thread-44) [70cb38d8] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 15:46:57,633 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (org.ovirt.thread.pool-8-thread-44) [70cb38d8] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 15:46:57,645 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-44) [6bceecc5] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE ] 2017-02-27 15:46:57,647 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-44) [6bceecc5] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:46:57,649 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-44) [1ba35d79] Running command: CreateOvfStoresForStorageDomainCommand internal: true. 2017-02-27 15:46:57,661 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-44) [14114598] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:46:57,690 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-44) [59d5bbaf] Running command: AddDiskCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group CREATE_DISK with role type USER 2017-02-27 15:46:57,797 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-44) [2aa0e87] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:46:57,833 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-44) [2aa0e87] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 73b02d61-81d3-46a8-8adf-2aca489de3f5, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = 18a3de2e-bec2-4ffd-98a8-1d371c6e651a, newImageDescription = {"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}), log id: 2b7f5a5e 2017-02-27 15:46:57,839 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-44) [2aa0e87] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID 2017-02-27 15:46:57,895 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-44) [2aa0e87] FINISH, CreateImageVDSCommand, return: 18a3de2e-bec2-4ffd-98a8-1d371c6e651a, log id: 2b7f5a5e 2017-02-27 15:46:57,917 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-44) [2aa0e87] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 4128442f-33ec-469f-801a-13b2bfe6df9f 2017-02-27 15:46:57,918 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-44) [2aa0e87] CommandMultiAsyncTasks::AttachTask: Attaching task 6a084318-90df-4945-aea1-a0922f117f05 to command 4128442f-33ec-469f-801a-13b2bfe6df9f. 2017-02-27 15:46:57,945 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-44) [2aa0e87] Adding task 6a084318-90df-4945-aea1-a0922f117f05 (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-27 15:46:57,993 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-44) [2aa0e87] Correlation ID: 59d5bbaf, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by the system. 2017-02-27 15:46:58,009 INFO [org.ovirt.engine.core.bll.CreateOvfVolumeForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-44) [427ad6a4] Running command: CreateOvfVolumeForStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:46:58,019 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-8-thread-44) [4708b76c] Running command: AddDiskCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group CREATE_DISK with role type USER 2017-02-27 15:46:58,053 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:46:58,065 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = be6592f3-9887-47e6-94ca-739a57ef9935, imageSizeInBytes = 134217728, volumeFormat = RAW, newImageId = c942c959-6d41-45c5-acd8-248138e00ccb, newImageDescription = {"DiskAlias":"OVF_STORE","DiskDescription":"OVF_STORE"}), log id: 18b0e21f 2017-02-27 15:46:58,068 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID 2017-02-27 15:46:58,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] FINISH, CreateImageVDSCommand, return: c942c959-6d41-45c5-acd8-248138e00ccb, log id: 18b0e21f 2017-02-27 15:46:58,125 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] CommandMultiAsyncTasks::AttachTask: Attaching task 77fa5488-05d8-481d-aa88-b2b492d64d1c to command 4128442f-33ec-469f-801a-13b2bfe6df9f. 2017-02-27 15:46:58,145 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] Adding task 77fa5488-05d8-481d-aa88-b2b492d64d1c (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-27 15:46:58,181 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] Correlation ID: 4708b76c, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of 'OVF_STORE' was initiated by the system. 2017-02-27 15:46:58,192 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE ] 2017-02-27 15:46:58,221 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] BaseAsyncTask::startPollingTask: Starting to poll task 6a084318-90df-4945-aea1-a0922f117f05. 2017-02-27 15:46:58,222 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-44) [182c2ffd] BaseAsyncTask::startPollingTask: Starting to poll task 77fa5488-05d8-481d-aa88-b2b492d64d1c. 2017-02-27 15:47:07,915 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-57) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now 2017-02-27 15:47:07,924 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-57) SPMAsyncTask::PollTask: Polling task 6a084318-90df-4945-aea1-a0922f117f05 (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. 2017-02-27 15:47:07,953 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-57) BaseAsyncTask::onTaskEndSuccess: Task 6a084318-90df-4945-aea1-a0922f117f05 (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. 2017-02-27 15:47:07,953 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-57) Task with DB Task ID e19cb433-8cf9-4a20-95f6-31fd5898c88b and VDSM Task ID 77fa5488-05d8-481d-aa88-b2b492d64d1c is in state Polling. End action for command 4128442f-33ec-469f-801a-13b2bfe6df9f will proceed when all the entitys tasks are completed. 2017-02-27 15:47:07,955 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-57) SPMAsyncTask::PollTask: Polling task 77fa5488-05d8-481d-aa88-b2b492d64d1c (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. 2017-02-27 15:47:07,965 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-57) BaseAsyncTask::onTaskEndSuccess: Task 77fa5488-05d8-481d-aa88-b2b492d64d1c (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. 2017-02-27 15:47:07,965 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-57) CommandAsyncTask::endActionIfNecessary: All tasks of command 4128442f-33ec-469f-801a-13b2bfe6df9f has ended -> executing endAction 2017-02-27 15:47:07,966 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-57) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 4128442f-33ec-469f-801a-13b2bfe6df9f): calling endAction . 2017-02-27 15:47:07,968 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-1) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction DeactivateStorageDomainWithOvfUpdate, executionIndex: 0 2017-02-27 15:47:08,001 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-1) Ending command successfully: org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand 2017-02-27 15:47:08,003 INFO [org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-1) Ending command successfully: org.ovirt.engine.core.bll.CreateOvfStoresForStorageDomainCommand 2017-02-27 15:47:08,055 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-1) [182c2ffd] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand 2017-02-27 15:47:08,069 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-1) [182c2ffd] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = be6592f3-9887-47e6-94ca-739a57ef9935, imageId = c942c959-6d41-45c5-acd8-248138e00ccb), log id: 2cb77f5 2017-02-27 15:47:08,257 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-1) [182c2ffd] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@f2b2d295, log id: 2cb77f5 2017-02-27 15:47:08,296 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-8-thread-1) [2aa0e87] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand 2017-02-27 15:47:08,298 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-1) [2aa0e87] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 73b02d61-81d3-46a8-8adf-2aca489de3f5, imageId = 18a3de2e-bec2-4ffd-98a8-1d371c6e651a), log id: 71ccf092 2017-02-27 15:47:08,317 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-1) [2aa0e87] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@2125b3a9, log id: 71ccf092 2017-02-27 15:47:08,378 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-1) [275b38f7] Lock Acquired to object EngineLock [exclusiveLocks= key: 73b02d61-81d3-46a8-8adf-2aca489de3f5 value: DISK key: be6592f3-9887-47e6-94ca-739a57ef9935 value: DISK , sharedLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE ] 2017-02-27 15:47:08,384 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-1) [275b38f7] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:47:08,459 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [275b38f7] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = be6592f3-9887-47e6-94ca-739a57ef9935, imageId = c942c959-6d41-45c5-acd8-248138e00ccb), log id: 5408f013 2017-02-27 15:47:08,460 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [275b38f7] -- executeIrsBrokerCommand: calling 'setVolumeDescription' 2017-02-27 15:47:08,460 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [275b38f7] -- setVolumeDescription parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGroupGUID=be6592f3-9887-47e6-94ca-739a57ef9935 volUUID=c942c959-6d41-45c5-acd8-248138e00ccb description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"831fd677-2894-48e7-8a0d-fd5c084a08e6"}],"Last Updated":null} 2017-02-27 15:47:08,557 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [275b38f7] FINISH, SetVolumeDescriptionVDSCommand, log id: 5408f013 2017-02-27 15:47:08,606 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS_EXECUTION ] 2017-02-27 15:47:08,613 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] Running command: UploadStreamCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:47:08,620 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] START, UploadStreamVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 465cd5bc 2017-02-27 15:47:08,620 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] -- executeVdsBrokerCommand: 2017-02-27 15:47:08,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] -- parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGUID=be6592f3-9887-47e6-94ca-739a57ef9935 volUUID=c942c959-6d41-45c5-acd8-248138e00ccb size=20,480 2017-02-27 15:47:09,137 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] FINISH, UploadStreamVDSCommand, log id: 465cd5bc 2017-02-27 15:47:09,161 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-1) [3082b6a] CommandMultiAsyncTasks::AttachTask: Attaching task 55171f8c-51b8-4212-a11f-038b96234482 to command 4128442f-33ec-469f-801a-13b2bfe6df9f. 2017-02-27 15:47:09,180 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-1) [3082b6a] Adding task 55171f8c-51b8-4212-a11f-038b96234482 (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-27 15:47:09,198 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS_EXECUTION ] 2017-02-27 15:47:09,202 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = be6592f3-9887-47e6-94ca-739a57ef9935, imageId = c942c959-6d41-45c5-acd8-248138e00ccb), log id: f0d1adf 2017-02-27 15:47:09,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] -- executeIrsBrokerCommand: calling 'setVolumeDescription' 2017-02-27 15:47:09,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] -- setVolumeDescription parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGroupGUID=be6592f3-9887-47e6-94ca-739a57ef9935 volUUID=c942c959-6d41-45c5-acd8-248138e00ccb description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"831fd677-2894-48e7-8a0d-fd5c084a08e6"}],"Last Updated":"Mon Feb 27 15:47:08 CST 2017","Size":20480} 2017-02-27 15:47:09,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] FINISH, SetVolumeDescriptionVDSCommand, log id: f0d1adf 2017-02-27 15:47:09,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 73b02d61-81d3-46a8-8adf-2aca489de3f5, imageId = 18a3de2e-bec2-4ffd-98a8-1d371c6e651a), log id: 21fb16b9 2017-02-27 15:47:09,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] -- executeIrsBrokerCommand: calling 'setVolumeDescription' 2017-02-27 15:47:09,348 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] -- setVolumeDescription parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGroupGUID=73b02d61-81d3-46a8-8adf-2aca489de3f5 volUUID=18a3de2e-bec2-4ffd-98a8-1d371c6e651a description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"831fd677-2894-48e7-8a0d-fd5c084a08e6"}],"Last Updated":null} 2017-02-27 15:47:09,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [3082b6a] FINISH, SetVolumeDescriptionVDSCommand, log id: 21fb16b9 2017-02-27 15:47:09,474 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS_EXECUTION ] 2017-02-27 15:47:09,481 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] Running command: UploadStreamCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:47:09,483 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] START, UploadStreamVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 24b6551d 2017-02-27 15:47:09,483 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] -- executeVdsBrokerCommand: 2017-02-27 15:47:09,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] -- parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGUID=73b02d61-81d3-46a8-8adf-2aca489de3f5 volUUID=18a3de2e-bec2-4ffd-98a8-1d371c6e651a size=20,480 2017-02-27 15:47:09,987 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] FINISH, UploadStreamVDSCommand, log id: 24b6551d 2017-02-27 15:47:10,009 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] CommandMultiAsyncTasks::AttachTask: Attaching task e8ffe4fb-5d4d-4c89-a8e2-4063a463074b to command 4128442f-33ec-469f-801a-13b2bfe6df9f. 2017-02-27 15:47:10,026 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] Adding task e8ffe4fb-5d4d-4c89-a8e2-4063a463074b (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-27 15:47:10,040 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS_EXECUTION ] 2017-02-27 15:47:10,042 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 73b02d61-81d3-46a8-8adf-2aca489de3f5, imageId = 18a3de2e-bec2-4ffd-98a8-1d371c6e651a), log id: 6439c311 2017-02-27 15:47:10,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] -- executeIrsBrokerCommand: calling 'setVolumeDescription' 2017-02-27 15:47:10,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] -- setVolumeDescription parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGroupGUID=73b02d61-81d3-46a8-8adf-2aca489de3f5 volUUID=18a3de2e-bec2-4ffd-98a8-1d371c6e651a description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"831fd677-2894-48e7-8a0d-fd5c084a08e6"}],"Last Updated":"Mon Feb 27 15:47:08 CST 2017","Size":20480} 2017-02-27 15:47:10,128 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] FINISH, SetVolumeDescriptionVDSCommand, log id: 6439c311 2017-02-27 15:47:10,138 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-1) [1b7b8db0] Lock freed to object EngineLock [exclusiveLocks= key: 73b02d61-81d3-46a8-8adf-2aca489de3f5 value: DISK key: be6592f3-9887-47e6-94ca-739a57ef9935 value: DISK , sharedLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE ] 2017-02-27 15:47:10,148 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-1) BaseAsyncTask::startPollingTask: Starting to poll task 55171f8c-51b8-4212-a11f-038b96234482. 2017-02-27 15:47:10,149 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-1) BaseAsyncTask::startPollingTask: Starting to poll task e8ffe4fb-5d4d-4c89-a8e2-4063a463074b. 2017-02-27 15:47:10,150 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-1) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type DeactivateStorageDomainWithOvfUpdate completed, handling the result. 2017-02-27 15:47:10,151 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-1) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type DeactivateStorageDomainWithOvfUpdate succeeded, clearing tasks. 2017-02-27 15:47:10,156 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-1) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 77fa5488-05d8-481d-aa88-b2b492d64d1c 2017-02-27 15:47:10,157 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-1) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = 77fa5488-05d8-481d-aa88-b2b492d64d1c), log id: 7462456f 2017-02-27 15:47:10,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-1) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=77fa5488-05d8-481d-aa88-b2b492d64d1c), log id: 5fbcb61a 2017-02-27 15:47:10,203 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-1) FINISH, HSMClearTaskVDSCommand, log id: 5fbcb61a 2017-02-27 15:47:10,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-1) FINISH, SPMClearTaskVDSCommand, log id: 7462456f 2017-02-27 15:47:10,218 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-1) BaseAsyncTask::removeTaskFromDB: Removed task 77fa5488-05d8-481d-aa88-b2b492d64d1c from DataBase 2017-02-27 15:47:10,218 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-1) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6a084318-90df-4945-aea1-a0922f117f05 2017-02-27 15:47:10,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-1) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = 6a084318-90df-4945-aea1-a0922f117f05), log id: 8512801 2017-02-27 15:47:10,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-1) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=6a084318-90df-4945-aea1-a0922f117f05), log id: 8195deb 2017-02-27 15:47:10,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-1) FINISH, HSMClearTaskVDSCommand, log id: 8195deb 2017-02-27 15:47:10,235 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-1) FINISH, SPMClearTaskVDSCommand, log id: 8512801 2017-02-27 15:47:10,240 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-1) BaseAsyncTask::removeTaskFromDB: Removed task 6a084318-90df-4945-aea1-a0922f117f05 from DataBase 2017-02-27 15:47:10,240 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-1) [within thread]: Some of the tasks related to command id 4128442f-33ec-469f-801a-13b2bfe6df9f were not cleared yet (Task id e8ffe4fb-5d4d-4c89-a8e2-4063a463074b is in state Polling). 2017-02-27 15:47:17,969 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-76) Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now 2017-02-27 15:47:17,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-76) Failed in HSMGetAllTasksStatusesVDS method 2017-02-27 15:47:17,976 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-76) Failed in HSMGetAllTasksStatusesVDS method 2017-02-27 15:47:17,977 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task 55171f8c-51b8-4212-a11f-038b96234482 (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'cleanSuccess'. 2017-02-27 15:47:18,004 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) BaseAsyncTask::logEndTaskFailure: Task 55171f8c-51b8-4212-a11f-038b96234482 (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: -- Result: cleanSuccess -- Message: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Logical Volume extend failed, code = 554, -- Exception: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Logical Volume extend failed, code = 554 2017-02-27 15:47:18,005 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-76) Task with DB Task ID 3a13f92d-97ef-4999-b715-81c8f7df4f81 and VDSM Task ID e8ffe4fb-5d4d-4c89-a8e2-4063a463074b is in state Polling. End action for command 4128442f-33ec-469f-801a-13b2bfe6df9f will proceed when all the entitys tasks are completed. 2017-02-27 15:47:18,006 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) SPMAsyncTask::PollTask: Polling task e8ffe4fb-5d4d-4c89-a8e2-4063a463074b (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'cleanSuccess'. 2017-02-27 15:47:18,014 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-76) BaseAsyncTask::logEndTaskFailure: Task e8ffe4fb-5d4d-4c89-a8e2-4063a463074b (Parent Command DeactivateStorageDomainWithOvfUpdate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: -- Result: cleanSuccess -- Message: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Logical Volume extend failed, code = 554, -- Exception: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Logical Volume extend failed, code = 554 2017-02-27 15:47:18,015 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-76) CommandAsyncTask::endActionIfNecessary: All tasks of command 4128442f-33ec-469f-801a-13b2bfe6df9f has ended -> executing endAction 2017-02-27 15:47:18,016 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-76) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 4128442f-33ec-469f-801a-13b2bfe6df9f): calling endAction . 2017-02-27 15:47:18,016 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-8) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction DeactivateStorageDomainWithOvfUpdate, executionIndex: 0 2017-02-27 15:47:18,030 ERROR [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-8) Ending command with failure: org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand 2017-02-27 15:47:18,038 ERROR [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-8) [1b7b8db0] Ending command with failure: org.ovirt.engine.core.bll.UploadStreamCommand 2017-02-27 15:47:18,056 ERROR [org.ovirt.engine.core.bll.UploadStreamCommand] (org.ovirt.thread.pool-8-thread-8) [3082b6a] Ending command with failure: org.ovirt.engine.core.bll.UploadStreamCommand 2017-02-27 15:47:18,071 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-10) waiting for all tasks related to domain 831fd677-2894-48e7-8a0d-fd5c084a08e6 to be cleared (if exist) before attempting to deactivate 2017-02-27 15:47:18,072 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-8) Lock freed to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE key: 00000002-0002-0002-0002-00000000002b value: POOL , sharedLocks= ] 2017-02-27 15:47:18,073 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-8) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type DeactivateStorageDomainWithOvfUpdate completed, handling the result. 2017-02-27 15:47:18,074 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-8) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type DeactivateStorageDomainWithOvfUpdate succeeded, clearing tasks. 2017-02-27 15:47:18,079 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) SPMAsyncTask::ClearAsyncTask: Attempting to clear task e8ffe4fb-5d4d-4c89-a8e2-4063a463074b 2017-02-27 15:47:18,080 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = e8ffe4fb-5d4d-4c89-a8e2-4063a463074b), log id: 3ec75aac 2017-02-27 15:47:18,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=e8ffe4fb-5d4d-4c89-a8e2-4063a463074b), log id: 1211f267 2017-02-27 15:47:18,092 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, HSMClearTaskVDSCommand, log id: 1211f267 2017-02-27 15:47:18,093 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, SPMClearTaskVDSCommand, log id: 3ec75aac 2017-02-27 15:47:18,099 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) BaseAsyncTask::removeTaskFromDB: Removed task e8ffe4fb-5d4d-4c89-a8e2-4063a463074b from DataBase 2017-02-27 15:47:18,100 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 55171f8c-51b8-4212-a11f-038b96234482 2017-02-27 15:47:18,100 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = 55171f8c-51b8-4212-a11f-038b96234482), log id: 2e4a09b0 2017-02-27 15:47:18,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=55171f8c-51b8-4212-a11f-038b96234482), log id: 7ec2198d 2017-02-27 15:47:18,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, HSMClearTaskVDSCommand, log id: 7ec2198d 2017-02-27 15:47:18,113 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, SPMClearTaskVDSCommand, log id: 2e4a09b0 2017-02-27 15:47:18,120 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-8) BaseAsyncTask::removeTaskFromDB: Removed task 55171f8c-51b8-4212-a11f-038b96234482 from DataBase 2017-02-27 15:47:18,120 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-8) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 4128442f-33ec-469f-801a-13b2bfe6df9f 2017-02-27 15:47:18,127 INFO [org.ovirt.engine.core.bll.RemoveAuditLogByIdCommand] (ajp--127.0.0.1-8702-29) [31a159bb] Running command: RemoveAuditLogByIdCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group AUDIT_LOG_MANAGEMENT with role type ADMIN 2017-02-27 15:47:18,145 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-29) [31a159bb] Correlation ID: 31a159bb, Call Stack: null, Custom Event ID: -1, Message: Event log message 3 was removed by User admin@internal. 2017-02-27 15:47:21,076 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-10) no tasks for the deactivated domain 831fd677-2894-48e7-8a0d-fd5c084a08e6, proceeding with deactivation 2017-02-27 15:47:21,078 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:47:21,120 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 170a02ed 2017-02-27 15:47:21,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] FINISH, DeactivateStorageDomainVDSCommand, log id: 170a02ed 2017-02-27 15:47:21,244 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] START, SpmStopOnIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 52c5c681 2017-02-27 15:47:21,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, ignoreStopFailed = false), log id: 73e1c628 2017-02-27 15:47:21,249 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] START, SpmStopVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b), log id: 73a83064 2017-02-27 15:47:21,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] SpmStopVDSCommand::Stopping SPM on vds hosted_engine_1, pool id 00000002-0002-0002-0002-00000000002b 2017-02-27 15:47:21,404 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] FINISH, SpmStopVDSCommand, log id: 73a83064 2017-02-27 15:47:21,415 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] FINISH, ResetIrsVDSCommand, log id: 73e1c628 2017-02-27 15:47:21,416 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] FINISH, SpmStopOnIrsVDSCommand, log id: 52c5c681 2017-02-27 15:47:21,418 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] START, DisconnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, vds_spm_id = 1), log id: 443b4bf7 2017-02-27 15:47:23,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] FINISH, DisconnectStoragePoolVDSCommand, log id: 443b4bf7 2017-02-27 15:47:23,777 INFO [org.ovirt.engine.core.bll.storage.DisconnectStoragePoolAsyncOperation] (org.ovirt.thread.pool-8-thread-11) [31b74579] Disconnect storage pool treatment vds: hosted_engine_1,pool Default 2017-02-27 15:47:23,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-11) [31b74579] START, DisconnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, vds_spm_id = 1), log id: 13c5296b 2017-02-27 15:47:23,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-11) [31b74579] FINISH, DisconnectStoragePoolVDSCommand, log id: 13c5296b 2017-02-27 15:47:23,791 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-16) After deactivate treatment vds: hosted_engine_1,pool Default 2017-02-27 15:47:23,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4813d1d0 2017-02-27 15:47:24,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, DisconnectStorageServerVDSCommand, return: {1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 4813d1d0 2017-02-27 15:47:24,063 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 338684a4 2017-02-27 15:47:24,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [31b74579] FINISH, DisconnectStorageServerVDSCommand, return: {1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 338684a4 2017-02-27 15:47:24,317 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) [31b74579] Correlation ID: 31b74579, Call Stack: null, Custom Event ID: -1, Message: Storage Domain vms (Data Center Default) was deactivated. 2017-02-27 15:47:28,245 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-3) [27e5be82] Lock Acquired to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:47:28,361 WARN [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-3) [27e5be82] CanDoAction of action DetachStorageDomainFromPool failed for user admin@internal. Reasons: VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DETACH,ERROR_CANNOT_DETACH_LAST_STORAGE_DOMAIN 2017-02-27 15:47:28,361 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-3) [27e5be82] Lock freed to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:47:36,957 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-30) [3b64e813] Lock Acquired to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:47:36,967 WARN [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-30) [3b64e813] CanDoAction of action DetachStorageDomainFromPool failed for user admin@internal. Reasons: VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DETACH,ERROR_CANNOT_DETACH_LAST_STORAGE_DOMAIN 2017-02-27 15:47:36,968 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-30) [3b64e813] Lock freed to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:48:01,056 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-14) [64552e7c] Lock Acquired to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:48:01,091 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-31) [64552e7c] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:48:01,099 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-31) [64552e7c] Lock freed to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE , sharedLocks= ] 2017-02-27 15:48:01,108 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-31) [64552e7c] ActivateStorage Domain. Before Connect all hosts to pool. Time:2/27/17 3:48 PM 2017-02-27 15:48:01,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-34) [64552e7c] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a9abd7d 2017-02-27 15:48:01,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-34) [64552e7c] FINISH, ConnectStorageServerVDSCommand, return: {1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 4a9abd7d 2017-02-27 15:48:01,347 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-31) [562a9079] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-27 15:48:01,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-31) [562a9079] START, GetVGInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, VGID=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq), log id: 7c77c0af 2017-02-27 15:48:01,443 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-31) [562a9079] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, storageDomainName=null]], log id: 7c77c0af 2017-02-27 15:48:01,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-31) [562a9079] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6), log id: c7a8364 2017-02-27 15:48:01,455 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 15:48:01,482 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] Correlation ID: 5ea0f89e, Call Stack: null, Custom Event ID: -1, Message: Data Center is being initialized, please wait for initialization to complete. 2017-02-27 15:48:01,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 6edb9ef1 2017-02-27 15:48:01,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] FINISH, ConnectStoragePoolVDSCommand, log id: 6edb9ef1 2017-02-27 15:48:01,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] hostFromVds::selectedVds - hosted_engine_1, spmStatus Free, storage pool Default, storage pool version 3.5 2017-02-27 15:48:01,962 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] starting spm on vds hosted_engine_1, storage pool Default, prevId -1, LVER -1 2017-02-27 15:48:01,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] START, SpmStartVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: b72f634 2017-02-27 15:48:01,978 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] spmStart polling started: taskId = bf79d01b-91c3-4171-be3d-edcd8c107017 2017-02-27 15:48:17,916 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-82) Setting new tasks map. The map contains now 2 tasks 2017-02-27 15:48:24,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] spmStart polling ended: taskId = bf79d01b-91c3-4171-be3d-edcd8c107017 task status = finished 2017-02-27 15:48:24,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] spmStart polling ended, spm status: SPM 2017-02-27 15:48:24,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=bf79d01b-91c3-4171-be3d-edcd8c107017), log id: 5d6d15a0 2017-02-27 15:48:24,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] FINISH, HSMClearTaskVDSCommand, log id: 5d6d15a0 2017-02-27 15:48:24,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@25e29f2e, log id: b72f634 2017-02-27 15:48:24,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] Initialize Irs proxy from vds: node1.dev1.api-digital.com 2017-02-27 15:48:24,166 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_1 (Address: node1.dev1.api-digital.com). 2017-02-27 15:48:24,168 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-27 15:48:24,292 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: c7a8364 2017-02-27 15:48:24,293 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] ActivateStorage Domain. After Connect all hosts to pool. Time:2/27/17 3:48 PM 2017-02-27 15:48:24,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-45) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 11dded25 2017-02-27 15:48:24,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-45) FINISH, ConnectStoragePoolVDSCommand, log id: 11dded25 2017-02-27 15:48:24,683 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] ActivateStorage Domain. After change storage pool status in vds. Time:2/27/17 3:48 PM 2017-02-27 15:48:24,714 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [5ea0f89e] Correlation ID: 64552e7c, Job ID: 06920041-9589-492b-b8d0-5d101ccf99fb, Call Stack: null, Custom Event ID: -1, Message: Storage Domain vms (Data Center Default) was activated by admin@internal 2017-02-27 15:48:47,919 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Setting new tasks map. The map contains now 0 tasks 2017-02-27 15:48:47,920 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) Cleared all tasks of pool 00000002-0002-0002-0002-00000000002b. 2017-02-27 15:48:48,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-24) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: 550b40c9 2017-02-27 15:48:48,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-24) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 550b40c9 2017-02-27 15:48:48,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-24) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: 74cb23d0 2017-02-27 15:48:49,048 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-24) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 74cb23d0 2017-02-27 15:49:11,557 INFO [org.ovirt.engine.core.bll.storage.AddIscsiBondCommand] (ajp--127.0.0.1-8702-8) [6a51cd62] Running command: AddIscsiBondCommand internal: false. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePoolAction group EDIT_STORAGE_POOL_CONFIGURATION with role type ADMIN 2017-02-27 15:49:11,626 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-17) [6a51cd62] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em3, netIfaceName: em3 };{ id: 8b39e990-6ccc-4d2b-88fe-837bf7a82707, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em4, netIfaceName: em4 };]), log id: 2577da3c 2017-02-27 15:49:12,178 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-17) [6a51cd62] FINISH, ConnectStorageServerVDSCommand, return: {8b39e990-6ccc-4d2b-88fe-837bf7a82707=0, 1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 2577da3c 2017-02-27 15:49:12,203 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-8) [6a51cd62] Correlation ID: 6a51cd62, Call Stack: null, Custom Event ID: -1, Message: iSCSI bond 'iscsi-vms' was successfully created in Data Center 'Default'. 2017-02-27 15:50:51,038 INFO [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (ajp--127.0.0.1-8702-3) Running command: LoginUserCommand internal: false. 2017-02-27 15:50:51,045 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-27 15:50:52,126 INFO [org.ovirt.engine.core.bll.network.cluster.UpdateNetworkOnClusterCommand] (ajp--127.0.0.1-8702-12) [57187ffd] Running command: UpdateNetworkOnClusterCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group CONFIGURE_CLUSTER_NETWORK with role type ADMIN, ID: 00000000-0000-0000-0000-000000000009 Type: NetworkAction group ASSIGN_CLUSTER_NETWORK with role type ADMIN 2017-02-27 15:50:52,190 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-12) Correlation ID: 57187ffd, Call Stack: null, Custom Event ID: -1, Message: Network ovirtmgmt on Cluster Default updated. 2017-02-27 15:50:53,231 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp--127.0.0.1-8702-18) [2318008d] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group CREATE_HOST with role type ADMIN 2017-02-27 15:50:53,252 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8702-18) [58facfd8] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-27 15:50:53,265 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp--127.0.0.1-8702-18) [58facfd8] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: REGISTER_VDS , sharedLocks= ] 2017-02-27 15:50:53,268 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp--127.0.0.1-8702-18) [58facfd8] START, RemoveVdsVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 7112d5b1 2017-02-27 15:50:53,269 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp--127.0.0.1-8702-18) [58facfd8] FINISH, RemoveVdsVDSCommand, log id: 7112d5b1 2017-02-27 15:50:53,270 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8702-18) [58facfd8] START, AddVdsVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 15c46ff1 2017-02-27 15:50:53,271 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8702-18) [58facfd8] AddVds - entered , starting logic to add VDS 45e4c281-f14f-43d5-8c3c-5664816072ee 2017-02-27 15:50:53,277 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8702-18) [58facfd8] AddVds - VDS 45e4c281-f14f-43d5-8c3c-5664816072ee was added, will try to add it to the resource manager 2017-02-27 15:50:53,278 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp--127.0.0.1-8702-18) [58facfd8] Entered VdsManager constructor 2017-02-27 15:50:53,287 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp--127.0.0.1-8702-18) [58facfd8] Initialize vdsBroker (node2.dev1.api-digital.com,54,321) 2017-02-27 15:50:53,288 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp--127.0.0.1-8702-18) [58facfd8] VDS 45e4c281-f14f-43d5-8c3c-5664816072ee was added to the Resource Manager 2017-02-27 15:50:53,289 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp--127.0.0.1-8702-18) [58facfd8] FINISH, AddVdsVDSCommand, log id: 15c46ff1 2017-02-27 15:50:53,293 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-18) [58facfd8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_2. 2017-02-27 15:50:53,319 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] Lock Acquired to object EngineLock [exclusiveLocks= key: 45e4c281-f14f-43d5-8c3c-5664816072ee value: VDS , sharedLocks= ] 2017-02-27 15:50:53,321 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-18) [58facfd8] Correlation ID: 2318008d, Job ID: 0bee0fa0-74d4-45fd-b0fa-2047d0b9bf9a, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 was added by admin@internal. 2017-02-27 15:50:53,333 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] Running command: InstallVdsInternalCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-27 15:50:53,337 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] Before Installation host 45e4c281-f14f-43d5-8c3c-5664816072ee, hosted_engine_2 2017-02-27 15:50:53,353 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] START, SetVdsStatusVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 28770fad 2017-02-27 15:50:53,365 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] FINISH, SetVdsStatusVDSCommand, log id: 28770fad 2017-02-27 15:50:53,405 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] Installation node2.dev1.api-digital.com: Connected to host node2.dev1.api-digital.com with SSH key fingerprint: 63:98:33:79:0b:ef:bf:74:d4:02:16:7d:3e:02:6c:17 2017-02-27 15:50:53,416 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Connected to host node2.dev1.api-digital.com with SSH key fingerprint: 63:98:33:79:0b:ef:bf:74:d4:02:16:7d:3e:02:6c:17. 2017-02-27 15:50:53,482 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] Installation of node2.dev1.api-digital.com. Executing command via SSH umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar 2017-02-27 15:50:53,485 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-8-thread-10) Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' refresh 2017-02-27 15:50:54,000 INFO [org.ovirt.engine.core.uutils.ssh.SSHDialog] (org.ovirt.thread.pool-8-thread-10) SSH execute root@node2.dev1.api-digital.com 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' 2017-02-27 15:50:54,964 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Initializing 2017-02-27 15:50:54,982 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Initializing. 2017-02-27 15:50:55,000 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Environment setup 2017-02-27 15:50:55,009 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Environment setup. 2017-02-27 15:50:55,016 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Environment packages setup 2017-02-27 15:50:55,022 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Environment packages setup. 2017-02-27 15:50:56,290 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-78) Initializing Host: hosted_engine_2 2017-02-27 15:51:00,593 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Programs detection 2017-02-27 15:51:00,618 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Programs detection. 2017-02-27 15:51:00,623 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Environment customization 2017-02-27 15:51:00,630 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Environment customization. 2017-02-27 15:51:00,638 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Kdump unsupported 2017-02-27 15:51:00,646 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Kdump unsupported. 2017-02-27 15:51:00,661 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Logs at host located at: '/tmp/ovirt-host-deploy-20170227155054-ypnhf4.log' 2017-02-27 15:51:00,669 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Logs at host located at: '/tmp/ovirt-host-deploy-20170227155054-ypnhf4.log'. 2017-02-27 15:51:00,706 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host node2.dev1.api-digital.com reports unique id 4C4C4544-0051-4810-8052-B6C04F504E31 2017-02-27 15:51:00,728 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0051-4810-8052-B6C04F504E31 to Host node2.dev1.api-digital.com 2017-02-27 15:51:00,802 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Disabling Kdump integration 2017-02-27 15:51:00,809 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Disabling Kdump integration. 2017-02-27 15:51:00,828 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Setup validation 2017-02-27 15:51:00,833 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Setup validation. 2017-02-27 15:51:00,961 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Hardware supports virtualization 2017-02-27 15:51:00,969 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Hardware supports virtualization. 2017-02-27 15:51:01,703 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Transaction setup 2017-02-27 15:51:01,724 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Transaction setup. 2017-02-27 15:51:01,785 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Misc configuration 2017-02-27 15:51:01,791 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Misc configuration. 2017-02-27 15:51:01,792 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Package installation 2017-02-27 15:51:01,799 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Package installation. 2017-02-27 15:51:11,014 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Yum Status: Downloading Packages 2017-02-27 15:51:11,044 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Yum Status: Downloading Packages. 2017-02-27 15:51:11,251 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Yum Download/Verify: 10:qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64 2017-02-27 15:51:11,271 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Yum Download/Verify: 10:qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64. 2017-02-27 15:51:11,272 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Yum Status: Check Package Signatures 2017-02-27 15:51:11,279 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Yum Status: Check Package Signatures. 2017-02-27 15:51:11,280 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Yum Status: Running Test Transaction 2017-02-27 15:51:11,287 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Yum Status: Running Test Transaction. 2017-02-27 15:51:11,288 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Yum Status: Running Transaction 2017-02-27 15:51:11,295 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Yum Status: Running Transaction. 2017-02-27 15:51:11,373 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Yum install: 1/1: 10:qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64 2017-02-27 15:51:11,379 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Yum install: 1/1: 10:qemu-kvm-tools-ev-2.6.0-28.el7_3.3.1.x86_64. 2017-02-27 15:51:11,464 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Yum Verify: 1/1: qemu-kvm-tools-ev.x86_64 10:2.6.0-28.el7_3.3.1 - u 2017-02-27 15:51:11,471 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Yum Verify: 1/1: qemu-kvm-tools-ev.x86_64 10:2.6.0-28.el7_3.3.1 - u. 2017-02-27 15:51:11,663 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Misc configuration 2017-02-27 15:51:11,671 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Misc configuration. 2017-02-27 15:51:13,194 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8702-19) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic 2017-02-27 15:51:13,195 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8702-19) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic 2017-02-27 15:51:13,196 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp--127.0.0.1-8702-19) [f34d1b1] Running command: UpdateVdsCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2017-02-27 15:51:13,224 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8702-19) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic 2017-02-27 15:51:13,224 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8702-19) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic 2017-02-27 15:51:13,530 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-19) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 from cluster Default was chosen as a proxy to execute Status command on Host hosted_engine_1. 2017-02-27 15:51:13,530 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-19) Using Host hosted_engine_2 from cluster Default as proxy to execute Status command on Host hosted_engine_1 2017-02-27 15:51:13,560 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-19) Executing Power Management command, Proxy Host:hosted_engine_2, Agent:ipmilan, Target Host:hosted_engine_1, Management IP:74.51.121.118, User:root, Options:lanplus=1, Fencing policy:null 2017-02-27 15:51:13,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-19) START, FenceVdsVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, targetVdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, action = Status, ip = 74.51.121.118, port = , type = ipmilan, user = root, password = ******, options = 'lanplus=1', policy = 'null'), log id: 19cb4bc7 2017-02-27 15:51:13,565 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-27 15:51:13,566 WARN [org.ovirt.vdsm.jsonrpc.client.utils.retry.Retryable] (SSL Stomp Reactor) Retry failed 2017-02-27 15:51:13,567 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (ajp--127.0.0.1-8702-19) Exception during connection 2017-02-27 15:51:13,570 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-19) Command FenceVdsVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, targetVdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, action = Status, ip = 74.51.121.118, port = , type = ipmilan, user = root, password = ******, options = 'lanplus=1', policy = 'null') execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused 2017-02-27 15:51:13,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-19) FINISH, FenceVdsVDSCommand, log id: 19cb4bc7 2017-02-27 15:51:13,599 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-19) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Power Management test failed for Host hosted_engine_1.VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused (Failed with error VDS_NETWORK_ERROR and code 5022) 2017-02-27 15:51:13,615 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-19) Correlation ID: f34d1b1, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 configuration was updated by admin@internal. 2017-02-27 15:51:14,105 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Enrolling certificate 2017-02-27 15:51:14,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Enrolling certificate. 2017-02-27 15:51:19,271 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Transaction commit 2017-02-27 15:51:19,295 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Transaction commit. 2017-02-27 15:51:19,448 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Closing up 2017-02-27 15:51:19,458 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Closing up. 2017-02-27 15:51:21,869 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stopping libvirtd 2017-02-27 15:51:21,896 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stopping libvirtd. 2017-02-27 15:51:22,019 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Starting vdsm 2017-02-27 15:51:22,028 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Starting vdsm. 2017-02-27 15:51:26,450 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Pre-termination 2017-02-27 15:51:26,479 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Pre-termination. 2017-02-27 15:51:26,493 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20170227155126-node2.dev1.api-digital.com-1c0d5dc1.log' 2017-02-27 15:51:26,499 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20170227155126-node2.dev1.api-digital.com-1c0d5dc1.log'. 2017-02-27 15:51:26,827 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation node2.dev1.api-digital.com: Stage: Termination 2017-02-27 15:51:26,854 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 1c0d5dc1, Call Stack: null, Custom Event ID: -1, Message: Installing Host hosted_engine_2. Stage: Termination. 2017-02-27 15:51:26,891 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-27 15:51:27,080 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-8-thread-10) [1c0d5dc1] Engine managed to communicate with VDSM agent on host hosted_engine_2 2017-02-27 15:51:28,008 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-8-thread-10) [42afb511] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:51:28,009 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (org.ovirt.thread.pool-8-thread-10) [42afb511] START, SetupNetworksVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, force=false, checkConnectivity=true, conectivityTimeout=120, networks=[ovirtmgmt {id=00000000-0000-0000-0000-000000000009, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=1612, stp=false, dataCenterId=00000002-0002-0002-0002-00000000002b, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=true, required=true, migration=true}, providedBy=null, label=null, qosId=null}], bonds=[], interfaces=[em4 {id=f28f75fd-c99c-492d-b9d9-f8e298066aea, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, macAddress=d4:be:d9:a8:c7:d6, networkName=null, baseInterface=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=STATIC_IP, address=10.43.0.13, subnet=255.255.255.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}, em1 {id=a9f3ea49-96d6-4a96-83e5-dd988ba7d8e0, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, macAddress=d4:be:d9:a8:c7:d0, networkName=null, baseInterface=null, vlanId=null, bonded=null, bondName=bond0, bondOptions=null, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}, em3 {id=d9c187b2-405f-49d5-b96a-0bac96970c2d, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, macAddress=d4:be:d9:a8:c7:d4, networkName=null, baseInterface=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=STATIC_IP, address=10.43.0.12, subnet=255.255.255.0, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}, em2 {id=043253fa-3967-4928-b6dd-e4ebd7d01f5a, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, macAddress=d4:be:d9:a8:c7:d2, networkName=null, baseInterface=null, vlanId=null, bonded=null, bondName=bond0, bondOptions=null, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}, bond0.1612 {id=68bc58e9-5898-444f-9bf3-ee45d2467081, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, macAddress=null, networkName=ovirtmgmt, baseInterface=bond0, vlanId=1612, bonded=null, bondName=null, bondOptions=null, bootProtocol=STATIC_IP, address=74.51.121.121, subnet=255.255.255.224, gateway=74.51.121.126, mtu=1500, bridged=false, speed=null, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}, bond0 {id=3ea4b19e-1dd9-4661-8d60-fcef07c16f16, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, macAddress=d4:be:d9:a8:c7:d0, networkName=null, baseInterface=null, vlanId=null, bonded=true, bondName=null, bondOptions=mode=802.3ad xmit_hash_policy=layer2+3 lacp_rate=1, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=null, type=0, networkImplementationDetails=null, qos=null qosOverridden=false, labels=null, customProperties=null}], removedNetworks=[], removedBonds=[]), log id: 1bbddd47 2017-02-27 15:51:28,036 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (org.ovirt.thread.pool-8-thread-10) [42afb511] FINISH, SetupNetworksVDSCommand, log id: 1bbddd47 2017-02-27 15:51:28,038 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-27 15:51:37,711 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-27 15:51:37,711 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-27 15:51:37,915 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (org.ovirt.thread.pool-8-thread-10) [1864476d] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:51:37,917 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (org.ovirt.thread.pool-8-thread-10) [1864476d] START, SetSafeNetworkConfigVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 710dc45d 2017-02-27 15:51:37,938 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (org.ovirt.thread.pool-8-thread-10) [1864476d] FINISH, SetSafeNetworkConfigVDSCommand, log id: 710dc45d 2017-02-27 15:51:37,953 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) [1864476d] Correlation ID: 1864476d, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host hosted_engine_2 2017-02-27 15:51:37,955 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-10) [1864476d] START, SetVdsStatusVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 11639738 2017-02-27 15:51:37,961 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-10) [1864476d] FINISH, SetVdsStatusVDSCommand, log id: 11639738 2017-02-27 15:51:37,961 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-10) [1864476d] After Installation host hosted_engine_2, VDS 2017-02-27 15:51:37,971 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) [1864476d] Correlation ID: 1c0d5dc1, Job ID: 0bee0fa0-74d4-45fd-b0fa-2047d0b9bf9a, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 installed 2017-02-27 15:51:37,979 INFO [org.ovirt.engine.core.bll.InstallVdsInternalCommand] (org.ovirt.thread.pool-8-thread-10) [1864476d] Lock freed to object EngineLock [exclusiveLocks= key: 45e4c281-f14f-43d5-8c3c-5664816072ee value: VDS , sharedLocks= ] 2017-02-27 15:51:38,364 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]), log id: 2b7e0a6b 2017-02-27 15:51:38,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GetHardwareInfoVDSCommand, log id: 2b7e0a6b 2017-02-27 15:51:38,451 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-71) [6089c695] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-27 15:51:38,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-71) [6089c695] START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]), log id: 8e192e5 2017-02-27 15:51:38,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-71) [6089c695] FINISH, GetHardwareInfoVDSCommand, log id: 8e192e5 2017-02-27 15:51:38,571 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-71) [7208c2b5] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 15:51:38,596 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-71) [4e10f64e] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 15:51:38,624 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-71) [4e10f64e] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: d03439a 2017-02-27 15:51:38,793 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-71) [4e10f64e] FINISH, ConnectStorageServerVDSCommand, return: {1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: d03439a 2017-02-27 15:51:38,794 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-71) [4e10f64e] Host hosted_engine_2 storage connection was succeeded 2017-02-27 15:51:38,799 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 3f74890e 2017-02-27 15:51:39,281 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, ConnectStoragePoolVDSCommand, log id: 3f74890e 2017-02-27 15:51:39,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-71) [4e10f64e] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 4b62f8e9 2017-02-27 15:51:39,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-71) [4e10f64e] FINISH, SetMOMPolicyParametersVDSCommand, log id: 4b62f8e9 2017-02-27 15:51:39,417 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-71) [4e10f64e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host hosted_engine_2 was set to Up. 2017-02-27 15:51:39,425 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-71) [4e10f64e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host hosted_engine_2. 2017-02-27 15:51:39,469 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-71) [7bec7682] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-27 15:51:39,472 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-71) [45164e69] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-27 15:51:39,986 INFO [org.ovirt.engine.core.bll.UpdateVdsGroupCommand] (ajp--127.0.0.1-8702-28) [2cb670cd] Running command: UpdateVdsGroupCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group EDIT_CLUSTER_CONFIGURATION with role type ADMIN 2017-02-27 15:51:40,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-28) [2cb670cd] Correlation ID: 2cb670cd, Call Stack: null, Custom Event ID: -1, Message: Host cluster Default was updated by admin@internal 2017-02-27 15:51:51,163 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic 2017-02-27 15:51:51,164 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic 2017-02-27 15:51:51,165 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp--127.0.0.1-8702-9) [106a6451] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group EDIT_HOST_CONFIGURATION with role type ADMIN 2017-02-27 15:51:51,201 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic 2017-02-27 15:51:51,201 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp--127.0.0.1-8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic 2017-02-27 15:51:51,459 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 from cluster Default was chosen as a proxy to execute Status command on Host hosted_engine_2. 2017-02-27 15:51:51,460 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-9) Using Host hosted_engine_1 from cluster Default as proxy to execute Status command on Host hosted_engine_2 2017-02-27 15:51:51,482 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-9) Executing Power Management command, Proxy Host:hosted_engine_1, Agent:ipmilan, Target Host:hosted_engine_2, Management IP:74.51.121.120, User:root, Options:lanplus=1, Fencing policy:null 2017-02-27 15:51:51,502 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-9) START, FenceVdsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, targetVdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, action = Status, ip = 74.51.121.120, port = , type = ipmilan, user = root, password = ******, options = 'lanplus=1', policy = 'null'), log id: 3e3e1787 2017-02-27 15:51:51,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-9) FINISH, FenceVdsVDSCommand, return: Test Succeeded, on, log id: 3e3e1787 2017-02-27 15:51:51,894 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) Correlation ID: 106a6451, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 configuration was updated by admin@internal. 2017-02-27 15:52:13,025 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (ajp--127.0.0.1-8702-18) [2016ce63] Running command: SetupNetworksCommand internal: false. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:52:13,057 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-18) [2016ce63] START, SetupNetworksVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, force=false, checkConnectivity=true, conectivityTimeout=120, networks=[iscsi1 {id=30499168-f824-4ec9-b70e-041d38aa3ca9, description=iSCSI only, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=00000002-0002-0002-0002-00000000002b, mtu=0, vmNetwork=false, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=false, migration=false}, providedBy=null, label=null, qosId=null}, iscsi2 {id=43b5510d-2881-4f24-a5c1-75d963d270f7, description=iSCSI only, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=00000002-0002-0002-0002-00000000002b, mtu=0, vmNetwork=false, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=false, migration=false}, providedBy=null, label=null, qosId=null}], bonds=[], interfaces=[bond0 {id=3ea4b19e-1dd9-4661-8d60-fcef07c16f16, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=bond0, macAddress=d4:be:d9:a8:c7:d0, networkName=null, bondOptions=mode=802.3ad xmit_hash_policy=layer2+3 lacp_rate=1, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, type=2, networkImplementationDetails=null}, bond0.1612 {id=68bc58e9-5898-444f-9bf3-ee45d2467081, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=bond0.1612, networkName=ovirtmgmt, vlanId=1612, bootProtocol=STATIC_IP, address=74.51.121.121, subnet=255.255.255.224, gateway=74.51.121.126, mtu=1500, bridged=true, type=2, networkImplementationDetails={inSync=true, managed=true}}, em2 {id=043253fa-3967-4928-b6dd-e4ebd7d01f5a, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=em2, macAddress=d4:be:d9:a8:c7:d2, networkName=null, bondName=bond0, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em3 {id=d9c187b2-405f-49d5-b96a-0bac96970c2d, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=em3, macAddress=d4:be:d9:a8:c7:d4, networkName=iscsi1, bondName=null, bootProtocol=STATIC_IP, address=10.43.0.12, subnet=255.255.255.0, gateway=null, mtu=0, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em1 {id=a9f3ea49-96d6-4a96-83e5-dd988ba7d8e0, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=em1, macAddress=d4:be:d9:a8:c7:d0, networkName=null, bondName=bond0, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em4 {id=f28f75fd-c99c-492d-b9d9-f8e298066aea, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=em4, macAddress=d4:be:d9:a8:c7:d6, networkName=iscsi2, bondName=null, bootProtocol=STATIC_IP, address=10.43.0.13, subnet=255.255.255.0, gateway=null, mtu=0, bridged=false, speed=1000, type=0, networkImplementationDetails=null}], removedNetworks=[], removedBonds=[]), log id: 64afeeb5 2017-02-27 15:52:13,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-18) [2016ce63] FINISH, SetupNetworksVDSCommand, log id: 64afeeb5 2017-02-27 15:52:13,111 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-27 15:52:13,112 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-27 15:52:23,075 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-27 15:52:23,075 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-27 15:52:23,331 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (ajp--127.0.0.1-8702-37) [3393c047] Running command: CommitNetworkChangesCommand internal: false. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:52:23,362 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (ajp--127.0.0.1-8702-37) [3393c047] START, SetSafeNetworkConfigVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: b91248e 2017-02-27 15:52:23,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (ajp--127.0.0.1-8702-37) [3393c047] FINISH, SetSafeNetworkConfigVDSCommand, log id: b91248e 2017-02-27 15:52:23,395 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-37) [3393c047] Correlation ID: 3393c047, Job ID: ef596931-eb8f-4769-9714-9afdd7629f55, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host hosted_engine_2 2017-02-27 15:52:29,183 INFO [org.ovirt.engine.core.bll.RemoveAuditLogByIdCommand] (ajp--127.0.0.1-8702-37) [5f640fd3] Running command: RemoveAuditLogByIdCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group AUDIT_LOG_MANAGEMENT with role type ADMIN 2017-02-27 15:52:29,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-37) [5f640fd3] Correlation ID: 5f640fd3, Call Stack: null, Custom Event ID: -1, Message: Event log message 103 was removed by User admin@internal. 2017-02-27 15:52:36,855 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-26) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 from cluster Default was chosen as a proxy to execute Status command on Host hosted_engine_1. 2017-02-27 15:52:36,856 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-26) Using Host hosted_engine_2 from cluster Default as proxy to execute Status command on Host 2017-02-27 15:52:36,876 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-26) Executing Power Management command, Proxy Host:hosted_engine_2, Agent:ipmilan, Target Host:, Management IP:74.51.121.118, User:root, Options:lanplus=1, Fencing policy:null 2017-02-27 15:52:36,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-26) START, FenceVdsVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, targetVdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, action = Status, ip = 74.51.121.118, port = , type = ipmilan, user = root, password = ******, options = 'lanplus=1', policy = 'null'), log id: 7639c7e3 2017-02-27 15:52:37,191 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-26) FINISH, FenceVdsVDSCommand, return: Test Succeeded, on, log id: 7639c7e3 2017-02-27 15:52:42,639 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-30) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 from cluster Default was chosen as a proxy to execute Status command on Host hosted_engine_2. 2017-02-27 15:52:42,639 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-30) Using Host hosted_engine_1 from cluster Default as proxy to execute Status command on Host 2017-02-27 15:52:42,675 INFO [org.ovirt.engine.core.bll.FenceExecutor] (ajp--127.0.0.1-8702-30) Executing Power Management command, Proxy Host:hosted_engine_1, Agent:ipmilan, Target Host:, Management IP:74.51.121.120, User:root, Options:lanplus=1, Fencing policy:null 2017-02-27 15:52:42,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-30) START, FenceVdsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, targetVdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, action = Status, ip = 74.51.121.120, port = , type = ipmilan, user = root, password = ******, options = 'lanplus=1', policy = 'null'), log id: 1e55968b 2017-02-27 15:52:43,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (ajp--127.0.0.1-8702-30) FINISH, FenceVdsVDSCommand, return: Test Succeeded, on, log id: 1e55968b 2017-02-27 15:53:01,437 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-18) [52ab7802] Lock Acquired to object EngineLock [exclusiveLocks= key: internal value: NETWORK , sharedLocks= ] 2017-02-27 15:53:01,440 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-18) [52ab7802] Running command: AddNetworkCommand internal: false. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePoolAction group CREATE_STORAGE_POOL_NETWORK with role type ADMIN 2017-02-27 15:53:01,467 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-18) [52ab7802] Correlation ID: 52ab7802, Call Stack: null, Custom Event ID: -1, Message: Network internal was added to Data Center: Default 2017-02-27 15:53:01,467 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (ajp--127.0.0.1-8702-18) [52ab7802] Lock freed to object EngineLock [exclusiveLocks= key: internal value: NETWORK , sharedLocks= ] 2017-02-27 15:53:01,508 INFO [org.ovirt.engine.core.bll.network.cluster.AttachNetworkToVdsGroupCommand] (org.ovirt.thread.pool-8-thread-34) [4909ed26] Running command: AttachNetworkToVdsGroupCommand internal: false. Entities affected : ID: 50f22920-742a-43c0-a429-c1ee82f3225c Type: NetworkAction group ASSIGN_CLUSTER_NETWORK with role type ADMIN 2017-02-27 15:53:01,529 INFO [org.ovirt.engine.core.bll.network.vm.AddVnicProfileCommand] (ajp--127.0.0.1-8702-28) [4399b0f7] Running command: AddVnicProfileCommand internal: false. Entities affected : ID: 50f22920-742a-43c0-a429-c1ee82f3225c Type: NetworkAction group CREATE_NETWORK_VNIC_PROFILE with role type ADMIN 2017-02-27 15:53:01,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-28) [4399b0f7] Correlation ID: 4399b0f7, Call Stack: null, Custom Event ID: -1, Message: VM network interface profile internal was added to network internal in Data Center: Default. (User: admin@internal) 2017-02-27 15:53:01,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-34) Correlation ID: 4909ed26, Call Stack: null, Custom Event ID: -1, Message: Network internal attached to Cluster Default 2017-02-27 15:53:28,682 WARN [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (ajp--127.0.0.1-8702-29) [2d1fbf1d] CanDoAction of action SetupNetworks failed for user admin@internal. Reasons: VAR__ACTION__SETUP,VAR__TYPE__NETWORKS,VALIDATION.REPETITIVE.IP.IN.VDS 2017-02-27 15:53:38,317 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (ajp--127.0.0.1-8702-8) [62a21261] Running command: SetupNetworksCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:53:38,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-8) [62a21261] START, SetupNetworksVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, force=false, checkConnectivity=true, conectivityTimeout=120, networks=[internal {id=50f22920-742a-43c0-a429-c1ee82f3225c, description=Cluster internal, comment=null, subnet=null, gateway=null, type=null, vlanId=42, stp=false, dataCenterId=00000002-0002-0002-0002-00000000002b, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=NON_OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null, qosId=null}], bonds=[], interfaces=[bond0 {id=a60b3029-10ec-4d5d-bb8f-a822e7cadd83, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=bond0, macAddress=84:2b:2b:fd:33:35, networkName=null, bondOptions=mode=802.3ad xmit_hash_policy=layer2+3 lacp_rate=1, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, type=2, networkImplementationDetails=null}, bond0.1612 {id=7f610ebf-eb69-4af5-9749-d70420de1aa3, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=bond0.1612, networkName=ovirtmgmt, vlanId=1612, bootProtocol=STATIC_IP, address=74.51.121.119, subnet=255.255.255.224, gateway=74.51.121.126, mtu=1500, bridged=true, type=2, networkImplementationDetails={inSync=true, managed=true}}, em2 {id=d868c7ea-6430-49d7-9146-ab86e99ce670, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=em2, macAddress=84:2b:2b:fd:33:37, networkName=null, bondName=bond0, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em3 {id=bacf1483-5048-4ad6-8f1e-043fd5fcfdac, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=em3, macAddress=84:2b:2b:fd:33:39, networkName=iscsi1, bondName=null, bootProtocol=STATIC_IP, address=10.43.0.10, subnet=255.255.255.0, gateway=, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails={inSync=true, managed=true}}, em1 {id=c731e77a-91d4-4e7e-bc38-07a79efb419e, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=em1, macAddress=84:2b:2b:fd:33:35, networkName=null, bondName=bond0, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em4 {id=b1a7dddb-2ab3-40ce-956a-87b94b9085a6, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, name=em4, macAddress=84:2b:2b:fd:33:3b, networkName=iscsi2, bondName=null, bootProtocol=STATIC_IP, address=10.43.0.11, subnet=255.255.255.0, gateway=, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails={inSync=true, managed=true}}, bond0.42 {id=null, vdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, macAddress=null, networkName=internal, baseInterface=bond0, vlanId=42, bonded=null, bondName=null, bondOptions=null, bootProtocol=STATIC_IP, address=10.42.0.11, subnet=255.255.255.0, gateway=null, mtu=0, bridged=true, speed=null, type=0, networkImplementationDetails=null, qos=[inbound {average=null, peak=null, burst=null}, outbound {average=null, peak=null, burst=null}] qosOverridden=false, labels=null, customProperties={}}], removedNetworks=[], removedBonds=[]), log id: 4654adb2 2017-02-27 15:53:38,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-8) [62a21261] FINISH, SetupNetworksVDSCommand, log id: 4654adb2 2017-02-27 15:53:38,359 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-27 15:53:38,360 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-27 15:53:43,913 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-27 15:53:43,914 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-27 15:53:44,342 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (ajp--127.0.0.1-8702-14) [5ff206c4] Running command: CommitNetworkChangesCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:53:44,370 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (ajp--127.0.0.1-8702-14) [5ff206c4] START, SetSafeNetworkConfigVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 3bcd6b52 2017-02-27 15:53:44,395 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (ajp--127.0.0.1-8702-14) [5ff206c4] FINISH, SetSafeNetworkConfigVDSCommand, log id: 3bcd6b52 2017-02-27 15:53:44,420 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-14) [5ff206c4] Correlation ID: 5ff206c4, Job ID: f9742b11-c672-4881-a285-6eebbc1be40d, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host hosted_engine_1 2017-02-27 15:54:01,488 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (ajp--127.0.0.1-8702-38) [33df76ba] Running command: SetupNetworksCommand internal: false. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:54:01,511 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-38) [33df76ba] START, SetupNetworksVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, force=false, checkConnectivity=true, conectivityTimeout=120, networks=[internal {id=50f22920-742a-43c0-a429-c1ee82f3225c, description=Cluster internal, comment=null, subnet=null, gateway=null, type=null, vlanId=42, stp=false, dataCenterId=00000002-0002-0002-0002-00000000002b, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=NON_OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null, qosId=null}], bonds=[], interfaces=[bond0 {id=3ea4b19e-1dd9-4661-8d60-fcef07c16f16, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=bond0, macAddress=d4:be:d9:a8:c7:d0, networkName=null, bondOptions=mode=802.3ad xmit_hash_policy=layer2+3 lacp_rate=1, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, type=2, networkImplementationDetails=null}, bond0.1612 {id=68bc58e9-5898-444f-9bf3-ee45d2467081, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=bond0.1612, networkName=ovirtmgmt, vlanId=1612, bootProtocol=STATIC_IP, address=74.51.121.121, subnet=255.255.255.224, gateway=74.51.121.126, mtu=1500, bridged=true, type=2, networkImplementationDetails={inSync=true, managed=true}}, em2 {id=043253fa-3967-4928-b6dd-e4ebd7d01f5a, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=em2, macAddress=d4:be:d9:a8:c7:d2, networkName=null, bondName=bond0, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em3 {id=d9c187b2-405f-49d5-b96a-0bac96970c2d, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=em3, macAddress=d4:be:d9:a8:c7:d4, networkName=iscsi1, bondName=null, bootProtocol=STATIC_IP, address=10.43.0.12, subnet=255.255.255.0, gateway=, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails={inSync=true, managed=true}}, em1 {id=a9f3ea49-96d6-4a96-83e5-dd988ba7d8e0, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=em1, macAddress=d4:be:d9:a8:c7:d0, networkName=null, bondName=bond0, bootProtocol=NONE, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, em4 {id=f28f75fd-c99c-492d-b9d9-f8e298066aea, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, name=em4, macAddress=d4:be:d9:a8:c7:d6, networkName=iscsi2, bondName=null, bootProtocol=STATIC_IP, address=10.43.0.13, subnet=255.255.255.0, gateway=, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails={inSync=true, managed=true}}, bond0.42 {id=null, vdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, macAddress=null, networkName=internal, baseInterface=bond0, vlanId=42, bonded=null, bondName=null, bondOptions=null, bootProtocol=STATIC_IP, address=10.42.0.12, subnet=255.255.255.0, gateway=null, mtu=0, bridged=true, speed=null, type=0, networkImplementationDetails=null, qos=[inbound {average=null, peak=null, burst=null}, outbound {average=null, peak=null, burst=null}] qosOverridden=false, labels=null, customProperties={}}], removedNetworks=[], removedBonds=[]), log id: 687e5904 2017-02-27 15:54:01,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp--127.0.0.1-8702-38) [33df76ba] FINISH, SetupNetworksVDSCommand, log id: 687e5904 2017-02-27 15:54:01,538 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-27 15:54:01,539 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-27 15:54:09,958 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-27 15:54:09,960 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-27 15:54:10,321 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (ajp--127.0.0.1-8702-37) [7b65abb1] Running command: CommitNetworkChangesCommand internal: false. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group CONFIGURE_HOST_NETWORK with role type ADMIN 2017-02-27 15:54:10,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (ajp--127.0.0.1-8702-37) [7b65abb1] START, SetSafeNetworkConfigVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 2837991c 2017-02-27 15:54:10,362 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (ajp--127.0.0.1-8702-37) [7b65abb1] FINISH, SetSafeNetworkConfigVDSCommand, log id: 2837991c 2017-02-27 15:54:10,377 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-37) [7b65abb1] Correlation ID: 7b65abb1, Job ID: 49b91412-c94f-4273-b20f-4cf6ff9037f9, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host hosted_engine_2 2017-02-27 15:54:21,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-7) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: 58338b37 2017-02-27 15:54:21,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-7) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true, sdf=true, sde=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: 58338b37 2017-02-27 15:54:21,662 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-7) START, GetDeviceListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageType=ISCSI), log id: eab0027 2017-02-27 15:54:22,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetDeviceListVDSCommand] (ajp--127.0.0.1-8702-7) FINISH, GetDeviceListVDSCommand, return: [LUNs [id=3600140539a99a921c0840979d9f7b2e2, physicalVolumeId=CZg4fO-cH41-8lzL-cysc-DSM6-qrGb-e2bwhc, volumeGroupId=UAooXa-2DdO-q1z6-IaQP-5Hmn-u4Cj-mrxjJJ, serial=SLIO-ORG_engine_39a99a92-1c08-4097-9d9f-7b2e20a65327, lunMapping=0, vendorId=LIO-ORG, productId=engine, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:engine, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=35, vendorName=LIO-ORG, pathsDictionary={sdb=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null], LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.2, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true, sdf=true, sde=true}, lunType=ISCSI, status=Used, diskId=null, diskAlias=null, storageDomainId=null, storageDomainName=null]], log id: eab0027 2017-02-27 15:54:51,975 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-18) [282bf884] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/isos value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:54:52,013 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-18) [282bf884] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:54:52,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-18) [282bf884] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7be406b7 2017-02-27 15:54:52,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-18) [282bf884] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 7be406b7 2017-02-27 15:54:52,260 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-18) [282bf884] Lock freed to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/isos value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:54:52,295 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-40) START, GetExistingStorageDomainListQuery(refresh: true, filtered: false), log id: 6dc6e215 2017-02-27 15:54:52,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-40) START, HSMGetStorageDomainsListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=null, storageDomainType=ISO, path=nfs.dev1.api-digital.com:/srv/nfs/isos), log id: 71847adf 2017-02-27 15:54:52,965 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-40) FINISH, HSMGetStorageDomainsListVDSCommand, return: [16173ef9-00bc-4546-b5fd-2a5fe6b3e371], log id: 71847adf 2017-02-27 15:54:53,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-40) START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 77cd67e7 2017-02-27 15:54:53,041 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-40) FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 77cd67e7 2017-02-27 15:54:53,042 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-40) FINISH, GetExistingStorageDomainListQuery, log id: 6dc6e215 2017-02-27 15:54:53,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-11) [4feecdf9] START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 3b121c58 2017-02-27 15:54:53,284 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-11) [4feecdf9] FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 3b121c58 2017-02-27 15:54:53,296 INFO [org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand] (ajp--127.0.0.1-8702-11) [4feecdf9] Running command: AddExistingFileStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:54:53,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-11) [4feecdf9] START, GetStorageDomainStatsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 6881f89d 2017-02-27 15:54:53,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-11) [4feecdf9] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, 16173ef9-00bc-4546-b5fd-2a5fe6b3e371], log id: 6881f89d 2017-02-27 15:54:53,352 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-11) [4feecdf9] Correlation ID: 4feecdf9, Job ID: 74f66d11-74d9-4e87-8d07-d42f6942a6ee, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was added by admin@internal 2017-02-27 15:54:53,463 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-12) [11bb1df2] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:54:53,594 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-12) [11bb1df2] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:54:53,641 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-4) [46182797] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:54:53,648 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-3) [5d96566d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:54:53,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-4) [46182797] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 50cad252 2017-02-27 15:54:53,731 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-4) [46182797] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 50cad252 2017-02-27 15:54:53,735 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-3) [5d96566d] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 38148cd8 2017-02-27 15:54:54,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-3) [5d96566d] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 38148cd8 2017-02-27 15:54:54,051 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-12) [11bb1df2] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 72702acc 2017-02-27 15:55:12,369 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-3) [72389353] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:55:12,401 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-3) [72389353] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:12,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-3) [72389353] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 658fddc4 2017-02-27 15:55:12,478 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-3) [72389353] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 658fddc4 2017-02-27 15:55:12,499 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-3) [72389353] Lock freed to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:55:12,607 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:12,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 45592f48-3106-458c-b6be-fe5105a39a65, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a147629 2017-02-27 15:55:12,654 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] FINISH, ConnectStorageServerVDSCommand, return: {45592f48-3106-458c-b6be-fe5105a39a65=0}, log id: 4a147629 2017-02-27 15:55:12,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] START, CreateStorageDomainVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomain=StorageDomainStatic[export, c331475e-53ab-4a4c-81ab-d7a855232df3], args=nfs.dev1.api-digital.com:/srv/nfs/export), log id: 11be18f1 2017-02-27 15:55:13,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand return value StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=361, mMessage=Storage domain is not empty - requires cleaning: (u'nfs.dev1.api-digital.com:/srv/nfs/export',)]] 2017-02-27 15:55:13,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] HostName = hosted_engine_1 2017-02-27 15:55:13,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] Command CreateStorageDomainVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomain=StorageDomainStatic[export, c331475e-53ab-4a4c-81ab-d7a855232df3], args=nfs.dev1.api-digital.com:/srv/nfs/export) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to CreateStorageDomainVDS, error = Storage domain is not empty - requires cleaning: (u'nfs.dev1.api-digital.com:/srv/nfs/export',) 2017-02-27 15:55:13,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] FINISH, CreateStorageDomainVDSCommand, log id: 11be18f1 2017-02-27 15:55:13,115 ERROR [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] Command org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed in vdscommand to CreateStorageDomainVDS, error = Storage domain is not empty - requires cleaning: (u'nfs.dev1.api-digital.com:/srv/nfs/export',) (Failed with error StorageDomainNotEmpty and code 361) 2017-02-27 15:55:13,122 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] Command [id=afd782f3-f41f-4d2e-8654-4ca8b1be7bfd]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StorageDomainDynamic; snapshot: c331475e-53ab-4a4c-81ab-d7a855232df3. 2017-02-27 15:55:13,125 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] Command [id=afd782f3-f41f-4d2e-8654-4ca8b1be7bfd]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StorageDomainStatic; snapshot: c331475e-53ab-4a4c-81ab-d7a855232df3. 2017-02-27 15:55:13,138 ERROR [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp--127.0.0.1-8702-18) [6d0a4b82] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand. 2017-02-27 15:55:13,145 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-18) [6d0a4b82] Correlation ID: 6d0a4b82, Job ID: b5849233-f93e-4656-ab24-46b9915c2891, Call Stack: null, Custom Event ID: -1, Message: Failed to add Storage Domain export. (User: admin@internal) 2017-02-27 15:55:13,230 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-24) [35a1ea7b] Lock Acquired to object EngineLock [exclusiveLocks= key: 45592f48-3106-458c-b6be-fe5105a39a65 value: STORAGE_CONNECTION key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:55:13,241 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-24) [35a1ea7b] Running command: RemoveStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:13,249 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-24) [35a1ea7b] Removing connection 45592f48-3106-458c-b6be-fe5105a39a65 from database 2017-02-27 15:55:13,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-24) [35a1ea7b] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 45592f48-3106-458c-b6be-fe5105a39a65, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6a8f7c14 2017-02-27 15:55:13,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-24) [35a1ea7b] FINISH, DisconnectStorageServerVDSCommand, return: {45592f48-3106-458c-b6be-fe5105a39a65=0}, log id: 6a8f7c14 2017-02-27 15:55:13,497 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp--127.0.0.1-8702-24) [35a1ea7b] Lock freed to object EngineLock [exclusiveLocks= key: 45592f48-3106-458c-b6be-fe5105a39a65 value: STORAGE_CONNECTION key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:55:16,385 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-12) [11bb1df2] FINISH, AttachStorageDomainVDSCommand, log id: 72702acc 2017-02-27 15:55:16,411 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-12) [11bb1df2] START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, sdUUID = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 7e47b143 2017-02-27 15:55:16,495 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-12) [11bb1df2] FINISH, GetImagesListVDSCommand, return: [], log id: 7e47b143 2017-02-27 15:55:16,499 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-12) There are no OVF_STORE disks on storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 2017-02-27 15:55:16,511 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-12) Correlation ID: 11bb1df2, Job ID: 954bc9c2-321f-49dc-916f-080ae4c6032e, Call Stack: null, Custom Event ID: -1, Message: The Storage Domain does not contain any OVF_STORE disks. Usually the Storage Domain does not contain OVF_STORE disks when the Storage Domain has been previously managed with a Data Center version lower then 3.5. 2017-02-27 15:55:16,526 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-12) Correlation ID: 11bb1df2, Job ID: 954bc9c2-321f-49dc-916f-080ae4c6032e, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was attached to Data Center Default by admin@internal 2017-02-27 15:55:16,535 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-12) Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:55:23,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-26) Adding domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to the domains in maintenance cache 2017-02-27 15:55:29,346 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp--127.0.0.1-8702-37) [470ebf99] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:29,364 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-37) [470ebf99] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 75f277f2 2017-02-27 15:55:29,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-37) [470ebf99] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 75f277f2 2017-02-27 15:55:29,814 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-40) [440c8ab2] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:55:29,848 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-40) [440c8ab2] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:29,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-40) [440c8ab2] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a24433c 2017-02-27 15:55:29,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-40) [440c8ab2] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 4a24433c 2017-02-27 15:55:29,944 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-40) [440c8ab2] Lock freed to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 15:55:29,974 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-22) START, GetExistingStorageDomainListQuery(refresh: true, filtered: false), log id: 3e5adfb2 2017-02-27 15:55:29,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-22) START, HSMGetStorageDomainsListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=null, storageDomainType=ImportExport, path=nfs.dev1.api-digital.com:/srv/nfs/export), log id: 713aa32c 2017-02-27 15:55:30,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-22) FINISH, HSMGetStorageDomainsListVDSCommand, return: [148f6960-94d6-4142-b65d-95e3f3f33c68], log id: 713aa32c 2017-02-27 15:55:30,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-22) START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 73617905 2017-02-27 15:55:30,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-22) FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 73617905 2017-02-27 15:55:30,710 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-22) FINISH, GetExistingStorageDomainListQuery, log id: 3e5adfb2 2017-02-27 15:55:30,938 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-28) [5e1784eb] START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 16d2669a 2017-02-27 15:55:30,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-28) [5e1784eb] FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 16d2669a 2017-02-27 15:55:30,961 INFO [org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand] (ajp--127.0.0.1-8702-28) [5e1784eb] Running command: AddExistingFileStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:30,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-28) [5e1784eb] START, GetStorageDomainStatsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: a9d3c57 2017-02-27 15:55:30,995 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-28) [5e1784eb] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, 148f6960-94d6-4142-b65d-95e3f3f33c68], log id: a9d3c57 2017-02-27 15:55:31,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-28) [5e1784eb] Correlation ID: 5e1784eb, Job ID: c49a0555-0a4a-493d-934c-1fd8337a5fbd, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports was added by admin@internal 2017-02-27 15:55:31,109 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-39) [7d21c0c6] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 15:55:31,208 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-39) [7d21c0c6] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:31,255 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-41) [69ab05ec] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:31,257 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-39) [57e7ab1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:31,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-39) [57e7ab1] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 67c4b8a 2017-02-27 15:55:31,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-39) [57e7ab1] FINISH, ConnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 67c4b8a 2017-02-27 15:55:31,314 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69ab05ec] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 137a5b3f 2017-02-27 15:55:31,366 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69ab05ec] FINISH, ConnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 137a5b3f 2017-02-27 15:55:31,367 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-39) [7d21c0c6] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 2af2395d 2017-02-27 15:55:52,564 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-38) [50d57442] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:55:52,794 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-6) [50d57442] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:52,802 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-6) [50d57442] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:55:52,803 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-6) [50d57442] ActivateStorage Domain. Before Connect all hosts to pool. Time:2/27/17 3:55 PM 2017-02-27 15:55:52,839 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-9) [5bfeda2c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:52,854 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-7) [2e84da4b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:55:52,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-7) [2e84da4b] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a95a6c 2017-02-27 15:55:52,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-9) [5bfeda2c] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 718fc7e6 2017-02-27 15:55:52,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-7) [2e84da4b] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 4a95a6c 2017-02-27 15:55:52,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-9) [5bfeda2c] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 718fc7e6 2017-02-27 15:55:52,983 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-6) [50d57442] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 19f7239a 2017-02-27 15:55:53,577 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-39) [7d21c0c6] Command AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68) execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' 2017-02-27 15:55:53,578 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-39) [7d21c0c6] FINISH, AttachStorageDomainVDSCommand, log id: 2af2395d 2017-02-27 15:55:53,579 ERROR [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-39) [7d21c0c6] Command org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' (Failed with error StorageDomainAlreadyAttached and code 380) 2017-02-27 15:55:53,586 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-39) [7d21c0c6] Command [id=07964db0-b73b-410f-9348-3b268f58444b]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: storagePoolId = 00000002-0002-0002-0002-00000000002b, storageId = 148f6960-94d6-4142-b65d-95e3f3f33c68. 2017-02-27 15:55:53,609 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-39) [7d21c0c6] Correlation ID: 7d21c0c6, Job ID: f93e56cb-cefd-4e70-a23c-b6a818d55154, Call Stack: null, Custom Event ID: -1, Message: Failed to attach Storage Domain exports to Data Center Default. (User: admin@internal) 2017-02-27 15:55:53,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-14) Removing domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 from the domains in maintenance cache 2017-02-27 15:55:53,620 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-39) [7d21c0c6] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 15:55:54,006 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-6) [50d57442] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 19f7239a 2017-02-27 15:55:54,006 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-6) [50d57442] ActivateStorage Domain. After Connect all hosts to pool. Time:2/27/17 3:55 PM 2017-02-27 15:55:54,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-20) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 3e394f7d 2017-02-27 15:55:54,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-18) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 2491b775 2017-02-27 15:55:54,435 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-20) FINISH, ConnectStoragePoolVDSCommand, log id: 3e394f7d 2017-02-27 15:55:54,435 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-20) Refreshed vds hosted_engine_2 in pool Default 2017-02-27 15:55:54,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-18) FINISH, ConnectStoragePoolVDSCommand, log id: 2491b775 2017-02-27 15:55:54,571 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-18) Refreshed vds hosted_engine_1 in pool Default 2017-02-27 15:55:54,572 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-6) [50d57442] ActivateStorage Domain. After change storage pool status in vds. Time:2/27/17 3:55 PM 2017-02-27 15:55:54,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-19) [50d57442] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 6f01a88 2017-02-27 15:55:54,581 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-6) [50d57442] Correlation ID: 50d57442, Job ID: de21032f-a29e-49f1-bd84-dc5b5252df95, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos (Data Center Default) was activated by admin@internal 2017-02-27 15:55:54,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-19) [50d57442] FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 6f01a88 2017-02-27 15:55:54,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-19) [50d57442] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 30ac4d26 2017-02-27 15:55:54,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-19) [50d57442] FINISH, GetFileStatsVDSCommand, return: {}, log id: 30ac4d26 2017-02-27 15:56:08,341 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (ajp--127.0.0.1-8702-26) [4da795b5] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:56:08,405 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-29) [4da795b5] Running command: DeactivateStorageDomainWithOvfUpdateCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:08,441 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-29) [2dd117c2] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:08,478 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2dd117c2] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 75088504 2017-02-27 15:56:08,494 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-29) [2dd117c2] FINISH, DeactivateStorageDomainVDSCommand, log id: 75088504 2017-02-27 15:56:08,494 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-29) [2dd117c2] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:56:08,533 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-33) After deactivate treatment vds: hosted_engine_2,pool Default 2017-02-27 15:56:08,537 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-32) After deactivate treatment vds: hosted_engine_1,pool Default 2017-02-27 15:56:08,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-33) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 1d69dcd 2017-02-27 15:56:08,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-32) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 4c108c67 2017-02-27 15:56:08,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-33) FINISH, ConnectStoragePoolVDSCommand, log id: 1d69dcd 2017-02-27 15:56:08,875 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-33) [48776a3c] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:08,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-33) [48776a3c] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5e2cd0c7 2017-02-27 15:56:08,978 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-32) FINISH, ConnectStoragePoolVDSCommand, log id: 4c108c67 2017-02-27 15:56:09,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-33) [48776a3c] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 5e2cd0c7 2017-02-27 15:56:09,061 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-39) Adding domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to the domains in maintenance cache 2017-02-27 15:56:09,063 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-29) [7a5981ac] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:09,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-29) [7a5981ac] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 67652d3c 2017-02-27 15:56:09,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-29) [7a5981ac] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 67652d3c 2017-02-27 15:56:09,339 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-29) [7a5981ac] Domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 will remain in PreparingForMaintenance status until deactivated on all hosts 2017-02-27 15:56:09,355 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-29) [7a5981ac] Correlation ID: 2dd117c2, Job ID: 49c04020-bdcd-4606-844a-48adef427a15, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos (Data Center Default) was deactivated. 2017-02-27 15:56:09,370 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-29) [7a5981ac] Trying to release exclusive lock which does not exist, lock key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371STORAGE 2017-02-27 15:56:09,371 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-29) [7a5981ac] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:56:15,379 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-37) [350d5919] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 15:56:15,473 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-45) [350d5919] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:15,530 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-10) [4ca27ebc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:15,537 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-2) [1a9f2d5a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:15,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [4ca27ebc] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2bad3699 2017-02-27 15:56:15,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-2) [1a9f2d5a] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 51e6db9a 2017-02-27 15:56:15,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [4ca27ebc] FINISH, ConnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 2bad3699 2017-02-27 15:56:15,594 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-2) [1a9f2d5a] FINISH, ConnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 51e6db9a 2017-02-27 15:56:15,595 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-45) [350d5919] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 23e923c3 2017-02-27 15:56:37,731 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-45) [350d5919] Command AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68) execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' 2017-02-27 15:56:37,732 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-45) [350d5919] FINISH, AttachStorageDomainVDSCommand, log id: 23e923c3 2017-02-27 15:56:37,733 ERROR [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-45) [350d5919] Command org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' (Failed with error StorageDomainAlreadyAttached and code 380) 2017-02-27 15:56:37,736 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-45) [350d5919] Command [id=67e2a21a-9def-41e0-803f-a950d7bb3a9d]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: storagePoolId = 00000002-0002-0002-0002-00000000002b, storageId = 148f6960-94d6-4142-b65d-95e3f3f33c68. 2017-02-27 15:56:37,759 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-45) [350d5919] Correlation ID: 350d5919, Job ID: d66137b7-32f4-4717-8be8-d7a6294346bc, Call Stack: null, Custom Event ID: -1, Message: Failed to attach Storage Domain exports to Data Center Default. (User: admin@internal) 2017-02-27 15:56:37,763 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-45) [350d5919] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 15:56:37,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-17) Moving domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to maintenance 2017-02-27 15:56:58,300 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-3) [aadfbce] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:56:58,404 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-35) [aadfbce] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:58,417 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-35) [aadfbce] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:56:58,418 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-35) [aadfbce] ActivateStorage Domain. Before Connect all hosts to pool. Time:2/27/17 3:56 PM 2017-02-27 15:56:58,467 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-31) [448f2faf] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:58,469 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-43) [3b4fc465] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:56:58,525 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3b4fc465] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5716961c 2017-02-27 15:56:58,526 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-31) [448f2faf] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1ddaedd8 2017-02-27 15:56:58,576 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-31) [448f2faf] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 1ddaedd8 2017-02-27 15:56:58,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-43) [3b4fc465] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 5716961c 2017-02-27 15:56:58,628 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-35) [aadfbce] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 112f93c2 2017-02-27 15:56:59,023 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-35) [aadfbce] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 112f93c2 2017-02-27 15:56:59,023 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-35) [aadfbce] ActivateStorage Domain. After Connect all hosts to pool. Time:2/27/17 3:56 PM 2017-02-27 15:56:59,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-10) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 14cd9cc8 2017-02-27 15:56:59,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 2dab46f7 2017-02-27 15:56:59,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, ConnectStoragePoolVDSCommand, log id: 2dab46f7 2017-02-27 15:56:59,427 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-2) Refreshed vds hosted_engine_2 in pool Default 2017-02-27 15:56:59,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-10) FINISH, ConnectStoragePoolVDSCommand, log id: 14cd9cc8 2017-02-27 15:56:59,459 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-10) Refreshed vds hosted_engine_1 in pool Default 2017-02-27 15:56:59,460 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-35) [aadfbce] ActivateStorage Domain. After change storage pool status in vds. Time:2/27/17 3:56 PM 2017-02-27 15:56:59,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-44) [aadfbce] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 24ad33f9 2017-02-27 15:56:59,627 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-35) [aadfbce] Correlation ID: aadfbce, Job ID: caebf6ff-f9de-4bbf-b166-16cd178053af, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos (Data Center Default) was activated by admin@internal 2017-02-27 15:56:59,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-44) [aadfbce] FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 24ad33f9 2017-02-27 15:56:59,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-44) [aadfbce] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 666eb6e6 2017-02-27 15:56:59,784 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-44) [aadfbce] FINISH, GetFileStatsVDSCommand, return: {}, log id: 666eb6e6 2017-02-27 15:57:07,092 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-3) [5b57f225] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 15:57:07,166 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-5) [5b57f225] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:57:07,222 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-1) [23b430a5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:57:07,230 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-9) [4c54048d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:57:07,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-1) [23b430a5] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4d92629c 2017-02-27 15:57:07,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-1) [23b430a5] FINISH, ConnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 4d92629c 2017-02-27 15:57:07,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-9) [4c54048d] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a838aa5 2017-02-27 15:57:07,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-9) [4c54048d] FINISH, ConnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 4a838aa5 2017-02-27 15:57:07,307 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-5) [5b57f225] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 31f0f987 2017-02-27 15:57:10,058 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-15) Removing domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 from the domains in maintenance cache 2017-02-27 15:57:29,399 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-5) [5b57f225] Command AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68) execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' 2017-02-27 15:57:29,401 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-5) [5b57f225] FINISH, AttachStorageDomainVDSCommand, log id: 31f0f987 2017-02-27 15:57:29,401 ERROR [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-5) [5b57f225] Command org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' (Failed with error StorageDomainAlreadyAttached and code 380) 2017-02-27 15:57:29,403 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-5) [5b57f225] Command [id=14798047-3d40-4f32-9d7e-cba54c5806d9]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: storagePoolId = 00000002-0002-0002-0002-00000000002b, storageId = 148f6960-94d6-4142-b65d-95e3f3f33c68. 2017-02-27 15:57:29,427 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-5) [5b57f225] Correlation ID: 5b57f225, Job ID: a7a6763f-92c8-4a18-a03a-aa3a46de584c, Call Stack: null, Custom Event ID: -1, Message: Failed to attach Storage Domain exports to Data Center Default. (User: admin@internal) 2017-02-27 15:57:29,431 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-5) [5b57f225] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 15:57:35,570 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (ajp--127.0.0.1-8702-37) [6e69e93e] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:57:35,622 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-34) [6e69e93e] Running command: DeactivateStorageDomainWithOvfUpdateCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:57:35,650 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-34) [42d54c3] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:57:35,718 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-34) [42d54c3] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 43fa24e9 2017-02-27 15:57:36,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-34) [42d54c3] FINISH, DeactivateStorageDomainVDSCommand, log id: 43fa24e9 2017-02-27 15:57:36,087 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-34) [42d54c3] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:57:36,129 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-41) After deactivate treatment vds: hosted_engine_2,pool Default 2017-02-27 15:57:36,130 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-30) After deactivate treatment vds: hosted_engine_1,pool Default 2017-02-27 15:57:36,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-41) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 1bc2bb69 2017-02-27 15:57:36,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-30) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 5cb69f3f 2017-02-27 15:57:36,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-41) FINISH, ConnectStoragePoolVDSCommand, log id: 1bc2bb69 2017-02-27 15:57:36,454 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-41) [48ac9971] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:57:36,474 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-41) [48ac9971] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 63454296 2017-02-27 15:57:36,586 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-30) FINISH, ConnectStoragePoolVDSCommand, log id: 5cb69f3f 2017-02-27 15:57:36,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-41) [48ac9971] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 63454296 2017-02-27 15:57:36,650 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-34) [14c2cde1] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:57:36,670 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-34) [14c2cde1] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5ad9e3cc 2017-02-27 15:57:36,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-34) [14c2cde1] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 5ad9e3cc 2017-02-27 15:57:36,893 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-34) [14c2cde1] Domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 will remain in PreparingForMaintenance status until deactivated on all hosts 2017-02-27 15:57:36,904 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-34) [14c2cde1] Correlation ID: 42d54c3, Job ID: 2cba9e06-122f-49d3-a172-e322c411a253, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos (Data Center Default) was deactivated. 2017-02-27 15:57:36,927 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-34) [14c2cde1] Trying to release exclusive lock which does not exist, lock key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371STORAGE 2017-02-27 15:57:36,928 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-34) [14c2cde1] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:57:40,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-46) Adding domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to the domains in maintenance cache 2017-02-27 15:57:49,799 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-9) Moving domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to maintenance 2017-02-27 15:58:00,670 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-9) [31f52101] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:58:00,722 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:00,723 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] Start detach storage domain 2017-02-27 15:58:00,730 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] Detach storage domain: before connect 2017-02-27 15:58:00,767 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-19) [2745e256] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:00,774 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-6) [55bb726] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:00,802 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-19) [2745e256] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 719ff962 2017-02-27 15:58:00,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-6) [55bb726] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4b91356d 2017-02-27 15:58:00,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-19) [2745e256] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 719ff962 2017-02-27 15:58:00,880 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-6) [55bb726] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 4b91356d 2017-02-27 15:58:00,881 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] Detach storage domain: after connect 2017-02-27 15:58:00,883 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1, force = false), log id: 3822e95a 2017-02-27 15:58:10,966 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-32) Removing domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 from the domains in maintenance cache 2017-02-27 15:58:22,505 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] FINISH, DetachStorageDomainVDSCommand, log id: 3822e95a 2017-02-27 15:58:22,505 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] Detach storage domain: after detach in vds 2017-02-27 15:58:22,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-31) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 7882ec4d 2017-02-27 15:58:22,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-2) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 1099e6f7 2017-02-27 15:58:22,881 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-2) FINISH, ConnectStoragePoolVDSCommand, log id: 1099e6f7 2017-02-27 15:58:22,885 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-2) [631ba350] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:22,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-2) [631ba350] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 21ee3292 2017-02-27 15:58:22,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-31) FINISH, ConnectStoragePoolVDSCommand, log id: 7882ec4d 2017-02-27 15:58:22,999 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-31) [70f26755] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:23,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-31) [70f26755] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7f85df36 2017-02-27 15:58:23,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-2) [631ba350] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 21ee3292 2017-02-27 15:58:23,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-31) [70f26755] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 7f85df36 2017-02-27 15:58:23,241 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] Detach storage domain: after disconnect storage 2017-02-27 15:58:23,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] START, ResetISOPathVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 3a63b224 2017-02-27 15:58:23,317 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] FINISH, ResetISOPathVDSCommand, log id: 3a63b224 2017-02-27 15:58:23,317 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] End detach storage domain 2017-02-27 15:58:23,330 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-16) [31f52101] Correlation ID: 31f52101, Job ID: 14fe87a5-3259-43b4-a98a-a3c0e6698e83, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was detached from Data Center Default by admin@internal 2017-02-27 15:58:23,342 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-16) [31f52101] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:58:32,015 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-11) [7f407b62] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:58:32,117 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-3) [7f407b62] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:32,170 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-1) [243a53d4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:32,170 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-7) [21c74f97] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:32,228 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-1) [243a53d4] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 137fe0ea 2017-02-27 15:58:32,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-7) [21c74f97] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2db986c0 2017-02-27 15:58:32,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-1) [243a53d4] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 137fe0ea 2017-02-27 15:58:32,307 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-7) [21c74f97] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 2db986c0 2017-02-27 15:58:32,308 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-3) [7f407b62] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 36967fe8 2017-02-27 15:58:54,526 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-3) [7f407b62] FINISH, AttachStorageDomainVDSCommand, log id: 36967fe8 2017-02-27 15:58:54,553 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (org.ovirt.thread.pool-8-thread-3) [7f407b62] START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, sdUUID = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 2136e2b4 2017-02-27 15:58:54,635 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (org.ovirt.thread.pool-8-thread-3) [7f407b62] FINISH, GetImagesListVDSCommand, return: [], log id: 2136e2b4 2017-02-27 15:58:54,639 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-3) There are no OVF_STORE disks on storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 2017-02-27 15:58:54,646 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) Correlation ID: 7f407b62, Job ID: 0058ec22-9a3c-43d7-9021-4520bb3e2d77, Call Stack: null, Custom Event ID: -1, Message: The Storage Domain does not contain any OVF_STORE disks. Usually the Storage Domain does not contain OVF_STORE disks when the Storage Domain has been previously managed with a Data Center version lower then 3.5. 2017-02-27 15:58:54,707 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-3) [49831887] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:54,718 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-3) [49831887] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:58:54,718 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-3) [49831887] ActivateStorage Domain. Before Connect all hosts to pool. Time:2/27/17 3:58 PM 2017-02-27 15:58:54,755 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-26) [51fccee7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:54,757 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-38) [1f62d723] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:58:54,799 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-26) [51fccee7] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 673f418d 2017-02-27 15:58:54,809 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-26) [51fccee7] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 673f418d 2017-02-27 15:58:54,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-38) [1f62d723] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 617f1018 2017-02-27 15:58:54,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-38) [1f62d723] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 617f1018 2017-02-27 15:58:54,826 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-3) [49831887] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 358f70af 2017-02-27 15:58:55,111 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-3) [49831887] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 358f70af 2017-02-27 15:58:55,112 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-3) [49831887] ActivateStorage Domain. After Connect all hosts to pool. Time:2/27/17 3:58 PM 2017-02-27 15:58:55,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-33) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 939d83f 2017-02-27 15:58:55,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-36) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 62d48537 2017-02-27 15:58:55,534 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-33) FINISH, ConnectStoragePoolVDSCommand, log id: 939d83f 2017-02-27 15:58:55,535 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-33) Refreshed vds hosted_engine_2 in pool Default 2017-02-27 15:58:55,582 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-36) FINISH, ConnectStoragePoolVDSCommand, log id: 62d48537 2017-02-27 15:58:55,582 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-36) Refreshed vds hosted_engine_1 in pool Default 2017-02-27 15:58:55,583 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-3) [49831887] ActivateStorage Domain. After change storage pool status in vds. Time:2/27/17 3:58 PM 2017-02-27 15:58:55,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-37) [49831887] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 49644ce5 2017-02-27 15:58:55,596 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) [49831887] Correlation ID: 49831887, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos (Data Center Default) was activated by admin@internal 2017-02-27 15:58:55,604 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) [49831887] Correlation ID: 7f407b62, Job ID: 0058ec22-9a3c-43d7-9021-4520bb3e2d77, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was attached to Data Center Default by admin@internal 2017-02-27 15:58:55,610 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-3) [49831887] Trying to release exclusive lock which does not exist, lock key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371STORAGE 2017-02-27 15:58:55,611 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-3) [49831887] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 15:58:55,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-37) [49831887] FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 49644ce5 2017-02-27 15:58:55,639 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-37) [49831887] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 41a465e5 2017-02-27 15:58:55,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-37) [49831887] FINISH, GetFileStatsVDSCommand, return: {}, log id: 41a465e5 2017-02-27 15:59:21,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp--127.0.0.1-8702-7) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 69e6c5b4 2017-02-27 15:59:21,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp--127.0.0.1-8702-7) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 69e6c5b4 2017-02-27 15:59:21,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp--127.0.0.1-8702-7) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 2bcc862e 2017-02-27 15:59:21,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp--127.0.0.1-8702-7) FINISH, GetFileStatsVDSCommand, return: {}, log id: 2bcc862e 2017-02-27 15:59:21,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): isos (All file type) 2017-02-27 15:59:32,180 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-28) [2671aa7a] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 15:59:32,278 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-27) [2671aa7a] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:59:32,347 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-24) [659b1529] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:59:32,349 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-22) [1bdbe819] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 15:59:32,387 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-24) [659b1529] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3a22363a 2017-02-27 15:59:32,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-24) [659b1529] FINISH, ConnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 3a22363a 2017-02-27 15:59:32,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-22) [1bdbe819] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 74d00db0 2017-02-27 15:59:32,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-22) [1bdbe819] FINISH, ConnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 74d00db0 2017-02-27 15:59:32,427 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-27) [2671aa7a] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 76707c2e 2017-02-27 15:59:54,657 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-27) [2671aa7a] Command AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68) execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' 2017-02-27 15:59:54,658 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-27) [2671aa7a] FINISH, AttachStorageDomainVDSCommand, log id: 76707c2e 2017-02-27 15:59:54,659 ERROR [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-27) [2671aa7a] Command org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' (Failed with error StorageDomainAlreadyAttached and code 380) 2017-02-27 15:59:54,661 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-27) [2671aa7a] Command [id=b21f01ab-0176-4407-9b71-666e72177dd4]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: storagePoolId = 00000002-0002-0002-0002-00000000002b, storageId = 148f6960-94d6-4142-b65d-95e3f3f33c68. 2017-02-27 15:59:54,702 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-27) [2671aa7a] Correlation ID: 2671aa7a, Job ID: 2a66e317-1d3f-44b2-8b5f-0b9f282b4d6b, Call Stack: null, Custom Event ID: -1, Message: Failed to attach Storage Domain exports to Data Center Default. (User: admin@internal) 2017-02-27 15:59:54,709 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-8-thread-27) [2671aa7a] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:00:18,251 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-12) [4ce53c0] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:00:18,260 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-12) [4ce53c0] Running command: RemoveStorageDomainCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group DELETE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:00:18,320 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-12) [4ce53c0] Correlation ID: 4ce53c0, Job ID: c3915049-7ff1-4324-8a80-adfe403851f0, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports was removed by admin@internal 2017-02-27 16:00:18,327 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-12) [4ce53c0] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:00:36,390 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp--127.0.0.1-8702-11) [3aa30b6a] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:00:36,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-11) [3aa30b6a] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 1918d99e-53e7-4342-b503-dfd6639b24a1, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4bea6df9 2017-02-27 16:00:36,619 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-11) [3aa30b6a] FINISH, DisconnectStorageServerVDSCommand, return: {1918d99e-53e7-4342-b503-dfd6639b24a1=0}, log id: 4bea6df9 2017-02-27 16:00:36,878 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-30) [3fea9ee6] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 16:00:36,913 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-30) [3fea9ee6] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:00:36,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-30) [3fea9ee6] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6bc08d81 2017-02-27 16:00:36,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-30) [3fea9ee6] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 6bc08d81 2017-02-27 16:00:37,017 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-30) [3fea9ee6] Lock freed to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 16:00:37,059 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-29) START, GetExistingStorageDomainListQuery(refresh: true, filtered: false), log id: 1a1bba8b 2017-02-27 16:00:37,077 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-29) START, HSMGetStorageDomainsListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=null, storageDomainType=ImportExport, path=nfs.dev1.api-digital.com:/srv/nfs/export), log id: 12740911 2017-02-27 16:00:37,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-29) FINISH, HSMGetStorageDomainsListVDSCommand, return: [148f6960-94d6-4142-b65d-95e3f3f33c68], log id: 12740911 2017-02-27 16:00:37,602 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-29) START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 614d85c7 2017-02-27 16:00:37,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-29) FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 614d85c7 2017-02-27 16:00:37,616 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-29) FINISH, GetExistingStorageDomainListQuery, log id: 1a1bba8b 2017-02-27 16:00:37,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-28) [414d7550] START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 679ce54c 2017-02-27 16:00:37,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-28) [414d7550] FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 679ce54c 2017-02-27 16:00:37,870 INFO [org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand] (ajp--127.0.0.1-8702-28) [414d7550] Running command: AddExistingFileStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:00:37,897 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-28) [414d7550] START, GetStorageDomainStatsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 1a5db7e8 2017-02-27 16:00:37,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-28) [414d7550] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, 148f6960-94d6-4142-b65d-95e3f3f33c68], log id: 1a5db7e8 2017-02-27 16:00:37,926 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-28) [414d7550] Correlation ID: 414d7550, Job ID: 536f7d86-e647-4f07-8fff-752748298905, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports was added by admin@internal 2017-02-27 16:00:38,007 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-19) [112606c4] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:00:38,097 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-19) [112606c4] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:00:38,141 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-30) [c2ed2cb] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:00:38,151 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-41) [5ba8ac3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:00:38,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-30) [c2ed2cb] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 67ad3923-6139-4bf1-9be5-1aee66087643, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 204c2f5d 2017-02-27 16:00:38,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-41) [5ba8ac3] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 67ad3923-6139-4bf1-9be5-1aee66087643, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 65c2f9e 2017-02-27 16:00:38,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-41) [5ba8ac3] FINISH, ConnectStorageServerVDSCommand, return: {67ad3923-6139-4bf1-9be5-1aee66087643=0}, log id: 65c2f9e 2017-02-27 16:00:38,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-30) [c2ed2cb] FINISH, ConnectStorageServerVDSCommand, return: {67ad3923-6139-4bf1-9be5-1aee66087643=0}, log id: 204c2f5d 2017-02-27 16:00:38,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-19) [112606c4] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 2728d522 2017-02-27 16:00:59,992 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-19) [112606c4] Command AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68) execution failed. Exception: IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' 2017-02-27 16:00:59,993 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-19) [112606c4] FINISH, AttachStorageDomainVDSCommand, log id: 2728d522 2017-02-27 16:00:59,993 ERROR [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-19) [112606c4] Command org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IrsOperationFailedNoFailoverException: IRSGenericException: IRSErrorException: Storage domain already attached to pool: u'domain=148f6960-94d6-4142-b65d-95e3f3f33c68, pool=00000002-0002-0002-0002-0000000003cc' (Failed with error StorageDomainAlreadyAttached and code 380) 2017-02-27 16:00:59,995 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-19) [112606c4] Command [id=45c121d7-3f01-4b3a-8039-8c32e42120ca]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.StoragePoolIsoMap; snapshot: storagePoolId = 00000002-0002-0002-0002-00000000002b, storageId = 148f6960-94d6-4142-b65d-95e3f3f33c68. 2017-02-27 16:01:00,024 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-19) [112606c4] Correlation ID: 112606c4, Job ID: c4a32256-52bf-4a52-880b-b0a08e4f12d7, Call Stack: null, Custom Event ID: -1, Message: Failed to attach Storage Domain exports to Data Center Default. (User: admin@internal) 2017-02-27 16:01:00,032 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-19) [112606c4] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:01:30,159 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-26) [3ae8001] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:01:30,170 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-26) [3ae8001] Running command: RemoveStorageDomainCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group DELETE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:01:30,234 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-26) [3ae8001] Correlation ID: 3ae8001, Job ID: bbe55004-215c-4f2c-aafb-02816a5cd543, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports was removed by admin@internal 2017-02-27 16:01:30,241 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-26) [3ae8001] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:01:35,463 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (ajp--127.0.0.1-8702-40) [2aa60042] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:01:35,495 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-10) [2aa60042] Running command: DeactivateStorageDomainWithOvfUpdateCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:01:35,522 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-10) [5c25f828] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:01:35,551 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-10) [5c25f828] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 629f50f2 2017-02-27 16:01:35,566 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-10) [5c25f828] FINISH, DeactivateStorageDomainVDSCommand, log id: 629f50f2 2017-02-27 16:01:35,567 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-10) [5c25f828] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:01:35,609 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-34) After deactivate treatment vds: hosted_engine_1,pool Default 2017-02-27 16:01:35,611 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-16) After deactivate treatment vds: hosted_engine_2,pool Default 2017-02-27 16:01:35,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-34) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 229159a6 2017-02-27 16:01:35,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 75534bac 2017-02-27 16:01:35,980 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-34) FINISH, ConnectStoragePoolVDSCommand, log id: 229159a6 2017-02-27 16:01:36,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, ConnectStoragePoolVDSCommand, log id: 75534bac 2017-02-27 16:01:36,083 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-16) [66e61d5a] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:01:36,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-16) [66e61d5a] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 380d0180 2017-02-27 16:01:36,274 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-16) [66e61d5a] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 380d0180 2017-02-27 16:01:36,277 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-10) [4f5512fa] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:01:36,297 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [4f5512fa] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7cceea7c 2017-02-27 16:01:36,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-10) [4f5512fa] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 7cceea7c 2017-02-27 16:01:36,598 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-10) [4f5512fa] Domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 will remain in PreparingForMaintenance status until deactivated on all hosts 2017-02-27 16:01:36,616 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-10) [4f5512fa] Correlation ID: 5c25f828, Job ID: f35827f2-6de5-4a9a-ab2e-bf1c9c0b60bb, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos (Data Center Default) was deactivated. 2017-02-27 16:01:36,641 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-10) [4f5512fa] Trying to release exclusive lock which does not exist, lock key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371STORAGE 2017-02-27 16:01:36,641 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-10) [4f5512fa] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:01:44,396 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-9) Adding domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to the domains in maintenance cache 2017-02-27 16:01:50,805 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-45) Moving domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to maintenance 2017-02-27 16:03:00,475 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-40) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): ovirt-image-repository (All file type) 2017-02-27 16:03:04,373 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): ovirt-image-repository (All file type) 2017-02-27 16:03:08,918 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-12) [3ab323f0] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:03:08,982 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:08,983 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] Start detach storage domain 2017-02-27 16:03:08,990 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] Detach storage domain: before connect 2017-02-27 16:03:09,029 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-30) [6727ea04] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:09,029 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-39) [6d74e184] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:09,076 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-39) [6d74e184] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4da4bd5f 2017-02-27 16:03:09,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6727ea04] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3aefdba 2017-02-27 16:03:09,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-39) [6d74e184] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 4da4bd5f 2017-02-27 16:03:09,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-30) [6727ea04] FINISH, ConnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 3aefdba 2017-02-27 16:03:09,186 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] Detach storage domain: after connect 2017-02-27 16:03:09,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1, force = false), log id: 493bd9ff 2017-02-27 16:03:15,863 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-35) Removing domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 from the domains in maintenance cache 2017-02-27 16:03:31,312 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] FINISH, DetachStorageDomainVDSCommand, log id: 493bd9ff 2017-02-27 16:03:31,312 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] Detach storage domain: after detach in vds 2017-02-27 16:03:31,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-45) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 4f12f405 2017-02-27 16:03:31,395 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-20) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 65529cd1 2017-02-27 16:03:31,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-20) FINISH, ConnectStoragePoolVDSCommand, log id: 65529cd1 2017-02-27 16:03:31,718 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-20) [61dc9437] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:31,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-20) [61dc9437] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 52e84365 2017-02-27 16:03:31,766 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-45) FINISH, ConnectStoragePoolVDSCommand, log id: 4f12f405 2017-02-27 16:03:31,768 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-45) [682caaa9] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:31,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-45) [682caaa9] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 17ffaa5b-571a-4064-9d40-dc27f5ef718f, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 77b0e313 2017-02-27 16:03:31,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-20) [61dc9437] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 52e84365 2017-02-27 16:03:31,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-45) [682caaa9] FINISH, DisconnectStorageServerVDSCommand, return: {17ffaa5b-571a-4064-9d40-dc27f5ef718f=0}, log id: 77b0e313 2017-02-27 16:03:31,995 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] Detach storage domain: after disconnect storage 2017-02-27 16:03:32,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] START, ResetISOPathVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 233f2c02 2017-02-27 16:03:32,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] FINISH, ResetISOPathVDSCommand, log id: 233f2c02 2017-02-27 16:03:32,060 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] End detach storage domain 2017-02-27 16:03:32,074 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] Correlation ID: 3ab323f0, Job ID: 457c5a0b-4055-4bb6-9ee3-fd4758426a7e, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was detached from Data Center Default by admin@internal 2017-02-27 16:03:32,088 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-5) [3ab323f0] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:03:40,123 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-9) [1eb673dc] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:03:40,138 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-9) [1eb673dc] Running command: RemoveStorageDomainCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group DELETE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:40,210 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) [1eb673dc] Correlation ID: 1eb673dc, Job ID: 54c1546d-bc26-460d-8922-3242a31b3b74, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was removed by admin@internal 2017-02-27 16:03:40,218 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageDomainCommand] (ajp--127.0.0.1-8702-9) [1eb673dc] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:03:57,447 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp--127.0.0.1-8702-11) [6cb9f58c] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:57,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-11) [6cb9f58c] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 67ad3923-6139-4bf1-9be5-1aee66087643, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4ac7770e 2017-02-27 16:03:57,692 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-11) [6cb9f58c] FINISH, DisconnectStorageServerVDSCommand, return: {67ad3923-6139-4bf1-9be5-1aee66087643=0}, log id: 4ac7770e 2017-02-27 16:03:58,090 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-12) [7dfde0f1] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/iso value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 16:03:58,132 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-12) [7dfde0f1] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:58,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-12) [7dfde0f1] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/iso, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 27754fde 2017-02-27 16:03:58,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-12) [7dfde0f1] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=477}, log id: 27754fde 2017-02-27 16:03:58,192 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-12) [7dfde0f1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection nfs.dev1.api-digital.com:/srv/nfs/iso returned by VDSM was: Problem while trying to mount target 2017-02-27 16:03:58,193 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (ajp--127.0.0.1-8702-12) [7dfde0f1] The connection with details nfs.dev1.api-digital.com:/srv/nfs/iso failed because of error code 477 and error message is: problem while trying to mount target 2017-02-27 16:03:58,194 ERROR [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-12) [7dfde0f1] Command org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand throw Vdc Bll exception. With error message VdcBLLException: ProblemWhileTryingToMountTarget (Failed with error ProblemWhileTryingToMountTarget and code 477) 2017-02-27 16:03:58,196 ERROR [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-12) [7dfde0f1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand. 2017-02-27 16:03:58,212 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-12) [7dfde0f1] Lock freed to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/iso value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 16:03:58,308 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp--127.0.0.1-8702-19) [1617b0f3] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:03:58,330 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-19) [1617b0f3] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/iso, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: ea77f53 2017-02-27 16:03:58,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-19) [1617b0f3] FINISH, DisconnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=477}, log id: ea77f53 2017-02-27 16:04:01,275 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-22) [42428619] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/isos value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 16:04:01,309 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-22) [42428619] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:01,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-22) [42428619] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 26c755b0 2017-02-27 16:04:01,391 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-22) [42428619] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 26c755b0 2017-02-27 16:04:01,409 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-22) [42428619] Lock freed to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/isos value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 16:04:01,433 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-28) START, GetExistingStorageDomainListQuery(refresh: true, filtered: false), log id: 271555f2 2017-02-27 16:04:01,451 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-28) START, HSMGetStorageDomainsListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=null, storageDomainType=ISO, path=nfs.dev1.api-digital.com:/srv/nfs/isos), log id: 69bd96e9 2017-02-27 16:04:02,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-28) FINISH, HSMGetStorageDomainsListVDSCommand, return: [16173ef9-00bc-4546-b5fd-2a5fe6b3e371], log id: 69bd96e9 2017-02-27 16:04:02,387 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-28) START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 6b9a5ef9 2017-02-27 16:04:02,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-28) FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 6b9a5ef9 2017-02-27 16:04:02,402 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-28) FINISH, GetExistingStorageDomainListQuery, log id: 271555f2 2017-02-27 16:04:02,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-14) [5ccaab3f] START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 5948d30a 2017-02-27 16:04:02,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-14) [5ccaab3f] FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 5948d30a 2017-02-27 16:04:02,670 INFO [org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand] (ajp--127.0.0.1-8702-14) [5ccaab3f] Running command: AddExistingFileStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:02,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-14) [5ccaab3f] START, GetStorageDomainStatsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 1037c85c 2017-02-27 16:04:02,706 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-14) [5ccaab3f] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, 16173ef9-00bc-4546-b5fd-2a5fe6b3e371], log id: 1037c85c 2017-02-27 16:04:02,725 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-14) [5ccaab3f] Correlation ID: 5ccaab3f, Job ID: d0af7964-f6b4-4e3e-8d1a-64f80d89df08, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was added by admin@internal 2017-02-27 16:04:02,810 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-18) [381db038] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:04:02,865 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-18) [381db038] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:02,908 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-35) [5219e3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:02,910 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-40) [23149e4f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:02,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-35) [5219e3] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 58735746 2017-02-27 16:04:02,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-40) [23149e4f] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2412f889 2017-02-27 16:04:02,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-40) [23149e4f] FINISH, ConnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 2412f889 2017-02-27 16:04:02,995 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-35) [5219e3] FINISH, ConnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 58735746 2017-02-27 16:04:02,997 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-18) [381db038] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 25ce0c2a 2017-02-27 16:04:25,329 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-18) [381db038] FINISH, AttachStorageDomainVDSCommand, log id: 25ce0c2a 2017-02-27 16:04:25,353 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-18) [381db038] START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, sdUUID = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 2408d10f 2017-02-27 16:04:25,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-18) [381db038] FINISH, GetImagesListVDSCommand, return: [11111111-1111-1111-1111-111111111111], log id: 2408d10f 2017-02-27 16:04:25,479 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (ajp--127.0.0.1-8702-18) [381db038] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371, imageGroupId = 11111111-1111-1111-1111-111111111111), log id: 5150e014 2017-02-27 16:04:25,536 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (ajp--127.0.0.1-8702-18) [381db038] FINISH, GetVolumesListVDSCommand, return: [], log id: 5150e014 2017-02-27 16:04:25,537 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-18) There are no OVF_STORE disks on storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 2017-02-27 16:04:25,544 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-18) Correlation ID: 381db038, Job ID: d29db046-c716-4b3d-a1db-f499232547c8, Call Stack: null, Custom Event ID: -1, Message: The Storage Domain does not contain any OVF_STORE disks. Usually the Storage Domain does not contain OVF_STORE disks when the Storage Domain has been previously managed with a Data Center version lower then 3.5. 2017-02-27 16:04:25,564 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-18) Correlation ID: 381db038, Job ID: d29db046-c716-4b3d-a1db-f499232547c8, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was attached to Data Center Default by admin@internal 2017-02-27 16:04:25,572 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-18) Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:04:31,868 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-21) Adding domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to the domains in maintenance cache 2017-02-27 16:04:56,303 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp--127.0.0.1-8702-26) [722a7568] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:56,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-26) [722a7568] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4ae06ec6 2017-02-27 16:04:56,607 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-26) [722a7568] FINISH, DisconnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 4ae06ec6 2017-02-27 16:04:56,874 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [1ee1f863] Lock Acquired to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 16:04:56,905 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [1ee1f863] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:56,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-8) [1ee1f863] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6e2280f6 2017-02-27 16:04:56,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--127.0.0.1-8702-8) [1ee1f863] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 6e2280f6 2017-02-27 16:04:57,012 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--127.0.0.1-8702-8) [1ee1f863] Lock freed to object EngineLock [exclusiveLocks= key: nfs.dev1.api-digital.com:/srv/nfs/export value: STORAGE_CONNECTION , sharedLocks= ] 2017-02-27 16:04:57,050 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-24) START, GetExistingStorageDomainListQuery(refresh: true, filtered: false), log id: 2b282003 2017-02-27 16:04:57,068 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-24) START, HSMGetStorageDomainsListVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=null, storageDomainType=ImportExport, path=nfs.dev1.api-digital.com:/srv/nfs/export), log id: 574dbb17 2017-02-27 16:04:57,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp--127.0.0.1-8702-24) FINISH, HSMGetStorageDomainsListVDSCommand, return: [148f6960-94d6-4142-b65d-95e3f3f33c68], log id: 574dbb17 2017-02-27 16:04:57,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-24) START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 5331104a 2017-02-27 16:04:58,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-24) FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 5331104a 2017-02-27 16:04:58,013 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp--127.0.0.1-8702-24) FINISH, GetExistingStorageDomainListQuery, log id: 2b282003 2017-02-27 16:04:58,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-28) [71878f21] START, HSMGetStorageDomainInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 18ff65d0 2017-02-27 16:04:58,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp--127.0.0.1-8702-28) [71878f21] FINISH, HSMGetStorageDomainInfoVDSCommand, return: , log id: 18ff65d0 2017-02-27 16:04:58,312 INFO [org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand] (ajp--127.0.0.1-8702-28) [71878f21] Running command: AddExistingFileStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:58,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-28) [71878f21] START, GetStorageDomainStatsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storageDomainId=148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 71a7ecdd 2017-02-27 16:04:58,348 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp--127.0.0.1-8702-28) [71878f21] FINISH, GetStorageDomainStatsVDSCommand, return: StorageDomain[, 148f6960-94d6-4142-b65d-95e3f3f33c68], log id: 71a7ecdd 2017-02-27 16:04:58,376 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-28) [71878f21] Correlation ID: 71878f21, Job ID: c246b08e-22a3-4f9e-a269-58fb3bde96a7, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports was added by admin@internal 2017-02-27 16:04:58,466 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-37) [1521550] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:04:58,533 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-37) [1521550] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:58,577 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-40) [4054e4f5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:58,577 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-35) [1813de04] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:04:58,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-40) [4054e4f5] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3a8329df 2017-02-27 16:04:58,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-35) [1813de04] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7afc8497 2017-02-27 16:04:58,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-40) [4054e4f5] FINISH, ConnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 3a8329df 2017-02-27 16:04:58,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-35) [1813de04] FINISH, ConnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 7afc8497 2017-02-27 16:04:58,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 2c351f8d 2017-02-27 16:05:21,223 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] FINISH, AttachStorageDomainVDSCommand, log id: 2c351f8d 2017-02-27 16:05:21,227 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] START, GetImagesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, sdUUID = 148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 65792d56 2017-02-27 16:05:21,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImagesListVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] FINISH, GetImagesListVDSCommand, return: [c57558cf-2816-46e2-b321-4bce1cfa87c8, ec2bcfce-1f10-403d-aba3-af77f42eac88], log id: 65792d56 2017-02-27 16:05:21,392 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, imageGroupId = c57558cf-2816-46e2-b321-4bce1cfa87c8), log id: 5cd38cdc 2017-02-27 16:05:21,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] FINISH, GetVolumesListVDSCommand, return: [a2dec34d-259f-41dc-a559-fc9b08048a9a], log id: 5cd38cdc 2017-02-27 16:05:21,404 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, imageGroupId = c57558cf-2816-46e2-b321-4bce1cfa87c8, imageId = a2dec34d-259f-41dc-a559-fc9b08048a9a), log id: 5d2f4125 2017-02-27 16:05:21,431 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@82f57c67, log id: 5d2f4125 2017-02-27 16:05:21,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] START, GetVolumesListVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, imageGroupId = ec2bcfce-1f10-403d-aba3-af77f42eac88), log id: 174ad415 2017-02-27 16:05:21,465 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] FINISH, GetVolumesListVDSCommand, return: [f63ca06f-9650-492e-b39d-afbf164244f9], log id: 174ad415 2017-02-27 16:05:21,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, imageGroupId = ec2bcfce-1f10-403d-aba3-af77f42eac88, imageId = f63ca06f-9650-492e-b39d-afbf164244f9), log id: 31a9baa5 2017-02-27 16:05:21,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (ajp--127.0.0.1-8702-37) [1521550] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@cb912ef1, log id: 31a9baa5 2017-02-27 16:05:21,490 WARN [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-37) There are no OVF_STORE disks on storage domain id 148f6960-94d6-4142-b65d-95e3f3f33c68 2017-02-27 16:05:21,498 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-37) Correlation ID: 1521550, Job ID: 03a7589d-c37a-4e10-a07b-97c8811d35be, Call Stack: null, Custom Event ID: -1, Message: The Storage Domain does not contain any OVF_STORE disks. Usually the Storage Domain does not contain OVF_STORE disks when the Storage Domain has been previously managed with a Data Center version lower then 3.5. 2017-02-27 16:05:21,514 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-37) Correlation ID: 1521550, Job ID: 03a7589d-c37a-4e10-a07b-97c8811d35be, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports was attached to Data Center Default by admin@internal 2017-02-27 16:05:21,522 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp--127.0.0.1-8702-37) Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:05:32,773 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-36) Adding domain 148f6960-94d6-4142-b65d-95e3f3f33c68 to the domains in maintenance cache 2017-02-27 16:05:53,078 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-37) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): ovirt-image-repository (All file type) 2017-02-27 16:06:02,702 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-40) [7dc2868d] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:06:02,779 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [7dc2868d] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:06:02,788 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [7dc2868d] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-27 16:06:02,789 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [7dc2868d] ActivateStorage Domain. Before Connect all hosts to pool. Time:2/27/17 4:06 PM 2017-02-27 16:06:02,828 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-1) [4074fb28] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:06:02,835 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-49) [576f88c0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:06:02,898 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-1) [4074fb28] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3b93d2bf 2017-02-27 16:06:02,917 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-49) [576f88c0] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: e7aeaba 2017-02-27 16:06:02,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-49) [576f88c0] FINISH, ConnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: e7aeaba 2017-02-27 16:06:02,960 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-1) [4074fb28] FINISH, ConnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 3b93d2bf 2017-02-27 16:06:02,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-4) [7dc2868d] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371), log id: 39b0c91d 2017-02-27 16:06:03,409 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-4) [7dc2868d] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 39b0c91d 2017-02-27 16:06:03,410 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [7dc2868d] ActivateStorage Domain. After Connect all hosts to pool. Time:2/27/17 4:06 PM 2017-02-27 16:06:03,484 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-45) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 4cbb3f65 2017-02-27 16:06:03,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-15) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 1c53f7f2 2017-02-27 16:06:03,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-15) FINISH, ConnectStoragePoolVDSCommand, log id: 1c53f7f2 2017-02-27 16:06:03,850 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-15) Refreshed vds hosted_engine_2 in pool Default 2017-02-27 16:06:03,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-45) FINISH, ConnectStoragePoolVDSCommand, log id: 4cbb3f65 2017-02-27 16:06:03,889 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-45) Refreshed vds hosted_engine_1 in pool Default 2017-02-27 16:06:03,889 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [7dc2868d] ActivateStorage Domain. After change storage pool status in vds. Time:2/27/17 4:06 PM 2017-02-27 16:06:03,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-5) [7dc2868d] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 7f79455 2017-02-27 16:06:03,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-17) Removing domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 from the domains in maintenance cache 2017-02-27 16:06:04,092 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-4) [7dc2868d] Correlation ID: 7dc2868d, Job ID: 3498a979-8072-4c3e-9234-0a97c85a88ba, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos (Data Center Default) was activated by admin@internal 2017-02-27 16:06:04,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-5) [7dc2868d] FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 7f79455 2017-02-27 16:06:04,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-5) [7dc2868d] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 96862f3 2017-02-27 16:06:04,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-5) [7dc2868d] FINISH, GetFileStatsVDSCommand, return: {}, log id: 96862f3 2017-02-27 16:06:09,336 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp--127.0.0.1-8702-3) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 33b98ea2 2017-02-27 16:06:09,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp--127.0.0.1-8702-3) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 33b98ea2 2017-02-27 16:06:09,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp--127.0.0.1-8702-3) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 532b38d0 2017-02-27 16:06:09,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp--127.0.0.1-8702-3) FINISH, GetFileStatsVDSCommand, return: {}, log id: 532b38d0 2017-02-27 16:06:09,377 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): isos (All file type) 2017-02-27 16:06:13,024 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp--127.0.0.1-8702-30) [3377d0eb] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:06:13,113 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-24) [3377d0eb] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:06:13,121 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-24) [3377d0eb] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-27 16:06:13,123 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-24) [3377d0eb] ActivateStorage Domain. Before Connect all hosts to pool. Time:2/27/17 4:06 PM 2017-02-27 16:06:13,176 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-23) [36c6864c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:06:13,200 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-26) [78a7ee9e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-27 16:06:13,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-23) [36c6864c] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 14df4da4 2017-02-27 16:06:13,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-26) [78a7ee9e] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2be6ba23 2017-02-27 16:06:13,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-23) [36c6864c] FINISH, ConnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 14df4da4 2017-02-27 16:06:13,297 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-26) [78a7ee9e] FINISH, ConnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 2be6ba23 2017-02-27 16:06:13,300 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-24) [3377d0eb] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68), log id: 556e2f69 2017-02-27 16:06:13,712 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-24) [3377d0eb] FINISH, ActivateStorageDomainVDSCommand, return: true, log id: 556e2f69 2017-02-27 16:06:13,713 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-24) [3377d0eb] ActivateStorage Domain. After Connect all hosts to pool. Time:2/27/17 4:06 PM 2017-02-27 16:06:13,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-25) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 2ec2afaf 2017-02-27 16:06:13,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-33) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 3b8d223c 2017-02-27 16:06:14,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-33) FINISH, ConnectStoragePoolVDSCommand, log id: 3b8d223c 2017-02-27 16:06:14,118 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-33) Refreshed vds hosted_engine_2 in pool Default 2017-02-27 16:06:14,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-25) FINISH, ConnectStoragePoolVDSCommand, log id: 2ec2afaf 2017-02-27 16:06:14,176 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-25) Refreshed vds hosted_engine_1 in pool Default 2017-02-27 16:06:14,176 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-24) [3377d0eb] ActivateStorage Domain. After change storage pool status in vds. Time:2/27/17 4:06 PM 2017-02-27 16:06:14,277 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-24) [3377d0eb] Correlation ID: 3377d0eb, Job ID: 6d763d8b-65c0-4b99-bf2d-0e4ad854ab67, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports (Data Center Default) was activated by admin@internal 2017-02-27 16:06:16,594 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp--127.0.0.1-8702-9) START, GetVmsInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, vmIdList = null), log id: 6b4bcde 2017-02-27 16:06:16,788 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp--127.0.0.1-8702-9) FINISH, GetVmsInfoVDSCommand, log id: 6b4bcde 2017-02-27 16:06:19,128 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-30) Removing domain 148f6960-94d6-4142-b65d-95e3f3f33c68 from the domains in maintenance cache 2017-02-27 16:39:18,389 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VMs/Templates Ovf. 2017-02-27 16:39:18,390 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-42) [3e6c5fee] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 16:39:18,413 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-42) [3e6c5fee] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 17:39:18,415 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. 2017-02-27 17:39:18,417 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-44) [77826564] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 17:39:18,443 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-44) [77826564] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 17:44:17,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-23) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 27ac99a7 2017-02-27 17:44:17,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-23) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 27ac99a7 2017-02-27 17:44:17,569 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-23) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-27 18:39:18,445 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. 2017-02-27 18:39:18,446 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-43) [66693514] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 18:39:18,486 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-43) [66693514] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 18:44:17,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-38) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 7d6957b1 2017-02-27 18:44:17,588 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-38) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 7d6957b1 2017-02-27 18:44:17,624 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-38) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-27 19:39:18,488 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. 2017-02-27 19:39:18,489 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-46) [59f3fae0] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 19:39:18,514 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-46) [59f3fae0] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 19:44:17,654 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 1f911140 2017-02-27 19:44:17,668 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 1f911140 2017-02-27 19:44:17,683 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-8) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-27 20:39:18,516 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. 2017-02-27 20:39:18,518 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-32) [476203ec] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 20:39:18,567 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-32) [476203ec] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 20:44:17,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 4f248eee 2017-02-27 20:44:17,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 4f248eee 2017-02-27 20:44:17,737 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-22) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-27 21:39:18,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) [3e6c5fee] Attempting to update VMs/Templates Ovf. 2017-02-27 21:39:18,570 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-42) [76f26ca4] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 21:39:18,596 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-42) [76f26ca4] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 21:44:17,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-19) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 3184a181 2017-02-27 21:44:17,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-19) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 3184a181 2017-02-27 21:44:17,782 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-19) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-27 22:39:18,598 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. 2017-02-27 22:39:18,599 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-30) [3d143ae] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 22:39:18,637 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-30) [3d143ae] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 22:44:17,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-33) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 57493e52 2017-02-27 22:44:17,821 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-33) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 57493e52 2017-02-27 22:44:17,838 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-33) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-27 23:39:18,639 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. 2017-02-27 23:39:18,640 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-47) [14980bc2] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-27 23:39:18,673 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-47) [14980bc2] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-27 23:44:17,842 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-16) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 4515f29d 2017-02-27 23:44:17,856 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-16) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 4515f29d 2017-02-27 23:44:17,863 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-16) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 00:39:18,675 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [3d143ae] Attempting to update VMs/Templates Ovf. 2017-02-28 00:39:18,676 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-30) [bfd12d5] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 00:39:18,720 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-30) [bfd12d5] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 00:44:17,867 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-26) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 20f4b736 2017-02-28 00:44:17,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-26) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 20f4b736 2017-02-28 00:44:17,892 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-26) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 01:39:18,721 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. 2017-02-28 01:39:18,722 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-27) [39bd0986] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 01:39:18,831 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-27) [39bd0986] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 01:42:07,235 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-37) [1541cdd4] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,239 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-40) [54d003f6] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,239 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [5c8a8aef] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,240 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-9) [338569e9] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,242 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-38) [78389fc4] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,238 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-18) [2d04fd0c] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,249 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-37) [1541cdd4] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,250 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [5c8a8aef] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,253 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-18) [2d04fd0c] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,255 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-40) [54d003f6] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,259 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [5c8a8aef] Correlation ID: 5c8a8aef, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:07,260 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-9) [338569e9] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,264 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-18) [2d04fd0c] Correlation ID: 2d04fd0c, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:07,265 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-37) [1541cdd4] Correlation ID: 1541cdd4, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:07,265 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-40) [54d003f6] Correlation ID: 54d003f6, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:07,264 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-38) [78389fc4] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,270 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) [338569e9] Correlation ID: 338569e9, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:07,274 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-28) [651614] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,276 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-28) [651614] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,279 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-38) [78389fc4] Correlation ID: 78389fc4, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:07,280 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-12) [4cd3dd95] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,280 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-30) [79bebb63] Running command: LogoutUserCommand internal: false. 2017-02-28 01:42:07,282 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-12) [4cd3dd95] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,285 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-30) [79bebb63] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 01:42:07,293 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-28) [651614] Correlation ID: 651614, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:07,298 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-12) [4cd3dd95] Correlation ID: 4cd3dd95, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:07,299 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-30) [79bebb63] Correlation ID: 79bebb63, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 01:42:08,294 INFO [org.ovirt.engine.docs.utils.servlet.ContextSensitiveHelpMappingServlet] (ajp--127.0.0.1-8702-24) Context-sensitive help is not installed. Manual directory doesn't exist: /usr/share/ovirt-engine/manual 2017-02-28 01:44:17,913 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-5) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 3242834d 2017-02-28 01:44:17,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-5) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 3242834d 2017-02-28 01:44:17,935 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-5) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 02:39:18,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. 2017-02-28 02:39:18,834 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-35) [245124ef] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 02:39:18,852 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-35) [245124ef] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 02:44:17,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-35) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 4e85acfa 2017-02-28 02:44:17,956 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-35) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 4e85acfa 2017-02-28 02:44:17,962 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-35) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-43) [66693514] Start deleteAgedOutCommandEntities 2017-02-28 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-84) Start deleteAgedOutAuditLogs 2017-02-28 03:35:35,011 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-84) Finished deleteAgedOutAuditLogs 2017-02-28 03:35:35,012 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-43) [66693514] Finished deleteAgedOutCommandEntities 2017-02-28 03:39:18,854 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) [245124ef] Attempting to update VMs/Templates Ovf. 2017-02-28 03:39:18,855 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-35) [49ac499] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 03:39:18,895 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-35) [49ac499] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 03:44:17,964 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-33) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 295dbc92 2017-02-28 03:44:18,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-33) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 295dbc92 2017-02-28 03:44:18,045 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-33) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 04:39:18,896 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. 2017-02-28 04:39:18,898 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-24) [45f437f1] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 04:39:18,942 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-24) [45f437f1] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 04:44:18,048 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-20) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 310b8a0e 2017-02-28 04:44:18,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-20) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 310b8a0e 2017-02-28 04:44:18,107 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-20) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 05:39:18,943 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) Attempting to update VMs/Templates Ovf. 2017-02-28 05:39:18,945 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-19) [40573eb3] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 05:39:18,975 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-19) [40573eb3] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 05:44:18,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-9) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: a1a6d98 2017-02-28 05:44:18,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-9) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: a1a6d98 2017-02-28 05:44:18,196 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-9) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 06:39:18,976 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. 2017-02-28 06:39:18,978 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-18) [6d5a702e] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 06:39:19,004 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-18) [6d5a702e] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 06:44:18,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 70410412 2017-02-28 06:44:18,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 70410412 2017-02-28 06:44:18,242 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-27) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 07:39:19,005 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. 2017-02-28 07:39:19,007 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-23) [31b27b72] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 07:39:19,055 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-23) [31b27b72] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 07:44:18,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-19) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 3d3e9ed5 2017-02-28 07:44:18,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-19) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 3d3e9ed5 2017-02-28 07:44:18,285 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-19) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 08:39:19,058 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. 2017-02-28 08:39:19,059 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-85) [6cdc2068] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 08:39:19,089 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-85) [6cdc2068] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 08:44:18,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 7a48d978 2017-02-28 08:44:18,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 7a48d978 2017-02-28 08:44:18,320 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-22) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 09:39:19,091 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. 2017-02-28 09:39:19,092 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-14) [1fe88cb0] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 09:39:19,141 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-14) [1fe88cb0] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 09:44:18,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-33) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 3bc7f82d 2017-02-28 09:44:18,336 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-8-thread-33) FINISH, GetFileStatsVDSCommand, return: {cent7-api.iso={status=0, ctime=1487695738.0, size=698351616}}, log id: 3bc7f82d 2017-02-28 09:44:18,346 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-8-thread-33) Finished automatic refresh process for ISO file type with success, for storage domain id 16173ef9-00bc-4546-b5fd-2a5fe6b3e371. 2017-02-28 10:39:19,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [40573eb3] Attempting to update VMs/Templates Ovf. 2017-02-28 10:39:19,144 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-19) [71e491b3] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 10:39:19,178 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-19) [71e491b3] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 10:40:56,170 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp--127.0.0.1-8702-39) Running command: LoginAdminUserCommand internal: false. 2017-02-28 10:40:56,184 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-39) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-28 10:41:11,284 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp--127.0.0.1-8702-9) START, GetVmsInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, vmIdList = null), log id: 57007826 2017-02-28 10:41:11,299 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp--127.0.0.1-8702-9) FINISH, GetVmsInfoVDSCommand, log id: 57007826 2017-02-28 10:41:32,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp--127.0.0.1-8702-30) [4fd271f8] START, GetVmsInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, vmIdList = null), log id: 4ca1cd31 2017-02-28 10:41:32,168 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSCommand] (ajp--127.0.0.1-8702-30) [4fd271f8] FINISH, GetVmsInfoVDSCommand, log id: 4ca1cd31 2017-02-28 10:41:32,611 INFO [org.ovirt.engine.core.bll.ImportVmTemplateCommand] (org.ovirt.thread.pool-8-thread-30) [4fd271f8] Running command: ImportVmTemplateCommand internal: false. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group IMPORT_EXPORT_VM with role type ADMIN 2017-02-28 10:41:32,641 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-30) [4fd271f8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: While importing Template API-CentOS7.3, the Network/s cluster were found to be Non-VM Networks or do not exist in Cluster. Network Name was not set in the Interface/s nic1. 2017-02-28 10:41:32,684 INFO [org.ovirt.engine.core.bll.CopyImageGroupCommand] (org.ovirt.thread.pool-8-thread-30) [b008a78] Running command: CopyImageGroupCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 10:41:32,782 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) [b008a78] START, CopyImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, imageGroupId = ec2bcfce-1f10-403d-aba3-af77f42eac88, imageId = f63ca06f-9650-492e-b39d-afbf164244f9, dstImageGroupId = f3a515dd-7936-4504-81d1-e00ede0a1b75, vmId = d5b9d987-52c5-4a9c-9806-da7b78f793df, dstImageId = befecce7-c82e-4eaf-8741-5765f2ac1e48, imageDescription = , dstStorageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, copyVolumeType = SharedVol, volumeFormat = COW, preallocate = Sparse, postZero = false, force = false), log id: 1b7be97d 2017-02-28 10:41:32,784 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) [b008a78] -- executeIrsBrokerCommand: calling 'copyImage' with two new parameters: description and UUID 2017-02-28 10:41:32,785 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) [b008a78] -- copyImage parameters: sdUUID=148f6960-94d6-4142-b65d-95e3f3f33c68 spUUID=00000002-0002-0002-0002-00000000002b vmGUID=d5b9d987-52c5-4a9c-9806-da7b78f793df srcImageGUID=ec2bcfce-1f10-403d-aba3-af77f42eac88 srcVolUUID=f63ca06f-9650-492e-b39d-afbf164244f9 dstImageGUID=f3a515dd-7936-4504-81d1-e00ede0a1b75 dstVolUUID=befecce7-c82e-4eaf-8741-5765f2ac1e48 descr= dstSdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 2017-02-28 10:41:33,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (org.ovirt.thread.pool-8-thread-30) [b008a78] FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 1b7be97d 2017-02-28 10:41:33,245 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-30) [b008a78] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 6e68a3ab-8eb8-4252-8b32-6b679cbba342 2017-02-28 10:41:33,246 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-30) [b008a78] CommandMultiAsyncTasks::AttachTask: Attaching task dd39b159-d927-484a-a7d0-67ac147dfa89 to command 6e68a3ab-8eb8-4252-8b32-6b679cbba342. 2017-02-28 10:41:33,265 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-30) [b008a78] Adding task dd39b159-d927-484a-a7d0-67ac147dfa89 (Parent Command ImportVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-28 10:41:33,388 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-30) [b008a78] Correlation ID: 4fd271f8, Job ID: 0d505996-a41b-4486-9883-1e6166e5b108, Call Stack: null, Custom Event ID: -1, Message: Starting to import Template API-CentOS7.3 to Data Center Default, Cluster Default 2017-02-28 10:41:33,389 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-30) [b008a78] BaseAsyncTask::startPollingTask: Starting to poll task dd39b159-d927-484a-a7d0-67ac147dfa89. 2017-02-28 10:41:39,822 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-14) [1fe88cb0] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now 2017-02-28 10:41:39,828 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-14) [1fe88cb0] SPMAsyncTask::PollTask: Polling task dd39b159-d927-484a-a7d0-67ac147dfa89 (Parent Command ImportVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. 2017-02-28 10:41:39,829 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-14) [1fe88cb0] Finished polling Tasks, will poll again in 10 seconds. 2017-02-28 10:41:51,191 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (ajp--127.0.0.1-8702-19) [9fecd6f] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-28 10:41:51,262 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-4) [9fecd6f] Running command: DeactivateStorageDomainWithOvfUpdateCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:41:51,307 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [3c9a6b60] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:41:51,355 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3c9a6b60] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 50b30d1e 2017-02-28 10:41:51,374 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-4) [3c9a6b60] FINISH, DeactivateStorageDomainVDSCommand, log id: 50b30d1e 2017-02-28 10:41:51,375 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [3c9a6b60] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-28 10:41:51,414 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-21) After deactivate treatment vds: hosted_engine_2,pool Default 2017-02-28 10:41:51,414 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-24) After deactivate treatment vds: hosted_engine_1,pool Default 2017-02-28 10:41:51,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-24) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 5201baa8 2017-02-28 10:41:51,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-21) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 70f4b69f 2017-02-28 10:41:51,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-21) FINISH, ConnectStoragePoolVDSCommand, log id: 70f4b69f 2017-02-28 10:41:51,795 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-21) [36309c01] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:41:51,816 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-21) [36309c01] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 711dcaa 2017-02-28 10:41:51,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-21) [36309c01] FINISH, DisconnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 711dcaa 2017-02-28 10:41:52,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-24) FINISH, ConnectStoragePoolVDSCommand, log id: 5201baa8 2017-02-28 10:41:52,031 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-4) [42087612] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:41:52,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-4) [42087612] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7072ce41 2017-02-28 10:41:52,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-4) [42087612] FINISH, DisconnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 7072ce41 2017-02-28 10:41:52,300 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [42087612] Domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 will remain in PreparingForMaintenance status until deactivated on all hosts 2017-02-28 10:41:52,316 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-4) [42087612] Correlation ID: 3c9a6b60, Job ID: 0b72ce24-3d9f-44ca-96b5-77c7627a72db, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos (Data Center Default) was deactivated. 2017-02-28 10:41:52,391 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-4) [42087612] Trying to release exclusive lock which does not exist, lock key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371STORAGE 2017-02-28 10:41:52,392 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-4) [42087612] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-28 10:41:59,227 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-5) Adding domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to the domains in maintenance cache 2017-02-28 10:42:08,449 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-49) Moving domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 to maintenance 2017-02-28 10:42:12,931 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-9) [3007e4c1] Lock Acquired to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-28 10:42:13,017 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:42:13,017 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] Start detach storage domain 2017-02-28 10:42:13,025 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] Detach storage domain: before connect 2017-02-28 10:42:13,065 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-35) [2c2d9a15] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:42:13,066 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-36) [31dba450] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:42:13,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-35) [2c2d9a15] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 16567a8 2017-02-28 10:42:13,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-36) [31dba450] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 41899938 2017-02-28 10:42:13,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-36) [31dba450] FINISH, ConnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 41899938 2017-02-28 10:42:13,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-35) [2c2d9a15] FINISH, ConnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 16567a8 2017-02-28 10:42:13,188 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] Detach storage domain: after connect 2017-02-28 10:42:13,188 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 16173ef9-00bc-4546-b5fd-2a5fe6b3e371, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1, force = false), log id: 39a39f68 2017-02-28 10:42:15,217 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-6) Removing domain 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 from the domains in maintenance cache 2017-02-28 10:42:36,378 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] FINISH, DetachStorageDomainVDSCommand, log id: 39a39f68 2017-02-28 10:42:36,379 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] Detach storage domain: after detach in vds 2017-02-28 10:42:36,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-32) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 420fe527 2017-02-28 10:42:36,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-8) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 6b2ef65d 2017-02-28 10:42:36,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-8) FINISH, ConnectStoragePoolVDSCommand, log id: 6b2ef65d 2017-02-28 10:42:36,807 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-8) [7b2f1425] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:42:36,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-8) [7b2f1425] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 590466c8 2017-02-28 10:42:36,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-32) FINISH, ConnectStoragePoolVDSCommand, log id: 420fe527 2017-02-28 10:42:36,935 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-32) [3e21eaba] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:42:36,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-32) [3e21eaba] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 6acdd24a-3863-47a8-9ae7-e046440cee3b, connection: nfs.dev1.api-digital.com:/srv/nfs/isos, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: cc457c2 2017-02-28 10:42:37,084 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-8) [7b2f1425] FINISH, DisconnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: 590466c8 2017-02-28 10:42:37,279 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-32) [3e21eaba] FINISH, DisconnectStorageServerVDSCommand, return: {6acdd24a-3863-47a8-9ae7-e046440cee3b=0}, log id: cc457c2 2017-02-28 10:42:37,280 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] Detach storage domain: after disconnect storage 2017-02-28 10:42:37,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] START, ResetISOPathVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 5f097885 2017-02-28 10:42:37,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] FINISH, ResetISOPathVDSCommand, log id: 5f097885 2017-02-28 10:42:37,342 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] End detach storage domain 2017-02-28 10:42:37,370 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] Correlation ID: 3007e4c1, Job ID: 404479fd-a44c-4364-af5b-6211152e13f8, Call Stack: null, Custom Event ID: -1, Message: Storage Domain isos was detached from Data Center Default by admin@internal 2017-02-28 10:42:37,378 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-7) [3007e4c1] Lock freed to object EngineLock [exclusiveLocks= key: 16173ef9-00bc-4546-b5fd-2a5fe6b3e371 value: STORAGE , sharedLocks= ] 2017-02-28 10:43:16,423 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) SPMAsyncTask::PollTask: Polling task dd39b159-d927-484a-a7d0-67ac147dfa89 (Parent Command ImportVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. 2017-02-28 10:43:16,433 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::onTaskEndSuccess: Task dd39b159-d927-484a-a7d0-67ac147dfa89 (Parent Command ImportVmTemplate, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. 2017-02-28 10:43:16,434 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-22) CommandAsyncTask::endActionIfNecessary: All tasks of command 6e68a3ab-8eb8-4252-8b32-6b679cbba342 has ended -> executing endAction 2017-02-28 10:43:16,435 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-22) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 6e68a3ab-8eb8-4252-8b32-6b679cbba342): calling endAction . 2017-02-28 10:43:16,435 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-3) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ImportVmTemplate, executionIndex: 0 2017-02-28 10:43:16,460 INFO [org.ovirt.engine.core.bll.ImportVmTemplateCommand] (org.ovirt.thread.pool-8-thread-3) Ending command successfully: org.ovirt.engine.core.bll.ImportVmTemplateCommand 2017-02-28 10:43:16,489 INFO [org.ovirt.engine.core.bll.CopyImageGroupCommand] (org.ovirt.thread.pool-8-thread-3) [b008a78] Ending command successfully: org.ovirt.engine.core.bll.CopyImageGroupCommand 2017-02-28 10:43:16,494 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-3) [b008a78] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = f3a515dd-7936-4504-81d1-e00ede0a1b75, imageId = befecce7-c82e-4eaf-8741-5765f2ac1e48), log id: 20d79e57 2017-02-28 10:43:16,530 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-3) [b008a78] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@4bbebea, log id: 20d79e57 2017-02-28 10:43:16,546 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) Correlation ID: 4fd271f8, Call Stack: null, Custom Event ID: -1, Message: Template API-CentOS7.3 was imported successfully to Data Center Default, Cluster Default 2017-02-28 10:43:16,547 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-3) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ImportVmTemplate completed, handling the result. 2017-02-28 10:43:16,548 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-3) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ImportVmTemplate succeeded, clearing tasks. 2017-02-28 10:43:16,553 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-3) SPMAsyncTask::ClearAsyncTask: Attempting to clear task dd39b159-d927-484a-a7d0-67ac147dfa89 2017-02-28 10:43:16,553 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-3) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = dd39b159-d927-484a-a7d0-67ac147dfa89), log id: 2a162b23 2017-02-28 10:43:16,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-3) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=dd39b159-d927-484a-a7d0-67ac147dfa89), log id: 156a1c6b 2017-02-28 10:43:16,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-3) FINISH, HSMClearTaskVDSCommand, log id: 156a1c6b 2017-02-28 10:43:16,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-3) FINISH, SPMClearTaskVDSCommand, log id: 2a162b23 2017-02-28 10:43:16,629 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-3) BaseAsyncTask::removeTaskFromDB: Removed task dd39b159-d927-484a-a7d0-67ac147dfa89 from DataBase 2017-02-28 10:43:16,629 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-3) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 6e68a3ab-8eb8-4252-8b32-6b679cbba342 2017-02-28 10:43:30,324 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (ajp--127.0.0.1-8702-28) [3918a993] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-28 10:43:30,384 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-4) [3918a993] Running command: DeactivateStorageDomainWithOvfUpdateCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:30,411 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [69ac8ec0] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:30,452 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-4) [69ac8ec0] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 391faf50 2017-02-28 10:43:30,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-4) [69ac8ec0] FINISH, DeactivateStorageDomainVDSCommand, log id: 391faf50 2017-02-28 10:43:30,499 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [69ac8ec0] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-28 10:43:30,537 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-11) After deactivate treatment vds: hosted_engine_2,pool Default 2017-02-28 10:43:30,541 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-8-thread-43) After deactivate treatment vds: hosted_engine_1,pool Default 2017-02-28 10:43:30,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-43) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 3e5e1a7e 2017-02-28 10:43:30,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-11) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 550cd4cc 2017-02-28 10:43:30,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-43) FINISH, ConnectStoragePoolVDSCommand, log id: 3e5e1a7e 2017-02-28 10:43:31,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-11) FINISH, ConnectStoragePoolVDSCommand, log id: 550cd4cc 2017-02-28 10:43:31,375 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-11) [24cf166] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:31,407 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-11) [24cf166] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 44b1d4e5 2017-02-28 10:43:31,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-11) [24cf166] FINISH, DisconnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 44b1d4e5 2017-02-28 10:43:31,586 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-5) Adding domain 148f6960-94d6-4142-b65d-95e3f3f33c68 to the domains in maintenance cache 2017-02-28 10:43:31,587 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-4) [1b304dfe] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:31,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-4) [1b304dfe] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 200c8325 2017-02-28 10:43:31,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-4) [1b304dfe] FINISH, DisconnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 200c8325 2017-02-28 10:43:31,875 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-8-thread-4) [1b304dfe] Domain 148f6960-94d6-4142-b65d-95e3f3f33c68 will remain in PreparingForMaintenance status until deactivated on all hosts 2017-02-28 10:43:31,905 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-4) [1b304dfe] Correlation ID: 69ac8ec0, Job ID: dcf1f796-2059-47a0-b757-6e38fd6b35b7, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports (Data Center Default) was deactivated. 2017-02-28 10:43:31,921 WARN [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (org.ovirt.thread.pool-8-thread-4) [1b304dfe] Trying to release exclusive lock which does not exist, lock key: 148f6960-94d6-4142-b65d-95e3f3f33c68STORAGE 2017-02-28 10:43:31,921 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainWithOvfUpdateCommand] (org.ovirt.thread.pool-8-thread-4) [1b304dfe] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-28 10:43:39,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-19) Moving domain 148f6960-94d6-4142-b65d-95e3f3f33c68 to maintenance 2017-02-28 10:43:54,223 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp--127.0.0.1-8702-12) [27285cc8] Lock Acquired to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-28 10:43:54,278 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 148f6960-94d6-4142-b65d-95e3f3f33c68 Type: StorageAction group MANIPULATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:54,279 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] Start detach storage domain 2017-02-28 10:43:54,286 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] Detach storage domain: before connect 2017-02-28 10:43:54,333 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-9) [21ae5f0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:54,340 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-8-thread-13) [4a0a50d3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:54,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-9) [21ae5f0] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 24d91d2f 2017-02-28 10:43:54,395 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-13) [4a0a50d3] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 330778a0 2017-02-28 10:43:54,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-9) [21ae5f0] FINISH, ConnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 24d91d2f 2017-02-28 10:43:54,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-13) [4a0a50d3] FINISH, ConnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 330778a0 2017-02-28 10:43:54,461 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] Detach storage domain: after connect 2017-02-28 10:43:54,462 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 148f6960-94d6-4142-b65d-95e3f3f33c68, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1, force = false), log id: 7400d8ab 2017-02-28 10:43:55,024 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] FINISH, DetachStorageDomainVDSCommand, log id: 7400d8ab 2017-02-28 10:43:55,024 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] Detach storage domain: after detach in vds 2017-02-28 10:43:55,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-44) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 6e1753ce 2017-02-28 10:43:55,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 6d91fadf 2017-02-28 10:43:55,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-44) FINISH, ConnectStoragePoolVDSCommand, log id: 6e1753ce 2017-02-28 10:43:55,424 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-44) [609eacda] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:55,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-44) [609eacda] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 137ba89c 2017-02-28 10:43:55,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, ConnectStoragePoolVDSCommand, log id: 6d91fadf 2017-02-28 10:43:55,490 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-8-thread-27) [6169adf5] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_STORAGE_DOMAIN with role type ADMIN 2017-02-28 10:43:55,511 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-27) [6169adf5] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54, connection: nfs.dev1.api-digital.com:/srv/nfs/export, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6d8484ed 2017-02-28 10:43:55,665 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-44) [609eacda] FINISH, DisconnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 137ba89c 2017-02-28 10:43:55,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-8-thread-27) [6169adf5] FINISH, DisconnectStorageServerVDSCommand, return: {2ec3b8f1-5346-4a6c-beb8-f5b598c6ec54=0}, log id: 6d8484ed 2017-02-28 10:43:55,732 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] Detach storage domain: after disconnect storage 2017-02-28 10:43:55,807 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] End detach storage domain 2017-02-28 10:43:55,823 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-50) [27285cc8] Correlation ID: 27285cc8, Job ID: f65d54d7-6ab0-4374-b7d7-77a117e10c18, Call Stack: null, Custom Event ID: -1, Message: Storage Domain exports was detached from Data Center Default by admin@internal 2017-02-28 10:43:55,831 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-8-thread-50) [27285cc8] Lock freed to object EngineLock [exclusiveLocks= key: 148f6960-94d6-4142-b65d-95e3f3f33c68 value: STORAGE , sharedLocks= ] 2017-02-28 10:44:02,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-24) Removing domain 148f6960-94d6-4142-b65d-95e3f3f33c68 from the domains in maintenance cache 2017-02-28 10:44:18,570 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Setting new tasks map. The map contains now 0 tasks 2017-02-28 10:44:18,571 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) Cleared all tasks of pool 00000002-0002-0002-0002-00000000002b. 2017-02-28 10:44:35,449 INFO [org.ovirt.engine.core.bll.AddVmCommand] (ajp--127.0.0.1-8702-7) [16caf029] Lock Acquired to object EngineLock [exclusiveLocks= key: test value: VM_NAME , sharedLocks= key: f3a515dd-7936-4504-81d1-e00ede0a1b75 value: DISK key: d5b9d987-52c5-4a9c-9806-da7b78f793df value: TEMPLATE ] 2017-02-28 10:44:35,499 INFO [org.ovirt.engine.core.bll.AddVmCommand] (ajp--127.0.0.1-8702-7) [16caf029] Running command: AddVmCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-0000000000da Type: VdsGroupsAction group CREATE_VM with role type USER, ID: d5b9d987-52c5-4a9c-9806-da7b78f793df Type: VmTemplateAction group CREATE_VM with role type USER, ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: StorageAction group CREATE_DISK with role type USER 2017-02-28 10:44:35,584 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (ajp--127.0.0.1-8702-7) [16caf029] START, SetVmStatusVDSCommand( vmId = 15c5443a-654a-4464-8b28-33d2bdd34ec7, status = ImageLocked, exit status = Normal), log id: 4a28bfb2 2017-02-28 10:44:35,602 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (ajp--127.0.0.1-8702-7) [16caf029] FINISH, SetVmStatusVDSCommand, log id: 4a28bfb2 2017-02-28 10:44:35,722 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (ajp--127.0.0.1-8702-7) [7adb7470] Running command: CreateSnapshotFromTemplateCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 10:44:35,736 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (ajp--127.0.0.1-8702-7) [7adb7470] START, CreateSnapshotVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 5c159fc6-918c-4efc-9f6c-767b31d6da6b, imageSizeInBytes = 8589934592, volumeFormat = COW, newImageId = b2b21742-04a4-4e4c-b5cc-2e0c64d4f6b8, newImageDescription = , imageId = befecce7-c82e-4eaf-8741-5765f2ac1e48, sourceImageGroupId = f3a515dd-7936-4504-81d1-e00ede0a1b75), log id: 2840d6c0 2017-02-28 10:44:35,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (ajp--127.0.0.1-8702-7) [7adb7470] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID 2017-02-28 10:44:35,788 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (ajp--127.0.0.1-8702-7) [7adb7470] FINISH, CreateSnapshotVDSCommand, return: b2b21742-04a4-4e4c-b5cc-2e0c64d4f6b8, log id: 2840d6c0 2017-02-28 10:44:35,803 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp--127.0.0.1-8702-7) [7adb7470] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command a6b3b0e6-1472-4ef0-b20a-ae6a72393ce2 2017-02-28 10:44:35,803 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-7) [7adb7470] CommandMultiAsyncTasks::AttachTask: Attaching task 738febba-c0f1-4854-9c85-49ad6913bb50 to command a6b3b0e6-1472-4ef0-b20a-ae6a72393ce2. 2017-02-28 10:44:35,835 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp--127.0.0.1-8702-7) [7adb7470] Adding task 738febba-c0f1-4854-9c85-49ad6913bb50 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-28 10:44:35,983 INFO [org.ovirt.engine.core.bll.AddWatchdogCommand] (ajp--127.0.0.1-8702-7) [4cb3979d] Running command: AddWatchdogCommand internal: true. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group EDIT_VM_PROPERTIES with role type USER 2017-02-28 10:44:36,080 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [4cb3979d] Correlation ID: 16caf029, Job ID: ddd699e7-e509-4179-a920-13fe8a0c5f4e, Call Stack: null, Custom Event ID: -1, Message: VM test creation was initiated by admin@internal. 2017-02-28 10:44:36,081 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp--127.0.0.1-8702-7) [4cb3979d] BaseAsyncTask::startPollingTask: Starting to poll task 738febba-c0f1-4854-9c85-49ad6913bb50. 2017-02-28 10:44:36,386 INFO [org.ovirt.engine.core.bll.network.vm.UpdateVmInterfaceCommand] (ajp--127.0.0.1-8702-38) [4c5fa548] Running command: UpdateVmInterfaceCommand internal: false. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group CONFIGURE_VM_NETWORK with role type USER, ID: 0000000e-000e-000e-000e-000000000394 Type: VnicProfileAction group CONFIGURE_VM_NETWORK with role type USER 2017-02-28 10:44:36,426 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-38) [4c5fa548] Correlation ID: 4c5fa548, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was updated for VM test. (User: admin@internal) 2017-02-28 10:44:36,438 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-82) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now 2017-02-28 10:44:36,446 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-82) SPMAsyncTask::PollTask: Polling task 738febba-c0f1-4854-9c85-49ad6913bb50 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. 2017-02-28 10:44:36,447 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-82) Finished polling Tasks, will poll again in 10 seconds. 2017-02-28 10:44:36,498 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp--127.0.0.1-8702-19) [22cdd3fe] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group CREATE_VM with role type USER 2017-02-28 10:44:46,454 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-25) SPMAsyncTask::PollTask: Polling task 738febba-c0f1-4854-9c85-49ad6913bb50 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. 2017-02-28 10:44:46,479 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-25) BaseAsyncTask::onTaskEndSuccess: Task 738febba-c0f1-4854-9c85-49ad6913bb50 (Parent Command AddVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. 2017-02-28 10:44:46,480 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-25) CommandAsyncTask::endActionIfNecessary: All tasks of command a6b3b0e6-1472-4ef0-b20a-ae6a72393ce2 has ended -> executing endAction 2017-02-28 10:44:46,480 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-25) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: a6b3b0e6-1472-4ef0-b20a-ae6a72393ce2): calling endAction . 2017-02-28 10:44:46,481 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-27) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction AddVm, executionIndex: 0 2017-02-28 10:44:46,510 INFO [org.ovirt.engine.core.bll.AddVmCommand] (org.ovirt.thread.pool-8-thread-27) [16caf029] Ending command successfully: org.ovirt.engine.core.bll.AddVmCommand 2017-02-28 10:44:46,534 INFO [org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand] (org.ovirt.thread.pool-8-thread-27) [7adb7470] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotFromTemplateCommand 2017-02-28 10:44:46,543 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [7adb7470] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 5c159fc6-918c-4efc-9f6c-767b31d6da6b, imageId = b2b21742-04a4-4e4c-b5cc-2e0c64d4f6b8), log id: cf4d02d 2017-02-28 10:44:46,620 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [7adb7470] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@55b8be62, log id: cf4d02d 2017-02-28 10:44:46,634 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, SetVmStatusVDSCommand( vmId = 15c5443a-654a-4464-8b28-33d2bdd34ec7, status = Down, exit status = Normal), log id: 2704a0f0 2017-02-28 10:44:46,639 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, SetVmStatusVDSCommand, log id: 2704a0f0 2017-02-28 10:44:46,646 INFO [org.ovirt.engine.core.bll.AddVmCommand] (org.ovirt.thread.pool-8-thread-27) Lock freed to object EngineLock [exclusiveLocks= key: test value: VM_NAME , sharedLocks= key: f3a515dd-7936-4504-81d1-e00ede0a1b75 value: DISK key: d5b9d987-52c5-4a9c-9806-da7b78f793df value: TEMPLATE ] 2017-02-28 10:44:46,663 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-27) Correlation ID: 16caf029, Call Stack: null, Custom Event ID: -1, Message: VM test creation has been completed. 2017-02-28 10:44:46,664 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddVm completed, handling the result. 2017-02-28 10:44:46,665 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddVm succeeded, clearing tasks. 2017-02-28 10:44:46,674 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-27) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 738febba-c0f1-4854-9c85-49ad6913bb50 2017-02-28 10:44:46,675 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = 738febba-c0f1-4854-9c85-49ad6913bb50), log id: 20d6cac3 2017-02-28 10:44:46,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-27) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=738febba-c0f1-4854-9c85-49ad6913bb50), log id: 4778df25 2017-02-28 10:44:46,758 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, HSMClearTaskVDSCommand, log id: 4778df25 2017-02-28 10:44:46,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-27) FINISH, SPMClearTaskVDSCommand, log id: 20d6cac3 2017-02-28 10:44:46,769 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-27) BaseAsyncTask::removeTaskFromDB: Removed task 738febba-c0f1-4854-9c85-49ad6913bb50 from DataBase 2017-02-28 10:44:46,769 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity a6b3b0e6-1472-4ef0-b20a-ae6a72393ce2 2017-02-28 10:44:54,473 INFO [org.ovirt.engine.core.bll.UpdateVmDiskCommand] (ajp--127.0.0.1-8702-28) [378376] Lock Acquired to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM_DISK_BOOT key: 5c159fc6-918c-4efc-9f6c-767b31d6da6b value: DISK , sharedLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM ] 2017-02-28 10:44:54,497 INFO [org.ovirt.engine.core.bll.UpdateVmDiskCommand] (ajp--127.0.0.1-8702-28) [378376] Running command: UpdateVmDiskCommand internal: false. Entities affected : ID: 5c159fc6-918c-4efc-9f6c-767b31d6da6b Type: DiskAction group EDIT_DISK_PROPERTIES with role type USER 2017-02-28 10:44:54,534 INFO [org.ovirt.engine.core.bll.ExtendImageSizeCommand] (ajp--127.0.0.1-8702-28) [5a60ac33] Running command: ExtendImageSizeCommand internal: true. Entities affected : ID: 5c159fc6-918c-4efc-9f6c-767b31d6da6b Type: DiskAction group EDIT_DISK_PROPERTIES with role type USER 2017-02-28 10:44:54,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ExtendImageSizeVDSCommand] (ajp--127.0.0.1-8702-28) [5a60ac33] START, ExtendImageSizeVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 140d24dc 2017-02-28 10:44:54,585 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ExtendImageSizeVDSCommand] (ajp--127.0.0.1-8702-28) [5a60ac33] FINISH, ExtendImageSizeVDSCommand, log id: 140d24dc 2017-02-28 10:44:54,613 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (ajp--127.0.0.1-8702-28) [5a60ac33] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 0d54fc5e-fe12-4584-9bc7-46bd681dfae1 2017-02-28 10:44:54,613 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-28) [5a60ac33] CommandMultiAsyncTasks::AttachTask: Attaching task fa0bb53b-bbbe-432b-a270-908a14b8c787 to command 0d54fc5e-fe12-4584-9bc7-46bd681dfae1. 2017-02-28 10:44:54,633 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ajp--127.0.0.1-8702-28) [5a60ac33] Adding task fa0bb53b-bbbe-432b-a270-908a14b8c787 (Parent Command UpdateVmDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-28 10:44:54,665 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-28) [5a60ac33] Correlation ID: 378376, Call Stack: null, Custom Event ID: -1, Message: VM test test_Disk1 disk was updated by admin@internal. 2017-02-28 10:44:54,665 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (ajp--127.0.0.1-8702-28) [5a60ac33] BaseAsyncTask::startPollingTask: Starting to poll task fa0bb53b-bbbe-432b-a270-908a14b8c787. 2017-02-28 10:44:56,484 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-49) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now 2017-02-28 10:44:56,491 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-49) SPMAsyncTask::PollTask: Polling task fa0bb53b-bbbe-432b-a270-908a14b8c787 (Parent Command UpdateVmDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. 2017-02-28 10:44:56,491 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-49) BaseAsyncTask::onTaskEndSuccess: Task fa0bb53b-bbbe-432b-a270-908a14b8c787 (Parent Command UpdateVmDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. 2017-02-28 10:44:56,492 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-49) CommandAsyncTask::endActionIfNecessary: All tasks of command 0d54fc5e-fe12-4584-9bc7-46bd681dfae1 has ended -> executing endAction 2017-02-28 10:44:56,495 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-49) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 0d54fc5e-fe12-4584-9bc7-46bd681dfae1): calling endAction . 2017-02-28 10:44:56,496 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-47) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction UpdateVmDisk, executionIndex: 0 2017-02-28 10:44:56,531 INFO [org.ovirt.engine.core.bll.UpdateVmDiskCommand] (org.ovirt.thread.pool-8-thread-47) [378376] Ending command successfully: org.ovirt.engine.core.bll.UpdateVmDiskCommand 2017-02-28 10:44:56,533 INFO [org.ovirt.engine.core.bll.ExtendImageSizeCommand] (org.ovirt.thread.pool-8-thread-47) Ending command successfully: org.ovirt.engine.core.bll.ExtendImageSizeCommand 2017-02-28 10:44:56,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ExtendVmDiskSizeVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, ExtendVmDiskSizeVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vmId=00000000-0000-0000-0000-000000000000), log id: 4d93f7f1 2017-02-28 10:44:57,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ExtendVmDiskSizeVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, ExtendVmDiskSizeVDSCommand, return: 10,737,418,240, log id: 4d93f7f1 2017-02-28 10:44:57,548 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 5c159fc6-918c-4efc-9f6c-767b31d6da6b, imageId = b2b21742-04a4-4e4c-b5cc-2e0c64d4f6b8), log id: 27ee6694 2017-02-28 10:44:57,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@55b8be62, log id: 27ee6694 2017-02-28 10:44:57,591 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-47) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Size of the disk 'test_Disk1' was successfully updated to 10 GB by admin@internal. 2017-02-28 10:44:57,620 INFO [org.ovirt.engine.core.bll.UpdateVmDiskCommand] (org.ovirt.thread.pool-8-thread-47) Lock freed to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM_DISK_BOOT key: 5c159fc6-918c-4efc-9f6c-767b31d6da6b value: DISK , sharedLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM ] 2017-02-28 10:44:57,627 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-47) Correlation ID: 378376, Call Stack: null, Custom Event ID: -1, Message: VM test test_Disk1 disk was updated by admin@internal. 2017-02-28 10:44:57,628 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type UpdateVmDisk completed, handling the result. 2017-02-28 10:44:57,628 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type UpdateVmDisk succeeded, clearing tasks. 2017-02-28 10:44:57,629 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-47) SPMAsyncTask::ClearAsyncTask: Attempting to clear task fa0bb53b-bbbe-432b-a270-908a14b8c787 2017-02-28 10:44:57,629 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = fa0bb53b-bbbe-432b-a270-908a14b8c787), log id: 24c27ea5 2017-02-28 10:44:57,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-47) START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=fa0bb53b-bbbe-432b-a270-908a14b8c787), log id: 5d08957d 2017-02-28 10:44:57,664 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, HSMClearTaskVDSCommand, log id: 5d08957d 2017-02-28 10:44:57,664 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-47) FINISH, SPMClearTaskVDSCommand, log id: 24c27ea5 2017-02-28 10:44:57,675 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-47) BaseAsyncTask::removeTaskFromDB: Removed task fa0bb53b-bbbe-432b-a270-908a14b8c787 from DataBase 2017-02-28 10:44:57,676 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-47) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 0d54fc5e-fe12-4584-9bc7-46bd681dfae1 2017-02-28 10:45:17,281 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-3) [69729fc7] Lock Acquired to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 10:45:17,305 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-3) [69729fc7] START, IsVmDuringInitiatingVDSCommand( vmId = 15c5443a-654a-4464-8b28-33d2bdd34ec7), log id: 4ee5bed3 2017-02-28 10:45:17,306 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-3) [69729fc7] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 4ee5bed3 2017-02-28 10:45:17,446 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] Running command: RunVmCommand internal: false. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group VM_BASIC_OPERATIONS with role type USER 2017-02-28 10:45:17,533 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-8-thread-41) [69729fc7] Started HA reservation scoring method 2017-02-28 10:45:17,591 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] START, UpdateVmDynamicDataVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@4c4cd41e), log id: 6a41f38d 2017-02-28 10:45:17,598 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] FINISH, UpdateVmDynamicDataVDSCommand, log id: 6a41f38d 2017-02-28 10:45:17,633 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] START, CreateVmVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, vm=VM [test]), log id: a27b0d1 2017-02-28 10:45:17,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] START, CreateVmFromCloudInitVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, vm=VM [test]), log id: 383f18d 2017-02-28 10:45:17,772 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7,acpiEnable=true,custom={device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=632f6e50-52e1-4131-a228-0d9d629c6cc5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=00000000-0000-0000-0000-000000000000, device=watchdog, type=WATCHDOG, bootOrder=0, specParams={model=i6300esb, action=reset}, address=, managed=false, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=31eacb8c-123e-4b61-b6c1-469da7091f15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5device_7dd1b520-9097-47a0-95f0-3fe64d077c8a=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=7dd1b520-9097-47a0-95f0-3fe64d077c8a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=682,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{shared=false, iface=ide, index=3, specParams={vmPayload={file={openstack/latest/meta_data.json=ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIsCiAgInV1aWQiIDogIjg5OGJhYWFiLTBhMjEtNGVmNS1iMmViLWI3NGUxMGQ4ZTJkZCIsCiAgIm1ldGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIsCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=, openstack/latest/user_data=I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAgYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwpjaHBhc3N3ZDoKICBleHBpcmU6IGZhbHNlCnJ1bmNtZDoKLSAnc2VkIC1pICcnL15kYXRhc291cmNlX2xpc3Q6IC9kJycgL2V0Yy9jbG91ZC9jbG91ZC5jZmc7IGVjaG8gJydkYXRhc291cmNlX2xpc3Q6CiAgWyJOb0Nsb3VkIiwgIkNvbmZpZ0RyaXZlIl0nJyA+PiAvZXRjL2Nsb3VkL2Nsb3VkLmNmZycK}, volId=config-2}}, path=, device=cdrom, type=disk, readonly=true, deviceId=9fc0435f-48cd-42e8-b1f5-ebbc27c45098}, {specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=59b7dba9-6e10-45ff-8011-8f98909ec3a3}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=6eb283b9-3664-45fc-8532-622edf18a951}, {shared=false, index=0, volumeID=b2b21742-04a4-4e4c-b5cc-2e0c64d4f6b8, propagateErrors=off, format=cow, type=disk, iface=scsi, bootOrder=1, address={unit=0, bus=0, target=0, controller=0, type=drive}, domainID=831fd677-2894-48e7-8a0d-fd5c084a08e6, imageID=5c159fc6-918c-4efc-9f6c-767b31d6da6b, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-00000000002b, readonly=false, deviceId=5c159fc6-918c-4efc-9f6c-767b31d6da6b}, {nicModel=pv, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:11:e4:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=927d4e5e-f1a5-42ac-ac6a-64e8639fc1b3}, {specParams={model=i6300esb, action=reset}, device=watchdog, type=watchdog, deviceId=00000000-0000-0000-0000-000000000000}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=fcc910bc-df4f-463e-b28d-db5663f19ac3}, {address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, specParams={}, device=virtio-serial, type=controller, deviceId=a1985699-56f9-4c05-876f-a489729d2080}],vmName=test,cpuType=Westmere,fileTransferEnable=true 2017-02-28 10:45:17,809 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVmFromCloudInitVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] FINISH, CreateVmFromCloudInitVDSCommand, log id: 383f18d 2017-02-28 10:45:17,838 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: a27b0d1 2017-02-28 10:45:17,838 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-41) [69729fc7] Lock freed to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 10:45:17,849 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-41) [69729fc7] Correlation ID: 69729fc7, Job ID: 248264ca-5fc5-41d3-bd80-811191a6d8cb, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin@internal (Host: hosted_engine_2). 2017-02-28 10:45:18,362 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-83) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 7db84a1a 2017-02-28 10:45:18,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-83) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=-1, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, smartcardEnable=false, custom={device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5device_7dd1b520-9097-47a0-95f0-3fe64d077c8a=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=7dd1b520-9097-47a0-95f0-3fe64d077c8a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=632f6e50-52e1-4131-a228-0d9d629c6cc5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=00000000-0000-0000-0000-000000000000, device=watchdog, type=WATCHDOG, bootOrder=0, specParams={model=i6300esb, action=reset}, address=, managed=false, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=31eacb8c-123e-4b61-b6c1-469da7091f15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=WaitForLaunch, bootMenuEnable=false, pid=0, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=-1, guestDiskMapping={}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@3d8d19bd, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 7db84a1a 2017-02-28 10:45:18,379 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon} 2017-02-28 10:45:18,384 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) Received a qxl Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=qxl, specParams={vram=32768, ram=65536, heads=1}, deviceType=video, type=video, deviceId=59b7dba9-6e10-45ff-8011-8f98909ec3a3} 2017-02-28 10:45:18,385 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=spice, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, type=graphics} 2017-02-28 10:45:18,386 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) Received a bridge Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {nicModel=pv, macAddr=00:1a:4a:11:e4:00, linkActive=true, network=ovirtmgmt, filter=vdsm-no-mac-spoofing, specParams={inbound={}, outbound={}}, deviceType=interface, deviceId=927d4e5e-f1a5-42ac-ac6a-64e8639fc1b3, device=bridge, type=interface} 2017-02-28 10:45:18,387 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) Received a watchdog Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=watchdog, specParams={action=reset, model=i6300esb}, deviceType=watchdog, type=watchdog, deviceId=00000000-0000-0000-0000-000000000000} 2017-02-28 10:45:18,388 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) Received a cdrom Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {index=3, iface=ide, specParams={vmPayload={volId=config-2, file={openstack/latest/meta_data.json=ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIsCiAgInV1aWQiIDogIjg5OGJhYWFiLTBhMjEtNGVmNS1iMmViLWI3NGUxMGQ4ZTJkZCIsCiAgIm1ldGEiIDogewogICAgImVzc2VudGlhbCIgOiAiZmFsc2UiLAogICAgInJvbGUiIDogInNlcnZlciIsCiAgICAiZHNtb2RlIiA6ICJsb2NhbCIKICB9Cn0=, openstack/latest/user_data=I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAgYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwpjaHBhc3N3ZDoKICBleHBpcmU6IGZhbHNlCnJ1bmNtZDoKLSAnc2VkIC1pICcnL15kYXRhc291cmNlX2xpc3Q6IC9kJycgL2V0Yy9jbG91ZC9jbG91ZC5jZmc7IGVjaG8gJydkYXRhc291cmNlX2xpc3Q6CiAgWyJOb0Nsb3VkIiwgIkNvbmZpZ0RyaXZlIl0nJyA+PiAvZXRjL2Nsb3VkL2Nsb3VkLmNmZycK}}}, readonly=true, deviceType=disk, deviceId=9fc0435f-48cd-42e8-b1f5-ebbc27c45098, path=/var/run/vdsm/payload/15c5443a-654a-4464-8b28-33d2bdd34ec7.a222ccba1ec29a69ff8d9133d3f835a1.img, device=cdrom, shared=false, type=disk} 2017-02-28 10:45:18,390 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) Received a cdrom Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {index=2, iface=ide, specParams={path=}, readonly=true, deviceType=disk, deviceId=6eb283b9-3664-45fc-8532-622edf18a951, path=, device=cdrom, shared=false, type=disk} 2017-02-28 10:45:21,532 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from WaitForLaunch --> PoweringUp 2017-02-28 10:45:21,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 2bc44a3e 2017-02-28 10:45:21,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5device_7dd1b520-9097-47a0-95f0-3fe64d077c8a=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=7dd1b520-9097-47a0-95f0-3fe64d077c8a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=632f6e50-52e1-4131-a228-0d9d629c6cc5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=00000000-0000-0000-0000-000000000000, device=watchdog, type=WATCHDOG, bootOrder=0, specParams={model=i6300esb, action=reset}, address=, managed=false, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=31eacb8c-123e-4b61-b6c1-469da7091f15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, pid=2204, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@63e642e4, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 2bc44a3e 2017-02-28 10:45:21,546 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 10:45:21,547 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 10:45:22,684 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp--127.0.0.1-8702-37) [777c8ccb] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group CONNECT_TO_VM with role type USER 2017-02-28 10:45:22,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8702-37) [777c8ccb] START, SetVmTicketVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, ticket=TsMyFH4Q5uTn, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 5b553d8b 2017-02-28 10:45:22,778 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8702-37) [777c8ccb] FINISH, SetVmTicketVDSCommand, log id: 5b553d8b 2017-02-28 10:45:22,817 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-37) [777c8ccb] Correlation ID: 777c8ccb, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM test 2017-02-28 10:45:24,720 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-24) [45f437f1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM test. 2017-02-28 10:45:48,572 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-88) Setting new tasks map. The map contains now 1 tasks 2017-02-28 10:46:18,574 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-25) Setting new tasks map. The map contains now 0 tasks 2017-02-28 10:46:18,574 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-25) Cleared all tasks of pool 00000002-0002-0002-0002-00000000002b. 2017-02-28 10:46:19,989 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from PoweringUp --> Up 2017-02-28 10:46:20,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-17) Correlation ID: 69729fc7, Job ID: 248264ca-5fc5-41d3-bd80-811191a6d8cb, Call Stack: null, Custom Event ID: -1, Message: VM test started on Host hosted_engine_2 2017-02-28 10:47:05,986 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from Up --> RebootInProgress 2017-02-28 10:47:05,989 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-25) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 5498a5d2 2017-02-28 10:47:05,995 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-25) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5device_7dd1b520-9097-47a0-95f0-3fe64d077c8a=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=7dd1b520-9097-47a0-95f0-3fe64d077c8a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=632f6e50-52e1-4131-a228-0d9d629c6cc5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=00000000-0000-0000-0000-000000000000, device=watchdog, type=WATCHDOG, bootOrder=0, specParams={model=i6300esb, action=reset}, address=, managed=false, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=31eacb8c-123e-4b61-b6c1-469da7091f15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, pid=2204, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={}, clientIp=76.164.165.5, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@71aea961, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 5498a5d2 2017-02-28 10:47:06,010 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 10:47:06,011 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 10:47:21,388 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-70) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 61eabfbd 2017-02-28 10:47:21,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-70) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5device_7dd1b520-9097-47a0-95f0-3fe64d077c8a=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=7dd1b520-9097-47a0-95f0-3fe64d077c8a, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15device_632f6e50-52e1-4131-a228-0d9d629c6cc5=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=632f6e50-52e1-4131-a228-0d9d629c6cc5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=00000000-0000-0000-0000-000000000000, device=watchdog, type=WATCHDOG, bootOrder=0, specParams={model=i6300esb, action=reset}, address=, managed=false, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6device_00000000-0000-0000-0000-000000000000device_31eacb8c-123e-4b61-b6c1-469da7091f15=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=31eacb8c-123e-4b61-b6c1-469da7091f15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=ab60cac8-ab1c-4fce-84b2-2d1fa700b6a6, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, pid=2204, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={0QEMU_QEMU_HARDDISK_5c159fc6-918c-4efc-9={name=/dev/sda}, QEMU_DVD-ROM={name=/dev/sr1}}, clientIp=76.164.165.5, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@7ad24383, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 61eabfbd 2017-02-28 10:47:21,407 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 10:47:21,408 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 10:47:24,546 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-62) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from RebootInProgress --> Up 2017-02-28 10:48:04,199 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from Up --> Paused 2017-02-28 10:48:53,246 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-44) [77826564] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal got disconnected from VM test. 2017-02-28 10:49:02,016 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-8-thread-36) [3cbefde3] Running command: StopVmCommand internal: false. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group VM_BASIC_OPERATIONS with role type USER 2017-02-28 10:49:02,081 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-36) [3cbefde3] START, DestroyVmVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, force=false, secondsToWait=0, gracefully=false, reason=), log id: 6798966 2017-02-28 10:49:02,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-36) [3cbefde3] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, force=false, secondsToWait=0, gracefully=false, reason=), log id: 18d4573e 2017-02-28 10:49:02,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-8-thread-36) [3cbefde3] FINISH, DestroyVDSCommand, log id: 18d4573e 2017-02-28 10:49:02,923 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-8-thread-36) [3cbefde3] FINISH, DestroyVmVDSCommand, return: Down, log id: 6798966 2017-02-28 10:49:02,958 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-36) [3cbefde3] Correlation ID: 3cbefde3, Job ID: f575ea16-3dc2-499c-b419-13938997dcff, Call Stack: null, Custom Event ID: -1, Message: VM test powered off by admin@internal (Host: hosted_engine_2) (Reason: Not Specified). 2017-02-28 10:49:02,972 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-10) [7b347a62] Running command: ProcessDownVmCommand internal: true. 2017-02-28 10:49:07,705 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp--127.0.0.1-8702-11) [250cf78b] Lock Acquired to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 10:49:07,726 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-11) [250cf78b] START, IsVmDuringInitiatingVDSCommand( vmId = 15c5443a-654a-4464-8b28-33d2bdd34ec7), log id: 445ae74a 2017-02-28 10:49:07,727 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp--127.0.0.1-8702-11) [250cf78b] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 445ae74a 2017-02-28 10:49:07,827 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] Running command: RunVmCommand internal: false. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group VM_BASIC_OPERATIONS with role type USER 2017-02-28 10:49:07,879 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (org.ovirt.thread.pool-8-thread-44) [250cf78b] Started HA reservation scoring method 2017-02-28 10:49:07,952 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] START, UpdateVmDynamicDataVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@a652d481), log id: 2919361a 2017-02-28 10:49:07,962 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] FINISH, UpdateVmDynamicDataVDSCommand, log id: 2919361a 2017-02-28 10:49:07,989 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] START, CreateVmVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, vm=VM [test]), log id: 2e90b927 2017-02-28 10:49:08,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] START, CreateVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, vm=VM [test]), log id: 612b66c 2017-02-28 10:49:08,044 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7,acpiEnable=true,custom={},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=682,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{address={bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}, specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=59b7dba9-6e10-45ff-8011-8f98909ec3a3}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=6eb283b9-3664-45fc-8532-622edf18a951}, {shared=false, index=0, volumeID=b2b21742-04a4-4e4c-b5cc-2e0c64d4f6b8, propagateErrors=off, format=cow, type=disk, iface=scsi, bootOrder=1, address={unit=0, bus=0, target=0, controller=0, type=drive}, domainID=831fd677-2894-48e7-8a0d-fd5c084a08e6, imageID=5c159fc6-918c-4efc-9f6c-767b31d6da6b, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-00000000002b, readonly=false, deviceId=5c159fc6-918c-4efc-9f6c-767b31d6da6b}, {nicModel=pv, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:11:e4:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=927d4e5e-f1a5-42ac-ac6a-64e8639fc1b3}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=fcc910bc-df4f-463e-b28d-db5663f19ac3}, {address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, specParams={}, device=virtio-serial, type=controller, deviceId=a1985699-56f9-4c05-876f-a489729d2080}],vmName=test,cpuType=Westmere,fileTransferEnable=true 2017-02-28 10:49:08,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] FINISH, CreateVDSCommand, log id: 612b66c 2017-02-28 10:49:08,078 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 2e90b927 2017-02-28 10:49:08,078 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-8-thread-44) [250cf78b] Lock freed to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 10:49:08,087 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-44) [250cf78b] Correlation ID: 250cf78b, Job ID: 569dad00-7099-41c3-871c-69aad2588398, Call Stack: null, Custom Event ID: -1, Message: VM test was started by admin@internal (Host: hosted_engine_2). 2017-02-28 10:49:09,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-26) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 33d5d88a 2017-02-28 10:49:09,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-26) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=-1, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, smartcardEnable=false, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=WaitForLaunch, bootMenuEnable=false, pid=0, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=-1, guestDiskMapping={}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@1c7b669c, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 33d5d88a 2017-02-28 10:49:09,078 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-26) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon} 2017-02-28 10:49:09,079 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-26) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=spice, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, type=graphics} 2017-02-28 10:49:12,198 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from WaitForLaunch --> PoweringUp 2017-02-28 10:49:12,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-81) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 477a28b 2017-02-28 10:49:12,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-81) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, pid=5052, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@4a5055f7, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 477a28b 2017-02-28 10:49:12,207 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 10:49:12,208 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 10:49:24,578 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp--127.0.0.1-8702-7) [3f3b6271] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group CONNECT_TO_VM with role type USER 2017-02-28 10:49:24,618 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8702-7) [3f3b6271] START, SetVmTicketVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, ticket=fPJRki1/57c5, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 48435d39 2017-02-28 10:49:24,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp--127.0.0.1-8702-7) [3f3b6271] FINISH, SetVmTicketVDSCommand, log id: 48435d39 2017-02-28 10:49:24,652 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [3f3b6271] Correlation ID: 3f3b6271, Call Stack: null, Custom Event ID: -1, Message: user admin@internal initiated console session for VM test 2017-02-28 10:49:27,698 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-43) [66693514] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM test. 2017-02-28 10:49:36,825 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from PoweringUp --> Up 2017-02-28 10:49:36,826 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-66) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 5d0abb8f 2017-02-28 10:49:36,831 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-66) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, pid=5052, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={0QEMU_QEMU_HARDDISK_5c159fc6-918c-4efc-9={name=/dev/sda}, QEMU_DVD-ROM={name=/dev/sr0}}, clientIp=76.164.165.5, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@6b9fd901, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 5d0abb8f 2017-02-28 10:49:36,834 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 10:49:36,835 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 10:49:36,893 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) Correlation ID: 250cf78b, Job ID: 569dad00-7099-41c3-871c-69aad2588398, Call Stack: null, Custom Event ID: -1, Message: VM test started on Host hosted_engine_2 2017-02-28 10:50:10,657 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-94) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal got disconnected from VM test. 2017-02-28 10:50:47,673 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-36) [1d3fdc16] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 10:50:47,710 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-36) [1d3fdc16] START, SetVdsStatusVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 2b62b76b 2017-02-28 10:50:47,737 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-36) [1d3fdc16] FINISH, SetVdsStatusVDSCommand, log id: 2b62b76b 2017-02-28 10:50:47,845 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-8-thread-36) [1d3fdc16] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 10:50:47,866 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-8-thread-36) [1d3fdc16] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 50224939 2017-02-28 10:50:47,878 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-8-thread-36) [1d3fdc16] FINISH, SetHaMaintenanceModeVDSCommand, log id: 50224939 2017-02-28 10:50:47,907 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-8-thread-36) [4276974c] Lock Acquired to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 10:50:47,977 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-8-thread-36) [4276974c] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VM 2017-02-28 10:50:48,060 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-8-thread-36) [4276974c] START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, srcHost=node2.dev1.api-digital.com, dstVdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, dstHost=node1.dev1.api-digital.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 677d3734 2017-02-28 10:50:48,082 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-8-thread-36) [4276974c] START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, srcHost=node2.dev1.api-digital.com, dstVdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, dstHost=node1.dev1.api-digital.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 250d194 2017-02-28 10:50:48,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-8-thread-36) [4276974c] FINISH, MigrateBrokerVDSCommand, log id: 250d194 2017-02-28 10:50:48,108 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-8-thread-36) [4276974c] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 677d3734 2017-02-28 10:50:48,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-36) [4276974c] Correlation ID: 1d3fdc16, Job ID: 4ddd20be-a31c-4c6e-bbe0-16e0f782d721, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 was switched to Maintenance mode by admin@internal. 2017-02-28 10:50:51,165 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done 2017-02-28 10:50:54,235 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-28) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done 2017-02-28 10:50:56,722 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-25) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 479c9504 2017-02-28 10:50:56,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-25) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Migration Source, bootMenuEnable=false, pid=5052, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={0QEMU_QEMU_HARDDISK_5c159fc6-918c-4efc-9={name=/dev/sda}, QEMU_DVD-ROM={name=/dev/sr0}}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@78fb5e56, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 479c9504 2017-02-28 10:50:56,731 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 10:50:56,732 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 10:50:57,340 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-22) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done 2017-02-28 10:50:59,893 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-43) [66693514] START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, force=false, secondsToWait=0, gracefully=false, reason=), log id: 1cffa624 2017-02-28 10:51:00,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-43) [66693514] FINISH, DestroyVDSCommand, log id: 1cffa624 2017-02-28 10:51:00,051 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) [66693514] Handing over VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 to Host eb2aea6e-7de9-4a29-86de-1d43f52fc92a. Setting VM to status MigratingTo 2017-02-28 10:51:00,051 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-43) [66693514] VM test (15c5443a-654a-4464-8b28-33d2bdd34ec7) is running in db and not running in VDS hosted_engine_2 2017-02-28 10:51:00,052 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-43) [66693514] START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 7da85dcf 2017-02-28 10:51:00,055 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-43) [66693514] FINISH, FullListVdsCommand, return: [], log id: 7da85dcf 2017-02-28 10:51:00,374 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from MigratingTo --> Up 2017-02-28 10:51:00,374 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-67) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 270c75bd 2017-02-28 10:51:00,380 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-67) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, afterMigrationStatus=, pid=31172, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5902, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, guestDiskMapping={0QEMU_QEMU_HARDDISK_5c159fc6-918c-4efc-9={name=/dev/sda}, QEMU_DVD-ROM={name=/dev/sr0}}, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, copyPasteEnable=true, displayIp=74.51.121.119, displayPort=5901, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@2305df52, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 270c75bd 2017-02-28 10:51:00,383 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {target=1048576, alias=balloon0, specParams={model=none}, deviceType=balloon, device=memballoon, type=balloon} 2017-02-28 10:51:00,384 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5902, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.119, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5901} 2017-02-28 10:51:00,468 WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (DefaultQuartzScheduler_Worker-67) [5db773be] CanDoAction of action ChangeVMCluster failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-28 10:51:00,484 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-67) [5db773be] Correlation ID: 4276974c, Job ID: 4ddd20be-a31c-4c6e-bbe0-16e0f782d721, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test, Source: hosted_engine_2, Destination: hosted_engine_1, Duration: 12 seconds). 2017-02-28 10:51:00,485 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (DefaultQuartzScheduler_Worker-67) [5db773be] Lock freed to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 10:51:03,179 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-31) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 45e4c281-f14f-43d5-8c3c-5664816072ee : hosted_engine_2 2017-02-28 10:51:03,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-25) Clearing cache of pool: 00000002-0002-0002-0002-00000000002b for problematic entities of VDS: hosted_engine_2. 2017-02-28 10:51:03,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-25) Removing vds [45e4c281-f14f-43d5-8c3c-5664816072ee] from the domain in maintenance cache 2017-02-28 10:51:03,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-25) Removing host(s) [45e4c281-f14f-43d5-8c3c-5664816072ee] from hosts unseen domain report cache 2017-02-28 10:51:03,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-31) START, DisconnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, vds_spm_id = 2), log id: 22144120 2017-02-28 10:51:06,897 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, DisconnectStoragePoolVDSCommand, log id: 22144120 2017-02-28 10:51:06,899 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-31) [39f75991] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 10:51:06,949 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-31) [39f75991] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em3, netIfaceName: em3 };{ id: 20970e9e-ba12-44c2-8ba2-54461474dd11, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em4, netIfaceName: em4 };]), log id: 2a96647 2017-02-28 10:51:07,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-31) [39f75991] FINISH, DisconnectStorageServerVDSCommand, return: {20970e9e-ba12-44c2-8ba2-54461474dd11=0, 1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 2a96647 2017-02-28 10:53:44,566 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages 2017-02-28 10:53:44,567 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-28 11:39:19,179 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) [49ac499] Attempting to update VMs/Templates Ovf. 2017-02-28 11:39:19,181 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-35) [28141a80] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 11:39:19,356 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-35) [28141a80] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 11:39:19,377 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [5deb382c] Lock Acquired to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE key: 73b02d61-81d3-46a8-8adf-2aca489de3f5 value: DISK key: be6592f3-9887-47e6-94ca-739a57ef9935 value: DISK , sharedLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE ] 2017-02-28 11:39:19,382 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [5deb382c] Running command: ProcessOvfUpdateForStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 11:39:19,404 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [5deb382c] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = be6592f3-9887-47e6-94ca-739a57ef9935, imageId = c942c959-6d41-45c5-acd8-248138e00ccb), log id: 4649bae2 2017-02-28 11:39:19,406 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [5deb382c] -- executeIrsBrokerCommand: calling 'setVolumeDescription' 2017-02-28 11:39:19,406 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [5deb382c] -- setVolumeDescription parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGroupGUID=be6592f3-9887-47e6-94ca-739a57ef9935 volUUID=c942c959-6d41-45c5-acd8-248138e00ccb description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"831fd677-2894-48e7-8a0d-fd5c084a08e6"}],"Last Updated":"Mon Feb 27 15:47:08 CST 2017"} 2017-02-28 11:39:19,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [5deb382c] FINISH, SetVolumeDescriptionVDSCommand, log id: 4649bae2 2017-02-28 11:39:19,576 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS_EXECUTION ] 2017-02-28 11:39:19,589 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] Running command: UploadStreamCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 11:39:19,609 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] START, UploadStreamVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 547b43d7 2017-02-28 11:39:19,610 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] -- executeVdsBrokerCommand: 2017-02-28 11:39:19,610 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] -- parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGUID=be6592f3-9887-47e6-94ca-739a57ef9935 volUUID=c942c959-6d41-45c5-acd8-248138e00ccb size=30,720 2017-02-28 11:39:20,177 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] FINISH, UploadStreamVDSCommand, log id: 547b43d7 2017-02-28 11:39:20,178 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-35) [1c9aad31] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 503357fe-8b2a-45bd-9b81-fb30705f7d18 2017-02-28 11:39:20,179 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) [1c9aad31] CommandMultiAsyncTasks::AttachTask: Attaching task b547b9b0-63f4-4a3a-a241-1f8c75f55d4b to command 503357fe-8b2a-45bd-9b81-fb30705f7d18. 2017-02-28 11:39:20,219 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) [1c9aad31] Adding task b547b9b0-63f4-4a3a-a241-1f8c75f55d4b (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-28 11:39:20,237 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS_EXECUTION ] 2017-02-28 11:39:20,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = be6592f3-9887-47e6-94ca-739a57ef9935, imageId = c942c959-6d41-45c5-acd8-248138e00ccb), log id: 40073b4c 2017-02-28 11:39:20,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] -- executeIrsBrokerCommand: calling 'setVolumeDescription' 2017-02-28 11:39:20,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] -- setVolumeDescription parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGroupGUID=be6592f3-9887-47e6-94ca-739a57ef9935 volUUID=c942c959-6d41-45c5-acd8-248138e00ccb description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"831fd677-2894-48e7-8a0d-fd5c084a08e6"}],"Last Updated":"Tue Feb 28 11:39:19 CST 2017","Size":30720} 2017-02-28 11:39:20,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] FINISH, SetVolumeDescriptionVDSCommand, log id: 40073b4c 2017-02-28 11:39:20,369 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 73b02d61-81d3-46a8-8adf-2aca489de3f5, imageId = 18a3de2e-bec2-4ffd-98a8-1d371c6e651a), log id: 1a1121a6 2017-02-28 11:39:20,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] -- executeIrsBrokerCommand: calling 'setVolumeDescription' 2017-02-28 11:39:20,370 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] -- setVolumeDescription parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGroupGUID=73b02d61-81d3-46a8-8adf-2aca489de3f5 volUUID=18a3de2e-bec2-4ffd-98a8-1d371c6e651a description={"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"831fd677-2894-48e7-8a0d-fd5c084a08e6"}],"Last Updated":"Mon Feb 27 15:47:08 CST 2017"} 2017-02-28 11:39:20,462 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [1c9aad31] FINISH, SetVolumeDescriptionVDSCommand, log id: 1a1121a6 2017-02-28 11:39:20,506 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS_EXECUTION ] 2017-02-28 11:39:20,514 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] Running command: UploadStreamCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 11:39:20,533 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] START, UploadStreamVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 600ccc50 2017-02-28 11:39:20,534 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] -- executeVdsBrokerCommand: 2017-02-28 11:39:20,534 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] -- parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGUID=73b02d61-81d3-46a8-8adf-2aca489de3f5 volUUID=18a3de2e-bec2-4ffd-98a8-1d371c6e651a size=30,720 2017-02-28 11:39:21,148 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] FINISH, UploadStreamVDSCommand, log id: 600ccc50 2017-02-28 11:39:21,149 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-35) [665e5ffe] CommandMultiAsyncTasks::AttachTask: Attaching task 11ebac94-64f3-4a53-8a6e-7c4a114b18fc to command 503357fe-8b2a-45bd-9b81-fb30705f7d18. 2017-02-28 11:39:21,224 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-35) [665e5ffe] Adding task 11ebac94-64f3-4a53-8a6e-7c4a114b18fc (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2017-02-28 11:39:21,239 INFO [org.ovirt.engine.core.bll.UploadStreamCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS_EXECUTION ] 2017-02-28 11:39:21,241 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] START, SetVolumeDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, storageDomainId = 831fd677-2894-48e7-8a0d-fd5c084a08e6, imageGroupId = 73b02d61-81d3-46a8-8adf-2aca489de3f5, imageId = 18a3de2e-bec2-4ffd-98a8-1d371c6e651a), log id: 7c478dd6 2017-02-28 11:39:21,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] -- executeIrsBrokerCommand: calling 'setVolumeDescription' 2017-02-28 11:39:21,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] -- setVolumeDescription parameters: spUUID=00000002-0002-0002-0002-00000000002b sdUUID=831fd677-2894-48e7-8a0d-fd5c084a08e6 imageGroupGUID=73b02d61-81d3-46a8-8adf-2aca489de3f5 volUUID=18a3de2e-bec2-4ffd-98a8-1d371c6e651a description={"Updated":true,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"831fd677-2894-48e7-8a0d-fd5c084a08e6"}],"Last Updated":"Tue Feb 28 11:39:19 CST 2017","Size":30720} 2017-02-28 11:39:21,351 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] FINISH, SetVolumeDescriptionVDSCommand, log id: 7c478dd6 2017-02-28 11:39:21,375 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [665e5ffe] BaseAsyncTask::startPollingTask: Starting to poll task b547b9b0-63f4-4a3a-a241-1f8c75f55d4b. 2017-02-28 11:39:21,376 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-35) [665e5ffe] BaseAsyncTask::startPollingTask: Starting to poll task 11ebac94-64f3-4a53-8a6e-7c4a114b18fc. 2017-02-28 11:39:21,376 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (DefaultQuartzScheduler_Worker-35) [665e5ffe] Lock freed to object EngineLock [exclusiveLocks= key: 831fd677-2894-48e7-8a0d-fd5c084a08e6 value: STORAGE key: 73b02d61-81d3-46a8-8adf-2aca489de3f5 value: DISK key: be6592f3-9887-47e6-94ca-739a57ef9935 value: DISK , sharedLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE ] 2017-02-28 11:39:26,608 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-22) Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now 2017-02-28 11:39:26,620 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-22) Failed in HSMGetAllTasksStatusesVDS method 2017-02-28 11:39:26,640 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-22) Failed in HSMGetAllTasksStatusesVDS method 2017-02-28 11:39:26,640 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) SPMAsyncTask::PollTask: Polling task 11ebac94-64f3-4a53-8a6e-7c4a114b18fc (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'cleanSuccess'. 2017-02-28 11:39:26,641 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::logEndTaskFailure: Task 11ebac94-64f3-4a53-8a6e-7c4a114b18fc (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: -- Result: cleanSuccess -- Message: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Logical Volume extend failed, code = 554, -- Exception: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Logical Volume extend failed, code = 554 2017-02-28 11:39:26,642 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-22) Task with DB Task ID ecdd11ed-2c1a-4c27-a521-4f00215ff3a6 and VDSM Task ID b547b9b0-63f4-4a3a-a241-1f8c75f55d4b is in state Polling. End action for command 503357fe-8b2a-45bd-9b81-fb30705f7d18 will proceed when all the entitys tasks are completed. 2017-02-28 11:39:26,643 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) SPMAsyncTask::PollTask: Polling task b547b9b0-63f4-4a3a-a241-1f8c75f55d4b (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'cleanSuccess'. 2017-02-28 11:39:26,643 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-22) BaseAsyncTask::logEndTaskFailure: Task b547b9b0-63f4-4a3a-a241-1f8c75f55d4b (Parent Command ProcessOvfUpdateForStorageDomain, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure: -- Result: cleanSuccess -- Message: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Logical Volume extend failed, code = 554, -- Exception: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Logical Volume extend failed, code = 554 2017-02-28 11:39:26,645 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-22) CommandAsyncTask::endActionIfNecessary: All tasks of command 503357fe-8b2a-45bd-9b81-fb30705f7d18 has ended -> executing endAction 2017-02-28 11:39:26,645 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-22) CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 503357fe-8b2a-45bd-9b81-fb30705f7d18): calling endAction . 2017-02-28 11:39:26,646 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction ProcessOvfUpdateForStorageDomain, executionIndex: 0 2017-02-28 11:39:26,661 ERROR [org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] Ending command with failure: org.ovirt.engine.core.bll.ProcessOvfUpdateForStorageDomainCommand 2017-02-28 11:39:26,662 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) [5deb382c] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain completed, handling the result. 2017-02-28 11:39:26,663 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) [5deb382c] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type ProcessOvfUpdateForStorageDomain succeeded, clearing tasks. 2017-02-28 11:39:26,663 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) [5deb382c] SPMAsyncTask::ClearAsyncTask: Attempting to clear task 11ebac94-64f3-4a53-8a6e-7c4a114b18fc 2017-02-28 11:39:26,664 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = 11ebac94-64f3-4a53-8a6e-7c4a114b18fc), log id: e38fe1f 2017-02-28 11:39:26,685 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=11ebac94-64f3-4a53-8a6e-7c4a114b18fc), log id: 3fb3ac84 2017-02-28 11:39:26,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] FINISH, HSMClearTaskVDSCommand, log id: 3fb3ac84 2017-02-28 11:39:26,698 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] FINISH, SPMClearTaskVDSCommand, log id: e38fe1f 2017-02-28 11:39:26,706 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) [5deb382c] BaseAsyncTask::removeTaskFromDB: Removed task 11ebac94-64f3-4a53-8a6e-7c4a114b18fc from DataBase 2017-02-28 11:39:26,707 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) [5deb382c] SPMAsyncTask::ClearAsyncTask: Attempting to clear task b547b9b0-63f4-4a3a-a241-1f8c75f55d4b 2017-02-28 11:39:26,707 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, taskId = b547b9b0-63f4-4a3a-a241-1f8c75f55d4b), log id: 77547c86 2017-02-28 11:39:26,727 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=b547b9b0-63f4-4a3a-a241-1f8c75f55d4b), log id: 4bbb7e9e 2017-02-28 11:39:26,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] FINISH, HSMClearTaskVDSCommand, log id: 4bbb7e9e 2017-02-28 11:39:26,738 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-12) [5deb382c] FINISH, SPMClearTaskVDSCommand, log id: 77547c86 2017-02-28 11:39:26,746 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) [5deb382c] BaseAsyncTask::removeTaskFromDB: Removed task b547b9b0-63f4-4a3a-a241-1f8c75f55d4b from DataBase 2017-02-28 11:39:26,747 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) [5deb382c] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 503357fe-8b2a-45bd-9b81-fb30705f7d18 2017-02-28 11:40:48,613 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-73) Setting new tasks map. The map contains now 0 tasks 2017-02-28 11:40:48,613 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-73) Cleared all tasks of pool 00000002-0002-0002-0002-00000000002b. 2017-02-28 12:05:13,743 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8702-24) [47a94273] Lock Acquired to object EngineLock [exclusiveLocks= key: 45e4c281-f14f-43d5-8c3c-5664816072ee value: VDS , sharedLocks= ] 2017-02-28 12:05:13,798 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-6) [47a94273] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 12:05:13,800 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-6) [47a94273] Before acquiring lock in order to prevent monitoring for host hosted_engine_2 from data-center Default 2017-02-28 12:05:13,801 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-6) [47a94273] Lock acquired, from now a monitoring of host will be skipped for host hosted_engine_2 from data-center Default 2017-02-28 12:05:13,822 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-6) [47a94273] START, SetVdsStatusVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7696735c 2017-02-28 12:05:13,850 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-6) [47a94273] FINISH, SetVdsStatusVDSCommand, log id: 7696735c 2017-02-28 12:05:14,046 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-8-thread-6) START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 5b5f0e42 2017-02-28 12:05:14,048 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 12:05:14,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-8-thread-6) FINISH, SetHaMaintenanceModeVDSCommand, log id: 5b5f0e42 2017-02-28 12:05:14,123 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-6) Activate finished. Lock released. Monitoring can run now for host hosted_engine_2 from data-center Default 2017-02-28 12:05:14,145 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-6) Correlation ID: 47a94273, Job ID: 188ccba3-2f47-4500-a1f4-8677d2259690, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 was activated by admin@internal. 2017-02-28 12:05:14,154 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-6) Lock freed to object EngineLock [exclusiveLocks= key: 45e4c281-f14f-43d5-8c3c-5664816072ee value: VDS , sharedLocks= ] 2017-02-28 12:05:16,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]), log id: 35b263a5 2017-02-28 12:05:16,501 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GetHardwareInfoVDSCommand, log id: 35b263a5 2017-02-28 12:05:16,567 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-83) [795b28df] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 12:05:16,594 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-83) [7c5f9960] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 12:05:16,604 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 12:05:16,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em3, netIfaceName: em3 };{ id: 64a1486d-d24f-460b-bb77-5cc5a11b30de, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em4, netIfaceName: em4 };]), log id: 4ce33c57 2017-02-28 12:05:17,237 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] FINISH, ConnectStorageServerVDSCommand, return: {64a1486d-d24f-460b-bb77-5cc5a11b30de=0, 1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 4ce33c57 2017-02-28 12:05:17,238 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] Host hosted_engine_2 storage connection was succeeded 2017-02-28 12:05:17,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-3) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 4f91f48d 2017-02-28 12:05:17,706 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-3) FINISH, ConnectStoragePoolVDSCommand, log id: 4f91f48d 2017-02-28 12:05:17,866 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 from cluster Default was chosen as a proxy to execute Status command on Host hosted_engine_2. 2017-02-28 12:05:17,867 INFO [org.ovirt.engine.core.bll.FenceExecutor] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] Using Host hosted_engine_1 from cluster Default as proxy to execute Status command on Host hosted_engine_2 2017-02-28 12:05:17,889 INFO [org.ovirt.engine.core.bll.FenceExecutor] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] Executing Power Management command, Proxy Host:hosted_engine_1, Agent:ipmilan, Target Host:hosted_engine_2, Management IP:74.51.121.120, User:root, Options:lanplus=1, Fencing policy:null 2017-02-28 12:05:17,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] START, FenceVdsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, targetVdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, action = Status, ip = 74.51.121.120, port = , type = ipmilan, user = root, password = ******, options = 'lanplus=1', policy = 'null'), log id: 6c91b79 2017-02-28 12:05:18,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] FINISH, FenceVdsVDSCommand, return: Test Succeeded, on, log id: 6c91b79 2017-02-28 12:05:18,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 77b85703 2017-02-28 12:05:18,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] FINISH, SetMOMPolicyParametersVDSCommand, log id: 77b85703 2017-02-28 12:05:18,460 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host hosted_engine_2 was set to Up. 2017-02-28 12:05:18,468 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) [1c4a3aff] Correlation ID: 7c5f9960, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 power management was verified successfully. 2017-02-28 12:05:18,519 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-83) [56be449b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 12:06:25,509 INFO [org.ovirt.engine.core.bll.ForceSelectSPMCommand] (ajp--127.0.0.1-8702-11) [59e0288] Running command: ForceSelectSPMCommand internal: false. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 12:06:25,510 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (ajp--127.0.0.1-8702-11) [59e0288] START, SpmStopOnIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 44a374c3 2017-02-28 12:06:25,511 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (ajp--127.0.0.1-8702-11) [59e0288] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, ignoreStopFailed = false), log id: 4746d169 2017-02-28 12:06:25,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (ajp--127.0.0.1-8702-11) [59e0288] START, SpmStopVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b), log id: 7d5d2f07 2017-02-28 12:06:25,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (ajp--127.0.0.1-8702-11) [59e0288] SpmStopVDSCommand::Stopping SPM on vds hosted_engine_1, pool id 00000002-0002-0002-0002-00000000002b 2017-02-28 12:06:25,688 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (ajp--127.0.0.1-8702-11) [59e0288] FINISH, SpmStopVDSCommand, log id: 7d5d2f07 2017-02-28 12:06:25,702 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (ajp--127.0.0.1-8702-11) [59e0288] FINISH, ResetIrsVDSCommand, log id: 4746d169 2017-02-28 12:06:25,703 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (ajp--127.0.0.1-8702-11) [59e0288] FINISH, SpmStopOnIrsVDSCommand, log id: 44a374c3 2017-02-28 12:06:25,710 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-11) [59e0288] Correlation ID: 59e0288, Job ID: c7944ee1-159d-4642-832d-89dbe8728d9a, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 was force selected by admin@internal 2017-02-28 12:06:34,960 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 12:06:34,962 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-55) [d6d05d7] Storage Pool 00000002-0002-0002-0002-00000000002b - Updating Storage Domain 831fd677-2894-48e7-8a0d-fd5c084a08e6 status from Active to Unknown, reason : null 2017-02-28 12:06:34,980 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-55) [d6d05d7] Correlation ID: d6d05d7, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. 2017-02-28 12:06:35,051 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 402086d3 2017-02-28 12:06:35,396 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] FINISH, ConnectStoragePoolVDSCommand, log id: 402086d3 2017-02-28 12:06:35,416 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-55) [d6d05d7] hostFromVds::selectedVds - hosted_engine_2, spmStatus Free, storage pool Default, storage pool version 3.5 2017-02-28 12:06:35,439 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-55) [d6d05d7] starting spm on vds hosted_engine_2, storage pool Default, prevId -1, LVER -1 2017-02-28 12:06:35,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] START, SpmStartVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 75171aee 2017-02-28 12:06:35,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] spmStart polling started: taskId = 5516fdb6-d879-4945-bc7e-1329841630c4 2017-02-28 12:06:36,478 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] spmStart polling ended: taskId = 5516fdb6-d879-4945-bc7e-1329841630c4 task status = finished 2017-02-28 12:06:36,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] spmStart polling ended, spm status: SPM 2017-02-28 12:06:36,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] START, HSMClearTaskVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, taskId=5516fdb6-d879-4945-bc7e-1329841630c4), log id: 34954051 2017-02-28 12:06:36,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] FINISH, HSMClearTaskVDSCommand, log id: 34954051 2017-02-28 12:06:36,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-55) [d6d05d7] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@544946d2, log id: 75171aee 2017-02-28 12:06:36,559 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-55) [d6d05d7] Initialize Irs proxy from vds: node2.dev1.api-digital.com 2017-02-28 12:06:36,587 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-55) [d6d05d7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_2 (Address: node2.dev1.api-digital.com). 2017-02-28 12:06:36,592 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) [d6d05d7] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 44887e6e 2017-02-28 12:06:36,592 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 12:06:36,704 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-5) [b330959] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 12:06:36,709 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) [d6d05d7] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-00000000002b 2017-02-28 12:06:36,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) [d6d05d7] START, HSMGetAllTasksInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 81a2188 2017-02-28 12:06:36,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) [d6d05d7] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 81a2188 2017-02-28 12:06:36,736 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-40) [d6d05d7] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 44887e6e 2017-02-28 12:06:36,737 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-40) [d6d05d7] Discovered no tasks on Storage Pool Default 2017-02-28 12:06:36,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-5) [b330959] START, GetVGInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, VGID=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq), log id: 403817bc 2017-02-28 12:06:36,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-5) [b330959] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, storageDomainName=null]], log id: 403817bc 2017-02-28 12:06:57,322 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp--127.0.0.1-8702-34) [338655b8] Lock Acquired to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 12:06:57,496 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-8-thread-4) [338655b8] Running command: MigrateVmCommand internal: false. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group MIGRATE_VM with role type USER 2017-02-28 12:06:57,618 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-8-thread-4) [338655b8] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, srcHost=node1.dev1.api-digital.com, dstVdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, dstHost=node2.dev1.api-digital.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 244e87ab 2017-02-28 12:06:57,651 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-8-thread-4) [338655b8] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, srcHost=node1.dev1.api-digital.com, dstVdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, dstHost=node2.dev1.api-digital.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 17c3f862 2017-02-28 12:06:57,667 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-8-thread-4) [338655b8] FINISH, MigrateBrokerVDSCommand, log id: 17c3f862 2017-02-28 12:06:57,683 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-8-thread-4) [338655b8] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 244e87ab 2017-02-28 12:06:57,690 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-4) [338655b8] Correlation ID: 338655b8, Job ID: 42cd4a05-1070-4338-9e3f-be4e1c48e957, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: test, Source: hosted_engine_1, Destination: hosted_engine_2, User: admin@internal). 2017-02-28 12:06:59,018 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:02,049 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:05,118 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-19) [71e491b3] RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:08,210 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-22) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:11,252 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:13,950 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-39) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, force=false, secondsToWait=0, gracefully=false, reason=), log id: 4229628f 2017-02-28 12:07:14,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-48) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: daf5dac 2017-02-28 12:07:14,297 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-48) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, afterMigrationStatus=, pid=5023, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, smartcardEnable=false, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@742ece38, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: daf5dac 2017-02-28 12:07:14,300 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {target=1048576, alias=balloon0, specParams={model=none}, deviceType=balloon, device=memballoon, type=balloon} 2017-02-28 12:07:14,301 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 12:07:14,375 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-48) Correlation ID: 338655b8, Job ID: 42cd4a05-1070-4338-9e3f-be4e1c48e957, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 16 seconds). 2017-02-28 12:07:14,383 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-48) Lock freed to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 12:07:14,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, DestroyVDSCommand, log id: 4229628f 2017-02-28 12:07:14,502 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) Handing over VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 to Host 45e4c281-f14f-43d5-8c3c-5664816072ee. Setting VM to status MigratingTo 2017-02-28 12:07:14,503 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) VM test (15c5443a-654a-4464-8b28-33d2bdd34ec7) is running in db and not running in VDS hosted_engine_1 2017-02-28 12:07:14,503 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 7ef659ae 2017-02-28 12:07:14,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-39) FINISH, FullListVdsCommand, return: [], log id: 7ef659ae 2017-02-28 12:07:17,415 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from MigratingTo --> Up 2017-02-28 12:07:17,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-40) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 5e21f55 2017-02-28 12:07:17,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-40) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, afterMigrationStatus=, pid=5023, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, smartcardEnable=false, custom={}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={0QEMU_QEMU_HARDDISK_5c159fc6-918c-4efc-9={name=/dev/sda}, QEMU_DVD-ROM={name=/dev/sr0}}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@40770877, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 5e21f55 2017-02-28 12:07:17,425 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {target=1048576, alias=balloon0, specParams={model=none}, deviceType=balloon, device=memballoon, type=balloon} 2017-02-28 12:07:17,426 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 12:07:33,162 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp--127.0.0.1-8702-30) [4b0c6fbc] Lock Acquired to object EngineLock [exclusiveLocks= key: 4a035efd-a041-4e46-84db-01cf79400913 value: VM , sharedLocks= ] 2017-02-28 12:07:33,276 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-8-thread-44) [4b0c6fbc] Running command: MigrateVmCommand internal: false. Entities affected : ID: 4a035efd-a041-4e46-84db-01cf79400913 Type: VMAction group MIGRATE_VM with role type USER 2017-02-28 12:07:33,431 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-8-thread-44) [4b0c6fbc] START, MigrateVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vmId=4a035efd-a041-4e46-84db-01cf79400913, srcHost=node1.dev1.api-digital.com, dstVdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, dstHost=node2.dev1.api-digital.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 41ec7100 2017-02-28 12:07:33,451 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-8-thread-44) [4b0c6fbc] START, MigrateBrokerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vmId=4a035efd-a041-4e46-84db-01cf79400913, srcHost=node1.dev1.api-digital.com, dstVdsId=45e4c281-f14f-43d5-8c3c-5664816072ee, dstHost=node2.dev1.api-digital.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 2bfc11af 2017-02-28 12:07:33,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-8-thread-44) [4b0c6fbc] FINISH, MigrateBrokerVDSCommand, log id: 2bfc11af 2017-02-28 12:07:33,468 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-8-thread-44) [4b0c6fbc] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 41ec7100 2017-02-28 12:07:33,482 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-44) [4b0c6fbc] Correlation ID: 4b0c6fbc, Job ID: 235e0ec2-faa3-4a6f-81a1-b88a52f05d1f, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: HostedEngine, Source: hosted_engine_1, Destination: hosted_engine_2, User: admin@internal). 2017-02-28 12:07:35,925 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-74) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:35,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-92) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: 4cb0efb2 2017-02-28 12:07:35,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-92) FINISH, FullListVdsCommand, return: [{status=Migration Source, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=24566, clientIp=, devices=[Ljava.lang.Object;@7448b673, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4cb0efb2 2017-02-28 12:07:35,944 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) Received a console Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {alias=console0, specParams={}, deviceType=console, deviceId=aa0b7357-8cdd-410d-8119-97fb727670eb, device=console, type=console} 2017-02-28 12:07:35,945 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) Received a memballoon Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 12:07:35,946 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) Received a vnc Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=vnc, specParams={spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, displayIp=0}, deviceType=graphics, type=graphics, port=5900} 2017-02-28 12:07:35,948 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) Empty or NULL values were passed for a VM 4a035efd-a041-4e46-84db-01cf79400913 device, Device is skipped 2017-02-28 12:07:35,948 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=63fecc05-bc31-4113-829e-c8d2588ca6cb, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:07:35,950 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=a8c31e80-8de1-47a1-8628-ca1f19267a76, device=cdrom, type=DISK, bootOrder=0, specParams={path=}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:07:35,951 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=df179798-d691-420d-8293-3582a8aaf74c, device=ich6, type=SOUND, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:07:35,953 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=eab19219-d581-4bb4-99de-6cc5afa8c700, device=qxl, type=VIDEO, bootOrder=0, specParams={vram=32768, heads=1}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:07:35,954 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-92) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=edddf45e-2c79-4c00-9dd5-8a46974c1d08, device=virtio-scsi, type=CONTROLLER, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:07:39,139 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-90) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:42,174 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-82) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:45,207 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:48,242 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) [6d5a702e] RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:51,324 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-27) [39bd0986] RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:54,459 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:07:57,495 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:00,532 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:03,566 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:06,642 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-58) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:09,765 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-55) [d6d05d7] RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:12,799 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-72) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:15,839 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-9) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:18,875 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-77) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:21,959 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-21) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:25,078 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-79) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:28,113 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:31,151 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-95) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:34,186 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-18) [6d5a702e] RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:37,268 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-28) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:40,378 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:43,424 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:46,460 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:49,495 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:52,571 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-58) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:55,679 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-1) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:08:58,714 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:09:01,750 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-9) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:09:04,787 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:09:07,864 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-78) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:09:10,989 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-8) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:09:14,022 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 is migrating to vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 12:09:16,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-98) START, DestroyVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vmId=4a035efd-a041-4e46-84db-01cf79400913, force=false, secondsToWait=0, gracefully=false, reason=), log id: 57375ab5 2017-02-28 12:09:17,054 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-99) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: 70c370c 2017-02-28 12:09:17,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-99) FINISH, FullListVdsCommand, return: [{status=Up, nicModel=rtl8139,pv, kvmEnable=true, emulatedMachine=pc, afterMigrationStatus=, pid=5604, vmId=4a035efd-a041-4e46-84db-01cf79400913, devices=[Ljava.lang.Object;@32f1f871, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5902, cpuType=Westmere, clientIp=, smp=2, vmName=HostedEngine, display=vnc}], log id: 70c370c 2017-02-28 12:09:17,061 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) Received a console Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {alias=console0, specParams={}, deviceType=console, deviceId=aa0b7357-8cdd-410d-8119-97fb727670eb, device=console, type=console} 2017-02-28 12:09:17,062 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) Received a memballoon Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {target=8388608, alias=balloon0, specParams={model=none}, deviceType=balloon, device=memballoon, type=balloon} 2017-02-28 12:09:17,063 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) Empty or NULL values were passed for a VM 4a035efd-a041-4e46-84db-01cf79400913 device, Device is skipped 2017-02-28 12:09:17,063 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) Received a vnc Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=vnc, specParams={spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, displayIp=0}, deviceType=graphics, type=graphics, port=5902} 2017-02-28 12:09:17,064 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=63fecc05-bc31-4113-829e-c8d2588ca6cb, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:17,065 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=a8c31e80-8de1-47a1-8628-ca1f19267a76, device=cdrom, type=DISK, bootOrder=0, specParams={path=}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:17,066 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=df179798-d691-420d-8293-3582a8aaf74c, device=ich6, type=SOUND, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:17,067 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=eab19219-d581-4bb4-99de-6cc5afa8c700, device=qxl, type=VIDEO, bootOrder=0, specParams={vram=32768, heads=1}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:17,068 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=edddf45e-2c79-4c00-9dd5-8a46974c1d08, device=virtio-scsi, type=CONTROLLER, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:17,164 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-99) Correlation ID: 4b0c6fbc, Job ID: 235e0ec2-faa3-4a6f-81a1-b88a52f05d1f, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: HostedEngine, Source: hosted_engine_1, Destination: hosted_engine_2, Duration: 1 minute 43 seconds). 2017-02-28 12:09:17,172 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-99) Lock freed to object EngineLock [exclusiveLocks= key: 4a035efd-a041-4e46-84db-01cf79400913 value: VM , sharedLocks= ] 2017-02-28 12:09:17,385 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, DestroyVDSCommand, log id: 57375ab5 2017-02-28 12:09:17,405 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Handing over VM HostedEngine 4a035efd-a041-4e46-84db-01cf79400913 to Host 45e4c281-f14f-43d5-8c3c-5664816072ee. Setting VM to status MigratingTo 2017-02-28 12:09:17,405 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) VM HostedEngine (4a035efd-a041-4e46-84db-01cf79400913) is running in db and not running in VDS hosted_engine_1 2017-02-28 12:09:17,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: 5be9598e 2017-02-28 12:09:17,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) FINISH, FullListVdsCommand, return: [], log id: 5be9598e 2017-02-28 12:09:20,201 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) VM HostedEngine 4a035efd-a041-4e46-84db-01cf79400913 moved from MigratingTo --> Up 2017-02-28 12:09:20,201 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-56) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: 31106405 2017-02-28 12:09:20,206 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-56) FINISH, FullListVdsCommand, return: [{status=Up, nicModel=rtl8139,pv, kvmEnable=true, emulatedMachine=pc, afterMigrationStatus=, pid=5604, vmId=4a035efd-a041-4e46-84db-01cf79400913, devices=[Ljava.lang.Object;@2b169d6d, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5902, cpuType=Westmere, clientIp=, smp=2, vmName=HostedEngine, display=vnc}], log id: 31106405 2017-02-28 12:09:20,229 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) Received a console Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {alias=console0, specParams={}, deviceType=console, deviceId=aa0b7357-8cdd-410d-8119-97fb727670eb, device=console, type=console} 2017-02-28 12:09:20,235 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) Received a memballoon Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {target=8388608, alias=balloon0, specParams={model=none}, deviceType=balloon, device=memballoon, type=balloon} 2017-02-28 12:09:20,236 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) Empty or NULL values were passed for a VM 4a035efd-a041-4e46-84db-01cf79400913 device, Device is skipped 2017-02-28 12:09:20,237 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) Received a vnc Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=vnc, specParams={spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, displayIp=0}, deviceType=graphics, type=graphics, port=5902} 2017-02-28 12:09:20,238 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=63fecc05-bc31-4113-829e-c8d2588ca6cb, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:20,239 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=a8c31e80-8de1-47a1-8628-ca1f19267a76, device=cdrom, type=DISK, bootOrder=0, specParams={path=}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:20,240 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=df179798-d691-420d-8293-3582a8aaf74c, device=ich6, type=SOUND, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:20,241 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=eab19219-d581-4bb4-99de-6cc5afa8c700, device=qxl, type=VIDEO, bootOrder=0, specParams={vram=32768, heads=1}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:09:20,242 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-56) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=edddf45e-2c79-4c00-9dd5-8a46974c1d08, device=virtio-scsi, type=CONTROLLER, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:12:29,440 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-8-thread-46) [351d0dc2] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 12:12:29,459 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-46) [351d0dc2] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 7003885e 2017-02-28 12:12:29,480 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-46) [351d0dc2] FINISH, SetVdsStatusVDSCommand, log id: 7003885e 2017-02-28 12:12:29,567 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-8-thread-46) [351d0dc2] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-28 12:12:29,602 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-8-thread-46) [351d0dc2] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 2c8837a9 2017-02-28 12:12:29,608 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-8-thread-46) [351d0dc2] FINISH, SetHaMaintenanceModeVDSCommand, log id: 2c8837a9 2017-02-28 12:12:29,616 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-46) [351d0dc2] Correlation ID: 351d0dc2, Job ID: 401f07f8-b979-41b3-ab36-76345a2203f8, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was switched to Maintenance mode by admin@internal. 2017-02-28 12:12:32,420 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-23) [31b27b72] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = eb2aea6e-7de9-4a29-86de-1d43f52fc92a : hosted_engine_1 2017-02-28 12:12:32,480 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-16) Clearing cache of pool: 00000002-0002-0002-0002-00000000002b for problematic entities of VDS: hosted_engine_1. 2017-02-28 12:12:32,481 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-16) Removing vds [eb2aea6e-7de9-4a29-86de-1d43f52fc92a] from the domain in maintenance cache 2017-02-28 12:12:32,481 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-16) Removing host(s) [eb2aea6e-7de9-4a29-86de-1d43f52fc92a] from hosts unseen domain report cache 2017-02-28 12:12:32,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-23) [31b27b72] START, DisconnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, vds_spm_id = 1), log id: 1455a99a 2017-02-28 12:12:36,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-23) [31b27b72] FINISH, DisconnectStoragePoolVDSCommand, log id: 1455a99a 2017-02-28 12:12:36,962 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-23) [28ae70bd] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 12:12:37,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-23) [28ae70bd] START, DisconnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em3, netIfaceName: em3 };{ id: 5a520b10-b9bd-4f56-8e58-342b9aeaff87, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em4, netIfaceName: em4 };]), log id: 29954271 2017-02-28 12:12:37,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-23) [28ae70bd] FINISH, DisconnectStorageServerVDSCommand, return: {5a520b10-b9bd-4f56-8e58-342b9aeaff87=0, 1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 29954271 2017-02-28 12:14:50,414 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) Unable to process messages 2017-02-28 12:14:50,415 WARN [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) Exception thrown during message processing 2017-02-28 12:26:40,233 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp--127.0.0.1-8702-3) [430ca598] Lock Acquired to object EngineLock [exclusiveLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS , sharedLocks= ] 2017-02-28 12:26:40,290 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-3) [430ca598] Running command: ActivateVdsCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 12:26:40,290 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-3) [430ca598] Before acquiring lock in order to prevent monitoring for host hosted_engine_1 from data-center Default 2017-02-28 12:26:40,291 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-3) [430ca598] Lock acquired, from now a monitoring of host will be skipped for host hosted_engine_1 from data-center Default 2017-02-28 12:26:40,321 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-3) [430ca598] START, SetVdsStatusVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 50ab36a4 2017-02-28 12:26:40,329 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-3) [430ca598] FINISH, SetVdsStatusVDSCommand, log id: 50ab36a4 2017-02-28 12:26:40,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-8-thread-3) START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 4621b63 2017-02-28 12:26:40,502 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 12:26:40,577 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (org.ovirt.thread.pool-8-thread-3) FINISH, SetHaMaintenanceModeVDSCommand, log id: 4621b63 2017-02-28 12:26:40,577 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-3) Activate finished. Lock released. Monitoring can run now for host hosted_engine_1 from data-center Default 2017-02-28 12:26:40,604 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-3) Correlation ID: 430ca598, Job ID: 02f1af51-3c7c-4a30-ac0e-c276272e8116, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 was activated by admin@internal. 2017-02-28 12:26:40,612 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-8-thread-3) Lock freed to object EngineLock [exclusiveLocks= key: eb2aea6e-7de9-4a29-86de-1d43f52fc92a value: VDS , sharedLocks= ] 2017-02-28 12:26:42,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]), log id: 9a4733c 2017-02-28 12:26:42,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GetHardwareInfoVDSCommand, log id: 9a4733c 2017-02-28 12:26:42,786 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-91) [35d893c1] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-28 12:26:42,814 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-91) [7d3aac8b] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 12:26:42,828 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 12:26:42,875 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em3, netIfaceName: em3 };{ id: 9ff1f8ba-e6a6-4782-8d2a-e54e8dbef943, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em4, netIfaceName: em4 };]), log id: 32f2418d 2017-02-28 12:26:43,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] FINISH, ConnectStorageServerVDSCommand, return: {9ff1f8ba-e6a6-4782-8d2a-e54e8dbef943=0, 1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 32f2418d 2017-02-28 12:26:43,321 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] Host hosted_engine_1 storage connection was succeeded 2017-02-28 12:26:43,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-28) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 2d2af568 2017-02-28 12:26:43,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-28) FINISH, ConnectStoragePoolVDSCommand, log id: 2d2af568 2017-02-28 12:26:43,878 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 from cluster Default was chosen as a proxy to execute Status command on Host hosted_engine_1. 2017-02-28 12:26:43,879 INFO [org.ovirt.engine.core.bll.FenceExecutor] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] Using Host hosted_engine_2 from cluster Default as proxy to execute Status command on Host hosted_engine_1 2017-02-28 12:26:43,903 INFO [org.ovirt.engine.core.bll.FenceExecutor] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] Executing Power Management command, Proxy Host:hosted_engine_2, Agent:ipmilan, Target Host:hosted_engine_1, Management IP:74.51.121.118, User:root, Options:lanplus=1, Fencing policy:null 2017-02-28 12:26:43,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] START, FenceVdsVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, targetVdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, action = Status, ip = 74.51.121.118, port = , type = ipmilan, user = root, password = ******, options = 'lanplus=1', policy = 'null'), log id: 452fea9c 2017-02-28 12:26:44,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] FINISH, FenceVdsVDSCommand, return: Test Succeeded, on, log id: 452fea9c 2017-02-28 12:26:44,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 40dd4270 2017-02-28 12:26:44,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] FINISH, SetMOMPolicyParametersVDSCommand, log id: 40dd4270 2017-02-28 12:26:44,480 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host hosted_engine_1 was set to Up. 2017-02-28 12:26:44,488 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-91) [3a5f91bb] Correlation ID: 7d3aac8b, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 power management was verified successfully. 2017-02-28 12:26:44,538 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-91) [67c8716d] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-28 12:34:06,803 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". 2017-02-28 12:34:06,809 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. 2017-02-28 12:34:06,810 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". 2017-02-28 12:34:06,810 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-java.conf". 2017-02-28 12:34:06,811 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". 2017-02-28 12:34:06,811 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". 2017-02-28 12:34:06,812 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". 2017-02-28 12:34:06,812 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_AJP_ENABLED" is "true". 2017-02-28 12:34:06,813 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_AJP_PORT" is "8702". 2017-02-28 12:34:06,813 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_APPS" is "engine.ear restapi.war legacy_restapi.war". 2017-02-28 12:34:06,813 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". 2017-02-28 12:34:06,814 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". 2017-02-28 12:34:06,815 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". 2017-02-28 12:34:06,815 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_DATABASE" is "engine". 2017-02-28 12:34:06,816 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". 2017-02-28 12:34:06,816 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_HOST" is "localhost". 2017-02-28 12:34:06,816 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". 2017-02-28 12:34:06,817 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". 2017-02-28 12:34:06,817 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_PASSWORD" is "***". 2017-02-28 12:34:06,817 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_PORT" is "5432". 2017-02-28 12:34:06,818 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_SECURED" is "False". 2017-02-28 12:34:06,818 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". 2017-02-28 12:34:06,818 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". 2017-02-28 12:34:06,819 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DB_USER" is "engine". 2017-02-28 12:34:06,819 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DEBUG_ADDRESS" is "". 2017-02-28 12:34:06,819 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". 2017-02-28 12:34:06,820 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". 2017-02-28 12:34:06,820 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_EXTENSION_PATH" is "/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d". 2017-02-28 12:34:06,821 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE" is "/var/lib/ovirt-engine/external_truststore". 2017-02-28 12:34:06,821 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD" is "***". 2017-02-28 12:34:06,821 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_TYPE" is "JKS". 2017-02-28 12:34:06,822 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_FQDN" is "engine.dev1.api-digital.com". 2017-02-28 12:34:06,822 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_GROUP" is "ovirt". 2017-02-28 12:34:06,822 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_HEAP_MAX" is "2000M". 2017-02-28 12:34:06,823 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_HEAP_MIN" is "2000M". 2017-02-28 12:34:06,823 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_HTTPS_ENABLED" is "false". 2017-02-28 12:34:06,823 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_HTTPS_PORT" is "None". 2017-02-28 12:34:06,824 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". 2017-02-28 12:34:06,824 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_HTTP_ENABLED" is "false". 2017-02-28 12:34:06,824 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_HTTP_PORT" is "None". 2017-02-28 12:34:06,825 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". 2017-02-28 12:34:06,825 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". 2017-02-28 12:34:06,826 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". 2017-02-28 12:34:06,826 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". 2017-02-28 12:34:06,826 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_MANUAL" is "/usr/share/ovirt-engine/manual". 2017-02-28 12:34:06,827 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PERM_MAX" is "256m". 2017-02-28 12:34:06,827 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PERM_MIN" is "256m". 2017-02-28 12:34:06,827 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". 2017-02-28 12:34:06,828 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". 2017-02-28 12:34:06,828 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". 2017-02-28 12:34:06,828 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". 2017-02-28 12:34:06,829 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". 2017-02-28 12:34:06,829 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". 2017-02-28 12:34:06,829 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". 2017-02-28 12:34:06,830 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". 2017-02-28 12:34:06,830 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PROPERTIES" is " java.awt.headless=true sun.rmi.dgc.client.gcInterval=3600000 sun.rmi.dgc.server.gcInterval=3600000 jsse.enableSNIExtension=false "java.security.krb5.conf=/etc/ovirt-engine/krb5.conf"". 2017-02-28 12:34:06,831 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PROXY_ENABLED" is "true". 2017-02-28 12:34:06,831 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". 2017-02-28 12:34:06,831 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". 2017-02-28 12:34:06,832 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_REPORTS_BASE_URL" is "". 2017-02-28 12:34:06,832 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_REPORTS_DASHBOARD_URL" is "/flow.html?viewAsDashboardFrame=true". 2017-02-28 12:34:06,833 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_REPORTS_NOT_INSTALLED_URL" is "/ovirt-engine/ReportsNotInstalled.html". 2017-02-28 12:34:06,833 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_REPORTS_PROXY_URL" is "/ovirt/reports-interface". 2017-02-28 12:34:06,833 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_REPORTS_READ_TIMEOUT" is "". 2017-02-28 12:34:06,834 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_REPORTS_RIGHTCLICK_URL" is "". 2017-02-28 12:34:06,834 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_REPORTS_VERIFY_CHAIN" is "true". 2017-02-28 12:34:06,834 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_REPORTS_VERIFY_HOST" is "true". 2017-02-28 12:34:06,835 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_STOP_INTERVAL" is "1". 2017-02-28 12:34:06,835 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_STOP_TIME" is "10". 2017-02-28 12:34:06,835 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". 2017-02-28 12:34:06,836 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". 2017-02-28 12:34:06,836 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_URI" is "/ovirt-engine". 2017-02-28 12:34:06,837 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_USER" is "ovirt". 2017-02-28 12:34:06,837 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". 2017-02-28 12:34:06,837 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". 2017-02-28 12:34:06,838 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "ENGINE_VERBOSE_GC" is "false". 2017-02-28 12:34:06,838 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "JBOSS_HOME" is "/usr/share/ovirt-engine-jboss-as". 2017-02-28 12:34:06,838 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". 2017-02-28 12:34:06,839 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-4) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD,ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD". 2017-02-28 12:34:07,760 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Start initializing Backend 2017-02-28 12:34:08,447 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (MSC service thread 1-2) Loading file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties 2017-02-28 12:34:08,867 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Running ovirt-engine 3.5.6.2-1.el6 2017-02-28 12:34:08,870 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-2) Start initializing dictionaries 2017-02-28 12:34:08,872 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-2) Finished initializing dictionaries 2017-02-28 12:34:08,873 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Start initializing AuditLogCleanupManager 2017-02-28 12:34:08,873 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting audit cleanup manager to run at: 35 35 3 * * ? 2017-02-28 12:34:08,887 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Finished initializing AuditLogCleanupManager 2017-02-28 12:34:08,888 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Start initializing CommandEntityCleanupManager 2017-02-28 12:34:08,888 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Setting command entity cleanup manager to run at: 35 35 3 * * ? 2017-02-28 12:34:08,895 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-2) Finished initializing CommandEntityCleanupManager 2017-02-28 12:34:08,897 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Start initializing TagsDirector 2017-02-28 12:34:08,905 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Tag root added to tree 2017-02-28 12:34:08,940 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-2) Finished initializing TagsDirector 2017-02-28 12:34:08,940 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-2) Start initializing IsoDomainListSyncronizer 2017-02-28 12:34:08,946 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-2) Finished initializing IsoDomainListSyncronizer 2017-02-28 12:34:09,054 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Completed initializing handlers 2017-02-28 12:34:09,081 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Start initializing ErrorTranslatorImpl 2017-02-28 12:34:09,101 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. 2017-02-28 12:34:09,102 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Finished initializing ErrorTranslatorImpl 2017-02-28 12:34:09,102 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Start initializing ErrorTranslatorImpl 2017-02-28 12:34:09,103 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-2) Finished initializing ErrorTranslatorImpl 2017-02-28 12:34:09,103 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-2) Mark incomplete jobs as UNKNOWN 2017-02-28 12:34:09,221 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-2) Start initializing JobRepositoryCleanupManager 2017-02-28 12:34:09,221 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-2) Finished initializing JobRepositoryCleanupManager 2017-02-28 12:34:09,222 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-2) Start initializing AutoRecoveryManager 2017-02-28 12:34:09,223 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-2) Finished initializing AutoRecoveryManager 2017-02-28 12:34:09,230 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-2) Start initializing ExecutionMessageDirector 2017-02-28 12:34:09,232 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-2) Finished initializing ExecutionMessageDirector 2017-02-28 12:34:09,403 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Loading extension 'builtin-authn-internal' 2017-02-28 12:34:09,406 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'builtin-authn-internal' loaded 2017-02-28 12:34:09,407 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Loading extension 'internal' 2017-02-28 12:34:09,409 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'internal' loaded 2017-02-28 12:34:09,421 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Initializing extension 'builtin-authn-internal' 2017-02-28 12:34:09,421 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'builtin-authn-internal' initialized 2017-02-28 12:34:09,422 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Initializing extension 'internal' 2017-02-28 12:34:09,422 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Extension 'internal' initialized 2017-02-28 12:34:09,423 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Start of enabled extensions list 2017-02-28 12:34:09,423 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Instance name: 'builtin-authn-internal', Extension name: 'Internal Authn (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-28 12:34:09,424 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) Instance name: 'internal', Extension name: 'Internal Authz (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-28 12:34:09,425 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-2) End of enabled extensions list 2017-02-28 12:34:09,643 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (MSC service thread 1-2) Initialization of AsyncTaskManager completed successfully. 2017-02-28 12:34:09,644 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) Start initializing ResourceManager 2017-02-28 12:34:09,748 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) Entered VdsManager constructor 2017-02-28 12:34:09,794 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) Initialize vdsBroker (node2.dev1.api-digital.com,54,321) 2017-02-28 12:34:10,076 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) VDS 45e4c281-f14f-43d5-8c3c-5664816072ee was added to the Resource Manager 2017-02-28 12:34:10,077 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) Entered VdsManager constructor 2017-02-28 12:34:10,088 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-2) Initialize vdsBroker (node1.dev1.api-digital.com,54,321) 2017-02-28 12:34:10,092 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) VDS eb2aea6e-7de9-4a29-86de-1d43f52fc92a was added to the Resource Manager 2017-02-28 12:34:10,116 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-2) Finished initializing ResourceManager 2017-02-28 12:34:10,117 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (MSC service thread 1-2) Initialization of OvfDataUpdater completed successfully. 2017-02-28 12:34:10,117 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Start scheduling to enable vds load balancer 2017-02-28 12:34:10,118 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Finished scheduling to enable vds load balancer 2017-02-28 12:34:10,118 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Start HA Reservation check 2017-02-28 12:34:10,119 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Finished HA Reservation check 2017-02-28 12:34:10,129 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Start initializing MacPoolManagerRanges 2017-02-28 12:34:10,129 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) Init VM custom properties utilities 2017-02-28 12:34:10,130 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-2) Init device custom properties utilities 2017-02-28 12:34:10,134 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Initializing Scheduling manager 2017-02-28 12:34:10,174 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Finished initializing. Available MACs in pool: 255 2017-02-28 12:34:10,196 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) External scheduler disabled, discovery skipped 2017-02-28 12:34:10,196 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-2) Initialized Scheduling manager 2017-02-28 12:34:10,197 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-2) Initializing DWH Heart Beat 2017-02-28 12:34:10,201 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-2) DWH Heart Beat initialized 2017-02-28 12:34:13,255 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 12:34:13,264 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 12:34:13,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]), log id: 35867309 2017-02-28 12:34:13,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]), log id: dea6f53 2017-02-28 12:34:13,944 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GetHardwareInfoVDSCommand, log id: 35867309 2017-02-28 12:34:13,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: dea6f53 2017-02-28 12:34:14,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-5) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=4a035efd-a041-4e46-84db-01cf79400913, force=false, secondsToWait=0, gracefully=false, reason=), log id: 4e039d06 2017-02-28 12:34:14,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, DestroyVDSCommand, log id: 4e039d06 2017-02-28 12:34:14,202 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: UNASSIGNED not exist in string table 2017-02-28 12:34:14,203 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table 2017-02-28 12:34:14,209 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table 2017-02-28 12:34:14,210 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table 2017-02-28 12:34:14,210 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table 2017-02-28 12:34:14,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table 2017-02-28 12:34:14,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_ADDED_DISK_PROFILE not exist in string table 2017-02-28 12:34:14,212 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_ADD_DISK_PROFILE not exist in string table 2017-02-28 12:34:14,213 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_REMOVED_DISK_PROFILE not exist in string table 2017-02-28 12:34:14,213 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_REMOVE_DISK_PROFILE not exist in string table 2017-02-28 12:34:14,213 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_UPDATED_DISK_PROFILE not exist in string table 2017-02-28 12:34:14,214 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_UPDATE_DISK_PROFILE not exist in string table 2017-02-28 12:34:14,214 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_ADDED_CPU_PROFILE not exist in string table 2017-02-28 12:34:14,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_ADD_CPU_PROFILE not exist in string table 2017-02-28 12:34:14,215 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_REMOVED_CPU_PROFILE not exist in string table 2017-02-28 12:34:14,216 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_REMOVE_CPU_PROFILE not exist in string table 2017-02-28 12:34:14,216 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_UPDATED_CPU_PROFILE not exist in string table 2017-02-28 12:34:14,216 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) AuditLogType: USER_FAILED_TO_UPDATE_CPU_PROFILE not exist in string table 2017-02-28 12:34:14,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-6) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: 134fbd1e 2017-02-28 12:34:14,330 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-6) FINISH, FullListVdsCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=6663, clientIp=, devices=[Ljava.lang.Object;@43b5d2fe, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 134fbd1e 2017-02-28 12:34:14,344 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) Received a console Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {alias=console0, specParams={}, deviceType=console, deviceId=aa0b7357-8cdd-410d-8119-97fb727670eb, device=console, type=console} 2017-02-28 12:34:14,345 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) Received a memballoon Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 12:34:14,346 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) Received a vnc Device without an address when processing VM 4a035efd-a041-4e46-84db-01cf79400913 devices, skipping device: {device=vnc, specParams={spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, displayIp=0}, deviceType=graphics, type=graphics, port=5900} 2017-02-28 12:34:14,347 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) Empty or NULL values were passed for a VM 4a035efd-a041-4e46-84db-01cf79400913 device, Device is skipped 2017-02-28 12:34:14,349 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=63fecc05-bc31-4113-829e-c8d2588ca6cb, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:34:14,350 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=a8c31e80-8de1-47a1-8628-ca1f19267a76, device=cdrom, type=DISK, bootOrder=0, specParams={path=}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:34:14,351 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=df179798-d691-420d-8293-3582a8aaf74c, device=ich6, type=SOUND, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:34:14,352 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=eab19219-d581-4bb4-99de-6cc5afa8c700, device=qxl, type=VIDEO, bootOrder=0, specParams={vram=32768, heads=1}, address=, managed=true, plugged=false, readOnly=true, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:34:14,353 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-6) VM 4a035efd-a041-4e46-84db-01cf79400913 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=4a035efd-a041-4e46-84db-01cf79400913, deviceId=edddf45e-2c79-4c00-9dd5-8a46974c1d08, device=virtio-scsi, type=CONTROLLER, bootOrder=0, specParams={}, address=, managed=true, plugged=false, readOnly=false, deviceAlias=, customProperties={}, snapshotId=null, logicalName=null} 2017-02-28 12:34:14,431 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM HostedEngine is down. Exit message: User shut down from within the guest 2017-02-28 12:34:14,443 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM HostedEngine (4a035efd-a041-4e46-84db-01cf79400913) is running in db and not running in VDS hosted_engine_2 2017-02-28 12:34:14,446 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-5) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[4a035efd-a041-4e46-84db-01cf79400913]), log id: a170d9d 2017-02-28 12:34:14,456 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-5) FINISH, FullListVdsCommand, return: [], log id: a170d9d 2017-02-28 12:34:14,636 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-5) Initializing Host: hosted_engine_2 2017-02-28 12:34:14,662 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: hosted_engine_1 2017-02-28 12:34:14,744 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-5) [492d504e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 12:34:14,744 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [7e8d8ba1] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-28 12:34:14,768 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-3) [65231516] Running command: ProcessDownVmCommand internal: true. 2017-02-28 12:34:14,794 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-2) [69a80de6] Running command: ProcessDownVmCommand internal: true. 2017-02-28 12:34:20,222 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-18) [7b9dc788] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 12:34:20,232 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-18) [7b9dc788] Storage Pool 00000002-0002-0002-0002-00000000002b - Updating Storage Domain 831fd677-2894-48e7-8a0d-fd5c084a08e6 status from Active to Unknown, reason : null 2017-02-28 12:34:20,551 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [7b9dc788] Correlation ID: 7b9dc788, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. 2017-02-28 12:34:20,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-18) [7b9dc788] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 77630ddd 2017-02-28 12:34:21,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-18) [7b9dc788] FINISH, ConnectStoragePoolVDSCommand, log id: 77630ddd 2017-02-28 12:34:21,200 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-18) [7b9dc788] hostFromVds::selectedVds - hosted_engine_2, spmStatus SPM, storage pool Default, storage pool version 3.5 2017-02-28 12:34:21,226 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-18) [7b9dc788] Initialize Irs proxy from vds: node2.dev1.api-digital.com 2017-02-28 12:34:21,281 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [7b9dc788] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_2 (Address: node2.dev1.api-digital.com). 2017-02-28 12:34:21,284 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 12:34:21,318 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [7b9dc788] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 1f6f8a1d 2017-02-28 12:34:21,461 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-14) [27ba970b] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 12:34:21,476 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [7b9dc788] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-00000000002b 2017-02-28 12:34:21,503 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [7b9dc788] START, HSMGetAllTasksInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 110f1712 2017-02-28 12:34:21,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [7b9dc788] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 110f1712 2017-02-28 12:34:21,510 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [7b9dc788] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 1f6f8a1d 2017-02-28 12:34:21,511 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-13) [7b9dc788] Discovered no tasks on Storage Pool Default 2017-02-28 12:34:21,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [27ba970b] START, GetVGInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, VGID=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq), log id: 18e266ac 2017-02-28 12:34:21,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [27ba970b] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, storageDomainName=null]], log id: 18e266ac 2017-02-28 12:34:46,896 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [37d807f9] Running command: LogoutUserCommand internal: false. 2017-02-28 12:34:46,903 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [50766669] Running command: LogoutUserCommand internal: false. 2017-02-28 12:34:46,907 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-1) [300643f5] Running command: LogoutUserCommand internal: false. 2017-02-28 12:34:46,909 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-1) [300643f5] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 12:34:46,910 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-4) [6b57a274] Running command: LogoutUserCommand internal: false. 2017-02-28 12:34:46,912 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [13069dbe] Running command: LogoutUserCommand internal: false. 2017-02-28 12:34:46,914 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [13069dbe] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 12:34:46,917 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [2dd0478e] Running command: LogoutUserCommand internal: false. 2017-02-28 12:34:46,919 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [37d807f9] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 12:34:46,920 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [50766669] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 12:34:46,922 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-4) [6b57a274] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 12:34:46,923 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [2dd0478e] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 12:34:46,946 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-1) [300643f5] Correlation ID: 300643f5, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 12:34:46,958 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [13069dbe] Correlation ID: 13069dbe, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 12:34:46,958 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [6b57a274] Correlation ID: 6b57a274, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 12:34:46,958 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [2dd0478e] Correlation ID: 2dd0478e, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 12:34:46,958 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) [50766669] Correlation ID: 50766669, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 12:34:46,958 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-5) [37d807f9] Correlation ID: 37d807f9, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 12:34:46,971 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [2fcec45] Running command: LogoutUserCommand internal: false. 2017-02-28 12:34:46,977 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [2fcec45] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 12:34:46,986 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) [2fcec45] Correlation ID: 2fcec45, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 12:34:47,002 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-9) [55f4411a] Running command: LogoutUserCommand internal: false. 2017-02-28 12:34:47,012 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-9) [55f4411a] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 12:34:47,022 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) [55f4411a] Correlation ID: 55f4411a, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 12:34:50,601 INFO [org.ovirt.engine.docs.utils.servlet.ContextSensitiveHelpMappingServlet] (ajp--127.0.0.1-8702-2) Context-sensitive help is not installed. Manual directory doesn't exist: /usr/share/ovirt-engine/manual 2017-02-28 13:02:32,035 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp--127.0.0.1-8702-2) Running command: LoginAdminUserCommand internal: false. 2017-02-28 13:02:32,059 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-28 13:07:36,422 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". 2017-02-28 13:07:36,431 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. 2017-02-28 13:07:36,432 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". 2017-02-28 13:07:36,432 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-java.conf". 2017-02-28 13:07:36,433 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". 2017-02-28 13:07:36,433 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". 2017-02-28 13:07:36,434 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". 2017-02-28 13:07:36,435 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_AJP_ENABLED" is "true". 2017-02-28 13:07:36,435 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_AJP_PORT" is "8702". 2017-02-28 13:07:36,436 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_APPS" is "engine.ear restapi.war legacy_restapi.war". 2017-02-28 13:07:36,436 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". 2017-02-28 13:07:36,436 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". 2017-02-28 13:07:36,437 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". 2017-02-28 13:07:36,437 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_DATABASE" is "engine". 2017-02-28 13:07:36,438 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". 2017-02-28 13:07:36,438 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_HOST" is "localhost". 2017-02-28 13:07:36,438 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". 2017-02-28 13:07:36,439 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". 2017-02-28 13:07:36,439 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_PASSWORD" is "***". 2017-02-28 13:07:36,439 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_PORT" is "5432". 2017-02-28 13:07:36,446 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_SECURED" is "False". 2017-02-28 13:07:36,446 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". 2017-02-28 13:07:36,446 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". 2017-02-28 13:07:36,447 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_USER" is "engine". 2017-02-28 13:07:36,447 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DEBUG_ADDRESS" is "". 2017-02-28 13:07:36,447 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". 2017-02-28 13:07:36,448 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". 2017-02-28 13:07:36,448 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_EXTENSION_PATH" is "/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d". 2017-02-28 13:07:36,449 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE" is "/var/lib/ovirt-engine/external_truststore". 2017-02-28 13:07:36,449 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD" is "***". 2017-02-28 13:07:36,449 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_TYPE" is "JKS". 2017-02-28 13:07:36,450 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_FQDN" is "engine.dev1.api-digital.com". 2017-02-28 13:07:36,450 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_GROUP" is "ovirt". 2017-02-28 13:07:36,451 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HEAP_MAX" is "2000M". 2017-02-28 13:07:36,451 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HEAP_MIN" is "2000M". 2017-02-28 13:07:36,451 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTPS_ENABLED" is "false". 2017-02-28 13:07:36,457 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTPS_PORT" is "None". 2017-02-28 13:07:36,457 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". 2017-02-28 13:07:36,457 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTP_ENABLED" is "false". 2017-02-28 13:07:36,458 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTP_PORT" is "None". 2017-02-28 13:07:36,458 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". 2017-02-28 13:07:36,459 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". 2017-02-28 13:07:36,459 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". 2017-02-28 13:07:36,459 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". 2017-02-28 13:07:36,460 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_MANUAL" is "/usr/share/ovirt-engine/manual". 2017-02-28 13:07:36,460 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PERM_MAX" is "256m". 2017-02-28 13:07:36,460 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PERM_MIN" is "256m". 2017-02-28 13:07:36,461 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". 2017-02-28 13:07:36,461 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". 2017-02-28 13:07:36,462 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". 2017-02-28 13:07:36,462 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". 2017-02-28 13:07:36,462 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". 2017-02-28 13:07:36,466 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". 2017-02-28 13:07:36,466 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". 2017-02-28 13:07:36,466 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". 2017-02-28 13:07:36,467 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PROPERTIES" is " java.awt.headless=true sun.rmi.dgc.client.gcInterval=3600000 sun.rmi.dgc.server.gcInterval=3600000 jsse.enableSNIExtension=false "java.security.krb5.conf=/etc/ovirt-engine/krb5.conf"". 2017-02-28 13:07:36,468 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PROXY_ENABLED" is "true". 2017-02-28 13:07:36,468 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". 2017-02-28 13:07:36,468 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". 2017-02-28 13:07:36,469 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_BASE_URL" is "". 2017-02-28 13:07:36,469 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_DASHBOARD_URL" is "/flow.html?viewAsDashboardFrame=true". 2017-02-28 13:07:36,469 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_NOT_INSTALLED_URL" is "/ovirt-engine/ReportsNotInstalled.html". 2017-02-28 13:07:36,470 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_PROXY_URL" is "/ovirt/reports-interface". 2017-02-28 13:07:36,470 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_READ_TIMEOUT" is "". 2017-02-28 13:07:36,471 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_RIGHTCLICK_URL" is "". 2017-02-28 13:07:36,471 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_VERIFY_CHAIN" is "true". 2017-02-28 13:07:36,471 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_VERIFY_HOST" is "true". 2017-02-28 13:07:36,472 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_STOP_INTERVAL" is "1". 2017-02-28 13:07:36,472 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_STOP_TIME" is "10". 2017-02-28 13:07:36,473 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". 2017-02-28 13:07:36,473 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". 2017-02-28 13:07:36,473 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_URI" is "/ovirt-engine". 2017-02-28 13:07:36,474 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_USER" is "ovirt". 2017-02-28 13:07:36,474 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". 2017-02-28 13:07:36,474 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". 2017-02-28 13:07:36,475 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_VERBOSE_GC" is "false". 2017-02-28 13:07:36,475 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "JBOSS_HOME" is "/usr/share/ovirt-engine-jboss-as". 2017-02-28 13:07:36,475 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". 2017-02-28 13:07:36,476 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD,ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD". 2017-02-28 13:07:37,083 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-3) Start initializing Backend 2017-02-28 13:07:37,606 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (MSC service thread 1-3) Loading file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties 2017-02-28 13:07:37,836 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-3) Running ovirt-engine 3.5.6.2-1.el6 2017-02-28 13:07:37,836 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-3) Start initializing dictionaries 2017-02-28 13:07:37,839 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-3) Finished initializing dictionaries 2017-02-28 13:07:37,839 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Start initializing AuditLogCleanupManager 2017-02-28 13:07:37,839 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Setting audit cleanup manager to run at: 35 35 3 * * ? 2017-02-28 13:07:37,858 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Finished initializing AuditLogCleanupManager 2017-02-28 13:07:37,858 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Start initializing CommandEntityCleanupManager 2017-02-28 13:07:37,859 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Setting command entity cleanup manager to run at: 35 35 3 * * ? 2017-02-28 13:07:37,866 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Finished initializing CommandEntityCleanupManager 2017-02-28 13:07:37,868 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-3) Start initializing TagsDirector 2017-02-28 13:07:37,879 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-3) Tag root added to tree 2017-02-28 13:07:37,891 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-3) Finished initializing TagsDirector 2017-02-28 13:07:37,892 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-3) Start initializing IsoDomainListSyncronizer 2017-02-28 13:07:37,897 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-3) Finished initializing IsoDomainListSyncronizer 2017-02-28 13:07:38,004 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-3) Completed initializing handlers 2017-02-28 13:07:38,031 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Start initializing ErrorTranslatorImpl 2017-02-28 13:07:38,054 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. 2017-02-28 13:07:38,055 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Finished initializing ErrorTranslatorImpl 2017-02-28 13:07:38,055 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Start initializing ErrorTranslatorImpl 2017-02-28 13:07:38,056 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Finished initializing ErrorTranslatorImpl 2017-02-28 13:07:38,056 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-3) Mark incomplete jobs as UNKNOWN 2017-02-28 13:07:38,093 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-3) Start initializing JobRepositoryCleanupManager 2017-02-28 13:07:38,094 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-3) Finished initializing JobRepositoryCleanupManager 2017-02-28 13:07:38,094 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-3) Start initializing AutoRecoveryManager 2017-02-28 13:07:38,095 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-3) Finished initializing AutoRecoveryManager 2017-02-28 13:07:38,097 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-3) Start initializing ExecutionMessageDirector 2017-02-28 13:07:38,099 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-3) Finished initializing ExecutionMessageDirector 2017-02-28 13:07:38,186 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Loading extension 'builtin-authn-internal' 2017-02-28 13:07:38,187 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Extension 'builtin-authn-internal' loaded 2017-02-28 13:07:38,189 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Loading extension 'internal' 2017-02-28 13:07:38,199 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Extension 'internal' loaded 2017-02-28 13:07:38,201 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Initializing extension 'builtin-authn-internal' 2017-02-28 13:07:38,201 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Extension 'builtin-authn-internal' initialized 2017-02-28 13:07:38,202 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Initializing extension 'internal' 2017-02-28 13:07:38,203 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Extension 'internal' initialized 2017-02-28 13:07:38,203 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Start of enabled extensions list 2017-02-28 13:07:38,204 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Instance name: 'builtin-authn-internal', Extension name: 'Internal Authn (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-28 13:07:38,204 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Instance name: 'internal', Extension name: 'Internal Authz (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-28 13:07:38,205 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) End of enabled extensions list 2017-02-28 13:07:38,398 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (MSC service thread 1-1) Initialization of AsyncTaskManager completed successfully. 2017-02-28 13:07:38,399 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) Start initializing ResourceManager 2017-02-28 13:07:38,497 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Entered VdsManager constructor 2017-02-28 13:07:38,523 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Initialize vdsBroker (node2.dev1.api-digital.com,54,321) 2017-02-28 13:07:38,712 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) VDS 45e4c281-f14f-43d5-8c3c-5664816072ee was added to the Resource Manager 2017-02-28 13:07:38,713 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Entered VdsManager constructor 2017-02-28 13:07:38,725 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-1) Initialize vdsBroker (node1.dev1.api-digital.com,54,321) 2017-02-28 13:07:38,734 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) VDS eb2aea6e-7de9-4a29-86de-1d43f52fc92a was added to the Resource Manager 2017-02-28 13:07:38,764 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-1) Finished initializing ResourceManager 2017-02-28 13:07:38,765 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (MSC service thread 1-1) Initialization of OvfDataUpdater completed successfully. 2017-02-28 13:07:38,766 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Start scheduling to enable vds load balancer 2017-02-28 13:07:38,766 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Finished scheduling to enable vds load balancer 2017-02-28 13:07:38,767 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Start HA Reservation check 2017-02-28 13:07:38,768 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Finished HA Reservation check 2017-02-28 13:07:38,777 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Start initializing MacPoolManagerRanges 2017-02-28 13:07:38,779 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) Init VM custom properties utilities 2017-02-28 13:07:38,780 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-1) Init device custom properties utilities 2017-02-28 13:07:38,791 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Initializing Scheduling manager 2017-02-28 13:07:38,803 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Finished initializing. Available MACs in pool: 255 2017-02-28 13:07:38,821 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) External scheduler disabled, discovery skipped 2017-02-28 13:07:38,822 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-1) Initialized Scheduling manager 2017-02-28 13:07:38,822 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-1) Initializing DWH Heart Beat 2017-02-28 13:07:38,829 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-1) DWH Heart Beat initialized 2017-02-28 13:07:40,936 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [79375ce8] Running command: LogoutUserCommand internal: false. 2017-02-28 13:07:40,936 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [1bbe85a2] Running command: LogoutUserCommand internal: false. 2017-02-28 13:07:40,940 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [6e27567d] Running command: LogoutUserCommand internal: false. 2017-02-28 13:07:40,935 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-1) [620cd265] Running command: LogoutUserCommand internal: false. 2017-02-28 13:07:40,950 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [1bbe85a2] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:07:40,957 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-1) [620cd265] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:07:40,957 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [6e27567d] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:07:40,958 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [79375ce8] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:07:40,998 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: UNASSIGNED not exist in string table 2017-02-28 13:07:40,998 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table 2017-02-28 13:07:40,999 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_FAILED_REMOVE_VM not exist in string table 2017-02-28 13:07:40,999 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table 2017-02-28 13:07:41,000 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table 2017-02-28 13:07:41,001 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table 2017-02-28 13:07:41,001 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_ADDED_DISK_PROFILE not exist in string table 2017-02-28 13:07:41,002 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_FAILED_TO_ADD_DISK_PROFILE not exist in string table 2017-02-28 13:07:41,002 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_REMOVED_DISK_PROFILE not exist in string table 2017-02-28 13:07:41,007 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_FAILED_TO_REMOVE_DISK_PROFILE not exist in string table 2017-02-28 13:07:41,007 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_UPDATED_DISK_PROFILE not exist in string table 2017-02-28 13:07:41,008 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_FAILED_TO_UPDATE_DISK_PROFILE not exist in string table 2017-02-28 13:07:41,014 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_ADDED_CPU_PROFILE not exist in string table 2017-02-28 13:07:41,014 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_FAILED_TO_ADD_CPU_PROFILE not exist in string table 2017-02-28 13:07:41,015 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_REMOVED_CPU_PROFILE not exist in string table 2017-02-28 13:07:41,015 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_FAILED_TO_REMOVE_CPU_PROFILE not exist in string table 2017-02-28 13:07:41,016 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_UPDATED_CPU_PROFILE not exist in string table 2017-02-28 13:07:41,016 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] AuditLogType: USER_FAILED_TO_UPDATE_CPU_PROFILE not exist in string table 2017-02-28 13:07:41,154 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) [79375ce8] Correlation ID: 79375ce8, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:07:41,157 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [1bbe85a2] Correlation ID: 1bbe85a2, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:07:41,157 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-1) [620cd265] Correlation ID: 620cd265, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:07:41,158 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) [6e27567d] Correlation ID: 6e27567d, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:07:41,213 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [6026f042] Running command: LogoutUserCommand internal: false. 2017-02-28 13:07:41,216 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-4) [5be4adde] Running command: LogoutUserCommand internal: false. 2017-02-28 13:07:41,220 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [6026f042] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:07:41,222 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [48ed10bc] Running command: LogoutUserCommand internal: false. 2017-02-28 13:07:41,223 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-4) [5be4adde] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:07:41,240 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [48ed10bc] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:07:41,241 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [5be4adde] Correlation ID: 5be4adde, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:07:41,244 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) [6026f042] Correlation ID: 6026f042, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:07:41,245 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-8) [139141a0] Running command: LogoutUserCommand internal: false. 2017-02-28 13:07:41,250 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-8) [139141a0] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:07:41,276 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-8) [139141a0] Correlation ID: 139141a0, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:07:41,278 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [48ed10bc] Correlation ID: 48ed10bc, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:07:41,952 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 13:07:41,991 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 13:07:42,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]), log id: 3888dd7 2017-02-28 13:07:42,602 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GetHardwareInfoVDSCommand, log id: 3888dd7 2017-02-28 13:07:42,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]), log id: 67ef7a4 2017-02-28 13:07:42,666 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: 67ef7a4 2017-02-28 13:07:42,791 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) VM test (15c5443a-654a-4464-8b28-33d2bdd34ec7) is running in db and not running in VDS hosted_engine_2 2017-02-28 13:07:42,799 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) add VM test to HA rerun treatment 2017-02-28 13:07:43,096 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-5) Initializing Host: hosted_engine_2 2017-02-28 13:07:43,145 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: hosted_engine_1 2017-02-28 13:07:43,156 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-5) [1616e7d4] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 13:07:43,230 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [2b9481ae] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-28 13:07:43,263 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-2) [3ff030e4] Running command: ProcessDownVmCommand internal: true. 2017-02-28 13:07:43,268 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-5) [1616e7d4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Highly Available VM test failed. It will be restarted automatically. 2017-02-28 13:07:43,269 INFO [org.ovirt.engine.core.bll.VdsEventListener] (DefaultQuartzScheduler_Worker-5) [1616e7d4] Highly Available VM went down. Attempting to restart. VM Name: test, VM Id: 15c5443a-654a-4464-8b28-33d2bdd34ec7 2017-02-28 13:07:43,342 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-5) [9184179] Running command: ProcessDownVmCommand internal: true. 2017-02-28 13:07:44,558 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] START, IsVmDuringInitiatingVDSCommand( vmId = 15c5443a-654a-4464-8b28-33d2bdd34ec7), log id: 7920c795 2017-02-28 13:07:44,558 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7920c795 2017-02-28 13:07:44,684 INFO [org.ovirt.engine.core.bll.RunVmCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] Running command: RunVmCommand internal: true. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VMAction group VM_BASIC_OPERATIONS with role type USER 2017-02-28 13:07:44,794 INFO [org.ovirt.engine.core.bll.scheduling.policyunits.HaReservationWeightPolicyUnit] (DefaultQuartzScheduler_Worker-9) [54e32f84] Started HA reservation scoring method 2017-02-28 13:07:44,865 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] START, UpdateVmDynamicDataVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmDynamic=org.ovirt.engine.core.common.businessentities.VmDynamic@d326103c), log id: 21d82ca 2017-02-28 13:07:44,876 INFO [org.ovirt.engine.core.vdsbroker.UpdateVmDynamicDataVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] FINISH, UpdateVmDynamicDataVDSCommand, log id: 21d82ca 2017-02-28 13:07:44,921 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] START, CreateVmVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, vm=VM [test]), log id: 44bba6dc 2017-02-28 13:07:44,966 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] START, CreateVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, vm=VM [test]), log id: 822fd20 2017-02-28 13:07:45,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand kvmEnable=true,keyboardLayout=en-us,nice=0,pitReinjection=false,displayNetwork=ovirtmgmt,copyPasteEnable=true,timeOffset=0,transparentHugePages=true,vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7,acpiEnable=true,custom={device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=6838e8b7-a07b-4ead-9209-5e7fa2470c29, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=81b15942-d7f8-46b9-bb3c-80246951c1e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=583396ab-952d-4d50-a4e9-90b7bf077a50, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29device_410a0504-c0c5-4183-9a5b-82dab9aab557=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=410a0504-c0c5-4183-9a5b-82dab9aab557, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}},spiceSslCipherSuite=DEFAULT,memSize=1024,smp=1,emulatedMachine=rhel6.5.0,vmType=kvm,memGuaranteedSize=682,display=qxl,smartcardEnable=false,bootMenuEnable=false,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,smpCoresPerSocket=1,maxVCpus=16,devices=[{address={bus=0x00, domain=0x0000, type=pci, slot=0x02, function=0x0}, specParams={ram=65536, vram=32768, heads=1}, device=qxl, type=video, deviceId=59b7dba9-6e10-45ff-8011-8f98909ec3a3}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=6eb283b9-3664-45fc-8532-622edf18a951}, {shared=false, index=0, volumeID=b2b21742-04a4-4e4c-b5cc-2e0c64d4f6b8, propagateErrors=off, format=cow, type=disk, iface=scsi, bootOrder=1, address={unit=0, bus=0, target=0, controller=0, type=drive}, domainID=831fd677-2894-48e7-8a0d-fd5c084a08e6, imageID=5c159fc6-918c-4efc-9f6c-767b31d6da6b, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-00000000002b, readonly=false, deviceId=5c159fc6-918c-4efc-9f6c-767b31d6da6b}, {nicModel=pv, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:11:e4:00, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=ovirtmgmt, deviceId=927d4e5e-f1a5-42ac-ac6a-64e8639fc1b3}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=fcc910bc-df4f-463e-b28d-db5663f19ac3}, {address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, specParams={}, device=virtio-serial, type=controller, deviceId=a1985699-56f9-4c05-876f-a489729d2080}],vmName=test,cpuType=Westmere,fileTransferEnable=true 2017-02-28 13:07:45,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] FINISH, CreateVDSCommand, log id: 822fd20 2017-02-28 13:07:45,131 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 44bba6dc 2017-02-28 13:07:45,132 INFO [org.ovirt.engine.core.bll.RunVmCommand] (DefaultQuartzScheduler_Worker-9) [54e32f84] Lock freed to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 13:07:45,167 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-9) [54e32f84] Correlation ID: 54e32f84, Job ID: 9786fc73-4a7b-47a2-8172-49976e198f3a, Call Stack: null, Custom Event ID: -1, Message: VM test was restarted on Host hosted_engine_2 2017-02-28 13:07:49,039 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-17) [3d533f87] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 13:07:49,080 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-17) [3d533f87] Storage Pool 00000002-0002-0002-0002-00000000002b - Updating Storage Domain 831fd677-2894-48e7-8a0d-fd5c084a08e6 status from Active to Unknown, reason : null 2017-02-28 13:07:49,342 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-17) [3d533f87] Correlation ID: 3d533f87, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. 2017-02-28 13:07:49,474 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from WaitForLaunch --> PoweringUp 2017-02-28 13:07:49,479 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 6a61d9c7 2017-02-28 13:07:49,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=6838e8b7-a07b-4ead-9209-5e7fa2470c29, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=81b15942-d7f8-46b9-bb3c-80246951c1e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=583396ab-952d-4d50-a4e9-90b7bf077a50, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29device_410a0504-c0c5-4183-9a5b-82dab9aab557=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=410a0504-c0c5-4183-9a5b-82dab9aab557, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, pid=19729, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@5bcd6224, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 6a61d9c7 2017-02-28 13:07:49,503 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 13:07:49,504 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-20) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 13:07:49,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-17) [3d533f87] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 503d0e5 2017-02-28 13:07:49,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-17) [3d533f87] FINISH, ConnectStoragePoolVDSCommand, log id: 503d0e5 2017-02-28 13:07:49,949 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-17) [3d533f87] hostFromVds::selectedVds - hosted_engine_2, spmStatus SPM, storage pool Default, storage pool version 3.5 2017-02-28 13:07:49,978 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-17) [3d533f87] Initialize Irs proxy from vds: node2.dev1.api-digital.com 2017-02-28 13:07:50,019 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-17) [3d533f87] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_2 (Address: node2.dev1.api-digital.com). 2017-02-28 13:07:50,024 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 13:07:50,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [3d533f87] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 295e5df 2017-02-28 13:07:50,235 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [3d533f87] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-00000000002b 2017-02-28 13:07:50,257 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-14) [6e957fa] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 13:07:50,267 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [3d533f87] START, HSMGetAllTasksInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 21834e3b 2017-02-28 13:07:50,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [3d533f87] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 21834e3b 2017-02-28 13:07:50,274 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-13) [3d533f87] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 295e5df 2017-02-28 13:07:50,274 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-13) [3d533f87] Discovered no tasks on Storage Pool Default 2017-02-28 13:07:50,329 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [6e957fa] START, GetVGInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, VGID=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq), log id: 3c01bffe 2017-02-28 13:07:50,477 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-14) [6e957fa] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, storageDomainName=null]], log id: 3c01bffe 2017-02-28 13:08:17,428 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from PoweringUp --> Up 2017-02-28 13:08:17,429 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-75) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 50597533 2017-02-28 13:08:17,436 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-75) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=6838e8b7-a07b-4ead-9209-5e7fa2470c29, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=81b15942-d7f8-46b9-bb3c-80246951c1e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=583396ab-952d-4d50-a4e9-90b7bf077a50, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29device_410a0504-c0c5-4183-9a5b-82dab9aab557=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=410a0504-c0c5-4183-9a5b-82dab9aab557, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, pid=19729, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestDiskMapping={0QEMU_QEMU_HARDDISK_5c159fc6-918c-4efc-9={name=/dev/sda}, QEMU_DVD-ROM={name=/dev/sr0}}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@1bf88c39, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 50597533 2017-02-28 13:08:17,444 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 13:08:17,445 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-75) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 13:08:17,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) Correlation ID: 54e32f84, Job ID: 9786fc73-4a7b-47a2-8172-49976e198f3a, Call Stack: null, Custom Event ID: -1, Message: VM test was restarted on Host hosted_engine_2 2017-02-28 13:09:01,230 INFO [org.ovirt.engine.docs.utils.servlet.ContextSensitiveHelpMappingServlet] (ajp--127.0.0.1-8702-2) Context-sensitive help is not installed. Manual directory doesn't exist: /usr/share/ovirt-engine/manual 2017-02-28 13:13:55,253 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp--127.0.0.1-8702-9) Running command: LoginAdminUserCommand internal: false. 2017-02-28 13:13:57,064 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-28 13:25:34,042 INFO [org.ovirt.engine.core.bll.SetHaMaintenanceCommand] (ajp--127.0.0.1-8702-9) [7f9e2c37] Running command: SetHaMaintenanceCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 13:25:34,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (ajp--127.0.0.1-8702-9) [7f9e2c37] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 6ec3fe91 2017-02-28 13:25:34,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (ajp--127.0.0.1-8702-9) [7f9e2c37] FINISH, SetHaMaintenanceModeVDSCommand, log id: 6ec3fe91 2017-02-28 13:25:34,178 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) [7f9e2c37] Correlation ID: 7f9e2c37, Call Stack: null, Custom Event ID: -1, Message: Hosted Engine HA maintenance mode was updated on host hosted_engine_1. 2017-02-28 13:32:03,566 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". 2017-02-28 13:32:03,585 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. 2017-02-28 13:32:03,586 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". 2017-02-28 13:32:03,586 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-java.conf". 2017-02-28 13:32:03,587 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". 2017-02-28 13:32:03,587 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". 2017-02-28 13:32:03,588 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". 2017-02-28 13:32:03,588 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_AJP_ENABLED" is "true". 2017-02-28 13:32:03,589 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_AJP_PORT" is "8702". 2017-02-28 13:32:03,589 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_APPS" is "engine.ear restapi.war legacy_restapi.war". 2017-02-28 13:32:03,592 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". 2017-02-28 13:32:03,592 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". 2017-02-28 13:32:03,593 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". 2017-02-28 13:32:03,593 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_DATABASE" is "engine". 2017-02-28 13:32:03,593 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". 2017-02-28 13:32:03,594 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_HOST" is "localhost". 2017-02-28 13:32:03,594 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". 2017-02-28 13:32:03,594 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". 2017-02-28 13:32:03,599 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_PASSWORD" is "***". 2017-02-28 13:32:03,599 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_PORT" is "5432". 2017-02-28 13:32:03,599 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_SECURED" is "False". 2017-02-28 13:32:03,600 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". 2017-02-28 13:32:03,600 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". 2017-02-28 13:32:03,601 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DB_USER" is "engine". 2017-02-28 13:32:03,601 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DEBUG_ADDRESS" is "". 2017-02-28 13:32:03,601 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". 2017-02-28 13:32:03,612 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". 2017-02-28 13:32:03,612 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_EXTENSION_PATH" is "/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d". 2017-02-28 13:32:03,613 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE" is "/var/lib/ovirt-engine/external_truststore". 2017-02-28 13:32:03,613 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD" is "***". 2017-02-28 13:32:03,613 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_TYPE" is "JKS". 2017-02-28 13:32:03,614 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_FQDN" is "engine.dev1.api-digital.com". 2017-02-28 13:32:03,614 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_GROUP" is "ovirt". 2017-02-28 13:32:03,614 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HEAP_MAX" is "2000M". 2017-02-28 13:32:03,615 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HEAP_MIN" is "2000M". 2017-02-28 13:32:03,615 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTPS_ENABLED" is "false". 2017-02-28 13:32:03,615 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTPS_PORT" is "None". 2017-02-28 13:32:03,620 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". 2017-02-28 13:32:03,620 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTP_ENABLED" is "false". 2017-02-28 13:32:03,621 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_HTTP_PORT" is "None". 2017-02-28 13:32:03,621 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". 2017-02-28 13:32:03,621 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". 2017-02-28 13:32:03,622 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". 2017-02-28 13:32:03,622 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". 2017-02-28 13:32:03,622 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_MANUAL" is "/usr/share/ovirt-engine/manual". 2017-02-28 13:32:03,623 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PERM_MAX" is "256m". 2017-02-28 13:32:03,623 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PERM_MIN" is "256m". 2017-02-28 13:32:03,629 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". 2017-02-28 13:32:03,629 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". 2017-02-28 13:32:03,630 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". 2017-02-28 13:32:03,630 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". 2017-02-28 13:32:03,631 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". 2017-02-28 13:32:03,631 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". 2017-02-28 13:32:03,631 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". 2017-02-28 13:32:03,632 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". 2017-02-28 13:32:03,632 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PROPERTIES" is " java.awt.headless=true sun.rmi.dgc.client.gcInterval=3600000 sun.rmi.dgc.server.gcInterval=3600000 jsse.enableSNIExtension=false "java.security.krb5.conf=/etc/ovirt-engine/krb5.conf"". 2017-02-28 13:32:03,639 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PROXY_ENABLED" is "true". 2017-02-28 13:32:03,639 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". 2017-02-28 13:32:03,639 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". 2017-02-28 13:32:03,640 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_BASE_URL" is "". 2017-02-28 13:32:03,640 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_DASHBOARD_URL" is "/flow.html?viewAsDashboardFrame=true". 2017-02-28 13:32:03,640 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_NOT_INSTALLED_URL" is "/ovirt-engine/ReportsNotInstalled.html". 2017-02-28 13:32:03,641 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_PROXY_URL" is "/ovirt/reports-interface". 2017-02-28 13:32:03,641 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_READ_TIMEOUT" is "". 2017-02-28 13:32:03,642 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_RIGHTCLICK_URL" is "". 2017-02-28 13:32:03,642 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_VERIFY_CHAIN" is "true". 2017-02-28 13:32:03,643 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_REPORTS_VERIFY_HOST" is "true". 2017-02-28 13:32:03,643 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_STOP_INTERVAL" is "1". 2017-02-28 13:32:03,644 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_STOP_TIME" is "10". 2017-02-28 13:32:03,644 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". 2017-02-28 13:32:03,644 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". 2017-02-28 13:32:03,645 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_URI" is "/ovirt-engine". 2017-02-28 13:32:03,645 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_USER" is "ovirt". 2017-02-28 13:32:03,645 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". 2017-02-28 13:32:03,646 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". 2017-02-28 13:32:03,646 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "ENGINE_VERBOSE_GC" is "false". 2017-02-28 13:32:03,647 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "JBOSS_HOME" is "/usr/share/ovirt-engine-jboss-as". 2017-02-28 13:32:03,647 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". 2017-02-28 13:32:03,647 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (MSC service thread 1-2) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD,ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD". 2017-02-28 13:32:04,467 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-3) Start initializing Backend 2017-02-28 13:32:05,191 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (MSC service thread 1-3) Loading file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties 2017-02-28 13:32:05,561 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-3) Running ovirt-engine 3.5.6.2-1.el6 2017-02-28 13:32:05,562 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-3) Start initializing dictionaries 2017-02-28 13:32:05,564 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (MSC service thread 1-3) Finished initializing dictionaries 2017-02-28 13:32:05,565 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Start initializing AuditLogCleanupManager 2017-02-28 13:32:05,565 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Setting audit cleanup manager to run at: 35 35 3 * * ? 2017-02-28 13:32:05,589 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Finished initializing AuditLogCleanupManager 2017-02-28 13:32:05,590 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Start initializing CommandEntityCleanupManager 2017-02-28 13:32:05,591 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Setting command entity cleanup manager to run at: 35 35 3 * * ? 2017-02-28 13:32:05,592 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (MSC service thread 1-3) Finished initializing CommandEntityCleanupManager 2017-02-28 13:32:05,595 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-3) Start initializing TagsDirector 2017-02-28 13:32:05,609 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-3) Tag root added to tree 2017-02-28 13:32:05,637 INFO [org.ovirt.engine.core.bll.TagsDirector] (MSC service thread 1-3) Finished initializing TagsDirector 2017-02-28 13:32:05,638 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-3) Start initializing IsoDomainListSyncronizer 2017-02-28 13:32:05,644 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (MSC service thread 1-3) Finished initializing IsoDomainListSyncronizer 2017-02-28 13:32:05,766 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-3) Completed initializing handlers 2017-02-28 13:32:05,793 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Start initializing ErrorTranslatorImpl 2017-02-28 13:32:05,811 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. 2017-02-28 13:32:05,812 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Finished initializing ErrorTranslatorImpl 2017-02-28 13:32:05,812 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Start initializing ErrorTranslatorImpl 2017-02-28 13:32:05,812 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (MSC service thread 1-3) Finished initializing ErrorTranslatorImpl 2017-02-28 13:32:05,814 INFO [org.ovirt.engine.core.bll.Backend] (MSC service thread 1-3) Mark incomplete jobs as UNKNOWN 2017-02-28 13:32:05,913 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-3) Start initializing JobRepositoryCleanupManager 2017-02-28 13:32:05,914 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (MSC service thread 1-3) Finished initializing JobRepositoryCleanupManager 2017-02-28 13:32:05,915 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-3) Start initializing AutoRecoveryManager 2017-02-28 13:32:05,916 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (MSC service thread 1-3) Finished initializing AutoRecoveryManager 2017-02-28 13:32:05,917 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-3) Start initializing ExecutionMessageDirector 2017-02-28 13:32:05,925 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (MSC service thread 1-3) Finished initializing ExecutionMessageDirector 2017-02-28 13:32:06,118 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Loading extension 'builtin-authn-internal' 2017-02-28 13:32:06,120 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Extension 'builtin-authn-internal' loaded 2017-02-28 13:32:06,122 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Loading extension 'internal' 2017-02-28 13:32:06,123 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Extension 'internal' loaded 2017-02-28 13:32:06,131 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Initializing extension 'builtin-authn-internal' 2017-02-28 13:32:06,131 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Extension 'builtin-authn-internal' initialized 2017-02-28 13:32:06,133 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Initializing extension 'internal' 2017-02-28 13:32:06,133 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Extension 'internal' initialized 2017-02-28 13:32:06,133 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Start of enabled extensions list 2017-02-28 13:32:06,134 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Instance name: 'builtin-authn-internal', Extension name: 'Internal Authn (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-28 13:32:06,135 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) Instance name: 'internal', Extension name: 'Internal Authz (Built-in)', Version: 'N/A', Notes: '', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: 'N/A', Initialized: 'true' 2017-02-28 13:32:06,135 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (MSC service thread 1-3) End of enabled extensions list 2017-02-28 13:32:06,381 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (MSC service thread 1-4) Initialization of AsyncTaskManager completed successfully. 2017-02-28 13:32:06,382 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-4) Start initializing ResourceManager 2017-02-28 13:32:06,495 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-4) Entered VdsManager constructor 2017-02-28 13:32:06,536 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-4) Initialize vdsBroker (node2.dev1.api-digital.com,54,321) 2017-02-28 13:32:06,825 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-4) VDS 45e4c281-f14f-43d5-8c3c-5664816072ee was added to the Resource Manager 2017-02-28 13:32:06,826 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-4) Entered VdsManager constructor 2017-02-28 13:32:06,836 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (MSC service thread 1-4) Initialize vdsBroker (node1.dev1.api-digital.com,54,321) 2017-02-28 13:32:06,843 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-4) VDS eb2aea6e-7de9-4a29-86de-1d43f52fc92a was added to the Resource Manager 2017-02-28 13:32:06,866 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (MSC service thread 1-4) Finished initializing ResourceManager 2017-02-28 13:32:06,867 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (MSC service thread 1-4) Initialization of OvfDataUpdater completed successfully. 2017-02-28 13:32:06,867 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Start scheduling to enable vds load balancer 2017-02-28 13:32:06,868 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Finished scheduling to enable vds load balancer 2017-02-28 13:32:06,868 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Start HA Reservation check 2017-02-28 13:32:06,869 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Finished HA Reservation check 2017-02-28 13:32:06,873 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-4) Init VM custom properties utilities 2017-02-28 13:32:06,874 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (MSC service thread 1-4) Init device custom properties utilities 2017-02-28 13:32:06,881 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Initializing Scheduling manager 2017-02-28 13:32:06,886 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Start initializing MacPoolManagerRanges 2017-02-28 13:32:06,918 INFO [org.ovirt.engine.core.bll.network.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) Finished initializing. Available MACs in pool: 255 2017-02-28 13:32:06,935 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) External scheduler disabled, discovery skipped 2017-02-28 13:32:06,935 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (MSC service thread 1-4) Initialized Scheduling manager 2017-02-28 13:32:06,936 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-4) Initializing DWH Heart Beat 2017-02-28 13:32:06,949 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (MSC service thread 1-4) DWH Heart Beat initialized 2017-02-28 13:32:10,081 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 13:32:10,089 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 13:32:11,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]), log id: 3d9699d8 2017-02-28 13:32:11,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: 3d9699d8 2017-02-28 13:32:11,052 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]), log id: 592c1a2c 2017-02-28 13:32:11,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GetHardwareInfoVDSCommand, log id: 592c1a2c 2017-02-28 13:32:11,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-5) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=4a035efd-a041-4e46-84db-01cf79400913, force=false, secondsToWait=0, gracefully=false, reason=), log id: 3a725f82 2017-02-28 13:32:11,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, DestroyVDSCommand, log id: 3a725f82 2017-02-28 13:32:11,938 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) RefreshVmList vm id 4a035efd-a041-4e46-84db-01cf79400913 status = Down on vds hosted_engine_2 ignoring it in the refresh until migration is done 2017-02-28 13:32:11,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-5) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 4b9d89f3 2017-02-28 13:32:11,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-5) FINISH, FullListVdsCommand, return: [{username=Unknown, acpiEnable=true, emulatedMachine=rhel6.5.0, pid=19729, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5901, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, pauseCode=NOERR, smartcardEnable=false, custom={device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=6838e8b7-a07b-4ead-9209-5e7fa2470c29, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=81b15942-d7f8-46b9-bb3c-80246951c1e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=583396ab-952d-4d50-a4e9-90b7bf077a50, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29device_410a0504-c0c5-4183-9a5b-82dab9aab557=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=410a0504-c0c5-4183-9a5b-82dab9aab557, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, guestFQDN=, bootMenuEnable=false, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, copyPasteEnable=true, displayIp=74.51.121.121, displayPort=5900, guestIPs=, guestDiskMapping={0QEMU_QEMU_HARDDISK_5c159fc6-918c-4efc-9={name=/dev/sda}, QEMU_DVD-ROM={name=/dev/sr0}}, clientIp=, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@191196e6, status=Up, timeOffset=0, maxVCpus=16, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=qxl}], log id: 4b9d89f3 2017-02-28 13:32:11,976 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {device=memballoon, specParams={model=none}, deviceType=balloon, type=balloon, alias=balloon0} 2017-02-28 13:32:11,983 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-5) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5901, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.121, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5900} 2017-02-28 13:32:12,660 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: hosted_engine_1 2017-02-28 13:32:12,717 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-5) Initializing Host: hosted_engine_2 2017-02-28 13:32:12,786 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-5) [2823b90] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 13:32:12,787 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [4271fb79] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-28 13:32:12,865 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-7) domain 831fd677-2894-48e7-8a0d-fd5c084a08e6:vms in problem. vds: hosted_engine_1 2017-02-28 13:32:16,928 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 13:32:16,940 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] Storage Pool 00000002-0002-0002-0002-00000000002b - Updating Storage Domain 831fd677-2894-48e7-8a0d-fd5c084a08e6 status from Active to Unknown, reason : null 2017-02-28 13:32:16,981 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: UNASSIGNED not exist in string table 2017-02-28 13:32:16,981 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table 2017-02-28 13:32:16,982 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_FAILED_REMOVE_VM not exist in string table 2017-02-28 13:32:16,982 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table 2017-02-28 13:32:16,983 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table 2017-02-28 13:32:16,984 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table 2017-02-28 13:32:16,984 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_ADDED_DISK_PROFILE not exist in string table 2017-02-28 13:32:16,985 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_FAILED_TO_ADD_DISK_PROFILE not exist in string table 2017-02-28 13:32:16,985 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_REMOVED_DISK_PROFILE not exist in string table 2017-02-28 13:32:16,986 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_FAILED_TO_REMOVE_DISK_PROFILE not exist in string table 2017-02-28 13:32:16,986 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_UPDATED_DISK_PROFILE not exist in string table 2017-02-28 13:32:16,987 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_FAILED_TO_UPDATE_DISK_PROFILE not exist in string table 2017-02-28 13:32:16,987 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_ADDED_CPU_PROFILE not exist in string table 2017-02-28 13:32:16,988 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_FAILED_TO_ADD_CPU_PROFILE not exist in string table 2017-02-28 13:32:16,988 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_REMOVED_CPU_PROFILE not exist in string table 2017-02-28 13:32:16,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_FAILED_TO_REMOVE_CPU_PROFILE not exist in string table 2017-02-28 13:32:16,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_UPDATED_CPU_PROFILE not exist in string table 2017-02-28 13:32:16,990 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] AuditLogType: USER_FAILED_TO_UPDATE_CPU_PROFILE not exist in string table 2017-02-28 13:32:17,357 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] Correlation ID: 63f3bc5b, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. 2017-02-28 13:32:17,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vdsId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 16f88c5b 2017-02-28 13:32:18,457 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] FINISH, ConnectStoragePoolVDSCommand, log id: 16f88c5b 2017-02-28 13:32:18,503 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] hostFromVds::selectedVds - hosted_engine_1, spmStatus Free, storage pool Default, storage pool version 3.5 2017-02-28 13:32:18,506 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [64a7ebf5] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,506 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [b56dcd0] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,516 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [18bfdce4] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,522 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [18bfdce4] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,526 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [64a7ebf5] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,528 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [b56dcd0] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] starting spm on vds hosted_engine_1, storage pool Default, prevId -1, LVER -1 2017-02-28 13:32:18,567 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [64a7ebf5] Correlation ID: 64a7ebf5, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,573 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-5) [18bfdce4] Correlation ID: 18bfdce4, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,573 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) [b56dcd0] Correlation ID: b56dcd0, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,593 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] START, SpmStartVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, storagePoolId = 00000002-0002-0002-0002-00000000002b, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 34655fc9 2017-02-28 13:32:18,596 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [675d02bb] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,595 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [38e3648c] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,594 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-8) [658efbd] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,600 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [38e3648c] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,601 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-8) [658efbd] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,606 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-8) [658efbd] Correlation ID: 658efbd, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,608 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [675d02bb] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,612 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [38e3648c] Correlation ID: 38e3648c, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,625 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [7ddf1502] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,627 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) [675d02bb] Correlation ID: 675d02bb, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,629 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-7) [7ddf1502] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] spmStart polling started: taskId = 2c28f185-3187-408d-82b0-7ae5f0824702 2017-02-28 13:32:18,644 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-7) [7ddf1502] Correlation ID: 7ddf1502, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,644 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [35dc298b] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,646 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [4c004b1d] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,651 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [4c004b1d] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,651 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [35dc298b] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,665 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-5) [35dc298b] Correlation ID: 35dc298b, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,672 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) [4c004b1d] Correlation ID: 4c004b1d, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,680 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [5c22c289] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,682 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [5c22c289] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,693 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [5c22c289] Correlation ID: 5c22c289, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,711 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [15902fd5] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,715 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-4) [7173113f] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,717 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-4) [7173113f] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,720 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [15902fd5] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,728 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [7173113f] Correlation ID: 7173113f, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,735 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) [15902fd5] Correlation ID: 15902fd5, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,752 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [396b9d15] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,754 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [170130c3] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,756 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [396b9d15] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,756 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [170130c3] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,767 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [396b9d15] Correlation ID: 396b9d15, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,772 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-5) [170130c3] Correlation ID: 170130c3, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,792 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-4) [4d465ab8] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,793 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [7ed1eb1c] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,795 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-4) [4d465ab8] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,797 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-2) [7ed1eb1c] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,804 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) [7ed1eb1c] Correlation ID: 7ed1eb1c, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,810 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-4) [4d465ab8] Correlation ID: 4d465ab8, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,869 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [6979eb8d] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,872 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [6979eb8d] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,882 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) [6979eb8d] Correlation ID: 6979eb8d, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,886 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [a189200] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,890 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [a189200] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,898 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [a189200] Correlation ID: a189200, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:18,954 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [45757b8b] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:18,959 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-6) [45757b8b] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:18,970 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-6) [45757b8b] Correlation ID: 45757b8b, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:19,005 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [387f2e91] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:19,014 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-3) [387f2e91] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:19,024 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-3) [387f2e91] Correlation ID: 387f2e91, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:19,048 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [57c48212] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:19,050 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [57c48212] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:19,069 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-5) [57c48212] Correlation ID: 57c48212, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:19,270 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [35b912dd] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:19,271 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-5) [35b912dd] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:19,297 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-5) [35b912dd] Correlation ID: 35b912dd, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:19,486 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-9) [32ca7e3f] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:19,488 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-9) [32ca7e3f] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:19,501 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) [32ca7e3f] Correlation ID: 32ca7e3f, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:19,534 INFO [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-9) [7dc3e70a] Running command: LogoutUserCommand internal: false. 2017-02-28 13:32:19,536 ERROR [org.ovirt.engine.core.bll.aaa.LogoutUserCommand] (ajp--127.0.0.1-8702-9) [7dc3e70a] Transaction rolled-back for command: org.ovirt.engine.core.bll.aaa.LogoutUserCommand. 2017-02-28 13:32:19,544 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-9) [7dc3e70a] Correlation ID: 7dc3e70a, Call Stack: null, Custom Event ID: -1, Message: Failed to log User SYSTEM out. 2017-02-28 13:32:40,781 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] spmStart polling ended: taskId = 2c28f185-3187-408d-82b0-7ae5f0824702 task status = finished 2017-02-28 13:32:41,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] spmStart polling ended, spm status: SPM 2017-02-28 13:32:41,157 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] START, HSMClearTaskVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, taskId=2c28f185-3187-408d-82b0-7ae5f0824702), log id: 39b10c07 2017-02-28 13:32:41,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] FINISH, HSMClearTaskVDSCommand, log id: 39b10c07 2017-02-28 13:32:41,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@55fd41f7, log id: 34655fc9 2017-02-28 13:32:41,191 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] Initialize Irs proxy from vds: node1.dev1.api-digital.com 2017-02-28 13:32:41,226 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [63f3bc5b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_1 (Address: node1.dev1.api-digital.com). 2017-02-28 13:32:41,230 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 13:32:41,310 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [63f3bc5b] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-00000000002b, ignoreFailoverLimit = false), log id: 390cba99 2017-02-28 13:32:41,403 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-28) [7c85a494] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 13:32:41,410 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [63f3bc5b] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-00000000002b 2017-02-28 13:32:41,446 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [63f3bc5b] START, HSMGetAllTasksInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 7ffe8efb 2017-02-28 13:32:41,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [63f3bc5b] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 7ffe8efb 2017-02-28 13:32:41,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-27) [63f3bc5b] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 390cba99 2017-02-28 13:32:41,455 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-27) [63f3bc5b] Discovered no tasks on Storage Pool Default 2017-02-28 13:32:41,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [7c85a494] START, GetVGInfoVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, VGID=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq), log id: 5679a274 2017-02-28 13:32:41,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-28) [7c85a494] FINISH, GetVGInfoVDSCommand, return: [LUNs [id=3600140568946636764f4c968b8d38f40, physicalVolumeId=MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH, volumeGroupId=E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq, serial=SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f, lunMapping=0, vendorId=LIO-ORG, productId=vms, _lunConnections=[{ id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };, { id: null, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };], deviceSize=1024, vendorName=LIO-ORG, pathsDictionary={sdd=true, sdc=true}, lunType=ISCSI, status=null, diskId=null, diskAlias=null, storageDomainId=831fd677-2894-48e7-8a0d-fd5c084a08e6, storageDomainName=null]], log id: 5679a274 2017-02-28 13:32:43,719 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-31) Domain 831fd677-2894-48e7-8a0d-fd5c084a08e6:vms recovered from problem. vds: hosted_engine_1 2017-02-28 13:33:04,367 INFO [org.ovirt.engine.docs.utils.servlet.ContextSensitiveHelpMappingServlet] (ajp--127.0.0.1-8702-2) Context-sensitive help is not installed. Manual directory doesn't exist: /usr/share/ovirt-engine/manual 2017-02-28 13:33:44,857 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (ajp--127.0.0.1-8702-2) Running command: LoginAdminUserCommand internal: false. 2017-02-28 13:33:44,872 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-28 13:37:12,869 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-30) starting processDomainRecovery for domain 831fd677-2894-48e7-8a0d-fd5c084a08e6:vms 2017-02-28 13:37:12,911 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-30) vds hosted_engine_2 reported domain 831fd677-2894-48e7-8a0d-fd5c084a08e6:vms as in problem, attempting to move the vds to status NonOperational 2017-02-28 13:37:12,912 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-30) Removing vds [45e4c281-f14f-43d5-8c3c-5664816072ee] from the domain in maintenance cache 2017-02-28 13:37:12,913 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-30) Removing host(s) [45e4c281-f14f-43d5-8c3c-5664816072ee] from hosts unseen domain report cache 2017-02-28 13:37:13,097 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (org.ovirt.thread.pool-8-thread-31) [78976d5b] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 13:37:13,121 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-31) [78976d5b] START, SetVdsStatusVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, status=NonOperational, nonOperationalReason=STORAGE_DOMAIN_UNREACHABLE, stopSpmFailureLogged=false), log id: 4e81fb24 2017-02-28 13:37:13,131 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-8-thread-31) [78976d5b] FINISH, SetVdsStatusVDSCommand, log id: 4e81fb24 2017-02-28 13:37:13,163 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-31) [78976d5b] Correlation ID: 78976d5b, Job ID: 2bcdd9ab-7ee8-45d5-9634-3d0fe3e661fe, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 cannot access the Storage Domain(s) vms attached to the Data Center Default. Setting Host state to Non-Operational. 2017-02-28 13:37:13,202 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-8-thread-29) [34fe667] Lock Acquired to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 13:37:13,383 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-8-thread-29) [34fe667] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: 15c5443a-654a-4464-8b28-33d2bdd34ec7 Type: VM 2017-02-28 13:37:13,476 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-8-thread-29) [34fe667] START, MigrateVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, srcHost=node2.dev1.api-digital.com, dstVdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, dstHost=node1.dev1.api-digital.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 76288613 2017-02-28 13:37:13,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-8-thread-29) [34fe667] START, MigrateBrokerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, srcHost=node2.dev1.api-digital.com, dstVdsId=eb2aea6e-7de9-4a29-86de-1d43f52fc92a, dstHost=node1.dev1.api-digital.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 1e58961b 2017-02-28 13:37:13,504 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-8-thread-29) [34fe667] FINISH, MigrateBrokerVDSCommand, log id: 1e58961b 2017-02-28 13:37:13,554 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-8-thread-29) [34fe667] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 76288613 2017-02-28 13:37:16,286 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-64) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done 2017-02-28 13:37:19,355 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done 2017-02-28 13:37:22,501 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-77) RefreshVmList vm id 15c5443a-654a-4464-8b28-33d2bdd34ec7 is migrating to vds hosted_engine_1 ignoring it in the refresh until migration is done 2017-02-28 13:37:25,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-81) START, DestroyVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, force=false, secondsToWait=0, gracefully=false, reason=), log id: 69841d23 2017-02-28 13:37:25,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-80) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 14201751 2017-02-28 13:37:25,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-80) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, afterMigrationStatus=, pid=18807, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5902, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, custom={device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=6838e8b7-a07b-4ead-9209-5e7fa2470c29, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=81b15942-d7f8-46b9-bb3c-80246951c1e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=583396ab-952d-4d50-a4e9-90b7bf077a50, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29device_410a0504-c0c5-4183-9a5b-82dab9aab557=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=410a0504-c0c5-4183-9a5b-82dab9aab557, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, guestDiskMapping={}, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, copyPasteEnable=true, displayIp=74.51.121.119, displayPort=5901, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@46dad129, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 14201751 2017-02-28 13:37:25,617 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-80) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {target=1048576, alias=balloon0, specParams={model=none}, deviceType=balloon, device=memballoon, type=balloon} 2017-02-28 13:37:25,618 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-80) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5902, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.119, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5901} 2017-02-28 13:37:25,703 WARN [org.ovirt.engine.core.bll.ChangeVMClusterCommand] (DefaultQuartzScheduler_Worker-80) [6da1d326] CanDoAction of action ChangeVMCluster failed for user SYSTEM. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM__CLUSTER,VM_CLUSTER_IS_NOT_VALID 2017-02-28 13:37:25,733 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-80) [6da1d326] Correlation ID: 34fe667, Job ID: 617dbd2a-f7db-4dbc-b0f4-e47a8519b5d9, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: test, Source: hosted_engine_2, Destination: hosted_engine_1, Duration: 12 seconds). 2017-02-28 13:37:25,739 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (DefaultQuartzScheduler_Worker-80) [6da1d326] Lock freed to object EngineLock [exclusiveLocks= key: 15c5443a-654a-4464-8b28-33d2bdd34ec7 value: VM , sharedLocks= ] 2017-02-28 13:37:25,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, DestroyVDSCommand, log id: 69841d23 2017-02-28 13:37:25,789 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) Handing over VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 to Host eb2aea6e-7de9-4a29-86de-1d43f52fc92a. Setting VM to status MigratingTo 2017-02-28 13:37:25,790 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) VM test (15c5443a-654a-4464-8b28-33d2bdd34ec7) is running in db and not running in VDS hosted_engine_2 2017-02-28 13:37:25,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-81) START, FullListVdsCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 5fd5b7f8 2017-02-28 13:37:25,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-81) FINISH, FullListVdsCommand, return: [], log id: 5fd5b7f8 2017-02-28 13:37:28,770 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) VM test 15c5443a-654a-4464-8b28-33d2bdd34ec7 moved from MigratingTo --> Up 2017-02-28 13:37:28,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-88) START, FullListVdsCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, vds=Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a], vmIds=[15c5443a-654a-4464-8b28-33d2bdd34ec7]), log id: 3438ee8f 2017-02-28 13:37:28,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-88) FINISH, FullListVdsCommand, return: [{acpiEnable=true, emulatedMachine=rhel6.5.0, afterMigrationStatus=, pid=18807, memGuaranteedSize=682, transparentHugePages=true, displaySecurePort=5902, spiceSslCipherSuite=DEFAULT, cpuType=Westmere, smp=1, custom={device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=6838e8b7-a07b-4ead-9209-5e7fa2470c29, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=81b15942-d7f8-46b9-bb3c-80246951c1e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=583396ab-952d-4d50-a4e9-90b7bf077a50, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}, device_81b15942-d7f8-46b9-bb3c-80246951c1e8device_583396ab-952d-4d50-a4e9-90b7bf077a50device_6838e8b7-a07b-4ead-9209-5e7fa2470c29device_410a0504-c0c5-4183-9a5b-82dab9aab557=VmDevice {vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, deviceId=410a0504-c0c5-4183-9a5b-82dab9aab557, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide, customProperties={}, snapshotId=null, logicalName=null}}, vmType=kvm, memSize=1024, smpCoresPerSocket=1, vmName=test, nice=0, status=Up, bootMenuEnable=false, guestDiskMapping={0QEMU_QEMU_HARDDISK_5c159fc6-918c-4efc-9={name=/dev/sda}, QEMU_DVD-ROM={name=/dev/sr0}}, vmId=15c5443a-654a-4464-8b28-33d2bdd34ec7, copyPasteEnable=true, displayIp=74.51.121.119, displayPort=5901, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, fileTransferEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, kvmEnable=true, pitReinjection=false, displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@5b60912, timeOffset=0, maxVCpus=16, clientIp=, display=qxl}], log id: 3438ee8f 2017-02-28 13:37:28,783 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) Received a memballoon Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {target=1048576, alias=balloon0, specParams={model=none}, deviceType=balloon, device=memballoon, type=balloon} 2017-02-28 13:37:28,784 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) Received a spice Device without an address when processing VM 15c5443a-654a-4464-8b28-33d2bdd34ec7 devices, skipping device: {tlsPort=5902, specParams={displayNetwork=ovirtmgmt, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=74.51.121.119, copyPasteEnable=true}, deviceType=graphics, device=spice, type=graphics, port=5901} 2017-02-28 13:40:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) Autorecovering 1 hosts 2017-02-28 13:40:00,028 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) Autorecovering hosts id: 45e4c281-f14f-43d5-8c3c-5664816072ee, name : hosted_engine_2 2017-02-28 13:40:00,049 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-16) [58f8bbf4] Lock Acquired to object EngineLock [exclusiveLocks= key: 45e4c281-f14f-43d5-8c3c-5664816072ee value: VDS , sharedLocks= ] 2017-02-28 13:40:00,050 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-16) [58f8bbf4] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 13:40:00,051 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-16) [58f8bbf4] Before acquiring lock in order to prevent monitoring for host hosted_engine_2 from data-center Default 2017-02-28 13:40:00,052 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-16) [58f8bbf4] Lock acquired, from now a monitoring of host will be skipped for host hosted_engine_2 from data-center Default 2017-02-28 13:40:00,074 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-16) [58f8bbf4] START, SetVdsStatusVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 483f2a0f 2017-02-28 13:40:00,107 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-16) [58f8bbf4] FINISH, SetVdsStatusVDSCommand, log id: 483f2a0f 2017-02-28 13:40:00,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (DefaultQuartzScheduler_Worker-16) START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 54a21c4d 2017-02-28 13:40:00,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, SetHaMaintenanceModeVDSCommand, log id: 54a21c4d 2017-02-28 13:40:00,296 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-16) Activate finished. Lock released. Monitoring can run now for host hosted_engine_2 from data-center Default 2017-02-28 13:40:00,303 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) Correlation ID: 58f8bbf4, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 was autorecovered. 2017-02-28 13:40:00,303 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-16) Lock freed to object EngineLock [exclusiveLocks= key: 45e4c281-f14f-43d5-8c3c-5664816072ee value: VDS , sharedLocks= ] 2017-02-28 13:40:03,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vds=Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]), log id: 7cff25ae 2017-02-28 13:40:03,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GetHardwareInfoVDSCommand, log id: 7cff25ae 2017-02-28 13:40:03,170 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-23) [4cbe64bc] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 13:40:03,197 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-23) [7d71c45f] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 13:40:03,231 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-23) [4d759887] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 13:40:03,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-23) [4d759887] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, storageType = ISCSI, connectionList = [{ id: 1132fab7-6c11-40e4-8b77-2f3814d4d665, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em3, netIfaceName: em3 };{ id: fae7855d-c20b-4d6a-b5f7-8a218d705ba3, connection: 10.43.0.1, iqn: iqn.2017-02.com.api-digital.dev1:vms, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null, iface: em4, netIfaceName: em4 };]), log id: 385ac333 2017-02-28 13:40:03,687 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-23) [4d759887] FINISH, ConnectStorageServerVDSCommand, return: {fae7855d-c20b-4d6a-b5f7-8a218d705ba3=0, 1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 385ac333 2017-02-28 13:40:03,688 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-23) [4d759887] Host hosted_engine_2 storage connection was succeeded 2017-02-28 13:40:03,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-22) START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee, vdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, storagePoolId = 00000002-0002-0002-0002-00000000002b, masterVersion = 1), log id: 5b4a90fa 2017-02-28 13:40:04,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-22) FINISH, ConnectStoragePoolVDSCommand, log id: 5b4a90fa 2017-02-28 13:40:04,239 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [4d759887] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_1 from cluster Default was chosen as a proxy to execute Status command on Host hosted_engine_2. 2017-02-28 13:40:04,240 INFO [org.ovirt.engine.core.bll.FenceExecutor] (DefaultQuartzScheduler_Worker-23) [4d759887] Using Host hosted_engine_1 from cluster Default as proxy to execute Status command on Host hosted_engine_2 2017-02-28 13:40:04,262 INFO [org.ovirt.engine.core.bll.FenceExecutor] (DefaultQuartzScheduler_Worker-23) [4d759887] Executing Power Management command, Proxy Host:hosted_engine_1, Agent:ipmilan, Target Host:hosted_engine_2, Management IP:74.51.121.120, User:root, Options:lanplus=1, Fencing policy:null 2017-02-28 13:40:04,284 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler_Worker-23) [4d759887] START, FenceVdsVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a, targetVdsId = 45e4c281-f14f-43d5-8c3c-5664816072ee, action = Status, ip = 74.51.121.120, port = , type = ipmilan, user = root, password = ******, options = 'lanplus=1', policy = 'null'), log id: d57cc98 2017-02-28 13:40:04,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler_Worker-23) [4d759887] FINISH, FenceVdsVDSCommand, return: Test Succeeded, on, log id: d57cc98 2017-02-28 13:40:04,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [4d759887] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_2, HostId = 45e4c281-f14f-43d5-8c3c-5664816072ee), log id: 4bfd3dbb 2017-02-28 13:40:04,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-23) [4d759887] FINISH, SetMOMPolicyParametersVDSCommand, log id: 4bfd3dbb 2017-02-28 13:40:04,805 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [4d759887] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host hosted_engine_2 was set to Up. 2017-02-28 13:40:04,813 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [4d759887] Correlation ID: 7d71c45f, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 power management was verified successfully. 2017-02-28 13:40:04,852 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-23) [19a02ad6] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 14:31:17,628 INFO [org.ovirt.engine.core.bll.SetHaMaintenanceCommand] (ajp--127.0.0.1-8702-8) [7f9b76f8] Running command: SetHaMaintenanceCommand internal: false. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 14:31:17,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (ajp--127.0.0.1-8702-8) [7f9b76f8] START, SetHaMaintenanceModeVDSCommand(HostName = hosted_engine_1, HostId = eb2aea6e-7de9-4a29-86de-1d43f52fc92a), log id: 1ae721f3 2017-02-28 14:31:17,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetHaMaintenanceModeVDSCommand] (ajp--127.0.0.1-8702-8) [7f9b76f8] FINISH, SetHaMaintenanceModeVDSCommand, log id: 1ae721f3 2017-02-28 14:31:17,748 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-8) [7f9b76f8] Correlation ID: 7f9b76f8, Call Stack: null, Custom Event ID: -1, Message: Hosted Engine HA maintenance mode was updated on host hosted_engine_1. 2017-02-28 14:32:06,870 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. 2017-02-28 14:32:06,877 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-90) [2d1a38d8] Running command: ProcessOvfUpdateForStoragePoolCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 14:32:06,926 INFO [org.ovirt.engine.core.bll.ProcessOvfUpdateForStoragePoolCommand] (DefaultQuartzScheduler_Worker-90) [2d1a38d8] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-00000000002b value: OVF_UPDATE , sharedLocks= ] 2017-02-28 14:40:28,525 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Loaded file '/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf'. 2017-02-28 14:40:28,526 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] The file '/etc/ovirt-engine/engine.conf' doesn't exist or isn't readable. Will return an empty set of properties. 2017-02-28 14:40:28,526 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-database.conf'. 2017-02-28 14:40:28,527 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-java.conf'. 2017-02-28 14:40:28,527 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf'. 2017-02-28 14:40:28,527 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf'. 2017-02-28 14:40:28,527 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Loaded file '/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf'. 2017-02-28 14:40:28,527 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Loaded file '/etc/ovirt-engine/engine.conf.d/20-setup-jboss-overlay.conf'. 2017-02-28 14:40:28,527 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Loaded file '/etc/ovirt-engine/engine.conf.d/50-ovirt-engine-extension-aaa-jdbc.conf'. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'AAA_JAAS_KEYTAB_FILE' is ''. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'AAA_JAAS_TICKET_CACHE_FILE' is ''. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'AAA_JAAS_USE_KEYTAB' is 'false'. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'AAA_JAAS_USE_TICKET_CACHE' is 'false'. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'AAA_KRB5_CONF_FILE' is ''. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_AJP_ENABLED' is 'true'. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_AJP_PORT' is '8702'. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_APPS' is 'engine.ear restapi.war legacy_restapi.war'. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_CACHE' is '/var/cache/ovirt-engine'. 2017-02-28 14:40:28,534 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_CHECK_INTERVAL' is '1000'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_CONNECTION_TIMEOUT' is '300000'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_DATABASE' is 'engine'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_DRIVER' is 'org.postgresql.Driver'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_HOST' is 'localhost'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_MAX_CONNECTIONS' is '100'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_MIN_CONNECTIONS' is '1'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_PASSWORD' is '***'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_PORT' is '5432'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_SECURED' is 'False'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_SECURED_VALIDATION' is 'False'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_URL' is 'jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DB_USER' is 'engine'. 2017-02-28 14:40:28,535 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DEBUG_ADDRESS' is ''. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DEPLOYMENT_SCANNER' is 'false'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_DOC' is '/usr/share/doc/ovirt-engine'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_ETC' is '/etc/ovirt-engine'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_EXTENSION_PATH' is '/usr/share/ovirt-engine/extensions.d:/etc/ovirt-engine/extensions.d'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE' is '/var/lib/ovirt-engine/external_truststore'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD' is '***'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_TYPE' is 'JKS'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_FQDN' is 'engine.dev1.api-digital.com'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_GROUP' is 'ovirt'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_HEAP_MAX' is '2000M'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_HEAP_MIN' is '2000M'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_HTTPS_ENABLED' is 'false'. 2017-02-28 14:40:28,536 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_HTTPS_PORT' is 'None'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_HTTPS_PROTOCOLS' is 'SSLv3,TLSv1,TLSv1.1,TLSv1.2'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_HTTP_ENABLED' is 'false'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_HTTP_PORT' is 'None'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_JAVA_MODULEPATH' is '/usr/share/ovirt-engine-wildfly-overlay/modules:/usr/share/ovirt-engine/modules/common:/usr/share/ovirt-engine-extension-aaa-jdbc/modules'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_JMX_INTERFACE' is 'loopback'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_JVM_ARGS' is ' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_LOG' is '/var/log/ovirt-engine'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_LOG_TO_CONSOLE' is 'false'. 2017-02-28 14:40:28,544 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_MANUAL' is '/usr/share/ovirt-engine/manual'. 2017-02-28 14:40:28,545 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_NON_JTA_DB_MAX_CONNECTIONS' is '10'. 2017-02-28 14:40:28,545 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_NON_JTA_DB_MIN_CONNECTIONS' is '1'. 2017-02-28 14:40:28,545 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PERM_MAX' is '256m'. 2017-02-28 14:40:28,545 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PERM_MIN' is '256m'. 2017-02-28 14:40:28,545 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI' is '/etc/pki/ovirt-engine'. 2017-02-28 14:40:28,545 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_CA' is '/etc/pki/ovirt-engine/ca.pem'. 2017-02-28 14:40:28,545 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_ENGINE_CERT' is '/etc/pki/ovirt-engine/certs/engine.cer'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_ENGINE_STORE' is '/etc/pki/ovirt-engine/keys/engine.p12'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_ENGINE_STORE_ALIAS' is '1'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_ENGINE_STORE_PASSWORD' is '***'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_ENGINE_STORE_TYPE' is 'PKCS12'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_TRUST_STORE' is '/etc/pki/ovirt-engine/.truststore'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_TRUST_STORE_PASSWORD' is '***'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PKI_TRUST_STORE_TYPE' is 'JKS'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PROPERTIES' is ' java.awt.headless=true sun.rmi.dgc.client.gcInterval=3600000 sun.rmi.dgc.server.gcInterval=3600000 jsse.enableSNIExtension=false "java.security.krb5.conf=/etc/ovirt-engine/krb5.conf"'. 2017-02-28 14:40:28,546 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PROXY_ENABLED' is 'true'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PROXY_HTTPS_PORT' is '443'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_PROXY_HTTP_PORT' is '80'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_REPORTS_BASE_URL' is ''. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_REPORTS_DASHBOARD_URL' is ''. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_REPORTS_NOT_INSTALLED_URL' is '/ovirt-engine/ReportsNotInstalled.html'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_REPORTS_PROXY_URL' is '/ovirt/reports-interface'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_REPORTS_READ_TIMEOUT' is ''. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_REPORTS_RIGHTCLICK_URL' is ''. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_REPORTS_VERIFY_CHAIN' is 'true'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_REPORTS_VERIFY_HOST' is 'true'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_STOP_INTERVAL' is '1'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_STOP_TIME' is '10'. 2017-02-28 14:40:28,547 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_TMP' is '/var/tmp/ovirt-engine'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_UP_MARK' is '/var/lib/ovirt-engine/engine.up'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_URI' is '/ovirt-engine'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_USER' is 'ovirt'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_USR' is '/usr/share/ovirt-engine'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_VAR' is '/var/lib/ovirt-engine'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'ENGINE_VERBOSE_GC' is 'false'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'JBOSS_HOME' is '/usr/share/ovirt-engine-wildfly'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'JBOSS_RUNTIME' is '/var/lib/ovirt-engine/jboss_runtime'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'PACKAGE_DISPLAY_VERSION' is '3.6.7.5-1.el6'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'PACKAGE_NAME' is 'ovirt-engine'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'PACKAGE_VERSION' is '3.6.7.5'. 2017-02-28 14:40:28,548 INFO [org.ovirt.engine.core.uutils.config.ShellLikeConfd] (default task-1) [] Value of property 'SENSITIVE_KEYS' is ',ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD,ENGINE_EXTERNAL_PROVIDERS_TRUST_STORE_PASSWORD'. 2017-02-28 14:40:39,337 INFO [org.ovirt.engine.core.dal.dbbroker.DbFacade] (ServerService Thread Pool -- 38) [] Initializing the DbFacade 2017-02-28 14:40:39,403 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Start initializing Backend 2017-02-28 14:40:39,530 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.hostedengine.PreviousHostedEngineHost@20cc7124 2017-02-28 14:40:39,641 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Started task scheduler org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl@1ab4195c 2017-02-28 14:40:39,745 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Started task scheduler org.ovirt.engine.core.utils.timer.DBSchedulerUtilQuartzImpl@692704e9 2017-02-28 14:40:39,999 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.dal.utils.CacheManager@453da046 2017-02-28 14:40:40,163 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 38) [] Loading file '/etc/ovirt-engine/osinfo.conf.d/00-defaults.properties' 2017-02-28 14:40:40,333 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Running ovirt-engine 3.6.7.5-1.el6 2017-02-28 14:40:40,333 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 38) [] Start initializing dictionaries 2017-02-28 14:40:40,336 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 38) [] Finished initializing dictionaries 2017-02-28 14:40:40,336 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 38) [] Start initializing AuditLogCleanupManager 2017-02-28 14:40:40,336 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 38) [] Setting audit cleanup manager to run at '35 35 3 * * ?' 2017-02-28 14:40:40,352 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 38) [] Finished initializing AuditLogCleanupManager 2017-02-28 14:40:40,355 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 38) [] Start initializing CommandEntityCleanupManager 2017-02-28 14:40:40,355 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 38) [] Setting command entity cleanup manager to run at: 35 35 3 * * ? 2017-02-28 14:40:40,359 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 38) [] Finished initializing CommandEntityCleanupManager 2017-02-28 14:40:40,359 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 38) [] Start initializing TagsDirector 2017-02-28 14:40:40,368 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 38) [] Tag 'root' added to tree 2017-02-28 14:40:40,379 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 38) [] Finished initializing TagsDirector 2017-02-28 14:40:40,389 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 38) [] Start initializing IsoDomainListSyncronizer 2017-02-28 14:40:40,393 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 38) [] Finished initializing IsoDomainListSyncronizer 2017-02-28 14:40:40,426 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Completed initializing handlers 2017-02-28 14:40:40,426 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 38) [] Start initializing ErrorTranslatorImpl 2017-02-28 14:40:40,436 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 38) [] Code 'MAC_ADDRESS_IS_IN_USE' appears more than once in string table. 2017-02-28 14:40:40,437 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 38) [] Finished initializing ErrorTranslatorImpl 2017-02-28 14:40:40,437 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 38) [] Start initializing ErrorTranslatorImpl 2017-02-28 14:40:40,437 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 38) [] Finished initializing ErrorTranslatorImpl 2017-02-28 14:40:40,437 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Mark incomplete jobs as UNKNOWN 2017-02-28 14:40:40,518 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 38) [] Start initializing JobRepositoryCleanupManager 2017-02-28 14:40:40,519 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 38) [] Finished initializing JobRepositoryCleanupManager 2017-02-28 14:40:40,520 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 38) [] Start initializing AutoRecoveryManager 2017-02-28 14:40:40,521 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 38) [] Finished initializing AutoRecoveryManager 2017-02-28 14:40:40,523 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 38) [] Start initializing ExecutionMessageDirector 2017-02-28 14:40:40,525 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 38) [] Finished initializing ExecutionMessageDirector 2017-02-28 14:40:40,527 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.VmPoolMonitor@142c3295 2017-02-28 14:40:40,559 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.AutoStartVmsRunner@23de8360 2017-02-28 14:40:40,561 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.quota.QuotaManager@5a9af229 2017-02-28 14:40:41,730 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Loading extension 'internal-authn' 2017-02-28 14:40:41,733 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Extension 'internal-authn' loaded 2017-02-28 14:40:41,735 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Loading extension 'internal' 2017-02-28 14:40:41,736 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Extension 'internal' loaded 2017-02-28 14:40:41,737 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Initializing extension 'internal-authn' 2017-02-28 14:40:41,757 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Extension 'internal-authn' initialized 2017-02-28 14:40:41,758 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Initializing extension 'internal' 2017-02-28 14:40:41,763 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Extension 'internal' initialized 2017-02-28 14:40:41,763 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Start of enabled extensions list 2017-02-28 14:40:41,763 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Instance name: 'internal-authn', Extension name: '"ovirt-engine-extension-aaa-jdbc".authn', Version: '"1.0.7"', Notes: 'Display name: "ovirt-engine-extension-aaa-jdbc"', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: '/etc/ovirt-engine/extensions.d/internal-authn.properties', Initialized: 'true' 2017-02-28 14:40:41,763 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] Instance name: 'internal', Extension name: '"ovirt-engine-extension-aaa-jdbc".authz', Version: '"1.0.7"', Notes: 'Display name: "ovirt-engine-extension-aaa-jdbc"', License: 'ASL 2.0', Home: 'http://www.ovirt.org', Author 'The oVirt Project', Build interface Version: '0', File: '/etc/ovirt-engine/extensions.d/internal-authz.properties', Initialized: 'true' 2017-02-28 14:40:41,763 INFO [org.ovirt.engine.core.extensions.mgr.ExtensionsManager] (ServerService Thread Pool -- 38) [] End of enabled extensions list 2017-02-28 14:40:41,939 INFO [org.ovirt.engine.core.bll.pm.PmHealthCheckManager] (ServerService Thread Pool -- 38) [] Finished initializing PmHealthCheckManager 2017-02-28 14:40:41,939 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.pm.PmHealthCheckManager@12803a13 2017-02-28 14:40:41,940 INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (ServerService Thread Pool -- 38) [] Start initializing EngineBackupAwarenessManager 2017-02-28 14:40:41,940 INFO [org.ovirt.engine.core.bll.EngineBackupAwarenessManager] (ServerService Thread Pool -- 38) [] Finished initializing EngineBackupAwarenessManager 2017-02-28 14:40:41,940 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.EngineBackupAwarenessManager@2064bee2 2017-02-28 14:40:41,949 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (ServerService Thread Pool -- 38) [] Initialization of AsyncTaskManager completed successfully. 2017-02-28 14:40:41,950 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) [] Start initializing ResourceManager 2017-02-28 14:40:42,054 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) [] Entered VdsManager constructor 2017-02-28 14:40:42,074 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) [] Initialize vdsBroker 'node1.dev1.api-digital.com:54321' 2017-02-28 14:40:42,192 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) [] VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' was added to the Resource Manager 2017-02-28 14:40:42,192 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) [] Entered VdsManager constructor 2017-02-28 14:40:42,202 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 38) [] Initialize vdsBroker 'node2.dev1.api-digital.com:54321' 2017-02-28 14:40:42,237 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) [] VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' was added to the Resource Manager 2017-02-28 14:40:42,270 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 38) [] Finished initializing ResourceManager 2017-02-28 14:40:42,272 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.vdsbroker.ResourceManager@4ce171c 2017-02-28 14:40:42,272 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 38) [] Initialization of OvfDataUpdater completed successfully. 2017-02-28 14:40:42,278 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Init VM custom properties utilities 2017-02-28 14:40:42,279 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Init device custom properties utilities 2017-02-28 14:40:42,298 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) [] Initializing Scheduling manager 2017-02-28 14:40:42,321 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) [] Start initializing MacPoolManagerRanges 2017-02-28 14:40:42,323 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolManagerRanges] (org.ovirt.thread.pool-8-thread-1) [] Finished initializing. Available MACs in pool: 256 2017-02-28 14:40:42,323 INFO [org.ovirt.engine.core.bll.network.macpoolmanager.MacPoolPerDc] (org.ovirt.thread.pool-8-thread-1) [] Successfully initialized 2017-02-28 14:40:42,369 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) [] External scheduler disabled, discovery skipped 2017-02-28 14:40:42,369 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) [] Start scheduling to enable vds load balancer 2017-02-28 14:40:42,369 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) [] Finished scheduling to enable vds load balancer 2017-02-28 14:40:42,369 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) [] Start HA Reservation check 2017-02-28 14:40:42,369 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) [] Finished HA Reservation check 2017-02-28 14:40:42,369 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 38) [] Initialized Scheduling manager 2017-02-28 14:40:42,369 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.scheduling.SchedulingManager@213d0342 2017-02-28 14:40:42,440 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-2) [4d9f0900] Start running CanDoAction for command number 1/2 (Command type 'RefreshHostDevices') 2017-02-28 14:40:42,452 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-3) [40806d0] Start running CanDoAction for command number 2/2 (Command type 'RefreshHostDevices') 2017-02-28 14:40:42,577 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-2) [4d9f0900] Finish handling CanDoAction for command number 1/2 (Command type 'RefreshHostDevices') 2017-02-28 14:40:42,582 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (org.ovirt.thread.pool-8-thread-3) [40806d0] Finish handling CanDoAction for command number 2/2 (Command type 'RefreshHostDevices') 2017-02-28 14:40:42,586 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.hostdev.HostDeviceManager@416371de 2017-02-28 14:40:42,586 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 38) [] Initializing DWH Heart Beat 2017-02-28 14:40:42,587 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 38) [] DWH Heart Beat initialized 2017-02-28 14:40:42,587 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.dwh.DwhHeartBeat@67c8c75b 2017-02-28 14:40:42,600 INFO [org.ovirt.engine.core.bll.hostdev.RefreshHostDevicesCommand] (org.ovirt.thread.pool-8-thread-4) [4d9f0900] Running command: RefreshHostDevicesCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 14:40:42,644 INFO [org.ovirt.engine.core.bll.hostdev.RefreshHostDevicesCommand] (org.ovirt.thread.pool-8-thread-4) [40806d0] Running command: RefreshHostDevicesCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 14:40:42,654 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 38) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Affinity Rules Enforcement Manager started. 2017-02-28 14:40:42,654 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.scheduling.AffinityRulesEnforcementManager@6942dd7b 2017-02-28 14:40:42,655 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 38) [] Start org.ovirt.engine.core.bll.CertificationValidityChecker@24daec3a 2017-02-28 14:40:45,293 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 14:40:45,313 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 14:40:45,470 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) [] Unable to process messages 2017-02-28 14:40:45,495 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) [] Unable to process messages 2017-02-28 14:40:48,200 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 14:40:48,248 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 14:40:48,277 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) [] Unable to process messages 2017-02-28 14:40:52,397 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-32) [7c386a60] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 14:40:52,409 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-32) [7c386a60] Storage Pool '00000002-0002-0002-0002-00000000002b' - Updating Storage Domain '831fd677-2894-48e7-8a0d-fd5c084a08e6' status from 'Active' to 'Unknown', reason: null 2017-02-28 14:40:52,566 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) [7c386a60] Correlation ID: 7c386a60, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. 2017-02-28 14:40:52,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-32) [7c386a60] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, ConnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', vdsId='45e4c281-f14f-43d5-8c3c-5664816072ee', storagePoolId='00000002-0002-0002-0002-00000000002b', masterVersion='1'}), log id: 5cc5dc33 2017-02-28 14:41:18,275 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) [] Internal server error 2017-02-28 14:41:18,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-32) [7c386a60] FINISH, ConnectStoragePoolVDSCommand, log id: 5cc5dc33 2017-02-28 14:41:18,283 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-32) [7c386a60] IrsBroker::Failed::GetStoragePoolInfoVDS: IRSGenericException: IRSErrorException: IRSNonOperationalException: Could not connect host to Data Center(Storage issue) 2017-02-28 14:41:18,291 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-22) [] Command 'ListVDSCommand(HostName = hosted_engine_2, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', vds='Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]'})' execution failed: VDSGenericException: VDSNetworkException: Heartbeat exeeded 2017-02-28 14:41:18,306 INFO [org.ovirt.engine.core.vdsbroker.PollVmStatsRefresher] (DefaultQuartzScheduler_Worker-22) [] Failed to fetch vms info for host 'hosted_engine_2' - skipping VMs monitoring. 2017-02-28 14:41:18,315 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM hosted_engine_2 command failed: Heartbeat exeeded 2017-02-28 14:41:18,321 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (DefaultQuartzScheduler_Worker-13) [] Command 'GetStatsVDSCommand(HostName = hosted_engine_2, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', vds='Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]'})' execution failed: VDSGenericException: VDSNetworkException: Heartbeat exeeded 2017-02-28 14:41:18,321 ERROR [org.ovirt.engine.core.vdsbroker.HostMonitoring] (DefaultQuartzScheduler_Worker-13) [] Failed getting vds stats, vds='hosted_engine_2'(45e4c281-f14f-43d5-8c3c-5664816072ee): org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Heartbeat exeeded 2017-02-28 14:41:18,324 ERROR [org.ovirt.engine.core.vdsbroker.HostMonitoring] (DefaultQuartzScheduler_Worker-13) [] Failure to refresh Vds runtime info: VDSGenericException: VDSNetworkException: Heartbeat exeeded 2017-02-28 14:41:18,324 ERROR [org.ovirt.engine.core.vdsbroker.HostMonitoring] (DefaultQuartzScheduler_Worker-13) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Heartbeat exeeded at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:188) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand.executeVdsBrokerCommand(GetStatsVDSCommand.java:21) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:110) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65) [vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:467) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.HostMonitoring.refreshVdsStats(HostMonitoring.java:472) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.HostMonitoring.refreshVdsRunTimeInfo(HostMonitoring.java:114) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.HostMonitoring.refresh(HostMonitoring.java:84) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:227) [vdsbroker.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_131] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_131] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_131] at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_131] at org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:81) [scheduler.jar:] at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:52) [scheduler.jar:] at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] 2017-02-28 14:41:18,326 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-13) [] Failed to refresh VDS, network error, continuing, vds='hosted_engine_2'(45e4c281-f14f-43d5-8c3c-5664816072ee): VDSGenericException: VDSNetworkException: Heartbeat exeeded 2017-02-28 14:41:18,327 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-8-thread-6) [] Host 'hosted_engine_2' is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. 2017-02-28 14:41:18,328 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-8-thread-5) [] Host 'hosted_engine_2' is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. 2017-02-28 14:41:18,387 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-32) [7c386a60] IRS failover failed - can't allocate vds server 2017-02-28 14:41:18,395 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-5) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. 2017-02-28 14:41:18,402 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-6) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 is not responding. It will stay in Connecting state for a grace period of 60 seconds and after that an attempt to fence the host will be issued. 2017-02-28 14:41:21,309 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to node2.dev1.api-digital.com/74.51.121.121 2017-02-28 14:41:21,386 ERROR [org.ovirt.vdsm.jsonrpc.client.JsonRpcClient] (ResponseWorker) [] Not able to update response for "12a50fcb-5994-43d1-9267-3e129804cfb6" 2017-02-28 14:41:21,396 ERROR [org.ovirt.vdsm.jsonrpc.client.JsonRpcClient] (ResponseWorker) [] Not able to update response for "4c53e166-a344-488a-bc10-2f09afd6c6e4" 2017-02-28 14:41:21,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-97) [] START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', vds='Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]'}), log id: 57350c81 2017-02-28 14:41:21,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-97) [] FINISH, GetHardwareInfoVDSCommand, log id: 57350c81 2017-02-28 14:41:21,566 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-96) [] VMs initialization finished for Host: 'hosted_engine_2:45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:41:21,680 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-97) [2f69ae78] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 14:41:21,786 ERROR [org.ovirt.vdsm.jsonrpc.client.JsonRpcClient] (ResponseWorker) [] Not able to update response for "795be5a9-4442-4eba-b4f5-ed21a6385845" 2017-02-28 14:41:21,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-97) [2f69ae78] START, GetHardwareInfoVDSCommand(HostName = hosted_engine_2, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', vds='Host[hosted_engine_2,45e4c281-f14f-43d5-8c3c-5664816072ee]'}), log id: 428a096d 2017-02-28 14:41:21,853 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-97) [2f69ae78] FINISH, GetHardwareInfoVDSCommand, log id: 428a096d 2017-02-28 14:41:21,968 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-97) [306a6275] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 14:41:22,008 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-97) [3b7c0543] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-00000000002b Type: StoragePool 2017-02-28 14:41:22,053 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-97) [3b7c0543] START, ConnectStorageServerVDSCommand(HostName = hosted_engine_2, StorageServerConnectionManagementVDSParameters:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', storagePoolId='00000002-0002-0002-0002-00000000002b', storageType='ISCSI', connectionList='[StorageServerConnections:{id='1132fab7-6c11-40e4-8b77-2f3814d4d665', connection='10.43.0.1', iqn='iqn.2017-02.com.api-digital.dev1:vms', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='em3', netIfaceName='em3'}, StorageServerConnections:{id='ded63d3e-2fb4-4a5c-b989-4fd426419f82', connection='10.43.0.1', iqn='iqn.2017-02.com.api-digital.dev1:vms', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='em4', netIfaceName='em4'}]'}), log id: 568f0bcf 2017-02-28 14:41:22,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-97) [3b7c0543] FINISH, ConnectStorageServerVDSCommand, return: {ded63d3e-2fb4-4a5c-b989-4fd426419f82=0, 1132fab7-6c11-40e4-8b77-2f3814d4d665=0}, log id: 568f0bcf 2017-02-28 14:41:22,399 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-97) [3b7c0543] Host 'hosted_engine_2' storage connection was succeeded 2017-02-28 14:41:22,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-8) [3b7c0543] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, ConnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', vdsId='45e4c281-f14f-43d5-8c3c-5664816072ee', storagePoolId='00000002-0002-0002-0002-00000000002b', masterVersion='1'}), log id: 1c4967e9 2017-02-28 14:41:22,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-8-thread-8) [3b7c0543] FINISH, ConnectStoragePoolVDSCommand, log id: 1c4967e9 2017-02-28 14:41:23,012 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) [3b7c0543] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Executing power management status on Host hosted_engine_2 using Proxy Host hosted_engine_1 and Fence Agent ipmilan:74.51.121.120. 2017-02-28 14:41:23,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler_Worker-97) [3b7c0543] START, FenceVdsVDSCommand(HostName = hosted_engine_1, FenceVdsVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', targetVdsId='45e4c281-f14f-43d5-8c3c-5664816072ee', action='STATUS', agent='FenceAgent:{id='00000028-0028-0028-0028-000000000111', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', order='1', type='ipmilan', ip='74.51.121.120', port='null', user='root', password='***', encryptOptions='false', options='lanplus=1'}', policy='null'}), log id: 1b111325 2017-02-28 14:41:23,017 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 14:41:23,175 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-21) [] VMs initialization finished for Host: 'hosted_engine_1:eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:41:23,280 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-9) [53202094] Running command: ProcessDownVmCommand internal: true. 2017-02-28 14:41:23,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-11) [] START, GetHardwareInfoVDSCommand(HostName = hosted_engine_1, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[hosted_engine_1,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]'}), log id: 164c519c 2017-02-28 14:41:23,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceVdsVDSCommand] (DefaultQuartzScheduler_Worker-97) [3b7c0543] FINISH, FenceVdsVDSCommand, return: FenceOperationResult:{status='SUCCESS', powerStatus='ON', message=''}, log id: 1b111325 2017-02-28 14:41:23,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-11) [] FINISH, GetHardwareInfoVDSCommand, log id: 164c519c 2017-02-28 14:41:23,396 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-97) [3b7c0543] START, SetMOMPolicyParametersVDSCommand(HostName = hosted_engine_2, MomPolicyVDSParameters:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee'}), log id: 2889ae55 2017-02-28 14:41:23,441 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-8-thread-9) [481813cd] Running command: ProcessDownVmCommand internal: true. 2017-02-28 14:41:23,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-97) [3b7c0543] FINISH, SetMOMPolicyParametersVDSCommand, log id: 2889ae55 2017-02-28 14:41:23,547 INFO [org.ovirt.engine.core.bll.hostdev.RefreshHostDevicesCommand] (DefaultQuartzScheduler_Worker-97) [13dd5ece] Running command: RefreshHostDevicesCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDSAction group MANIPULATE_HOST with role type ADMIN 2017-02-28 14:41:23,617 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) [13dd5ece] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Status of host hosted_engine_2 was set to Up. 2017-02-28 14:41:23,638 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-97) [13dd5ece] Correlation ID: 306a6275, Call Stack: null, Custom Event ID: -1, Message: Host hosted_engine_2 power management was verified successfully. 2017-02-28 14:41:23,676 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-11) [2ae1b47b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: eb2aea6e-7de9-4a29-86de-1d43f52fc92a Type: VDS 2017-02-28 14:41:23,707 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-97) [3b3f5410] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45e4c281-f14f-43d5-8c3c-5664816072ee Type: VDS 2017-02-28 14:41:27,631 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-19) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:41:28,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-23) [] START, ConnectStoragePoolVDSCommand(HostName = hosted_engine_2, ConnectStoragePoolVDSCommandParameters:{runAsync='true', hostId='45e4c281-f14f-43d5-8c3c-5664816072ee', vdsId='45e4c281-f14f-43d5-8c3c-5664816072ee', storagePoolId='00000002-0002-0002-0002-00000000002b', masterVersion='1'}), log id: 17bffc17 2017-02-28 14:41:28,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-23) [] FINISH, ConnectStoragePoolVDSCommand, log id: 17bffc17 2017-02-28 14:41:28,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-23) [] hostFromVds::selectedVds - 'hosted_engine_2', spmStatus 'Free', storage pool 'Default', storage pool version '3.5' 2017-02-28 14:41:28,966 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-23) [] Found spm host 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a', host name: 'hosted_engine_1', according to spmId: '1'. 2017-02-28 14:41:28,987 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-23) [] SpmStatus on vds 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a': 'SPM' 2017-02-28 14:41:28,987 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-23) [] Using old spm server: 'hosted_engine_1', no start needed 2017-02-28 14:41:29,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (DefaultQuartzScheduler_Worker-23) [] Initialize Irs proxy from vds: node1.dev1.api-digital.com 2017-02-28 14:41:29,048 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host hosted_engine_1 (Address: node1.dev1.api-digital.com). 2017-02-28 14:41:29,051 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 14:41:29,123 ERROR [org.ovirt.vdsm.jsonrpc.client.reactors.Reactor] (SSL Stomp Reactor) [] Unable to process messages 2017-02-28 14:41:29,148 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [] START, SPMGetAllTasksInfoVDSCommand( IrsBaseVDSCommandParameters:{runAsync='true', storagePoolId='00000002-0002-0002-0002-00000000002b', ignoreFailoverLimit='false'}), log id: 636aa9a6 2017-02-28 14:41:32,295 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-38) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:41:32,424 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-38) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 2ed56440 2017-02-28 14:41:32,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-38) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@3ba8bdc5, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 2ed56440 2017-02-28 14:41:37,289 INFO [org.ovirt.engine.docs.utils.servlet.ContextSensitiveHelpMappingServlet] (default task-9) [] Context-sensitive help is not installed. Manual directory doesn't exist: /usr/share/ovirt-engine/manual 2017-02-28 14:41:42,760 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-83) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:41:47,509 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-94) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:41:47,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-94) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 52b80371 2017-02-28 14:41:47,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-94) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@2eea1a24, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 52b80371 2017-02-28 14:41:57,102 INFO [org.ovirt.engine.extension.aaa.jdbc.core.Tasks] (default task-19) [] (house keeping) deleting failed logins prior to 2017-02-21 20:41:57Z. 2017-02-28 14:41:57,196 INFO [org.ovirt.engine.extension.aaa.jdbc.core.Tasks] (default task-19) [] (house keeping) deleting failed logins prior to 2017-02-21 20:41:57Z. 2017-02-28 14:41:57,285 INFO [org.ovirt.engine.core.bll.aaa.LoginAdminUserCommand] (default task-19) [] Running command: LoginAdminUserCommand internal: false. 2017-02-28 14:41:57,328 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-19) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. 2017-02-28 14:41:57,450 INFO [org.ovirt.engine.api.common.security.CORSSupportFilter] (default task-30) [] CORS support is disabled. 2017-02-28 14:41:57,828 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-36) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:42:02,720 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-52) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:42:02,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-52) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 31a3bc04 2017-02-28 14:42:02,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-52) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@748cc411, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 31a3bc04 2017-02-28 14:42:12,880 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-32) [7c386a60] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:42:17,868 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-4) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:42:17,985 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-4) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 2cda9ea8 2017-02-28 14:42:17,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-4) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6817d225, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 2cda9ea8 2017-02-28 14:42:27,928 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-45) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:42:33,079 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-63) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:42:33,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-63) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 4140c9fa 2017-02-28 14:42:33,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-63) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@48c5d8e, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4140c9fa 2017-02-28 14:42:42,971 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-2) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:42:48,194 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-18) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:42:48,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-18) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 2f74f88 2017-02-28 14:42:48,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-18) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@3a866b3d, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 2f74f88 2017-02-28 14:42:58,017 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-56) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:43:03,327 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-75) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:43:03,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-75) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 7bfdd4b4 2017-02-28 14:43:03,395 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-75) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@5597b504, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 7bfdd4b4 2017-02-28 14:43:13,063 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-6) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:43:18,449 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-28) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:43:18,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-28) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 6e24f873 2017-02-28 14:43:18,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-28) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@7fb6e9d8, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 6e24f873 2017-02-28 14:43:28,105 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-65) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:43:33,580 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-84) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:43:33,670 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-84) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 244fc03b 2017-02-28 14:43:33,675 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-84) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6fd5741c, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 244fc03b 2017-02-28 14:43:43,148 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-20) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:43:48,742 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-41) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:43:48,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-41) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 577264ea 2017-02-28 14:43:48,809 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-41) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@173f6b80, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 577264ea 2017-02-28 14:43:58,193 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-77) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:44:03,863 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-95) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:44:03,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-95) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 4096312 2017-02-28 14:44:03,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-95) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@44734d0, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4096312 2017-02-28 14:44:13,239 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-34) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:44:18,977 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-52) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:44:19,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-52) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 39ee23c8 2017-02-28 14:44:19,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-52) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@416f3d2e, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 39ee23c8 2017-02-28 14:44:28,281 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-86) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:44:34,082 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-11) [2ae1b47b] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:44:34,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-11) [2ae1b47b] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 46af2624 2017-02-28 14:44:34,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-11) [2ae1b47b] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@14f129bd, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 46af2624 2017-02-28 14:44:43,326 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-45) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:44:49,210 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-65) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:44:49,273 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-23) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM command failed: Message timeout which can be caused by communication issues 2017-02-28 14:44:49,279 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-23) [] ERROR, org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand, exception: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues, log id: 73c7395c 2017-02-28 14:44:49,279 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-23) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:188) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand.executeIrsBrokerCommand(GetStoragePoolInfoVDSCommand.java:32) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand.executeVDSCommand(IrsBrokerCommand.java:161) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65) [vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:467) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData.proceedStoragePoolStats(IrsProxyData.java:336) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData._updatingTimer_Elapsed(IrsProxyData.java:238) [vdsbroker.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_131] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_131] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_131] at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_131] at org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:81) [scheduler.jar:] at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:52) [scheduler.jar:] at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] 2017-02-28 14:44:49,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-65) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 391e46b6 2017-02-28 14:44:49,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-65) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@72b47405, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 391e46b6 2017-02-28 14:44:49,322 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [] -- executeIrsBrokerCommand: Attempting on storage pool '00000002-0002-0002-0002-00000000002b' 2017-02-28 14:44:49,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [] START, HSMGetAllTasksInfoVDSCommand(HostName = hosted_engine_1, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a'}), log id: 1362d739 2017-02-28 14:44:49,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 1362d739 2017-02-28 14:44:49,331 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-8-thread-15) [] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 636aa9a6 2017-02-28 14:44:49,331 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-15) [] Discovered no tasks on Storage Pool 'Default' 2017-02-28 14:44:58,363 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-94) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:44:59,384 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to node1.dev1.api-digital.com/74.51.121.119 2017-02-28 14:44:59,490 ERROR [org.ovirt.vdsm.jsonrpc.client.JsonRpcClient] (ResponseWorker) [] Not able to update response for "4cbf1cb8-9f61-4ed1-82c5-950960a3214c" 2017-02-28 14:44:59,572 INFO [org.ovirt.engine.core.bll.storage.SyncLunsInfoForBlockStorageDomainCommand] (org.ovirt.thread.pool-8-thread-39) [110598c5] Running command: SyncLunsInfoForBlockStorageDomainCommand internal: true. Entities affected : ID: 831fd677-2894-48e7-8a0d-fd5c084a08e6 Type: Storage 2017-02-28 14:44:59,608 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-39) [110598c5] START, GetVGInfoVDSCommand(HostName = hosted_engine_1, GetVGInfoVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', VGID='E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq'}), log id: 588f188b 2017-02-28 14:44:59,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetVGInfoVDSCommand] (org.ovirt.thread.pool-8-thread-39) [110598c5] FINISH, GetVGInfoVDSCommand, return: [LUNs:{id='3600140568946636764f4c968b8d38f40', physicalVolumeId='MHdNP5-TgRr-Y6bC-umBi-YiBm-dmM0-d1cWwH', volumeGroupId='E8QGR3-fnwb-dSD8-5wWR-hXU2-SfOh-envhcq', serial='SLIO-ORG_vms_68946636-764f-4c96-8b8d-38f4049ec60f', lunMapping='0', vendorId='LIO-ORG', productId='vms', lunConnections='[StorageServerConnections:{id='null', connection='10.43.0.1', iqn='iqn.2017-02.com.api-digital.dev1:vms', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}, StorageServerConnections:{id='null', connection='10.43.0.1', iqn='iqn.2017-02.com.api-digital.dev1:vms', vfsType='null', mountOptions='null', nfsVersion='null', nfsRetrans='null', nfsTimeo='null', iface='null', netIfaceName='null'}]', deviceSize='1024', pvSize='0', vendorName='LIO-ORG', pathsDictionary='[sdd=true, sdc=true]', pathsCapacity='[]', lunType='ISCSI', status='null', diskId='null', diskAlias='null', storageDomainId='831fd677-2894-48e7-8a0d-fd5c084a08e6', storageDomainName='null'}], log id: 588f188b 2017-02-28 14:45:04,362 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-17) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:45:04,418 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-17) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 705520d1 2017-02-28 14:45:04,423 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-17) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@64ddb2f4, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 705520d1 2017-02-28 14:45:13,428 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-57) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:45:19,472 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-77) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:45:19,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-77) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 3efcce41 2017-02-28 14:45:19,515 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-77) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@47492db5, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 3efcce41 2017-02-28 14:45:28,486 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-4) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:45:34,588 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-34) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:45:34,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-34) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 28960894 2017-02-28 14:45:34,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-34) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@120d415d, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 28960894 2017-02-28 14:45:43,529 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-73) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:45:49,703 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-91) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:45:49,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-91) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 6b6ff3e 2017-02-28 14:45:49,762 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-91) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6d07250, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 6b6ff3e 2017-02-28 14:45:58,572 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-25) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:46:04,815 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-53) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:46:04,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-53) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: b743f36 2017-02-28 14:46:04,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-53) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@7ce1f819, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: b743f36 2017-02-28 14:46:13,624 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-85) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:46:19,933 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-21) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:46:19,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-21) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 6d8c7f10 2017-02-28 14:46:19,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-21) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@22ea2ba0, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 6d8c7f10 2017-02-28 14:46:28,668 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-39) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:46:35,042 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-61) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:46:35,083 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-61) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 21b235f7 2017-02-28 14:46:35,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-61) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@3af4fc69, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 21b235f7 2017-02-28 14:46:43,709 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-94) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:46:50,143 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-24) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:46:50,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-24) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 2e5828ca 2017-02-28 14:46:50,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-24) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1dddfd8b, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 2e5828ca 2017-02-28 14:46:58,751 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-53) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:47:05,251 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-77) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:47:05,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-77) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 74e04f01 2017-02-28 14:47:05,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-77) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@32630699, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 74e04f01 2017-02-28 14:47:13,813 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-97) [3b3f5410] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:47:20,387 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-33) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:47:20,445 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-33) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 7e3136b0 2017-02-28 14:47:20,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-33) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@50fd9d89, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 7e3136b0 2017-02-28 14:47:28,872 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-64) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:47:35,511 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-88) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:47:35,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-88) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 79b1f159 2017-02-28 14:47:35,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-88) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@115c487a, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 79b1f159 2017-02-28 14:47:43,914 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-17) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:47:50,657 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-46) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:47:50,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-46) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 546ecefa 2017-02-28 14:47:50,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-46) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@36d6aa64, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 546ecefa 2017-02-28 14:47:58,959 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-76) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:48:05,787 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-96) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:48:05,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-96) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 20d02897 2017-02-28 14:48:05,850 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-96) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@4218e255, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 20d02897 2017-02-28 14:48:14,017 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-33) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:48:20,917 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-59) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:48:20,980 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-59) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 619f8ffc 2017-02-28 14:48:20,985 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-59) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@32a61b76, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 619f8ffc 2017-02-28 14:48:29,058 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-86) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:48:36,036 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-8) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:48:36,079 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-8) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 4bf7a93d 2017-02-28 14:48:36,085 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-8) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@70880ac1, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4bf7a93d 2017-02-28 14:48:44,100 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-46) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:48:51,146 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-74) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:48:51,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-74) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 43b2c177 2017-02-28 14:48:51,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-74) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@cbb8e5a, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 43b2c177 2017-02-28 14:48:59,170 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-100) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:49:06,254 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-27) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:49:06,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-27) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 4250438d 2017-02-28 14:49:06,326 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-27) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6d748ee8, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4250438d 2017-02-28 14:49:14,221 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-59) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:49:21,377 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-85) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:49:21,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-85) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 502236a6 2017-02-28 14:49:21,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-85) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@7631f563, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 502236a6 2017-02-28 14:49:29,273 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-6) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:49:36,494 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-36) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:49:36,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-36) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 4fcf4b4 2017-02-28 14:49:36,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-36) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@7b2557fa, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4fcf4b4 2017-02-28 14:49:44,314 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-74) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:49:51,634 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-93) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:49:51,693 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-93) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 301cc3de 2017-02-28 14:49:51,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-93) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@307f3c7f, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 301cc3de 2017-02-28 14:49:59,355 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-29) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:50:06,759 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-55) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:50:06,799 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-55) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 36c24e67 2017-02-28 14:50:06,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-55) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@ea96847, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 36c24e67 2017-02-28 14:50:14,402 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-85) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:50:21,883 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-5) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:50:21,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-5) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 7cc4f353 2017-02-28 14:50:21,947 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-5) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@66430e23, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 7cc4f353 2017-02-28 14:50:29,445 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-36) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:50:36,998 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-23) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:50:37,057 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-23) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 78b8d8c3 2017-02-28 14:50:37,062 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-23) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@2f9f2820, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 78b8d8c3 2017-02-28 14:50:44,496 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-2) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:50:52,109 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-28) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:50:52,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-28) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 2bac30d 2017-02-28 14:50:52,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-28) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@335b8be1, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 2bac30d 2017-02-28 14:50:59,559 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-56) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:51:07,216 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-83) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:51:07,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-83) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 30f11374 2017-02-28 14:51:07,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-83) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@23343dc6, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 30f11374 2017-02-28 14:51:14,602 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-9) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:51:22,307 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-41) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:51:22,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-41) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 1ab9846c 2017-02-28 14:51:22,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-41) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@9a4dc29, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 1ab9846c 2017-02-28 14:51:29,642 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-66) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:51:37,411 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-32) [7c386a60] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:51:37,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-32) [7c386a60] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 185a0ec3 2017-02-28 14:51:37,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-32) [7c386a60] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@407f30b2, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 185a0ec3 2017-02-28 14:51:44,681 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-28) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:51:52,519 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-57) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:51:52,586 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-57) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 80a6a25 2017-02-28 14:51:52,592 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-57) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@79d71136, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 80a6a25 2017-02-28 14:51:59,731 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-81) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:52:07,641 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-5) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:52:07,706 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-5) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 78ecab5d 2017-02-28 14:52:07,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-5) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@79e6a4b0, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 78ecab5d 2017-02-28 14:52:14,779 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-38) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:52:22,767 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-66) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:52:22,826 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-66) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 6f8123cd 2017-02-28 14:52:22,841 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-66) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@755a0ec, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 6f8123cd 2017-02-28 14:52:29,816 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-22) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:52:37,887 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-15) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:52:37,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-15) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 8630324 2017-02-28 14:52:37,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-15) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1c6334c9, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 8630324 2017-02-28 14:52:44,857 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-52) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:52:52,995 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-80) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:52:53,064 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-80) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 4ffccac0 2017-02-28 14:52:53,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-80) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@5d632c46, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4ffccac0 2017-02-28 14:52:59,895 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-96) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:53:08,154 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-39) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:53:08,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-39) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 1d7c487a 2017-02-28 14:53:08,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-39) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@4a7a50b5, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 1d7c487a 2017-02-28 14:53:14,937 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-60) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:53:23,283 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-91) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:53:23,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-91) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 3f1577ed 2017-02-28 14:53:23,365 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-91) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1a7488f6, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 3f1577ed 2017-02-28 14:53:29,985 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-14) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:53:38,414 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-49) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:53:38,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-49) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 17b867aa 2017-02-28 14:53:38,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-49) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@4b9dd610, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 17b867aa 2017-02-28 14:53:45,028 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-76) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:53:53,521 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-11) [2ae1b47b] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:53:53,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-11) [2ae1b47b] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 3919d359 2017-02-28 14:53:53,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-11) [2ae1b47b] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@4e829558, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 3919d359 2017-02-28 14:54:00,067 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-33) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:54:08,651 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-63) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:54:08,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-63) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 290d49ae 2017-02-28 14:54:08,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-63) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@27605390, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 290d49ae 2017-02-28 14:54:15,116 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-89) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:54:23,764 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-24) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:54:23,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-24) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 3753f9f8 2017-02-28 14:54:23,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-24) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6a402528, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 3753f9f8 2017-02-28 14:54:30,162 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-41) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:54:38,885 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-74) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:54:38,927 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-74) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 31132179 2017-02-28 14:54:38,934 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-74) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@5efaa81a, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 31132179 2017-02-28 14:54:45,202 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-2) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:54:53,989 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-39) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:54:54,053 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-39) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 2a2db0b7 2017-02-28 14:54:54,069 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-39) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1dacd403, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 2a2db0b7 2017-02-28 14:55:00,242 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-58) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:55:09,119 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-89) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:55:09,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-89) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 1535b74e 2017-02-28 14:55:09,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-89) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@79956cc2, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 1535b74e 2017-02-28 14:55:15,275 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-12) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:55:24,227 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-47) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:55:24,280 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-47) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 488fb622 2017-02-28 14:55:24,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-47) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@52fe9765, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 488fb622 2017-02-28 14:55:30,312 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-70) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:55:39,330 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-100) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:55:39,379 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-100) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 7d2a383a 2017-02-28 14:55:39,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-100) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@5ed1a808, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 7d2a383a 2017-02-28 14:55:45,349 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-26) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:55:54,439 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-67) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:55:54,504 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-67) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 4b6e5435 2017-02-28 14:55:54,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-67) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@402b519c, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4b6e5435 2017-02-28 14:56:00,394 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-83) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:56:09,571 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-14) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:56:09,639 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-14) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 6898fac1 2017-02-28 14:56:09,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-14) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1376ca8d, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 6898fac1 2017-02-28 14:56:15,435 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-42) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:56:24,688 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-73) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:56:24,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-73) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 2bc768ad 2017-02-28 14:56:24,747 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-73) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@30a94c4f, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 2bc768ad 2017-02-28 14:56:30,476 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-91) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:56:39,802 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-29) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:56:39,862 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-29) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 697f5a43 2017-02-28 14:56:39,867 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-29) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@27ff1ad1, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 697f5a43 2017-02-28 14:56:45,517 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-56) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:56:54,948 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-87) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:56:55,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-87) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 2bd55371 2017-02-28 14:56:55,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-87) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@42593632, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 2bd55371 2017-02-28 14:57:00,560 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-21) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:57:10,082 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-45) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:57:10,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-45) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 56b87d3e 2017-02-28 14:57:10,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-45) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6a269dec, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 56b87d3e 2017-02-28 14:57:15,600 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-23) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:57:25,187 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-100) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:57:25,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-100) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 7fefd72f 2017-02-28 14:57:25,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-100) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@5b189047, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 7fefd72f 2017-02-28 14:57:30,641 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-24) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:57:40,297 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-55) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:57:40,364 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-55) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 671db792 2017-02-28 14:57:40,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-55) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@4fff0721, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 671db792 2017-02-28 14:57:45,680 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-77) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:57:55,417 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-4) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:57:55,468 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-4) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 10d664d4 2017-02-28 14:57:55,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-4) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6b75a2ee, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 10d664d4 2017-02-28 14:58:00,722 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-33) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:58:10,540 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-65) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:58:10,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-65) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 23fb78b1 2017-02-28 14:58:10,601 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-65) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@52b0beeb, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 23fb78b1 2017-02-28 14:58:15,764 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-88) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:58:25,649 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-27) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:58:25,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-27) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 5096e11a 2017-02-28 14:58:25,724 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-27) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@61949b4b, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 5096e11a 2017-02-28 14:58:30,804 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-41) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:58:40,769 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-78) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:58:40,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-78) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 10e66f7d 2017-02-28 14:58:40,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-78) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@8a18036, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 10e66f7d 2017-02-28 14:58:45,840 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-3) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:58:55,910 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-42) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:58:55,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-42) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 35514648 2017-02-28 14:58:56,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-42) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6add3c50, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 35514648 2017-02-28 14:59:00,877 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-55) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:59:11,097 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-22) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:59:11,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-22) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 58eec489 2017-02-28 14:59:11,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-22) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@23a92bfc, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 58eec489 2017-02-28 14:59:15,923 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-8) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:59:26,244 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-48) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:59:26,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-48) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 62a7ab3f 2017-02-28 14:59:26,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-48) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6ddbe7b2, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 62a7ab3f 2017-02-28 14:59:30,972 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-66) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:59:41,355 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-21) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:59:41,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-21) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 311f2b29 2017-02-28 14:59:41,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-21) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@754aa9f0, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 311f2b29 2017-02-28 14:59:46,010 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-25) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 14:59:56,471 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-67) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 14:59:56,565 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-67) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 1b2c147c 2017-02-28 14:59:56,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-67) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@6af4e6d3, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 1b2c147c 2017-02-28 15:00:01,051 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-80) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:00:11,639 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-10) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:00:11,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-10) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 7037a893 2017-02-28 15:00:11,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-10) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@51b0d764, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 7037a893 2017-02-28 15:00:16,091 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-43) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:00:26,752 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-72) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:00:26,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-72) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 4d55c00 2017-02-28 15:00:26,805 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-72) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@538b067a, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 4d55c00 2017-02-28 15:00:31,132 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-32) [7c386a60] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:00:41,856 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-39) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:00:41,917 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-39) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 1dcfc473 2017-02-28 15:00:41,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-39) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@336a694f, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 1dcfc473 2017-02-28 15:00:46,181 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-59) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:00:56,977 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-32) [7c386a60] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:00:57,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-32) [7c386a60] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 1a7ddc7b 2017-02-28 15:00:57,034 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-32) [7c386a60] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@3d161cd3, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 1a7ddc7b 2017-02-28 15:01:01,224 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-12) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:01:12,087 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-53) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:01:12,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-53) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 29fcf1bd 2017-02-28 15:01:12,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-53) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1d62c4d4, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 29fcf1bd 2017-02-28 15:01:16,267 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-65) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:01:27,201 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-96) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:01:27,248 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-96) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 1e0947f 2017-02-28 15:01:27,253 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-96) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@3f351ecf, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 1e0947f 2017-02-28 15:01:31,318 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-18) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:01:42,300 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-60) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:01:42,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-60) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 756b58b8 2017-02-28 15:01:42,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-60) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@5a8dd441, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 756b58b8 2017-02-28 15:01:46,356 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-82) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:01:57,397 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-19) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:01:57,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-19) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 5f18f511 2017-02-28 15:01:57,468 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-19) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@5f815fdd, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 5f18f511 2017-02-28 15:02:01,407 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-35) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:02:12,521 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-79) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:02:12,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-79) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 960b9e 2017-02-28 15:02:12,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-79) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@7ad4b25e, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 960b9e 2017-02-28 15:02:16,450 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-13) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:02:27,635 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-30) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:02:27,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-30) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 5e98405b 2017-02-28 15:02:27,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-30) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@5da946e1, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 5e98405b 2017-02-28 15:02:31,490 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-50) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:02:42,755 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-89) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:02:42,852 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-89) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 5c36ef4c 2017-02-28 15:02:42,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-89) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1a9895e0, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 5c36ef4c 2017-02-28 15:02:46,530 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-96) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:02:57,905 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-46) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:02:57,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-46) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 1c18c3eb 2017-02-28 15:02:57,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-46) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1de687b6, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 1c18c3eb 2017-02-28 15:03:01,567 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-62) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:03:13,014 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-3) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:03:13,069 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-3) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 40190dc1 2017-02-28 15:03:13,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-3) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@2cd61ac7, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 40190dc1 2017-02-28 15:03:16,609 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-14) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee' 2017-02-28 15:03:28,122 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-58) [] Fetched 2 VMs from VDS 'eb2aea6e-7de9-4a29-86de-1d43f52fc92a' 2017-02-28 15:03:28,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-58) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync='true', hostId='eb2aea6e-7de9-4a29-86de-1d43f52fc92a', vds='Host[,eb2aea6e-7de9-4a29-86de-1d43f52fc92a]', vmIds='[4a035efd-a041-4e46-84db-01cf79400913]'}), log id: 358c814d 2017-02-28 15:03:28,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-58) [] FINISH, FullListVDSCommand, return: [{status=Up, nicModel=rtl8139,pv, emulatedMachine=pc, vmId=4a035efd-a041-4e46-84db-01cf79400913, pid=13908, clientIp=, devices=[Ljava.lang.Object;@1b7d01b2, smp=2, vmType=kvm, displayIp=0, displaySecurePort=-1, memSize=8192, displayPort=5900, cpuType=Westmere, spiceSecureChannels=smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir, guestDiskMapping={1ae8a7f2-80fb-41ff-a={name=/dev/vda}, QEMU_DVD-ROM_={name=/dev/sr0}}, vmName=HostedEngine, display=vnc, pauseCode=NOERR}], log id: 358c814d 2017-02-28 15:03:31,657 INFO [org.ovirt.engine.core.vdsbroker.VmsStatisticsFetcher] (DefaultQuartzScheduler_Worker-71) [] Fetched 0 VMs from VDS '45e4c281-f14f-43d5-8c3c-5664816072ee'