[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

On 18 Jul 2019, at 18:33, Daniel Erez <derez(a)redhat.com&gt; wrote: On Thu, Jul 18, 2019 at 7:31 PM Vrgotic, Marko <M.Vrgotic(a)activevideo.com&gt; wrote: > > Hi Daniel, > > Is it possible that upgrade from 4.3.3 to 4.3.4 affected/reset/changed the certificate for imageio? Have you restarted the ovirt-imageio-proxy service after upgrading? It should be restarted to reload the certificate. > > Reason why I am asking is that, while running 4.3.3 version, I was uploading Ubuntu 16-18, CentOS 7 cloud images, and CentOS6 no issues. > Now issue is with CentOS6. > I have tried to upload centos6.5 image via Ansible ovirt_disk and than one ended stuck in “Finalizing” state. > Than I tried with to Upload same image from UI and that ended in “Paused” state. > > I will try Test Connection and let you know. > > Sent from my iPhone > >> On 18 Jul 2019, at 16:13, Daniel Erez <derez(a)redhat.com&gt; wrote: >> >> Hi Marko, >> >> According to the log, it seems there's an issue with a secured >> connection to the proxy. >> Can you please try the 'Test Connection' button on upload disk dialog, >> to ensure the certificate is properly installed? >> Also, is the disk currently in 'Paused by System' status? >> >> Thanks, >> Daniel >> >> On Thu, Jul 18, 2019 at 2:35 PM Vrgotic, Marko >> <M.Vrgotic(a)activevideo.com&gt; wrote: >>> >>> Hi Nir, >>> >>> >>> >>> Since this is already compressed file, I have added output of grep for moment this command was issue and following 300lines. >>> >>> >>> >>> [root@ovirt-engine ovirt-engine]# zgrep "2019-07-17 13:36:11,121Z" engine.log-20190* -A300 >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: TransferDiskImageCommand internal: false. Entities affected : ID: 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group EDIT_DISK_PROPERTIES with role type USER >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19' >>> >>> gzip: -A300.gz: No such file or directory >>> >>> [root@ovirt-engine ovirt-engine]# zgrep -A 300 "2019-07-17 13:36:11,121Z" engine.log-20190* >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: TransferDiskImageCommand internal: false. Entities affected : ID: 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group EDIT_DISK_PROPERTIES with role type USER >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,142Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Successfully added Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') for image transfer command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,188Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, PrepareImageVDSCommand(HostName = ovirt-hv-01.avinity.tv, PrepareImageVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d'}), log id: 3bd84b38 >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,351Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, PrepareImageVDSCommand, return: PrepareImageReturn:{status='Status [code=0, message=Done]'}, log id: 3bd84b38 >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,356Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, SetVolumeLegalityVDSCommand( SetVolumeLegalityVDSCommandParameters:{storagePoolId='10525aa0-839d-11e9-a016-00163e4f2a6d', ignoreFailoverLimit='false', storageDomainId='644aacaa-12e1-4fcd-b3aa-941678cf95bd', imageGroupId='3452459d-aec6-430e-9509-1d9ca815b2d8', imageId='b44659a9-607a-4eeb-a255-99532fd4fce4'}), log id: 5e0f7654 >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,390Z INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, SetVolumeLegalityVDSCommand, return: , log id: 5e0f7654 >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,394Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, AddImageTicketVDSCommand(HostName = ovirt-hv-01.avinity.tv, AddImageTicketVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d', ticketId='10096b11-d10d-43aa-ad16-668b29a8c152', timeout='300', operations='[write]', size='47244640256', url='file:///rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4', filename='null', sparse='true', transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19'}), log id: 3bf6b943 >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,410Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, AddImageTicketVDSCommand, return: StatusOnlyReturn [status=Status [code=0, message=Done]], log id: 3bf6b943 >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,411Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Started transfer session with ticket id 10096b11-d10d-43aa-ad16-668b29a8c152, timeout 300 seconds >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,411Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Adding image ticket to ovirt-imageio-proxy, id 10096b11-d10d-43aa-ad16-668b29a8c152 >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,469Z ERROR [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to add image ticket to ovirt-imageio-proxy: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target >>> >>> engine.log-20190718.gz: at sun.security.ssl.Alerts.getSSLException(Alerts.java:192) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1946) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:316) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:310) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1639) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.Handshaker.process_record(Handshaker.java:965) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1064) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1367) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1395) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1379) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:559) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1334) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1309) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(HttpsURLConnectionImpl.java:259) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand.addImageTicketToProxy(TransferDiskImageCommand.java:988) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand.startImageTransferSession(TransferDiskImageCommand.java:911) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand.handleImageIsReadyForTransfer(TransferDiskImageCommand.java:554) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand.executeCommand(TransferDiskImageCommand.java:393) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1157) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1315) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1964) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1375) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:419) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:451) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:433) [bll.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:388) [bll.jar:] >>> >>> engine.log-20190718.gz: at sun.reflect.GeneratedMethodAccessor775.invoke(Unknown Source) [:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) >>> >>> engine.log-20190718.gz: at org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext.proceed(DelegatingInterceptorInvocationContext.java:92) [wildfly-weld-ejb-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.interceptorChainCompleted(WeldInvocationContextImpl.java:107) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] >>> >>> engine.log-20190718.gz: at org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.proceed(WeldInvocationContextImpl.java:126) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12) [common.jar:] >>> >>> engine.log-20190718.gz: at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) [:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] >>> >>> engine.log-20190718.gz: at org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.invokeNext(WeldInvocationContextImpl.java:92) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] >>> >>> engine.log-20190718.gz: at org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.proceed(WeldInvocationContextImpl.java:124) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] >>> >>> engine.log-20190718.gz: at org.jboss.weld.bean.InterceptorImpl.intercept(InterceptorImpl.java:105) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] >>> >>> engine.log-20190718.gz: at org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext.proceed(DelegatingInterceptorInvocationContext.java:82) [wildfly-weld-ejb-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.as.weld.interceptors.EjbComponentInterceptorSupport.delegateInterception(EjbComponentInterceptorSupport.java:60) >>> >>> engine.log-20190718.gz: at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:77) >>> >>> engine.log-20190718.gz: at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:89) >>> >>> engine.log-20190718.gz: at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:102) >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13) [bll.jar:] >>> >>> engine.log-20190718.gz: at sun.reflect.GeneratedMethodAccessor147.invoke(Unknown Source) [:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:216) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:418) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:148) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509) >>> >>> engine.log-20190718.gz: at org.jboss.weld.module.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:81) [weld-ejb-3.0.5.Final.jar:3.0.5.Final] >>> >>> engine.log-20190718.gz: at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final] >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438) >>> >>> engine.log-20190718.gz: at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:618) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422) >>> >>> engine.log-20190718.gz: at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53) >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) >>> >>> engine.log-20190718.gz: at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view3.runAction(Unknown Source) [common.jar:] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.resource.BackendResource.doAction(BackendResource.java:250) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.doCreateEntity(AbstractBackendCollectionResource.java:233) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.performCreate(AbstractBackendCollectionResource.java:144) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.performCreate(AbstractBackendCollectionResource.java:134) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.performCreate(AbstractBackendCollectionResource.java:153) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.resource.BackendImageTransfersResource.performCreate(BackendImageTransfersResource.java:70) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.resource.BackendImageTransfersResource.addForImage(BackendImageTransfersResource.java:39) >>> >>> engine.log-20190718.gz: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.resource.ImageTransfersResource.add(ImageTransfersResource.java:101) >>> >>> engine.log-20190718.gz: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:137) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:100) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final] >>> >>> engine.log-20190718.gz: at javax.servlet.http.HttpServlet.service(HttpServlet.java:791) [jboss-servlet-api_4.0_spec-1.0.0.Final.jar:1.0.0.Final] >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:81) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) >>> >>> engine.log-20190718.gz: at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) >>> >>> engine.log-20190718.gz: at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) >>> >>> engine.log-20190718.gz: at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:274) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler.dispatchToPath(ServletInitialHandler.java:209) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImpl(RequestDispatcherImpl.java:223) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.spec.RequestDispatcherImpl.forwardImplSetup(RequestDispatcherImpl.java:149) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.spec.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:111) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:178) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:98) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:117) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:72) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.aaa.filters.RestApiSessionMgmtFilter.doFilter(RestApiSessionMgmtFilter.java:78) [aaa.jar:] >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.aaa.filters.EnforceAuthFilter.doFilter(EnforceAuthFilter.java:42) [aaa.jar:] >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.aaa.filters.SsoRestApiNegotiationFilter.doFilter(SsoRestApiNegotiationFilter.java:84) [aaa.jar:] >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.aaa.filters.SsoRestApiAuthFilter.doFilter(SsoRestApiAuthFilter.java:47) [aaa.jar:] >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:59) [aaa.jar:] >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.aaa.filters.RestApiSessionValidationFilter.doFilter(RestApiSessionValidationFilter.java:35) [aaa.jar:] >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:111) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:102) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at org.ovirt.engine.core.utils.servlet.CORSSupportFilter.doFilter(CORSSupportFilter.java:283) [utils.jar:] >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) >>> >>> engine.log-20190718.gz: at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) >>> >>> engine.log-20190718.gz: at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:132) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) >>> >>> engine.log-20190718.gz: at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) >>> >>> engine.log-20190718.gz: at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) >>> >>> engine.log-20190718.gz: at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) >>> >>> engine.log-20190718.gz: at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) >>> >>> engine.log-20190718.gz: at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) >>> >>> engine.log-20190718.gz: at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) >>> >>> engine.log-20190718.gz: at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) >>> >>> engine.log-20190718.gz: at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) >>> >>> engine.log-20190718.gz: at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) >>> >>> engine.log-20190718.gz: at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) >>> >>> engine.log-20190718.gz: at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105) >>> >>> engine.log-20190718.gz: at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) >>> >>> engine.log-20190718.gz: at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) >>> >>> engine.log-20190718.gz: at org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) >>> >>> engine.log-20190718.gz: at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) >>> >>> engine.log-20190718.gz: at io.undertow.server.Connectors.executeRootHandler(Connectors.java:360) >>> >>> engine.log-20190718.gz: at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:830) >>> >>> engine.log-20190718.gz: at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35) >>> >>> engine.log-20190718.gz: at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985) >>> >>> engine.log-20190718.gz: at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487) >>> >>> engine.log-20190718.gz: at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378) >>> >>> engine.log-20190718.gz: at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz:Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target >>> >>> engine.log-20190718.gz: at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.validator.Validator.validate(Validator.java:262) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:324) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:229) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:124) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1621) [jsse.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: ... 224 more >>> >>> engine.log-20190718.gz:Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target >>> >>> engine.log-20190718.gz: at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392) [rt.jar:1.8.0_201] >>> >>> engine.log-20190718.gz: ... 230 more >>> >>> engine.log-20190718.gz: >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,495Z ERROR [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to add image ticket to ovirt-imageio-proxy >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,502Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] EVENT_ID: TRANSFER_IMAGE_STOPPED_BY_SYSTEM_FAILED_TO_ADD_TICKET_TO_PROXY(1,070), Transfer was stopped by system. Reason: failed to add image ticket to ovirt-imageio-proxy. >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,503Z INFO [org.ovirt.engine.core.bll.storage.disk.image.ImageTransferUpdater] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Updating image transfer 28eda0c2-e36b-4e70-91ea-2ecf4a030d19 (image 3452459d-aec6-430e-9509-1d9ca815b2d8) phase to Paused by System >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,506Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Returning from proceedCommandExecution after starting transfer session for image transfer command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,520Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] EVENT_ID: TRANSFER_IMAGE_INITIATED(1,031), Image Upload with disk av-07-centos-65-base was initiated by mvrgotic@ictv.com(a)ictv.com-authz. >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,562Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferImageStatusCommand] (default task-376) [edda86b2-d78b-45ed-a523-18966af140f4] Running command: TransferImageStatusCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_DISK with role type USER >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,563Z INFO [org.ovirt.engine.core.bll.storage.disk.image.ImageTransferUpdater] (default task-376) [edda86b2-d78b-45ed-a523-18966af140f4] Updating image transfer 28eda0c2-e36b-4e70-91ea-2ecf4a030d19 (image 3452459d-aec6-430e-9509-1d9ca815b2d8) phase to Finalizing Success >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,610Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-60) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,612Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-60) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,613Z INFO [org.ovirt.engine.core.sso.servlets.OAuthRevokeServlet] (default task-378) [] User mvrgotic@ictv.com(a)ictv.com successfully logged out >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,624Z INFO [org.ovirt.engine.core.bll.aaa.TerminateSessionsForTokenCommand] (default task-385) [2b577b1a] Running command: TerminateSessionsForTokenCommand internal: true. >>> >>> engine.log-20190718.gz:2019-07-17 13:36:11,625Z INFO [org.ovirt.engine.core.bll.aaa.SessionDataContainer] (default task-385) [2b577b1a] Not removing session 'IGb5NgFB7aK78R92aRxJYix9y4TVQJtzYtUW+EGiAanLfxkDb/CCEuU6pgN0e7EzOuki+mMK14LaJutl9Rhydw==', session has running commands for user &#39;mvrgotic@ictv.com(a)ictv.com-authz&#39;. >>> >>> engine.log-20190718.gz:2019-07-17 13:36:13,658Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-69) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:36:13,659Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-69) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:17,703Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-5) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:36:17,703Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-5) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:25,748Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-52) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:36:25,748Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-52) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:35,802Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-95) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:36:35,802Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-95) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:45,821Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-9) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:36:45,821Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-9) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:36:53,434Z INFO [org.ovirt.engine.core.bll.aaa.SessionDataContainer] (EE-ManagedThreadFactory-engineScheduled-Thread-26) [] Not removing session 'IGb5NgFB7aK78R92aRxJYix9y4TVQJtzYtUW+EGiAanLfxkDb/CCEuU6pgN0e7EzOuki+mMK14LaJutl9Rhydw==', session has running commands for user &#39;mvrgotic@ictv.com(a)ictv.com-authz&#39;. >>> >>> engine.log-20190718.gz:2019-07-17 13:36:55,872Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-72) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:36:55,872Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-72) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:37:05,893Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-60) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:37:05,894Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-60) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:37:15,945Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-29) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:37:15,945Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-29) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:37:25,999Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-48) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:37:25,999Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-48) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:37:28,864Z INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-376) [] User mvrgotic(a)ictv.com successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access >>> >>> engine.log-20190718.gz:2019-07-17 13:37:30,187Z INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-376) [] User mvrgotic(a)ictv.com successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access >>> >>> engine.log-20190718.gz:2019-07-17 13:37:33,323Z INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-85) [] Setting new tasks map. The map contains now 0 tasks >>> >>> engine.log-20190718.gz:2019-07-17 13:37:33,323Z INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-85) [] Cleared all tasks of pool '10525aa0-839d-11e9-a016-00163e4f2a6d'. >>> >>> engine.log-20190718.gz:2019-07-17 13:37:35,547Z INFO [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-376) [] User mvrgotic(a)ictv.com successfully logged in with scopes: ovirt-app-api ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access >>> >>> engine.log-20190718.gz:2019-07-17 13:37:35,599Z INFO [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default task-376) [519046b4] Running command: CreateUserSessionCommand internal: false. >>> >>> engine.log-20190718.gz:2019-07-17 13:37:35,614Z INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-376) [519046b4] EVENT_ID: USER_VDC_LOGIN(30), User mvrgotic@ictv.com(a)ictv.com-authz connecting from '172.16.105.206' using session 'rhZQZDBy6kGp85btZDieKp2gQ5kQLWBcC7BOfXrU/fJHCVWyoyOvIwnwnaaD12f8YBK5HK3MOaQcYYptCMWRcA==' logged in. >>> >>> engine.log-20190718.gz:2019-07-17 13:37:36,045Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:37:36,045Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-67) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:37:46,092Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-23) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:37:46,093Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-23) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> engine.log-20190718.gz:2019-07-17 13:37:53,430Z INFO [org.ovirt.engine.core.bll.aaa.SessionDataContainer] (EE-ManagedThreadFactory-engineScheduled-Thread-47) [] Not removing session 'IGb5NgFB7aK78R92aRxJYix9y4TVQJtzYtUW+EGiAanLfxkDb/CCEuU6pgN0e7EzOuki+mMK14LaJutl9Rhydw==', session has running commands for user &#39;mvrgotic@ictv.com(a)ictv.com-authz&#39;. >>> >>> engine.log-20190718.gz:2019-07-17 13:37:56,109Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-27) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> engine.log-20190718.gz:2019-07-17 13:37:56,110Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-27) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> >>> >>> From: Nir Soffer <nsoffer(a)redhat.com&gt; >>> Date: Thursday, 18 July 2019 at 13:14 >>> To: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; >>> Cc: users <users(a)ovirt.org&gt;, Daniel Erez <derez(a)redhat.com&gt; >>> Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase >>> >>> >>> >>> On Thu, Jul 18, 2019 at 1:44 PM Vrgotic, Marko <M.Vrgotic(a)activevideo.com&gt; wrote: >>> >>> Hi Nir, >>> >>> >>> >>> Sure: here is the ovirt-engine/engine.log related to transaction: >>> >>> ... >>> >>> 2019-07-17 13:36:11,394Z INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, AddImageTicketVDSCommand(HostName = ovirt-hv-01.avinity.tv, AddImageTicketVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d', ticketId='10096b11-d10d-43aa-ad16-668b29a8c152', timeout='300', operations='[write]', size='47244640256', url='file:///rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4', filename='null', sparse='true', transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19'}), log id: 3bf6b943 >>> >>> >>> >>> The transfer uuid is mentioned in this log: >>> >>> >>> >>> transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19' >>> >>> >>> >>> Please attach complete engine.log since this line. >>> >>> >>> >>> You can see that the host used for upload was ovirt-hv-01.avinity.tv. Please attach vdsm logs >>> >>> from this host from the time this ticket was added. >>> >>> >>> >>> Please attach imageio daemon logs from the same time on this host. >>> >>> >>> >>> — — — >>> Met vriendelijke groet / Kind regards, >>> >>> Marko Vrgotic >>> >>> >>> >>> >>> >>> From: Nir Soffer <nsoffer(a)redhat.com&gt; >>> Date: Thursday, 18 July 2019 at 12:20 >>> To: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; >>> Cc: users <users(a)ovirt.org&gt;, Daniel Erez <derez(a)redhat.com&gt; >>> Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase >>> >>> >>> >>> On Thu, Jul 18, 2019 at 10:49 AM Vrgotic, Marko <M.Vrgotic(a)activevideo.com&gt; wrote: >>> >>> Dear Nir, >>> >>> >>> >>> None of my Hosts has any updated left to be added, they are as up to date as they can be. >>> >>> The imageio packages version installed is: >>> >>> >>> >>> Ovirt-imageio-common-1.5.1-0.el7.x86_64 >>> >>> Ovirt-imageio-daemon-1.5.1-0.el7.x86_64 >>> >>> >>> >>> We need logs to understand the issue. >>> >>> >>> >>> Can you share logs from the time the upload was started? >>> >>> - engine log (/var/log/ovirt-engine/engine.log) >>> >>> - vdsm log on the host that performed the upload (/var/log/vdsm/vdsm.log) >>> >>> - daemon logs on that host (/var/log/ovirt-imageio-daemon/daemon.log) >>> >>> >>> >>> To locate the right host you can grep for the transfer uuid that should be mentioned in engine logs. >>> >>> >>> >>> >>> >>> Additional software info from Host >>> >>> OS Version: >>> >>> RHEL - 7 - 6.1810.2.el7.centos >>> >>> OS Description: >>> >>> CentOS Linux 7 (Core) >>> >>> Kernel Version: >>> >>> 3.10.0 - 957.21.3.el7.x86_64 >>> >>> KVM Version: >>> >>> 2.12.0 - 18.el7_6.5.1 >>> >>> LIBVIRT Version: >>> >>> libvirt-4.5.0-10.el7_6.12 >>> >>> VDSM Version: >>> >>> vdsm-4.30.17-1.el7 >>> >>> SPICE Version: >>> >>> 0.14.0 - 6.el7_6.1 >>> >>> GlusterFS Version: >>> >>> [N/A] >>> >>> CEPH Version: >>> >>> librbd1-10.2.5-4.el7 >>> >>> Open vSwitch Version: >>> >>> openvswitch-2.10.1-3.el7 >>> >>> Kernel Features: >>> >>> PTI: 1, IBRS: 0, RETP: 1, SSBD: 3 >>> >>> >>> >>> From: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com&gt; >>> Date: Thursday, 18 July 2019 at 08:03 >>> To: Nir Soffer <nsoffer(a)redhat.com&gt; >>> Cc: users <users(a)ovirt.org&gt;, Daniel Erez <derez(a)redhat.com&gt; >>> Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase >>> >>> >>> >>> Hi Nir, >>> >>> >>> >>> Sure, i will check. >>> >>> >>> >>> Is there a way for Adminstrator to view tickets or close them by force? >>> >>> Sent from my iPhone >>> >>> >>> On 18 Jul 2019, at 00:05, Nir Soffer <nsoffer(a)redhat.com&gt; wrote: >>> >>> >>> >>> On Wed, Jul 17, 2019, 19:20 Vrgotic, Marko <M.Vrgotic(a)activevideo.com&gt; wrote: >>> >>> Dear oVIrt, >>> >>> >>> >>> I initiated upload of qcow2 disk image for Centos 6.5: >>> >>> It reached finalizing phase and than started throwing following errors: >>> >>> >>> >>> 2019-07-17 14:40:51,480Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-86) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> 2019-07-17 14:40:51,480Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-86) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> >>> >>> Old versions of ovirt-imageio-daemon were failing to remove a ticket if the ticket does not exist, and engine did not handle this well. >>> >>> >>> >>> This was fixed in 4.2. Are you running the latest version on the hosts? >>> >>> >>> >>> Please update ovirt-imageio-daemon to latest version. >>> >>> >>> >>> Nir >>> >>> >>> >>> 2019-07-17 14:41:01,572Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-19) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> 2019-07-17 14:41:01,574Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-19) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> 2019-07-17 14:41:11,690Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-7) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> 2019-07-17 14:41:11,690Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-7) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> 2019-07-17 14:41:21,781Z INFO [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for Upload disk 'av-07-centos-65-base' (disk id: '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 'b44659a9-607a-4eeb-a255-99532fd4fce4') >>> >>> 2019-07-17 14:41:21,782Z WARN [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-12) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8' >>> >>> >>> >>> I can not cancel it, can not stop it, not via UI not via force option using ovirt_disk module. >>> >>> >>> >>> Help! >>> >>> >>> >>> oVIrt 4.3.4.3-1 version running with CentOS 7.6 Hosts. >>> >>> >>> >>> Kindly awaiting your reply. >>> >>> >>> >>> >>> >>> — — — >>> Met vriendelijke groet / Kind regards, >>> >>> Marko Vrgotic >>> >>> ActiveVideo >>> >>> >>> >>> _______________________________________________ >>> Users mailing list -- users(a)ovirt.org >>> To unsubscribe send an email to users-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJPWK5A3346...