Guest User

oVirt hang on Cinder snapshot clone

a guest
Sep 19th, 2016
82
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] Command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' failed: null
  2. 2016-09-19 14:48:40,702 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] Exception: java.lang.NullPointerException
  3.  
  4.  
  5. 2016-09-19 14:48:39,511 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-93) [284e62be] Lock Acquired to object 'EngineLock:{exclusiveLocks='[testRBDclone1=<VM_NAME, ACTION_TYPE_FAILED_OBJECT_LOCKED>, f0a23345-9afa-4388-ae77-5e982c626ea3=<VM, ACTION_TYPE_FAILED_OBJECT_LOCKED>]', sharedLocks='null'}'
  6. 2016-09-19 14:48:39,973 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-93) [284e62be] Running command: AddVmFromSnapshotCommand internal: false. Entities affected : ID: 00000002-0002-0002-0002-0000000000ad Type: ClusterAction group CREATE_VM with role type USER, ID: 8891b61e-5c13-45b2-9b31-2f3382a2d9e6 Type: StorageAction group CREATE_DISK with role type USER, ID: f0a23345-9afa-4388-ae77-5e982c626ea3 Type: VMAction group CREATE_VM with role type USER
  7. 2016-09-19 14:48:40,040 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-93) [] Locking VM(id = 'ceddf746-b7a4-484b-8240-bca6f456d81b') with compensation.
  8. 2016-09-19 14:48:40,043 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-93) [] START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameters:{runAsync='true', vmId='ceddf746-b7a4-484b-8240-bca6f456d81b', status='ImageLocked', exitStatus='Normal'}), log id: 6d92862b
  9. 2016-09-19 14:48:40,050 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-93) [] FINISH, SetVmStatusVDSCommand, log id: 6d92862b
  10. 2016-09-19 14:48:40,052 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-93) [] Lock freed to object 'EngineLock:{exclusiveLocks='[testRBDclone1=<VM_NAME, ACTION_TYPE_FAILED_OBJECT_LOCKED>, f0a23345-9afa-4388-ae77-5e982c626ea3=<VM, ACTION_TYPE_FAILED_OBJECT_LOCKED>]', sharedLocks='null'}'
  11. 2016-09-19 14:48:40,078 INFO [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (default task-93) [50af631a] Running command: CloneSingleCinderDiskCommand internal: true. Entities affected : ID: 8891b61e-5c13-45b2-9b31-2f3382a2d9e6 Type: StorageAction group CONFIGURE_VM_STORAGE with role type USER
  12. 2016-09-19 14:48:40,229 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [1713e0d3] Fetched 0 VMs from VDS 'f7cd0b39-c59e-4dfa-9f96-77706a023f22'
  13.  
  14. 2016-09-19 14:48:40,701 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-93) [50af631a] Command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' failed: null
  15. 2016-09-19 14:48:40,702 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-93) [50af631a] Exception: java.lang.NullPointerException
  16. at org.ovirt.engine.core.common.businessentities.storage.DiskVmElement.copyProperties(DiskVmElement.java:96) [common.jar:]
  17. at org.ovirt.engine.core.common.businessentities.storage.DiskVmElement.copyOf(DiskVmElement.java:91) [common.jar:]
  18. at org.ovirt.engine.core.bll.AddVmCommand.createAndSaveNewDiskVmElement(AddVmCommand.java:1223) [bll.jar:]
  19. at org.ovirt.engine.core.bll.AddVmCommand.addVmCinderDisks(AddVmCommand.java:1245) [bll.jar:]
  20. at org.ovirt.engine.core.bll.AddVmAndCloneImageCommand.addVmImages(AddVmAndCloneImageCommand.java:392) [bll.jar:]
  21. at org.ovirt.engine.core.bll.AddVmCommand.executeVmCommand(AddVmCommand.java:911) [bll.jar:]
  22. at org.ovirt.engine.core.bll.AddVmAndCloneImageCommand.executeVmCommand(AddVmAndCloneImageCommand.java:299) [bll.jar:]
  23. at org.ovirt.engine.core.bll.VmCommand.executeCommand(VmCommand.java:103) [bll.jar:]
  24. at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1301) [bll.jar:]
  25. at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1443) [bll.jar:]
  26. at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:2071) [bll.jar:]
  27. at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:166) [utils.jar:]
  28. at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:105) [utils.jar:]
  29. at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1486) [bll.jar:]
  30. at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:398) [bll.jar:]
  31. at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:493) [bll.jar:]
  32. at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:475) [bll.jar:]
  33. at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:428) [bll.jar:]
  34. at sun.reflect.GeneratedMethodAccessor237.invoke(Unknown Source) [:1.8.0_102]
  35. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102]
  36. at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102]
  37. at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52)
  38. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  39. at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)
  40. at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:70) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final]
  41. at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:80) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final]
  42. at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final]
  43. at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)
  44. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  45. at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)
  46. at org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13) [bll.jar:]
  47. at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source) [:1.8.0_102]
  48. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102]
  49. at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102]
  50. at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89)
  51. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  52. at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  53. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  54. at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)
  55. at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.3.2.Final.jar:2.3.2.Final]
  56. at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83) [wildfly-weld-10.0.0.Final.jar:10.0.0.Final]
  57. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  58. at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-10.0.0.Final.jar:10.0.0.Final]
  59. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  60. at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21)
  61. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  62. at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
  63. at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52)
  64. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  65. at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  66. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  67. at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:263) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  68. at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  69. at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:243) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  70. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  71. at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  72. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  73. at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  74. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  75. at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  76. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  77. at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  78. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  79. at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:66) [wildfly-ejb3-10.0.0.Final.jar:10.0.0.Final]
  80. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  81. at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
  82. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  83. at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64)
  84. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  85. at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356)
  86. at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636)
  87. at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61)
  88. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  89. at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356)
  90. at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80)
  91. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  92. at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
  93. at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:195)
  94. at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185)
  95. at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
  96. at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
  97. at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73)
  98. at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view4.runAction(Unknown Source) [common.jar:]
  99. at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl.runAction(GenericApiGWTServiceImpl.java:131)
  100. at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) [:1.8.0_102]
  101. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_102]
  102. at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_102]
  103. at com.google.gwt.rpc.server.RPC.invokeAndStreamResponse(RPC.java:196)
  104. at com.google.gwt.rpc.server.RpcServlet.processCall(RpcServlet.java:172)
  105. at com.google.gwt.rpc.server.RpcServlet.processPost(RpcServlet.java:233)
  106. at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet.doPost(AbstractRemoteServiceServlet.java:62)
  107. at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final]
  108. at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.0.0.Final.jar:1.0.0.Final]
  109. at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85)
  110. at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129)
  111. at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(HeaderFilter.java:94) [utils.jar:]
  112. at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60)
  113. at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
  114. at org.ovirt.engine.ui.frontend.server.gwt.GwtCachingFilter.doFilter(GwtCachingFilter.java:132)
  115. at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60)
  116. at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
  117. at org.ovirt.engine.core.branding.BrandingFilter.doFilter(BrandingFilter.java:73) [branding.jar:]
  118. at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60)
  119. at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
  120. at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(LocaleFilter.java:66) [utils.jar:]
  121. at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:60)
  122. at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
  123. at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84)
  124. at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)
  125. at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)
  126. at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78)
  127. at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
  128. at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131)
  129. at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57)
  130. at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
  131. at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:51)
  132. at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46)
  133. at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64)
  134. at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:56)
  135. at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60)
  136. at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77)
  137. at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50)
  138. at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43)
  139. at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
  140. at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61)
  141. at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
  142. at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
  143. at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:284)
  144. at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:263)
  145. at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81)
  146. at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:174)
  147. at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202)
  148. at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:793)
  149. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_102]
  150. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_102]
  151. at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_102]
  152.  
  153. 2016-09-19 14:48:40,727 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-93) [50af631a] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to create VM testRBDclone1 (User: arichards@keepertech.com@keepertech.com-authz).
  154. 2016-09-19 14:48:42,350 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  155. 2016-09-19 14:48:42,369 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  156. 2016-09-19 14:48:42,436 INFO [org.ovirt.engine.core.bll.storage.disk.cinder.RemoveCinderDiskCommand] (DefaultQuartzScheduler9) [54f663c9] Running command: RemoveCinderDiskCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage
  157. 2016-09-19 14:48:42,585 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.RemoveCinderDiskCommand] (DefaultQuartzScheduler9) [] Transaction rolled-back for command 'org.ovirt.engine.core.bll.storage.disk.cinder.RemoveCinderDiskCommand'.
  158. 2016-09-19 14:48:42,585 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler9) [] transaction rolled back
  159. 2016-09-19 14:48:42,704 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler9) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  160. 2016-09-19 14:48:42,705 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler9) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'org.ovirt.engine.core.common.action.ImagesContainterParametersBase cannot be cast to org.ovirt.engine.core.common.action.MoveOrCopyImageGroupParameters', the callback is marked for end method retries
  161. 2016-09-19 14:48:43,332 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [b5255b] Fetched 2 VMs from VDS '2fbed419-59d1-466a-a535-4a3dd98dbdc5'
  162. 2016-09-19 14:48:43,715 INFO [org.ovirt.engine.core.bll.storage.disk.cinder.RemoveCinderDiskCommand] (DefaultQuartzScheduler8) [54f663c9] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.RemoveCinderDiskCommand' successfully.
  163. 2016-09-19 14:48:44,385 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [76a2dcf2] Fetched 1 VMs from VDS '8a5822de-9020-4d7d-a240-bbd6c3a12c0c'
  164. 2016-09-19 14:48:46,818 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  165. 2016-09-19 14:48:46,830 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  166. 2016-09-19 14:48:46,878 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler9) [] transaction rolled back
  167. 2016-09-19 14:48:46,987 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler9) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  168. 2016-09-19 14:48:46,987 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler9) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  169. 2016-09-19 14:48:55,024 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  170. 2016-09-19 14:48:55,029 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  171. 2016-09-19 14:48:55,087 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler9) [] transaction rolled back
  172. 2016-09-19 14:48:55,128 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler9) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  173. 2016-09-19 14:48:55,129 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler9) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  174. 2016-09-19 14:48:56,236 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [1713e0d3] Fetched 0 VMs from VDS 'f7cd0b39-c59e-4dfa-9f96-77706a023f22'
  175. 2016-09-19 14:48:59,351 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler4) [549b037d] Fetched 2 VMs from VDS '2fbed419-59d1-466a-a535-4a3dd98dbdc5'
  176. 2016-09-19 14:48:59,603 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [b5255b] Fetched 1 VMs from VDS '8a5822de-9020-4d7d-a240-bbd6c3a12c0c'
  177. 2016-09-19 14:49:05,162 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler10) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  178. 2016-09-19 14:49:05,168 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler10) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  179. 2016-09-19 14:49:05,221 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler10) [] transaction rolled back
  180. 2016-09-19 14:49:05,252 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler10) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  181. 2016-09-19 14:49:05,252 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler10) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  182. 2016-09-19 14:49:11,248 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [76a2dcf2] Fetched 0 VMs from VDS 'f7cd0b39-c59e-4dfa-9f96-77706a023f22'
  183. 2016-09-19 14:49:14,617 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler2) [b5255b] Fetched 2 VMs from VDS '2fbed419-59d1-466a-a535-4a3dd98dbdc5'
  184. 2016-09-19 14:49:15,287 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler7) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  185. 2016-09-19 14:49:15,292 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler7) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  186. 2016-09-19 14:49:15,341 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler7) [] transaction rolled back
  187. 2016-09-19 14:49:15,387 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler7) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  188. 2016-09-19 14:49:15,387 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler7) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  189. 2016-09-19 14:49:15,620 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [3c61a35e] Fetched 1 VMs from VDS '8a5822de-9020-4d7d-a240-bbd6c3a12c0c'
  190. 2016-09-19 14:49:25,420 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  191. 2016-09-19 14:49:25,425 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  192. 2016-09-19 14:49:25,474 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler9) [] transaction rolled back
  193. 2016-09-19 14:49:25,496 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler9) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  194. 2016-09-19 14:49:25,496 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler9) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  195. 2016-09-19 14:49:27,255 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [1713e0d3] Fetched 0 VMs from VDS 'f7cd0b39-c59e-4dfa-9f96-77706a023f22'
  196. 2016-09-19 14:49:29,707 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [] Fetched 2 VMs from VDS '2fbed419-59d1-466a-a535-4a3dd98dbdc5'
  197. 2016-09-19 14:49:31,638 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [] Fetched 1 VMs from VDS '8a5822de-9020-4d7d-a240-bbd6c3a12c0c'
  198. 2016-09-19 14:49:35,630 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler1) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  199. 2016-09-19 14:49:35,635 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler1) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  200. 2016-09-19 14:49:35,693 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler1) [] transaction rolled back
  201. 2016-09-19 14:49:35,722 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler1) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  202. 2016-09-19 14:49:35,723 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler1) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  203. 2016-09-19 14:49:43,330 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler5) [76a2dcf2] Fetched 0 VMs from VDS 'f7cd0b39-c59e-4dfa-9f96-77706a023f22'
  204. 2016-09-19 14:49:44,875 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [] Fetched 2 VMs from VDS '2fbed419-59d1-466a-a535-4a3dd98dbdc5'
  205. 2016-09-19 14:49:45,866 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler1) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  206. 2016-09-19 14:49:45,873 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler1) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  207. 2016-09-19 14:49:45,917 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler1) [] transaction rolled back
  208. 2016-09-19 14:49:45,940 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler1) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  209. 2016-09-19 14:49:45,940 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler1) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  210. 2016-09-19 14:49:46,700 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler7) [] Fetched 1 VMs from VDS '8a5822de-9020-4d7d-a240-bbd6c3a12c0c'
  211. 2016-09-19 14:49:55,982 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  212. 2016-09-19 14:49:55,994 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler9) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  213. 2016-09-19 14:49:56,057 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler9) [] transaction rolled back
  214. 2016-09-19 14:49:56,086 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler9) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  215. 2016-09-19 14:49:56,086 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler9) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  216. 2016-09-19 14:49:58,906 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler9) [] Fetched 0 VMs from VDS 'f7cd0b39-c59e-4dfa-9f96-77706a023f22'
  217. 2016-09-19 14:49:59,903 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [1713e0d3] Fetched 2 VMs from VDS '2fbed419-59d1-466a-a535-4a3dd98dbdc5'
  218. 2016-09-19 14:50:01,832 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [1713e0d3] Fetched 1 VMs from VDS '8a5822de-9020-4d7d-a240-bbd6c3a12c0c'
  219. 2016-09-19 14:50:06,126 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler6) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  220. 2016-09-19 14:50:06,131 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler6) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  221. 2016-09-19 14:50:06,168 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler6) [] transaction rolled back
  222. 2016-09-19 14:50:06,198 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler6) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  223. 2016-09-19 14:50:06,198 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler6) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  224. 2016-09-19 14:50:14,913 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [] Fetched 0 VMs from VDS 'f7cd0b39-c59e-4dfa-9f96-77706a023f22'
  225. 2016-09-19 14:50:15,924 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler1) [] Fetched 2 VMs from VDS '2fbed419-59d1-466a-a535-4a3dd98dbdc5'
  226. 2016-09-19 14:50:16,236 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler4) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  227. 2016-09-19 14:50:16,241 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler4) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  228. 2016-09-19 14:50:16,276 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler4) [] transaction rolled back
  229. 2016-09-19 14:50:16,302 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler4) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  230. 2016-09-19 14:50:16,302 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler4) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  231. 2016-09-19 14:50:16,912 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [] Fetched 1 VMs from VDS '8a5822de-9020-4d7d-a240-bbd6c3a12c0c'
  232. 2016-09-19 14:50:26,345 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler10) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  233. 2016-09-19 14:50:26,350 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler10) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  234. 2016-09-19 14:50:26,384 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler10) [] transaction rolled back
  235. 2016-09-19 14:50:26,411 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler10) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  236. 2016-09-19 14:50:26,411 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler10) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  237. 2016-09-19 14:50:30,987 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler3) [bece0d9] Fetched 0 VMs from VDS 'f7cd0b39-c59e-4dfa-9f96-77706a023f22'
  238. 2016-09-19 14:50:31,925 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler10) [] Fetched 2 VMs from VDS '2fbed419-59d1-466a-a535-4a3dd98dbdc5'
  239. 2016-09-19 14:50:32,946 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFetcher] (DefaultQuartzScheduler6) [] Fetched 1 VMs from VDS '8a5822de-9020-4d7d-a240-bbd6c3a12c0c'
  240. 2016-09-19 14:50:36,443 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler1) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  241. 2016-09-19 14:50:36,448 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler1) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  242. 2016-09-19 14:50:36,510 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler1) [] transaction rolled back
  243. 2016-09-19 14:50:36,613 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler1) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  244. 2016-09-19 14:50:36,613 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler1) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
  245. 2016-09-19 14:50:46,646 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (DefaultQuartzScheduler7) [50af631a] Ending command 'org.ovirt.engine.core.bll.AddVmFromSnapshotCommand' with failure.
  246. 2016-09-19 14:50:46,651 ERROR [org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand] (DefaultQuartzScheduler7) [50af631a] Ending command 'org.ovirt.engine.core.bll.storage.disk.cinder.CloneSingleCinderDiskCommand' with failure.
  247. 2016-09-19 14:50:46,689 INFO [org.ovirt.engine.core.utils.transaction.TransactionSupport] (DefaultQuartzScheduler7) [] transaction rolled back
  248. 2016-09-19 14:50:46,717 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler7) [] Correlation ID: 284e62be, Job ID: 1899e73a-e5f8-4cda-b166-fbd5d444dc7c, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM testRBDclone1 creation.
  249. 2016-09-19 14:50:46,717 ERROR [org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller] (DefaultQuartzScheduler7) [] Failed invoking callback end method 'onFailed' for command '81f6cbd0-6298-4033-99a2-6a740e10c61f' with exception 'null', the callback is marked for end method retries
RAW Paste Data