API tools faq
paste
Advertisement
Guest User

cm-log

a guest
Sep 16th, 2016
23
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 11.62 KB | None | 0 0
raw download clone embed print report
  1. 2016-09-16 12:55:05,584 INFO CommandPusher:com.cloudera.cmf.command.CommandHelpers: Command (GlobalHostInstall, 1823623) is still active on service null.
  2. 2016-09-16 12:55:05,585 INFO CommandPusher:com.cloudera.cmf.command.CommandHelpers: Command (GlobalHostInstall, 1823291) is still active on service null.
  3. 2016-09-16 12:55:05,586 INFO CommandPusher:com.cloudera.cmf.command.CommandHelpers: Command (GlobalHostInstall, 1823283) is still active on service null.
  4. 2016-09-16 12:55:05,588 INFO CommandPusher:com.cloudera.cmf.command.CommandHelpers: Command (GlobalHostInstall, 1823275) is still active on service null.
  5. 2016-09-16 12:55:06,568 WARN 2091149079@scm-web-21203:org.hibernate.engine.jdbc.spi.SqlExceptionHelper: SQL Error: 0, SQLState: 40P01
  6. 2016-09-16 12:55:06,568 ERROR 2091149079@scm-web-21203:org.hibernate.engine.jdbc.spi.SqlExceptionHelper: ERROR: deadlock detected
  7.   Detail: Process 6587 waits for ShareLock on transaction 7662245; blocked by process 12064.
  8. Process 12064 waits for ExclusiveLock on tuple (0,56) of relation 16459 of database 16385; blocked by process 6587.
  9.   Hint: See server log for query details.
  10. 2016-09-16 12:55:06,568 WARN 2091149079@scm-web-21203:org.hibernate.cache.ehcache.internal.strategy.AbstractReadWriteEhcacheAccessStrategy: HHH020008: Cache[com.cloudera.cmf.model.DbCommand] Key[com.cloudera.cmf.model.DbCommand#1825522] Lockable[(null)]
  11. A soft-locked cache entry was expired by the underlying Ehcache. If this happens regularly you should consider increasing the cache timeouts and/or capacity limits
  12. 2016-09-16 12:55:06,568 WARN 2091149079@scm-web-21203:org.hibernate.cache.ehcache.internal.strategy.AbstractReadWriteEhcacheAccessStrategy: HHH020008: Cache[com.cloudera.cmf.model.DbCommand] Key[com.cloudera.cmf.model.DbCommand#1825523] Lockable[(null)]
  13. A soft-locked cache entry was expired by the underlying Ehcache. If this happens regularly you should consider increasing the cache timeouts and/or capacity limits
  14. 2016-09-16 12:55:06,568 WARN 2091149079@scm-web-21203:org.hibernate.cache.ehcache.internal.strategy.AbstractReadWriteEhcacheAccessStrategy: HHH020008: Cache[com.cloudera.cmf.model.DbCommand] Key[com.cloudera.cmf.model.DbCommand#1825525] Lockable[(null)]
  15. A soft-locked cache entry was expired by the underlying Ehcache. If this happens regularly you should consider increasing the cache timeouts and/or capacity limits
  16. 2016-09-16 12:55:06,569 WARN 2091149079@scm-web-21203:com.cloudera.api.ApiExceptionMapper: Unexpected exception.
  17. javax.persistence.RollbackException: Error while committing the transaction
  18. at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:92)
  19. at com.cloudera.enterprise.AbstractWrappedEntityManager.commit(AbstractWrappedEntityManager.java:110)
  20. at com.cloudera.cmf.persist.CmfEntityManager.commit(CmfEntityManager.java:377)
  21. at com.cloudera.api.dao.impl.ManagerDaoBase.runInNewTransaction(ManagerDaoBase.java:276)
  22. at com.cloudera.api.dao.impl.ManagerDaoBase.access$300(ManagerDaoBase.java:83)
  23. at com.cloudera.api.dao.impl.ManagerDaoBase$TransactionCallable.call(ManagerDaoBase.java:315)
  24. at com.cloudera.server.common.RetryWrapper.executeWithRetry(RetryWrapper.java:30)
  25. at com.cloudera.api.dao.impl.ManagerDaoBase.runInNewTransactionWithRetry(ManagerDaoBase.java:224)
  26. at com.cloudera.api.dao.impl.ManagerDaoBase.invoke(ManagerDaoBase.java:350)
  27. at com.sun.proxy.$Proxy131.issueGlobalCommand(Unknown Source)
  28. at com.cloudera.api.v2.impl.ClouderaManagerResourceV2Impl.hostsStartRolesCommand(ClouderaManagerResourceV2Impl.java:72)
  29. at sun.reflect.GeneratedMethodAccessor1632.invoke(Unknown Source)
  30. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  31. at java.lang.reflect.Method.invoke(Method.java:497)
  32. at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180)
  33. at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96)
  34. at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192)
  35. at com.cloudera.api.ApiInvoker.invoke(ApiInvoker.java:116)
  36. at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:256)
  37. at com.cloudera.api.ApiInvoker.invoke(ApiInvoker.java:116)
  38. at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:256)
  39. at com.cloudera.api.ApiInvoker.invoke(ApiInvoker.java:116)
  40. at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:100)
  41. at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:57)
  42. at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:93)
  43. at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272)
  44. at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
  45. at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
  46. at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248)
  47. --
  48. at org.hibernate.internal.SessionImpl.managedFlush(SessionImpl.java:404)
  49. at org.hibernate.engine.transaction.internal.jdbc.JdbcTransaction.beforeTransactionCommit(JdbcTransaction.java:101)
  50. at org.hibernate.engine.transaction.spi.AbstractTransactionImpl.commit(AbstractTransactionImpl.java:175)
  51. at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:75)
  52. ... 83 more
  53. Caused by: org.postgresql.util.PSQLException: ERROR: deadlock detected
  54.   Detail: Process 6587 waits for ShareLock on transaction 7662245; blocked by process 12064.
  55. Process 12064 waits for ExclusiveLock on tuple (0,56) of relation 16459 of database 16385; blocked by process 6587.
  56.   Hint: See server log for query details.
  57. at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2102)
  58. at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1835)
  59. at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
  60. at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:500)
  61. at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)
  62. at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:334)
  63. at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeUpdate(NewProxyPreparedStatement.java:105)
  64. at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.executeUpdate(ResultSetReturnImpl.java:133)
  65. ... 97 more
  66. 2016-09-16 12:55:06,602 INFO 1891988400@scm-web-21194:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing role command Start BasicCmdArgs{args=[]}.  Service: DbService{id=8, name=yarn} Role: DbRole{id=96112, name=yarn-NODEMANAGER-12321ffbdb2e4adb4469a84220e3229b, hostName=ip-10-0-3-153.ec2.internal}
  67. 2016-09-16 12:55:08,684 WARN 1891988400@scm-web-21194:org.hibernate.engine.jdbc.spi.SqlExceptionHelper: SQL Error: 0, SQLState: 40P01
  68. 2016-09-16 12:55:08,684 ERROR 1891988400@scm-web-21194:org.hibernate.engine.jdbc.spi.SqlExceptionHelper: ERROR: deadlock detected
  69.   Detail: Process 21629 waits for ExclusiveLock on tuple (0,56) of relation 16459 of database 16385; blocked by process 12064.
  70. Process 12064 waits for ShareLock on transaction 7662248; blocked by process 21629.
  71.   Hint: See server log for query details.
  72. 2016-09-16 12:55:08,685 WARN 1891988400@scm-web-21194:com.cloudera.api.ApiExceptionMapper: Unexpected exception.
  73. javax.persistence.RollbackException: Error while committing the transaction
  74. at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:92)
  75. at com.cloudera.enterprise.AbstractWrappedEntityManager.commit(AbstractWrappedEntityManager.java:110)
  76. at com.cloudera.cmf.persist.CmfEntityManager.commit(CmfEntityManager.java:377)
  77. at com.cloudera.api.dao.impl.ManagerDaoBase.runInNewTransaction(ManagerDaoBase.java:276)
  78. at com.cloudera.api.dao.impl.ManagerDaoBase.access$300(ManagerDaoBase.java:83)
  79. at com.cloudera.api.dao.impl.ManagerDaoBase$TransactionCallable.call(ManagerDaoBase.java:315)
  80. at com.cloudera.server.common.RetryWrapper.executeWithRetry(RetryWrapper.java:30)
  81. at com.cloudera.api.dao.impl.ManagerDaoBase.runInNewTransactionWithRetry(ManagerDaoBase.java:224)
  82. at com.cloudera.api.dao.impl.ManagerDaoBase.invoke(ManagerDaoBase.java:350)
  83. at com.sun.proxy.$Proxy131.issueGlobalCommand(Unknown Source)
  84. at com.cloudera.api.v2.impl.ClouderaManagerResourceV2Impl.hostsStartRolesCommand(ClouderaManagerResourceV2Impl.java:72)
  85. at sun.reflect.GeneratedMethodAccessor1632.invoke(Unknown Source)
  86. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  87. at java.lang.reflect.Method.invoke(Method.java:497)
  88. at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180)
  89. at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96)
  90. at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192)
  91. at com.cloudera.api.ApiInvoker.invoke(ApiInvoker.java:116)
  92. at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:256)
  93. at com.cloudera.api.ApiInvoker.invoke(ApiInvoker.java:116)
  94. at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:256)
  95. at com.cloudera.api.ApiInvoker.invoke(ApiInvoker.java:116)
  96. at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:100)
  97. at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:57)
  98. at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:93)
  99. at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272)
  100. at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
  101. at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
  102. at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248)
  103. at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:222)
  104. at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:153)
  105. at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:167)
  106. at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:286)
  107. at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:206)
  108. at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
  109. --
  110. at org.hibernate.internal.SessionImpl.managedFlush(SessionImpl.java:404)
  111. at org.hibernate.engine.transaction.internal.jdbc.JdbcTransaction.beforeTransactionCommit(JdbcTransaction.java:101)
  112. at org.hibernate.engine.transaction.spi.AbstractTransactionImpl.commit(AbstractTransactionImpl.java:175)
  113. at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:75)
  114. ... 83 more
  115. Caused by: org.postgresql.util.PSQLException: ERROR: deadlock detected
  116.   Detail: Process 21629 waits for ExclusiveLock on tuple (0,56) of relation 16459 of database 16385; blocked by process 12064.
  117. Process 12064 waits for ShareLock on transaction 7662248; blocked by process 21629.
  118.   Hint: See server log for query details.
  119. at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2102)
  120. at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1835)
  121. at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
  122. at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:500)
  123. at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)
  124. at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:334)
  125. at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeUpdate(NewProxyPreparedStatement.java:105)
  126. at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.executeUpdate(ResultSetReturnImpl.java:133)
  127. ... 97 more
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!