Guest User

hive-log

a guest
Nov 8th, 2020
103
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 52.71 KB | None | 0 0
  1. 2020-11-08 06:33:44,788 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: get_table : tbl=cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5.cloudera_manager_metastore_canary_test_db_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5.CM_TEST_TABLE
  2. 2020-11-08 06:33:44,788 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-199]: ugi=hue/[email protected] ip=172.27.167.198 cmd=get_table : tbl=cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5.cloudera_manager_metastore_canary_test_db_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5.CM_TEST_TABLE
  3. 2020-11-08 06:33:44,790 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
  4. 2020-11-08 06:33:44,791 INFO org.apache.hadoop.hive.metastore.ObjectStore: [pool-7-thread-199]: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@657d51e2, with PersistenceManager: null will be shutdown
  5. 2020-11-08 06:33:44,791 INFO org.apache.hadoop.hive.metastore.ObjectStore: [pool-7-thread-199]: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@657d51e2, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@1c204bf4 created in the thread with id: 5745
  6. 2020-11-08 06:33:44,795 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@657d51e2 from thread id: 5745
  7. 2020-11-08 06:33:44,798 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: get_database: cloudera_manager_metastore_canary_test_db_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5
  8. 2020-11-08 06:33:44,798 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-199]: ugi=hue/[email protected] ip=172.27.167.198 cmd=get_database: cloudera_manager_metastore_canary_test_db_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5
  9. 2020-11-08 06:33:44,800 WARN org.apache.hadoop.hive.metastore.ObjectStore: [pool-7-thread-199]: Failed to get database cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5.cloudera_manager_metastore_canary_test_db_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5, returning NoSuchObjectException
  10. 2020-11-08 06:33:44,800 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: drop_catalog: cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5
  11. 2020-11-08 06:33:44,801 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-199]: ugi=hue/[email protected] ip=172.27.167.198 cmd=drop_catalog: cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5
  12. 2020-11-08 06:33:44,858 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.runworker.in does not exist
  13. 2020-11-08 06:33:44,858 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.housekeeping.threads.on does not exist
  14. 2020-11-08 06:33:44,858 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.server.filter.enabled does not exist
  15. 2020-11-08 06:33:44,859 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: get_databases: @cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5#
  16. 2020-11-08 06:33:44,859 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-199]: ugi=hue/[email protected] ip=172.27.167.198 cmd=get_databases: @cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5#
  17. 2020-11-08 06:33:44,921 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.runworker.in does not exist
  18. 2020-11-08 06:33:44,921 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.housekeeping.threads.on does not exist
  19. 2020-11-08 06:33:44,921 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.server.filter.enabled does not exist
  20. 2020-11-08 06:33:44,936 INFO org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer: [pool-7-thread-199]: Current user : hue, Current Roles : []
  21. 2020-11-08 06:33:44,939 ERROR org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-7-thread-199]: Retrying HMSHandler after 2000 ms (attempt 1 of 10) with error: javax.jdo.JDODataStoreException: Exception thrown flushing changes to datastore
  22. at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543)
  23. at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:171)
  24. at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:929)
  25. at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
  26. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  27. at java.lang.reflect.Method.invoke(Method.java:498)
  28. at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
  29. at com.sun.proxy.$Proxy26.commitTransaction(Unknown Source)
  30. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.dropCatalogCore(HiveMetaStore.java:1378)
  31. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_catalog(HiveMetaStore.java:1322)
  32. at sun.reflect.GeneratedMethodAccessor94.invoke(Unknown Source)
  33. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  34. at java.lang.reflect.Method.invoke(Method.java:498)
  35. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
  36. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
  37. at com.sun.proxy.$Proxy27.drop_catalog(Unknown Source)
  38. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16119)
  39. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16103)
  40. at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
  41. at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
  42. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
  43. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
  44. at java.security.AccessController.doPrivileged(Native Method)
  45. at javax.security.auth.Subject.doAs(Subject.java:422)
  46. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
  47. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:638)
  48. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
  49. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  50. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  51. at java.lang.Thread.run(Thread.java:748)
  52. NestedThrowablesStackTrace:
  53. java.sql.BatchUpdateException: Cannot delete or update a parent row: a foreign key constraint fails ("hive1"."DBS", CONSTRAINT "CTLG_FK1" FOREIGN KEY ("CTLG_NAME") REFERENCES "CTLGS" ("NAME"))
  54. at sun.reflect.GeneratedConstructorAccessor128.newInstance(Unknown Source)
  55. at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  56. at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  57. at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
  58. at com.mysql.jdbc.Util.getInstance(Util.java:408)
  59. at com.mysql.jdbc.SQLError.createBatchUpdateException(SQLError.java:1162)
  60. at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1778)
  61. at com.mysql.jdbc.PreparedStatement.executeBatchInternal(PreparedStatement.java:1262)
  62. at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:970)
  63. at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:125)
  64. at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java)
  65. at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeBatch(ParamLoggingPreparedStatement.java:366)
  66. at org.datanucleus.store.rdbms.SQLController.processConnectionStatement(SQLController.java:676)
  67. at org.datanucleus.store.rdbms.SQLController.processStatementsForConnection(SQLController.java:644)
  68. at org.datanucleus.store.rdbms.SQLController$1.transactionFlushed(SQLController.java:731)
  69. at org.datanucleus.store.connection.AbstractManagedConnection.transactionFlushed(AbstractManagedConnection.java:89)
  70. at org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionFlushed(ConnectionManagerImpl.java:450)
  71. at org.datanucleus.TransactionImpl.flush(TransactionImpl.java:210)
  72. at org.datanucleus.TransactionImpl.commit(TransactionImpl.java:274)
  73. at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:107)
  74. at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:929)
  75. at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
  76. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  77. at java.lang.reflect.Method.invoke(Method.java:498)
  78. at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
  79. at com.sun.proxy.$Proxy26.commitTransaction(Unknown Source)
  80. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.dropCatalogCore(HiveMetaStore.java:1378)
  81. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_catalog(HiveMetaStore.java:1322)
  82. at sun.reflect.GeneratedMethodAccessor94.invoke(Unknown Source)
  83. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  84. at java.lang.reflect.Method.invoke(Method.java:498)
  85. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
  86. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
  87. at com.sun.proxy.$Proxy27.drop_catalog(Unknown Source)
  88. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16119)
  89. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16103)
  90. at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
  91. at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
  92. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
  93. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
  94. at java.security.AccessController.doPrivileged(Native Method)
  95. at javax.security.auth.Subject.doAs(Subject.java:422)
  96. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
  97. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:638)
  98. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
  99. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  100. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  101. at java.lang.Thread.run(Thread.java:748)
  102. Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Cannot delete or update a parent row: a foreign key constraint fails ("hive1"."DBS", CONSTRAINT "CTLG_FK1" FOREIGN KEY ("CTLG_NAME") REFERENCES "CTLGS" ("NAME"))
  103. at sun.reflect.GeneratedConstructorAccessor127.newInstance(Unknown Source)
  104. at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  105. at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  106. at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
  107. at com.mysql.jdbc.Util.getInstance(Util.java:408)
  108. at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:935)
  109. at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3973)
  110. at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3909)
  111. at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2527)
  112. at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2680)
  113. at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2487)
  114. at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1858)
  115. at com.mysql.jdbc.PreparedStatement.executeUpdateInternal(PreparedStatement.java:2079)
  116. at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1756)
  117. ... 41 more
  118.  
  119. 2020-11-08 06:33:46,942 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: drop_catalog: cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5
  120. 2020-11-08 06:33:46,942 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-199]: ugi=hue/[email protected] ip=172.27.167.198 cmd=drop_catalog: cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5
  121. 2020-11-08 06:33:47,001 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.runworker.in does not exist
  122. 2020-11-08 06:33:47,001 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.housekeeping.threads.on does not exist
  123. 2020-11-08 06:33:47,001 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.server.filter.enabled does not exist
  124. 2020-11-08 06:33:47,002 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: get_databases: @cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5#
  125. 2020-11-08 06:33:47,002 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-199]: ugi=hue/[email protected] ip=172.27.167.198 cmd=get_databases: @cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5#
  126. 2020-11-08 06:33:47,066 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.runworker.in does not exist
  127. 2020-11-08 06:33:47,066 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.housekeeping.threads.on does not exist
  128. 2020-11-08 06:33:47,066 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.server.filter.enabled does not exist
  129. 2020-11-08 06:33:47,080 INFO org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer: [pool-7-thread-199]: Current user : hue, Current Roles : []
  130. 2020-11-08 06:33:47,086 ERROR org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-7-thread-199]: Retrying HMSHandler after 2000 ms (attempt 2 of 10) with error: javax.jdo.JDODataStoreException: Exception thrown flushing changes to datastore
  131. at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543)
  132. at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:171)
  133. at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:929)
  134. at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
  135. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  136. at java.lang.reflect.Method.invoke(Method.java:498)
  137. at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
  138. at com.sun.proxy.$Proxy26.commitTransaction(Unknown Source)
  139. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.dropCatalogCore(HiveMetaStore.java:1378)
  140. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_catalog(HiveMetaStore.java:1322)
  141. at sun.reflect.GeneratedMethodAccessor94.invoke(Unknown Source)
  142. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  143. at java.lang.reflect.Method.invoke(Method.java:498)
  144. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
  145. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
  146. at com.sun.proxy.$Proxy27.drop_catalog(Unknown Source)
  147. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16119)
  148. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16103)
  149. at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
  150. at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
  151. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
  152. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
  153. at java.security.AccessController.doPrivileged(Native Method)
  154. at javax.security.auth.Subject.doAs(Subject.java:422)
  155. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
  156. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:638)
  157. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
  158. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  159. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  160. at java.lang.Thread.run(Thread.java:748)
  161. NestedThrowablesStackTrace:
  162. java.sql.BatchUpdateException: Cannot delete or update a parent row: a foreign key constraint fails ("hive1"."DBS", CONSTRAINT "CTLG_FK1" FOREIGN KEY ("CTLG_NAME") REFERENCES "CTLGS" ("NAME"))
  163. at sun.reflect.GeneratedConstructorAccessor128.newInstance(Unknown Source)
  164. at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  165. at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  166. at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
  167. at com.mysql.jdbc.Util.getInstance(Util.java:408)
  168. at com.mysql.jdbc.SQLError.createBatchUpdateException(SQLError.java:1162)
  169. at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1778)
  170. at com.mysql.jdbc.PreparedStatement.executeBatchInternal(PreparedStatement.java:1262)
  171. at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:970)
  172. at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:125)
  173. at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java)
  174. at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeBatch(ParamLoggingPreparedStatement.java:366)
  175. at org.datanucleus.store.rdbms.SQLController.processConnectionStatement(SQLController.java:676)
  176. at org.datanucleus.store.rdbms.SQLController.processStatementsForConnection(SQLController.java:644)
  177. at org.datanucleus.store.rdbms.SQLController$1.transactionFlushed(SQLController.java:731)
  178. at org.datanucleus.store.connection.AbstractManagedConnection.transactionFlushed(AbstractManagedConnection.java:89)
  179. at org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionFlushed(ConnectionManagerImpl.java:450)
  180. at org.datanucleus.TransactionImpl.flush(TransactionImpl.java:210)
  181. at org.datanucleus.TransactionImpl.commit(TransactionImpl.java:274)
  182. at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:107)
  183. at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:929)
  184. at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
  185. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  186. at java.lang.reflect.Method.invoke(Method.java:498)
  187. at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
  188. at com.sun.proxy.$Proxy26.commitTransaction(Unknown Source)
  189. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.dropCatalogCore(HiveMetaStore.java:1378)
  190. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_catalog(HiveMetaStore.java:1322)
  191. at sun.reflect.GeneratedMethodAccessor94.invoke(Unknown Source)
  192. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  193. at java.lang.reflect.Method.invoke(Method.java:498)
  194. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
  195. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
  196. at com.sun.proxy.$Proxy27.drop_catalog(Unknown Source)
  197. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16119)
  198. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16103)
  199. at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
  200. at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
  201. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
  202. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
  203. at java.security.AccessController.doPrivileged(Native Method)
  204. at javax.security.auth.Subject.doAs(Subject.java:422)
  205. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
  206. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:638)
  207. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
  208. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  209. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  210. at java.lang.Thread.run(Thread.java:748)
  211. Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Cannot delete or update a parent row: a foreign key constraint fails ("hive1"."DBS", CONSTRAINT "CTLG_FK1" FOREIGN KEY ("CTLG_NAME") REFERENCES "CTLGS" ("NAME"))
  212. at sun.reflect.GeneratedConstructorAccessor127.newInstance(Unknown Source)
  213. at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  214. at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  215. at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
  216. at com.mysql.jdbc.Util.getInstance(Util.java:408)
  217. at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:935)
  218. at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3973)
  219. at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3909)
  220. at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2527)
  221. at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2680)
  222. at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2487)
  223. at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1858)
  224. at com.mysql.jdbc.PreparedStatement.executeUpdateInternal(PreparedStatement.java:2079)
  225. at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1756)
  226. ... 41 more
  227.  
  228. 2020-11-08 06:33:47,963 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-200]: 176: get_database: default
  229. 2020-11-08 06:33:47,963 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-200]: ugi=hive/[email protected] ip=172.27.167.198 cmd=get_database: default
  230. 2020-11-08 06:33:47,964 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-200]: 176: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
  231. 2020-11-08 06:33:47,969 INFO org.apache.hadoop.hive.metastore.ObjectStore: [pool-7-thread-200]: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@19f390de, with PersistenceManager: null will be shutdown
  232. 2020-11-08 06:33:47,970 INFO org.apache.hadoop.hive.metastore.ObjectStore: [pool-7-thread-200]: RawStore: org.apache.hadoop.hive.metastore.ObjectStore@19f390de, with PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@26ab3c3e created in the thread with id: 5780
  233. 2020-11-08 06:33:47,974 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-200]: Created RawStore: org.apache.hadoop.hive.metastore.ObjectStore@19f390de from thread id: 5780
  234. 2020-11-08 06:33:48,018 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-200]: HiveConf of name hive.metastore.runworker.in does not exist
  235. 2020-11-08 06:33:48,018 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-200]: HiveConf of name hive.metastore.housekeeping.threads.on does not exist
  236. 2020-11-08 06:33:48,018 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-200]: HiveConf of name hive.metastore.server.filter.enabled does not exist
  237. 2020-11-08 06:33:48,018 INFO org.apache.hadoop.hive.metastore.MetastoreDefaultTransformer: [pool-7-thread-200]: Starting translation for transformDatabase for processor [email protected] with [EXTWRITE, EXTREAD, HIVEBUCKET2, HIVEFULLACIDREAD, HIVEFULLACIDWRITE, HIVECACHEINVALIDATE, HIVEMANAGESTATS, HIVEMANAGEDINSERTWRITE, HIVEMANAGEDINSERTREAD, HIVESQL, HIVEMQT, HIVEONLYMQTWRITE, ACCEPTS_UNMODIFIED_METADATA] on database default locationUri=hdfs://phivea-3.phivea.root.hwx.site:8020/warehouse/tablespace/external/hive managedLocationUri=null
  238. 2020-11-08 06:33:48,019 INFO org.apache.hadoop.hive.metastore.MetastoreDefaultTransformer: [pool-7-thread-200]: Transformer returning database:Database(name:default, description:Default Hive database, locationUri:hdfs://phivea-3.phivea.root.hwx.site:8020/warehouse/tablespace/external/hive, parameters:{}, ownerName:public, ownerType:ROLE, catalogName:hive, createTime:1604555938, managedLocationUri:hdfs://phivea-3.phivea.root.hwx.site:8020/warehouse/tablespace/managed/hive)
  239. 2020-11-08 06:33:48,130 INFO org.apache.hadoop.hive.metastore.txn.TxnHandler: [pool-7-thread-200]: Added entries to MIN_HISTORY_LEVEL with a single query for current txn: [39]
  240. 2020-11-08 06:33:48,165 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-200]: 176: get_not_null_constraints : tbl=hive._dummy_database._dummy_table
  241. 2020-11-08 06:33:48,165 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-200]: ugi=hive/[email protected] ip=172.27.167.198 cmd=get_not_null_constraints : tbl=hive._dummy_database._dummy_table
  242. 2020-11-08 06:33:48,168 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-200]: 176: get_primary_keys : tbl=hive._dummy_database._dummy_table
  243. 2020-11-08 06:33:48,168 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-200]: ugi=hive/[email protected] ip=172.27.167.198 cmd=get_primary_keys : tbl=hive._dummy_database._dummy_table
  244. 2020-11-08 06:33:48,170 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-200]: 176: get_unique_constraints : tbl=hive._dummy_database._dummy_table
  245. 2020-11-08 06:33:48,171 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-200]: ugi=hive/[email protected] ip=172.27.167.198 cmd=get_unique_constraints : tbl=hive._dummy_database._dummy_table
  246. 2020-11-08 06:33:48,173 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-200]: 176: get_foreign_keys : parentdb=null parenttbl=null foreigndb=_dummy_database foreigntbl=_dummy_table
  247. 2020-11-08 06:33:48,173 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-200]: ugi=hive/[email protected] ip=172.27.167.198 cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=_dummy_database foreigntbl=_dummy_table
  248. 2020-11-08 06:33:48,184 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-200]: 176: get_table : tbl=hive._dummy_database._dummy_table
  249. 2020-11-08 06:33:48,184 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-200]: ugi=hive/[email protected] ip=172.27.167.198 cmd=get_table : tbl=hive._dummy_database._dummy_table
  250. 2020-11-08 06:33:48,285 INFO org.apache.hadoop.hive.metastore.txn.TxnHandler: [pool-7-thread-200]: Expected to move at least one record from txn_components to completed_txn_components when committing txn! txnid:39
  251. 2020-11-08 06:33:48,287 INFO org.apache.hadoop.hive.metastore.txn.TxnHandler: [pool-7-thread-200]: Removed committed transaction: (39) from MIN_HISTORY_LEVEL
  252.  
  253. ==> hadoop-cmf-HIVE_ON_TEZ-1-HIVESERVER2-phivea-3.phivea.root.hwx.site.log.out <==
  254. 2020-11-08 06:33:47,932 INFO org.apache.hive.service.cli.thrift.ThriftCLIService: [HiveServer2-Handler-Pool: Thread-201]: Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V10
  255. 2020-11-08 06:33:47,949 INFO org.apache.hadoop.hive.ql.session.SessionState: [HiveServer2-Handler-Pool: Thread-201]: Created HDFS directory: /tmp/hive/hive/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10
  256. 2020-11-08 06:33:47,951 INFO org.apache.hadoop.hive.ql.session.SessionState: [HiveServer2-Handler-Pool: Thread-201]: Created local directory: /tmp/hive/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10
  257. 2020-11-08 06:33:47,953 INFO org.apache.hadoop.hive.ql.session.SessionState: [HiveServer2-Handler-Pool: Thread-201]: Created HDFS directory: /tmp/hive/hive/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10/_tmp_space.db
  258. 2020-11-08 06:33:47,954 WARN org.apache.hadoop.hive.ql.processors.SetProcessor: [HiveServer2-Handler-Pool: Thread-201]: This config will be deprecated and may not be available in the future versions. Please adjust DDL towards the new semantics.
  259. 2020-11-08 06:33:47,956 INFO org.apache.hadoop.hive.metastore.HiveMetaStoreClient: [HiveServer2-Handler-Pool: Thread-201]: HMS client filtering is enabled.
  260. 2020-11-08 06:33:47,956 INFO org.apache.hadoop.hive.metastore.HiveMetaStoreClient: [HiveServer2-Handler-Pool: Thread-201]: Trying to connect to metastore with URI thrift://phivea-3.phivea.root.hwx.site:9083
  261. 2020-11-08 06:33:47,956 INFO org.apache.hadoop.hive.metastore.HiveMetaStoreClient: [HiveServer2-Handler-Pool: Thread-201]: HMSC::open(): Could not find delegation token. Creating KERBEROS-based thrift connection.
  262. 2020-11-08 06:33:47,962 INFO org.apache.hadoop.hive.metastore.HiveMetaStoreClient: [HiveServer2-Handler-Pool: Thread-201]: Opened a connection to metastore, current connections: 12
  263. 2020-11-08 06:33:47,962 INFO org.apache.hadoop.hive.metastore.HiveMetaStoreClient: [HiveServer2-Handler-Pool: Thread-201]: Connected to metastore.
  264. 2020-11-08 06:33:47,962 INFO org.apache.hadoop.hive.metastore.RetryingMetaStoreClient: [HiveServer2-Handler-Pool: Thread-201]: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hive/[email protected] (auth:KERBEROS) retries=1 delay=1 lifetime=0
  265. 2020-11-08 06:33:48,022 INFO org.apache.hive.service.cli.session.HiveSessionImpl: [HiveServer2-Handler-Pool: Thread-201]: Operation log session directory is created: /var/log/hive/operation_logs/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10
  266. 2020-11-08 06:33:48,022 INFO org.apache.hive.service.CompositeService: [HiveServer2-Handler-Pool: Thread-201]: Session opened, SessionHandle [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10], current sessions:1
  267. 2020-11-08 06:33:48,116 INFO org.apache.hive.service.cli.operation.OperationManager: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Adding operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=c51001ad-4c68-47f9-ab1d-d73b262f6f9e]
  268. 2020-11-08 06:33:48,116 INFO org.apache.hadoop.hive.common.LogUtils: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Thread context registration is done.
  269. 2020-11-08 06:33:48,118 INFO org.apache.hive.service.cli.operation.Operation: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: [opType=EXECUTE_STATEMENT, queryId=hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79, startTime=1604817228114, sessionId=26bc05dc-23bd-45c9-8aca-a67cbaf5eb10, createTime=1604817227937, userName=knoxui, ipAddress=172.27.29.70]
  270. 2020-11-08 06:33:48,119 INFO org.apache.hadoop.hive.ql.Driver: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Compiling command(queryId=hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79): select current_user()
  271. 2020-11-08 06:33:48,134 INFO org.apache.hadoop.hive.ql.lockmgr.DbTxnManager: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Opened txnid:39
  272. 2020-11-08 06:33:48,136 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Starting Semantic Analysis
  273. 2020-11-08 06:33:48,137 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Completed phase 1 of Semantic Analysis
  274. 2020-11-08 06:33:48,137 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Get metadata for source tables
  275. 2020-11-08 06:33:48,137 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Get metadata for subqueries
  276. 2020-11-08 06:33:48,137 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Get metadata for destination tables
  277. 2020-11-08 06:33:48,137 INFO hive.ql.Context: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: New scratch dir is hdfs://phivea-3.phivea.root.hwx.site:8020/tmp/hive/hive/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10/hive_2020-11-08_06-33-48_119_6091948204668817229-3
  278. 2020-11-08 06:33:48,137 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Completed getting MetaData in Semantic Analysis
  279. 2020-11-08 06:33:48,140 INFO hive.ql.Context: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: New scratch dir is hdfs://phivea-3.phivea.root.hwx.site:8020/tmp/hive/hive/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10/hive_2020-11-08_06-33-48_119_6091948204668817229-3
  280. 2020-11-08 06:33:48,183 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Get metadata for source tables
  281. 2020-11-08 06:33:48,187 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Get metadata for subqueries
  282. 2020-11-08 06:33:48,187 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Get metadata for destination tables
  283. 2020-11-08 06:33:48,187 INFO hive.ql.Context: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: New scratch dir is hdfs://phivea-3.phivea.root.hwx.site:8020/tmp/hive/hive/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10/hive_2020-11-08_06-33-48_119_6091948204668817229-3
  284. 2020-11-08 06:33:48,187 INFO hive.ql.Context: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: New scratch dir is hdfs://phivea-3.phivea.root.hwx.site:8020/tmp/hive/hive/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10/hive_2020-11-08_06-33-48_119_6091948204668817229-3
  285. 2020-11-08 06:33:48,190 INFO org.apache.hadoop.hive.common.FileUtils: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Creating directory if it doesn't exist: hdfs://phivea-3.phivea.root.hwx.site:8020/tmp/hive/hive/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10/hive_2020-11-08_06-33-48_119_6091948204668817229-3/-mr-10001/.hive-staging_hive_2020-11-08_06-33-48_119_6091948204668817229-3
  286. 2020-11-08 06:33:48,193 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: CBO Succeeded; optimized logical plan.
  287. 2020-11-08 06:33:48,194 INFO org.apache.hadoop.hive.ql.ppd.OpProcFactory: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Processing for FS(2)
  288. 2020-11-08 06:33:48,194 INFO org.apache.hadoop.hive.ql.ppd.OpProcFactory: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Processing for SEL(1)
  289. 2020-11-08 06:33:48,194 INFO org.apache.hadoop.hive.ql.ppd.OpProcFactory: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Processing for TS(0)
  290. 2020-11-08 06:33:48,196 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Completed plan generation
  291. 2020-11-08 06:33:48,196 INFO org.apache.hadoop.hive.ql.parse.CalcitePlanner: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Not eligible for results caching - no mr/tez/spark jobs
  292. 2020-11-08 06:33:48,197 INFO org.apache.hadoop.hive.ql.Driver: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Semantic Analysis Completed (retrial = false)
  293. 2020-11-08 06:33:48,197 INFO org.apache.hadoop.hive.ql.Driver: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:_c0, type:string, comment:null)], properties:null)
  294. 2020-11-08 06:33:48,198 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Initializing operator TS[0]
  295. 2020-11-08 06:33:48,199 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Initializing operator SEL[1]
  296. 2020-11-08 06:33:48,199 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: SELECT null
  297. 2020-11-08 06:33:48,199 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Initializing operator LIST_SINK[3]
  298. 2020-11-08 06:33:48,266 INFO org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Current user : knoxui, Current Roles : []
  299. 2020-11-08 06:33:48,266 INFO org.apache.hadoop.hive.ql.Driver: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Completed compiling command(queryId=hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79); Time taken: 0.147 seconds
  300. 2020-11-08 06:33:48,266 INFO org.apache.hadoop.hive.common.LogUtils: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Unregistered logging context.
  301. 2020-11-08 06:33:48,267 INFO org.apache.hadoop.hive.common.LogUtils: [HiveServer2-Background-Pool: Thread-14540]: Thread context registration is done.
  302. 2020-11-08 06:33:48,268 INFO org.apache.hadoop.hive.ql.reexec.ReExecDriver: [HiveServer2-Background-Pool: Thread-14540]: Execution #1 of query
  303. 2020-11-08 06:33:48,268 INFO org.apache.hadoop.hive.ql.lockmgr.DbTxnManager: [HiveServer2-Background-Pool: Thread-14540]: Setting lock request transaction to txnid:39 for queryId=hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79
  304. 2020-11-08 06:33:48,269 INFO org.apache.hadoop.hive.ql.Driver: [HiveServer2-Background-Pool: Thread-14540]: Executing command(queryId=hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79): select current_user()
  305. 2020-11-08 06:33:48,269 INFO org.apache.hadoop.hive.ql.hooks.HiveProtoLoggingHook: [HiveServer2-Background-Pool: Thread-14540]: Received pre-hook notification for: hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79
  306. 2020-11-08 06:33:48,279 INFO org.apache.hadoop.hive.ql.hooks.HiveProtoLoggingHook: [HiveServer2-Background-Pool: Thread-14540]: Received post-hook notification for: hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79
  307. 2020-11-08 06:33:48,281 INFO org.apache.hadoop.hive.ql.Driver: [HiveServer2-Background-Pool: Thread-14540]: Completed executing command(queryId=hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79); Time taken: 0.011 seconds
  308. 2020-11-08 06:33:48,281 INFO org.apache.hadoop.hive.ql.Driver: [HiveServer2-Background-Pool: Thread-14540]: OK
  309. 2020-11-08 06:33:48,281 INFO org.apache.hadoop.hive.ql.lockmgr.DbTxnManager: [HiveServer2-Background-Pool: Thread-14540]: Stopped heartbeat for query: hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79
  310. 2020-11-08 06:33:48,291 INFO org.apache.hadoop.hive.common.LogUtils: [HiveServer2-Background-Pool: Thread-14540]: Unregistered logging context.
  311. 2020-11-08 06:33:48,343 INFO org.apache.hadoop.hive.ql.io.NullRowsInputFormat$NullRowsRecordReader: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Using null rows input format
  312. 2020-11-08 06:33:48,344 INFO org.apache.hadoop.hive.ql.exec.TableScanOperator: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:1,
  313. 2020-11-08 06:33:48,344 INFO org.apache.hadoop.hive.ql.exec.SelectOperator: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_SEL_1:1,
  314. 2020-11-08 06:33:48,344 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_LIST_SINK_3:1,
  315. 2020-11-08 06:33:48,387 INFO org.apache.hive.service.cli.operation.OperationManager: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Closing operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=c51001ad-4c68-47f9-ab1d-d73b262f6f9e]
  316. 2020-11-08 06:33:48,387 INFO org.apache.hive.service.cli.operation.OperationManager: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Removed queryId: hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79 corresponding to operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=c51001ad-4c68-47f9-ab1d-d73b262f6f9e] with tag: null
  317. 2020-11-08 06:33:48,390 INFO org.apache.hive.service.cli.operation.Operation: [26bc05dc-23bd-45c9-8aca-a67cbaf5eb10 HiveServer2-Handler-Pool: Thread-201]: Closing operation log /var/log/hive/operation_logs/26bc05dc-23bd-45c9-8aca-a67cbaf5eb10/hive_20201108063348_73799994-9771-4f5e-ab3e-076ddef26e79 without delay
  318.  
  319. ==> hadoop-cmf-HIVE-1-HIVEMETASTORE-phivea-3.phivea.root.hwx.site.log.out <==
  320. 2020-11-08 06:33:49,089 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: drop_catalog: cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5
  321. 2020-11-08 06:33:49,089 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-199]: ugi=hue/[email protected] ip=172.27.167.198 cmd=drop_catalog: cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5
  322. 2020-11-08 06:33:49,129 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.runworker.in does not exist
  323. 2020-11-08 06:33:49,129 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.housekeeping.threads.on does not exist
  324. 2020-11-08 06:33:49,129 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.server.filter.enabled does not exist
  325. 2020-11-08 06:33:49,130 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: [pool-7-thread-199]: 175: get_databases: @cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5#
  326. 2020-11-08 06:33:49,130 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-7-thread-199]: ugi=hue/[email protected] ip=172.27.167.198 cmd=get_databases: @cloudera_manager_metastore_canary_test_catalog_HIVE_1_HIVEMETASTORE_b4cd1ce07e2360f70c14eceebdf512a5#
  327. 2020-11-08 06:33:49,169 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.runworker.in does not exist
  328. 2020-11-08 06:33:49,169 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.housekeeping.threads.on does not exist
  329. 2020-11-08 06:33:49,169 WARN org.apache.hadoop.hive.conf.HiveConf: [pool-7-thread-199]: HiveConf of name hive.metastore.server.filter.enabled does not exist
  330. 2020-11-08 06:33:49,184 INFO org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer: [pool-7-thread-199]: Current user : hue, Current Roles : []
  331. 2020-11-08 06:33:49,187 ERROR org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-7-thread-199]: Retrying HMSHandler after 2000 ms (attempt 3 of 10) with error: javax.jdo.JDODataStoreException: Exception thrown flushing changes to datastore
  332. at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543)
  333. at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:171)
  334. at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:929)
  335. at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
  336. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  337. at java.lang.reflect.Method.invoke(Method.java:498)
  338. at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
  339. at com.sun.proxy.$Proxy26.commitTransaction(Unknown Source)
  340. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.dropCatalogCore(HiveMetaStore.java:1378)
  341. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_catalog(HiveMetaStore.java:1322)
  342. at sun.reflect.GeneratedMethodAccessor94.invoke(Unknown Source)
  343. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  344. at java.lang.reflect.Method.invoke(Method.java:498)
  345. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
  346. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
  347. at com.sun.proxy.$Proxy27.drop_catalog(Unknown Source)
  348. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16119)
  349. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16103)
  350. at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
  351. at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
  352. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
  353. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
  354. at java.security.AccessController.doPrivileged(Native Method)
  355. at javax.security.auth.Subject.doAs(Subject.java:422)
  356. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
  357. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:638)
  358. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
  359. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  360. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  361. at java.lang.Thread.run(Thread.java:748)
  362. NestedThrowablesStackTrace:
  363. java.sql.BatchUpdateException: Cannot delete or update a parent row: a foreign key constraint fails ("hive1"."DBS", CONSTRAINT "CTLG_FK1" FOREIGN KEY ("CTLG_NAME") REFERENCES "CTLGS" ("NAME"))
  364. at sun.reflect.GeneratedConstructorAccessor128.newInstance(Unknown Source)
  365. at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  366. at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  367. at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
  368. at com.mysql.jdbc.Util.getInstance(Util.java:408)
  369. at com.mysql.jdbc.SQLError.createBatchUpdateException(SQLError.java:1162)
  370. at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1778)
  371. at com.mysql.jdbc.PreparedStatement.executeBatchInternal(PreparedStatement.java:1262)
  372. at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:970)
  373. at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:125)
  374. at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java)
  375. at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeBatch(ParamLoggingPreparedStatement.java:366)
  376. at org.datanucleus.store.rdbms.SQLController.processConnectionStatement(SQLController.java:676)
  377. at org.datanucleus.store.rdbms.SQLController.processStatementsForConnection(SQLController.java:644)
  378. at org.datanucleus.store.rdbms.SQLController$1.transactionFlushed(SQLController.java:731)
  379. at org.datanucleus.store.connection.AbstractManagedConnection.transactionFlushed(AbstractManagedConnection.java:89)
  380. at org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionFlushed(ConnectionManagerImpl.java:450)
  381. at org.datanucleus.TransactionImpl.flush(TransactionImpl.java:210)
  382. at org.datanucleus.TransactionImpl.commit(TransactionImpl.java:274)
  383. at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:107)
  384. at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:929)
  385. at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
  386. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  387. at java.lang.reflect.Method.invoke(Method.java:498)
  388. at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
  389. at com.sun.proxy.$Proxy26.commitTransaction(Unknown Source)
  390. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.dropCatalogCore(HiveMetaStore.java:1378)
  391. at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_catalog(HiveMetaStore.java:1322)
  392. at sun.reflect.GeneratedMethodAccessor94.invoke(Unknown Source)
  393. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  394. at java.lang.reflect.Method.invoke(Method.java:498)
  395. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
  396. at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
  397. at com.sun.proxy.$Proxy27.drop_catalog(Unknown Source)
  398. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16119)
  399. at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$drop_catalog.getResult(ThriftHiveMetastore.java:16103)
  400. at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
  401. at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
  402. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
  403. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
  404. at java.security.AccessController.doPrivileged(Native Method)
  405. at javax.security.auth.Subject.doAs(Subject.java:422)
  406. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
  407. at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:638)
  408. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
  409. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  410. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  411. at java.lang.Thread.run(Thread.java:748)
  412. Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Cannot delete or update a parent row: a foreign key constraint fails ("hive1"."DBS", CONSTRAINT "CTLG_FK1" FOREIGN KEY ("CTLG_NAME") REFERENCES "CTLGS" ("NAME"))
  413. at sun.reflect.GeneratedConstructorAccessor127.newInstance(Unknown Source)
  414. at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  415. at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  416. at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
  417. at com.mysql.jdbc.Util.getInstance(Util.java:408)
  418. at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:935)
  419. at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3973)
  420. at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3909)
  421. at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2527)
  422. at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2680)
  423. at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2487)
  424. at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1858)
  425. at com.mysql.jdbc.PreparedStatement.executeUpdateInternal(PreparedStatement.java:2079)
  426. at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1756)
  427. ... 41 more
  428.  
Advertisement
Add Comment
Please, Sign In to add comment