Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2016-06-01 10:59:04,678 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:04,678 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.468 seconds.
- 2016-06-01 10:59:04,692 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:04,692 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.343 seconds.
- 2016-06-01 10:59:04,706 DEBUG (SLF4JLogger.java[debug]:56) => Closing connection connectionId{localValue:7080}
- 2016-06-01 10:59:04,881 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:04,881 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.415 seconds.
- 2016-06-01 10:59:05,273 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:05,273 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.346 seconds.
- 2016-06-01 10:59:05,497 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:05,497 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.458 seconds.
- 2016-06-01 10:59:05,655 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:05,655 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.458 seconds.
- 2016-06-01 10:59:06,008 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:06,008 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:06,008 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.575 seconds.
- 2016-06-01 10:59:06,008 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.569 seconds.
- 2016-06-01 10:59:06,043 INFO (ConnectionManager.java[closeMasterService]:2068) => Closing master protocol: MasterService
- 2016-06-01 10:59:06,044 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:305) => 2500 records loaded in 1 batch(es)!
- 2016-06-01 10:59:06,045 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.449 seconds.
- 2016-06-01 10:59:06,068 WARN (AsyncProcess.java[sendMultiAction]:985) => #1, the task was rejected by the pool. This is unexpected. Server is server2,16020,1464699764207
- java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@606dde49 rejected from java.util.concurrent.ThreadPoolExecutor@4d1cbc14[Shutting down, pool size = 3, active threads = 3, queued tasks = 0, completed tasks = 4025242]
- at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
- at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
- at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
- at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.sendMultiAction(AsyncProcess.java:980)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.groupAndSendMultiAction(AsyncProcess.java:886)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.access$100(AsyncProcess.java:575)
- at org.apache.hadoop.hbase.client.AsyncProcess.submitAll(AsyncProcess.java:557)
- at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:911)
- at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:928)
- at org.apache.phoenix.execute.MutationState.commit(MutationState.java:491)
- at org.apache.phoenix.jdbc.PhoenixConnection$3.call(PhoenixConnection.java:482)
- at org.apache.phoenix.jdbc.PhoenixConnection$3.call(PhoenixConnection.java:479)
- at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
- at org.apache.phoenix.jdbc.PhoenixConnection.commit(PhoenixConnection.java:479)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.commitUpserts(DataLoadQueueConsumerTask.java:304)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.call(DataLoadQueueConsumerTask.java:229)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.call(DataLoadQueueConsumerTask.java:35)
- at java.util.concurrent.FutureTask.run(FutureTask.java:262)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
- at java.lang.Thread.run(Thread.java:744)
- 2016-06-01 10:59:06,074 WARN (AsyncProcess.java[sendMultiAction]:985) => #1, the task was rejected by the pool. This is unexpected. Server is server2,16020,1464699764207
- java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ff661ea rejected from java.util.concurrent.ThreadPoolExecutor@4d1cbc14[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 4025243]
- at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
- at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
- at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
- at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.sendMultiAction(AsyncProcess.java:980)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.groupAndSendMultiAction(AsyncProcess.java:886)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.access$100(AsyncProcess.java:575)
- at org.apache.hadoop.hbase.client.AsyncProcess.submitAll(AsyncProcess.java:557)
- at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:911)
- at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:928)
- at org.apache.phoenix.execute.MutationState.commit(MutationState.java:491)
- at org.apache.phoenix.jdbc.PhoenixConnection$3.call(PhoenixConnection.java:482)
- at org.apache.phoenix.jdbc.PhoenixConnection$3.call(PhoenixConnection.java:479)
- at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
- at org.apache.phoenix.jdbc.PhoenixConnection.commit(PhoenixConnection.java:479)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.commitUpserts(DataLoadQueueConsumerTask.java:304)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.call(DataLoadQueueConsumerTask.java:229)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.call(DataLoadQueueConsumerTask.java:35)
- at java.util.concurrent.FutureTask.run(FutureTask.java:262)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
- at java.lang.Thread.run(Thread.java:744)
- 2016-06-01 10:59:06,086 WARN (AsyncProcess.java[sendMultiAction]:985) => #1, the task was rejected by the pool. This is unexpected. Server is server1,16020,1464699764279
- java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2f5c99a3 rejected from java.util.concurrent.ThreadPoolExecutor@4d1cbc14[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 4025243]
- at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
- at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
- at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
- at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.sendMultiAction(AsyncProcess.java:980)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.groupAndSendMultiAction(AsyncProcess.java:886)
- at org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl.access$100(AsyncProcess.java:575)
- at org.apache.hadoop.hbase.client.AsyncProcess.submitAll(AsyncProcess.java:557)
- at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:911)
- at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:928)
- at org.apache.phoenix.execute.MutationState.commit(MutationState.java:491)
- at org.apache.phoenix.jdbc.PhoenixConnection$3.call(PhoenixConnection.java:482)
- at org.apache.phoenix.jdbc.PhoenixConnection$3.call(PhoenixConnection.java:479)
- at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
- at org.apache.phoenix.jdbc.PhoenixConnection.commit(PhoenixConnection.java:479)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.commitUpserts(DataLoadQueueConsumerTask.java:304)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.call(DataLoadQueueConsumerTask.java:229)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.call(DataLoadQueueConsumerTask.java:35)
- at java.util.concurrent.FutureTask.run(FutureTask.java:262)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
- at java.lang.Thread.run(Thread.java:744)
- 2016-06-01 10:59:06,095 INFO (ConnectionManager.java[closeZooKeeperWatcher]:1676) => Closing zookeeper sessionid=0x1550104165000d6
- 2016-06-01 10:59:06,096 DEBUG (ZooKeeper.java[close]:673) => Closing session: 0x1550104165000d6
- 2016-06-01 10:59:06,096 DEBUG (ClientCnxn.java[close]:1306) => Closing client for session: 0x1550104165000d6
- 2016-06-01 10:59:06,099 DEBUG (ClientCnxn.java[readResponse]:818) => Reading reply sessionid:0x1550104165000d6, packet:: clientPath:null serverPath:null finished:false header:: 7,-11 replyHeader:: 7,8589939591,0 request:: null response:: null
- 2016-06-01 10:59:06,100 DEBUG (ClientCnxn.java[run]:1086) => An exception was thrown while closing send thread for session 0x1550104165000d6 : Unable to read additional data from server sessionid 0x1550104165000d6, likely server has closed socket
- 2016-06-01 10:59:06,100 DEBUG (ClientCnxn.java[disconnect]:1290) => Disconnecting client for session: 0x1550104165000d6
- 2016-06-01 10:59:06,100 INFO (ZooKeeper.java[close]:684) => Session: 0x1550104165000d6 closed
- 2016-06-01 10:59:06,100 INFO (ClientCnxn.java[run]:512) => EventThread shut down
- 2016-06-01 10:59:06,100 DEBUG (RpcClientImpl.java[close]:1105) => Stopping rpc client
- 2016-06-01 10:59:06,106 DEBUG (JdbcUtils.java[closeConnection]:29) => Connection successfully closed!
- 2016-06-01 10:59:06,114 DEBUG (JdbcUtils.java[closeConnection]:29) => Connection successfully closed!
- 2016-06-01 10:59:06,129 ERROR (DataLoadQueueConsumerTask.java[commitUpserts]:308) => java.sql.SQLException: java.lang.IllegalArgumentException: Connection is null or closed.
- java.sql.SQLException: java.lang.IllegalArgumentException: Connection is null or closed.
- at org.apache.phoenix.query.ConnectionQueryServicesImpl.metaDataCoprocessorExec(ConnectionQueryServicesImpl.java:1055)
- at org.apache.phoenix.query.ConnectionQueryServicesImpl.metaDataCoprocessorExec(ConnectionQueryServicesImpl.java:1016)
- at org.apache.phoenix.query.ConnectionQueryServicesImpl.getTable(ConnectionQueryServicesImpl.java:1289)
- at org.apache.phoenix.schema.MetaDataClient.updateCache(MetaDataClient.java:446)
- at org.apache.phoenix.schema.MetaDataClient.updateCache(MetaDataClient.java:389)
- at org.apache.phoenix.schema.MetaDataClient.updateCache(MetaDataClient.java:385)
- at org.apache.phoenix.execute.MutationState.validate(MutationState.java:369)
- at org.apache.phoenix.execute.MutationState.commit(MutationState.java:417)
- at org.apache.phoenix.jdbc.PhoenixConnection$3.call(PhoenixConnection.java:482)
- at org.apache.phoenix.jdbc.PhoenixConnection$3.call(PhoenixConnection.java:479)
- at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
- at org.apache.phoenix.jdbc.PhoenixConnection.commit(PhoenixConnection.java:479)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.commitUpserts(DataLoadQueueConsumerTask.java:304)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.call(DataLoadQueueConsumerTask.java:229)
- at com.salviol.fropsdr.loader.tasks.DataLoadQueueConsumerTask.call(DataLoadQueueConsumerTask.java:35)
- at java.util.concurrent.FutureTask.run(FutureTask.java:262)
- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
- at java.lang.Thread.run(Thread.java:744)
- Caused by: java.lang.IllegalArgumentException: Connection is null or closed.
- at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:299)
- at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getTable(ConnectionManager.java:726)
- at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getTable(ConnectionManager.java:708)
- at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getTable(ConnectionManager.java:703)
- at org.apache.phoenix.query.HTableFactory$HTableFactoryImpl.getTable(HTableFactory.java:51)
- at org.apache.phoenix.query.ConnectionQueryServicesImpl.getTable(ConnectionQueryServicesImpl.java:309)
- at org.apache.phoenix.query.ConnectionQueryServicesImpl.metaDataCoprocessorExec(ConnectionQueryServicesImpl.java:1034)
- ... 18 more
- 2016-06-01 10:59:06,130 DEBUG (DataLoadQueueConsumerTask.java[commitUpserts]:315) => Commit took 0.071 seconds.
- 2016-06-01 10:59:06,176 ERROR (AsyncProcess.java[manageLocationError]:927) => Cannot get replica 0 location for {"totalColumns":1,"families":{"0":[{"timestamp":1464771545776,"tag":[],"qualifier":"_0","vlen":0}]},"row":"10.10.10.158\\x00971.8.99.64\\x00\\x80\\x00\\x01U\\x03\\xB2\\xBFp\\x00\\x00\\x00\\x00\\xA2\\x91\\xDA\\xDD\\x9C\\xF0\\xFD\\x93"}
- 2016-06-01 10:59:06,178 ERROR (AsyncProcess.java[manageLocationError]:927) => Cannot get replica 0 location for {"totalColumns":1,"families":{"0":[{"timestamp":1464771545776,"tag":[],"qualifier":"_0","vlen":0}]},"row":"10.10.10.9\\x00341.13.99.64\\x00\\x80\\x00\\x01U\\x03\\xB2\\xC7@\\x00\\x00\\x00\\x00\\xA2\\x91\\xDA\\xDD\\x9C\\xF17F"}
- 2016-06-01 10:59:06,179 ERROR (AsyncProcess.java[manageLocationError]:927) => Cannot get replica 0 location for {"totalColumns":1,"families":{"0":[{"timestamp":1464771545776,"tag":[],"qualifier":"_0","vlen":0}]},"row":"10.10.10.168\\x00512.011.99.64\\x00\\x80\\x00\\x01U\\x03\\xB3z\\xF0\\x00\\x00\\x00\\x00\\xA2\\x91\\xDA\\xDD\\x9C\\xF1\\x01\\xE7"}
Advertisement
Add Comment
Please, Sign In to add comment