11/06/29 17:35:12 INFO ipc.HBaseRPC: Using org.apache.hadoop.hbase.ipc.WritableRpcEngine for org.apache.hadoop.hbase.ipc.HRegionInterface 11/06/29 17:48:12 WARN client.HConnectionManager$HConnectionImplementation: Error executing for row 00223199610B220970111:2:0:7524:: java.util.concurrent.ExecutionException: org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact region server mysite.com/myip:62091 for region info_test,00223199610B220970111:2:0:7524::,1309363489443.c3192674341c8d10d84966e8e663a644., row '00223199610B220970111:2:0:7524::', but failed after 10 attempts. Exceptions: java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:14738 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:14867 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10902 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10902 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10991 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:11034 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17236 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17303 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17925 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17925 remote=mysite.com/myip:62091] at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) at java.util.concurrent.FutureTask.get(FutureTask.java:83) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processExecs(HConnectionManager.java:1337) at org.apache.hadoop.hbase.client.HTable.coprocessorExec(HTable.java:1476) at org.apache.hadoop.hbase.client.coprocessor.GetListClient.getList(GetListClient.java:104) at coprocess.TestGetList.testGetList(TestGetList.java:75) at coprocess.TestGetList.testValueFilter(TestGetList.java:64) at coprocess.TestGetList.main(TestGetList.java:135) Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact region server mysite.com/myip:62091 for region info_test,00223199610B220970111:2:0:7524::,1309363489443.c3192674341c8d10d84966e8e663a644., row '00223199610B220970111:2:0:7524::', but failed after 10 attempts. Exceptions: java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:14738 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:14867 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10902 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10902 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10991 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:11034 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17236 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17303 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17925 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17925 remote=mysite.com/myip:62091] at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionServerWithRetries(HConnectionManager.java:1215) at org.apache.hadoop.hbase.ipc.ExecRPCInvoker.invoke(ExecRPCInvoker.java:79) at $Proxy1.getList(Unknown Source) at org.apache.hadoop.hbase.client.coprocessor.GetListClient$1.call(GetListClient.java:108) at org.apache.hadoop.hbase.client.coprocessor.GetListClient$1.call(GetListClient.java:105) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$4.call(HConnectionManager.java:1325) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact region server mysite.com/myip:62091 for region info_test,00223199610B220970111:2:0:7524::,1309363489443.c3192674341c8d10d84966e8e663a644., row '00223199610B220970111:2:0:7524::', but failed after 10 attempts. Exceptions: java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:14738 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:14867 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10902 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10902 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:10991 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:11034 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17236 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17303 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17925 remote=mysite.com/myip:62091] java.net.SocketTimeoutException: Call to mysite.com/myip:62091 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/myip:17925 remote=mysite.com/myip:62091] at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionServerWithRetries(HConnectionManager.java:1215) at org.apache.hadoop.hbase.ipc.ExecRPCInvoker.invoke(ExecRPCInvoker.java:79) at $Proxy1.getList(Unknown Source) at org.apache.hadoop.hbase.client.coprocessor.GetListClient$1.call(GetListClient.java:108) at org.apache.hadoop.hbase.client.coprocessor.GetListClient$1.call(GetListClient.java:105) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$4.call(HConnectionManager.java:1325) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662)