API tools faq
paste
Guest User

Table RS Thread Stack

a guest
Jun 15th, 2015
358
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 93.31 KB | None | 0 0
raw download clone embed print report
  1. 2015-06-15 11:19:38
  2. Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.55-b03 mixed mode):
  3.  
  4. "ResponseProcessor for block BP-1564683557-Master-1431405724229:blk_1073745331_4526" daemon prio=10 tid=0x00007fee28051800 nid=0x5a59 runnable [0x00007fee13d29000]
  5. java.lang.Thread.State: RUNNABLE
  6. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  7. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  8. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  9. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  10. - locked <0x0000000798113020> (a sun.nio.ch.Util$2)
  11. - locked <0x0000000798113008> (a java.util.Collections$UnmodifiableSet)
  12. - locked <0x00000007a6dd03e8> (a sun.nio.ch.EPollSelectorImpl)
  13. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  14. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
  15. at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
  16. at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
  17. at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
  18. at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118)
  19. at java.io.FilterInputStream.read(FilterInputStream.java:83)
  20. at java.io.FilterInputStream.read(FilterInputStream.java:83)
  21. at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:1998)
  22. at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:176)
  23. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:798)
  24.  
  25. "DataStreamer for file /hbasedata/data/testing/test/7a7b21e639344e3759db94d4582ce449/.tmp/d490bbe617db47528fca676efe97d2c4 block BP-1564683557-Master-1431405724229:blk_1073745331_4526" daemon prio=10 tid=0x00007fee302d1800 nid=0x5a56 in Object.wait() [0x00007fee13a26000]
  26. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  27. at java.lang.Object.wait(Native Method)
  28. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:503)
  29. - locked <0x000000078023fbf8> (a java.util.LinkedList)
  30.  
  31. "hconnection-0x66148e7b-shared--pool3-t6" daemon prio=10 tid=0x00007fee28417000 nid=0x5a54 waiting on condition [0x00007fee13b27000]
  32. java.lang.Thread.State: TIMED_WAITING (parking)
  33. at sun.misc.Unsafe.park(Native Method)
  34. - parking to wait for <0x0000000794b528f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  35. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  36. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  37. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  38. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  39. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  40. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  41. at java.lang.Thread.run(Thread.java:745)
  42.  
  43. "hconnection-0x66148e7b-shared--pool3-t5" daemon prio=10 tid=0x00007fee2833b800 nid=0x5a53 waiting on condition [0x00007fee13c28000]
  44. java.lang.Thread.State: TIMED_WAITING (parking)
  45. at sun.misc.Unsafe.park(Native Method)
  46. - parking to wait for <0x0000000794b528f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  47. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  48. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  49. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  50. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  51. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  52. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  53. at java.lang.Thread.run(Thread.java:745)
  54.  
  55. "IPC Client (209179201) connection to /R2:16020 from sas" daemon prio=10 tid=0x00007fee282b0000 nid=0x5a47 in Object.wait() [0x00007fee13e2a000]
  56. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  57. at java.lang.Object.wait(Native Method)
  58. at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.waitForWork(RpcClientImpl.java:537)
  59. - locked <0x000000078023fcd0> (a org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection)
  60. at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:552)
  61.  
  62. "regionserver//R1:16020-splits-1434347377305" prio=10 tid=0x0000000000eb3000 nid=0x5a1d waiting on condition [0x00007fee14d3d000]
  63. java.lang.Thread.State: WAITING (parking)
  64. at sun.misc.Unsafe.park(Native Method)
  65. - parking to wait for <0x00000007934795e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  66. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  67. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  68. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  69. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  70. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  71. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  72. at java.lang.Thread.run(Thread.java:745)
  73.  
  74. "IPC Client (209179201) connection to /Master:9999 from sas" daemon prio=10 tid=0x00007fee2c09f800 nid=0x59e5 in Object.wait() [0x00007fee17060000]
  75. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  76. at java.lang.Object.wait(Native Method)
  77. at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:904)
  78. - locked <0x00000007936cbb88> (a org.apache.hadoop.ipc.Client$Connection)
  79. at org.apache.hadoop.ipc.Client$Connection.run(Client.java:949)
  80.  
  81. "ResponseProcessor for block BP-1564683557-Master-1431405724229:blk_1073745320_4515" daemon prio=10 tid=0x00007fee28404000 nid=0x576e runnable [0x00007fee1412d000]
  82. java.lang.Thread.State: RUNNABLE
  83. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  84. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  85. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  86. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  87. - locked <0x00000007a4154a00> (a sun.nio.ch.Util$2)
  88. - locked <0x00000007a41549e8> (a java.util.Collections$UnmodifiableSet)
  89. - locked <0x00000007a6dd0940> (a sun.nio.ch.EPollSelectorImpl)
  90. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  91. at org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
  92. at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
  93. at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
  94. at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
  95. at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118)
  96. at java.io.FilterInputStream.read(FilterInputStream.java:83)
  97. at java.io.FilterInputStream.read(FilterInputStream.java:83)
  98. at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:1998)
  99. at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:176)
  100. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:798)
  101.  
  102. "DataStreamer for file /hbasedata/WALs/R1,16020,1432798738361/R1%2C16020%2C1432798738361.default.1434347311675 block BP-1564683557-Master-1431405724229:blk_1073745320_4515" daemon prio=10 tid=0x00007fee3011f000 nid=0x576a in Object.wait() [0x00007fee1422e000]
  103. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  104. at java.lang.Object.wait(Native Method)
  105. at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:503)
  106. - locked <0x00000007a78d2898> (a java.util.LinkedList)
  107.  
  108. "1547712307@qtp-843966615-49" daemon prio=10 tid=0x00007fee2c0a1000 nid=0x5666 in Object.wait() [0x00007fee16656000]
  109. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  110. at java.lang.Object.wait(Native Method)
  111. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  112. - locked <0x0000000792ca18b8> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
  113.  
  114. "2081346502@qtp-843966615-48" daemon prio=10 tid=0x00007fee2c0a0000 nid=0x5665 in Object.wait() [0x00007fee1402c000]
  115. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  116. at java.lang.Object.wait(Native Method)
  117. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  118. - locked <0x0000000796877fb8> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
  119.  
  120. "910391358@qtp-843966615-45" daemon prio=10 tid=0x00007fee2c0fd800 nid=0x5662 in Object.wait() [0x00007fee16454000]
  121. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  122. at java.lang.Object.wait(Native Method)
  123. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  124. - locked <0x00000007968781e8> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
  125.  
  126. "753426310@qtp-843966615-40" daemon prio=10 tid=0x00007fee2c0d0000 nid=0x7ff0 in Object.wait() [0x00007fee14531000]
  127. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  128. at java.lang.Object.wait(Native Method)
  129. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  130. - locked <0x0000000796877ca8> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
  131.  
  132. "RS_CLOSE_REGION-R1:16020-0" prio=10 tid=0x00007fee282a3800 nid=0x57ab waiting on condition [0x00007fee14939000]
  133. java.lang.Thread.State: WAITING (parking)
  134. at sun.misc.Unsafe.park(Native Method)
  135. - parking to wait for <0x0000000793783400> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  136. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  137. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  138. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  139. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  140. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  141. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  142. at java.lang.Thread.run(Thread.java:745)
  143.  
  144. "Attach Listener" daemon prio=10 tid=0x00007fee30ecb000 nid=0x34f1 waiting on condition [0x0000000000000000]
  145. java.lang.Thread.State: RUNNABLE
  146.  
  147. "RS_OPEN_REGION-R1:16020-2" prio=10 tid=0x00007fee306ce800 nid=0x3c8a waiting on condition [0x00007fee16252000]
  148. java.lang.Thread.State: WAITING (parking)
  149. at sun.misc.Unsafe.park(Native Method)
  150. - parking to wait for <0x0000000793782f68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  151. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  152. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  153. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  154. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  155. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  156. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  157. at java.lang.Thread.run(Thread.java:745)
  158.  
  159. "RS_OPEN_REGION-R1:16020-1" prio=10 tid=0x00007fee3013e000 nid=0x3c89 waiting on condition [0x00007fee14430000]
  160. java.lang.Thread.State: WAITING (parking)
  161. at sun.misc.Unsafe.park(Native Method)
  162. - parking to wait for <0x0000000793782f68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  163. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  164. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  165. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  166. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  167. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  168. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  169. at java.lang.Thread.run(Thread.java:745)
  170.  
  171. "ReplicationExecutor-0" daemon prio=10 tid=0x00007fee280d2000 nid=0x3bf2 waiting on condition [0x00007fee1432f000]
  172. java.lang.Thread.State: WAITING (parking)
  173. at sun.misc.Unsafe.park(Native Method)
  174. - parking to wait for <0x00000007934fe468> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  175. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  176. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  177. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  178. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  179. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  180. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  181. at java.lang.Thread.run(Thread.java:745)
  182.  
  183. "regionserver//R1:16020-shortCompactions-1432798748986" daemon prio=10 tid=0x00007fee28070800 nid=0x3bd8 runnable [0x00007fee14837000]
  184. java.lang.Thread.State: RUNNABLE
  185. at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
  186. at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
  187. at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
  188. at sun.nio.ch.IOUtil.read(IOUtil.java:192)
  189. at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
  190. - locked <0x00000007802991f0> (a java.lang.Object)
  191. at org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:57)
  192. at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
  193. at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
  194. at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.readChannelFully(PacketReceiver.java:258)
  195. at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:209)
  196. at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:171)
  197. at org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:102)
  198. at org.apache.hadoop.hdfs.RemoteBlockReader2.readNextPacket(RemoteBlockReader2.java:186)
  199. at org.apache.hadoop.hdfs.RemoteBlockReader2.read(RemoteBlockReader2.java:146)
  200. - locked <0x00000007802971d0> (a org.apache.hadoop.hdfs.RemoteBlockReader2)
  201. at org.apache.hadoop.hdfs.DFSInputStream$ByteArrayStrategy.doRead(DFSInputStream.java:686)
  202. at org.apache.hadoop.hdfs.DFSInputStream.readBuffer(DFSInputStream.java:742)
  203. - eliminated <0x0000000780297028> (a org.apache.hadoop.hdfs.DFSInputStream)
  204. at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:799)
  205. at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:840)
  206. - locked <0x0000000780297028> (a org.apache.hadoop.hdfs.DFSInputStream)
  207. at java.io.DataInputStream.read(DataInputStream.java:149)
  208. at org.apache.hadoop.hbase.io.hfile.HFileBlock.readWithExtra(HFileBlock.java:678)
  209. at org.apache.hadoop.hbase.io.hfile.HFileBlock$AbstractFSReader.readAtOffset(HFileBlock.java:1369)
  210. at org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockDataInternal(HFileBlock.java:1588)
  211. at org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderImpl.readBlockData(HFileBlock.java:1467)
  212. at org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:430)
  213. at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:699)
  214. at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:819)
  215. at org.apache.hadoop.hbase.io.HalfStoreFileReader$1.next(HalfStoreFileReader.java:160)
  216. at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:139)
  217. at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:107)
  218. at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:539)
  219. at org.apache.hadoop.hbase.regionserver.compactions.Compactor.performCompaction(Compactor.java:245)
  220. at org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:102)
  221. at org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:110)
  222. at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1167)
  223. at org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1610)
  224. at org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:511)
  225. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  226. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  227. at java.lang.Thread.run(Thread.java:745)
  228.  
  229. "RS_OPEN_REGION-R1:16020-0" prio=10 tid=0x0000000000f6b800 nid=0x3bb9 waiting on condition [0x00007fee14c3c000]
  230. java.lang.Thread.State: WAITING (parking)
  231. at sun.misc.Unsafe.park(Native Method)
  232. - parking to wait for <0x0000000793782f68> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  233. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  234. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  235. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  236. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  237. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  238. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  239. at java.lang.Thread.run(Thread.java:745)
  240.  
  241. "RS_LOG_REPLAY_OPS-R1:16020-1" prio=10 tid=0x00007fee310ea000 nid=0x3bab waiting on condition [0x00007fee14b3b000]
  242. java.lang.Thread.State: WAITING (parking)
  243. at sun.misc.Unsafe.park(Native Method)
  244. - parking to wait for <0x00000007934fe168> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  245. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  246. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  247. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  248. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  249. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  250. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  251. at java.lang.Thread.run(Thread.java:745)
  252.  
  253. "org.apache.hadoop.hdfs.PeerCache@6d79dea2" daemon prio=10 tid=0x00007fee2c4f6000 nid=0x3ba3 waiting on condition [0x00007fee14a3a000]
  254. java.lang.Thread.State: TIMED_WAITING (sleeping)
  255. at java.lang.Thread.sleep(Native Method)
  256. at org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:244)
  257. at org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:41)
  258. at org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:119)
  259. at java.lang.Thread.run(Thread.java:745)
  260.  
  261. "RS_LOG_REPLAY_OPS-R1:16020-0" prio=10 tid=0x00007fee310e8000 nid=0x3b9f waiting on condition [0x00007fee14e3e000]
  262. java.lang.Thread.State: WAITING (parking)
  263. at sun.misc.Unsafe.park(Native Method)
  264. - parking to wait for <0x00000007934fe168> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  265. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  266. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  267. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  268. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  269. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  270. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  271. at java.lang.Thread.run(Thread.java:745)
  272.  
  273. "R1,16020,1432798738361-HeapMemoryTunerChore" daemon prio=10 tid=0x00007fee310df800 nid=0x3b9e in Object.wait() [0x00007fee14f3f000]
  274. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  275. at java.lang.Object.wait(Native Method)
  276. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  277. - locked <0x0000000793804e38> (a java.lang.Object)
  278. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  279. at java.lang.Thread.run(Thread.java:745)
  280.  
  281. "SplitLogWorker-R1:16020" prio=10 tid=0x00007fee310dd000 nid=0x3b9d in Object.wait() [0x00007fee15040000]
  282. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  283. at java.lang.Object.wait(Native Method)
  284. at org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination.taskLoop(ZkSplitLogWorkerCoordination.java:444)
  285. - locked <0x00000007934dead0> (a java.lang.Object)
  286. at org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:142)
  287. at java.lang.Thread.run(Thread.java:745)
  288.  
  289. "R1:16020Replication Statistics #0" daemon prio=10 tid=0x00007fee310db800 nid=0x3b9c waiting on condition [0x00007fee15141000]
  290. java.lang.Thread.State: TIMED_WAITING (parking)
  291. at sun.misc.Unsafe.park(Native Method)
  292. - parking to wait for <0x00000007934fe1b0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  293. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  294. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  295. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
  296. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  297. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  298. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  299. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  300. at java.lang.Thread.run(Thread.java:745)
  301.  
  302. "regionserver//R1:16020-EventThread" daemon prio=10 tid=0x00007fee310d9800 nid=0x3b9b waiting on condition [0x00007fee15242000]
  303. java.lang.Thread.State: WAITING (parking)
  304. at sun.misc.Unsafe.park(Native Method)
  305. - parking to wait for <0x0000000793804e50> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  306. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  307. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  308. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  309. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  310.  
  311. "regionserver//R1:16020-SendThread(ZK:2191)" daemon prio=10 tid=0x00007fee310be800 nid=0x3b9a runnable [0x00007fee15343000]
  312. java.lang.Thread.State: RUNNABLE
  313. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  314. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  315. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  316. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  317. - locked <0x0000000793804e98> (a sun.nio.ch.Util$2)
  318. - locked <0x0000000793804eb0> (a java.util.Collections$UnmodifiableSet)
  319. - locked <0x0000000793811198> (a sun.nio.ch.EPollSelectorImpl)
  320. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  321. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
  322. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
  323.  
  324. "regionserver//R1:16020.leaseChecker" daemon prio=10 tid=0x00007fee310bb000 nid=0x3b99 waiting on condition [0x00007fee15444000]
  325. java.lang.Thread.State: TIMED_WAITING (sleeping)
  326. at java.lang.Thread.sleep(Native Method)
  327. at org.apache.hadoop.hbase.regionserver.Leases.run(Leases.java:94)
  328. at java.lang.Thread.run(Thread.java:745)
  329.  
  330. "regionserver//R1:16020.nonceCleaner" daemon prio=10 tid=0x00007fee310b9000 nid=0x3b98 in Object.wait() [0x00007fee15545000]
  331. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  332. at java.lang.Object.wait(Native Method)
  333. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  334. - locked <0x00000007934da0c0> (a java.lang.Object)
  335. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  336. at java.lang.Thread.run(Thread.java:745)
  337.  
  338. "regionserver//R1:16020.periodicFlusher" daemon prio=10 tid=0x00007fee310b7000 nid=0x3b97 in Object.wait() [0x00007fee15646000]
  339. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  340. at java.lang.Object.wait(Native Method)
  341. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  342. - locked <0x000000079325c660> (a java.lang.Object)
  343. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  344. at java.lang.Thread.run(Thread.java:745)
  345.  
  346. "regionserver//R1:16020.compactionChecker" daemon prio=10 tid=0x00007fee310b4800 nid=0x3b96 in Object.wait() [0x00007fee15747000]
  347. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  348. at java.lang.Object.wait(Native Method)
  349. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  350. - locked <0x00000007933f8d28> (a java.lang.Object)
  351. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  352. at java.lang.Thread.run(Thread.java:745)
  353.  
  354. "MemStoreFlusher.1" prio=10 tid=0x00007fee310b3000 nid=0x3b95 waiting on condition [0x00007fee15848000]
  355. java.lang.Thread.State: TIMED_WAITING (parking)
  356. at sun.misc.Unsafe.park(Native Method)
  357. - parking to wait for <0x00000007932c6dd0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  358. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  359. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  360. at java.util.concurrent.DelayQueue.poll(DelayQueue.java:256)
  361. at java.util.concurrent.DelayQueue.poll(DelayQueue.java:68)
  362. at org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:205)
  363. at java.lang.Thread.run(Thread.java:745)
  364.  
  365. "MemStoreFlusher.0" prio=10 tid=0x00007fee310b1000 nid=0x3b94 waiting on condition [0x00007fee15949000]
  366. java.lang.Thread.State: TIMED_WAITING (parking)
  367. at sun.misc.Unsafe.park(Native Method)
  368. - parking to wait for <0x00000007932c6dd0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  369. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  370. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  371. at java.util.concurrent.DelayQueue.poll(DelayQueue.java:256)
  372. at java.util.concurrent.DelayQueue.poll(DelayQueue.java:68)
  373. at org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:205)
  374. at java.lang.Thread.run(Thread.java:745)
  375.  
  376. "regionserver//R1:16020.logRoller" daemon prio=10 tid=0x00007fee310af800 nid=0x3b93 in Object.wait() [0x00007fee15a4a000]
  377. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  378. at java.lang.Object.wait(Native Method)
  379. at org.apache.hadoop.hbase.regionserver.LogRoller.run(LogRoller.java:116)
  380. - locked <0x00000007932f18d0> (a java.util.concurrent.atomic.AtomicBoolean)
  381. at java.lang.Thread.run(Thread.java:745)
  382.  
  383. "HBase-Metrics2-1" daemon prio=10 tid=0x00007fee310a3800 nid=0x3b92 waiting on condition [0x00007fee15b4b000]
  384. java.lang.Thread.State: TIMED_WAITING (parking)
  385. at sun.misc.Unsafe.park(Native Method)
  386. - parking to wait for <0x00000007934dc370> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  387. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  388. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  389. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
  390. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  391. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  392. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  393. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  394. at java.lang.Thread.run(Thread.java:745)
  395.  
  396. "sync.4" prio=10 tid=0x00007fee310a4800 nid=0x3b91 waiting on condition [0x00007fee15c4c000]
  397. java.lang.Thread.State: WAITING (parking)
  398. at sun.misc.Unsafe.park(Native Method)
  399. - parking to wait for <0x00000007934dc3a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  400. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  401. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  402. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  403. at org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1282)
  404. at java.lang.Thread.run(Thread.java:745)
  405.  
  406. "sync.3" prio=10 tid=0x00007fee3109f800 nid=0x3b90 waiting on condition [0x00007fee15d4d000]
  407. java.lang.Thread.State: WAITING (parking)
  408. at sun.misc.Unsafe.park(Native Method)
  409. - parking to wait for <0x00000007934dc3e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  410. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  411. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  412. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  413. at org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1282)
  414. at java.lang.Thread.run(Thread.java:745)
  415.  
  416. "sync.2" prio=10 tid=0x00007fee3109e000 nid=0x3b8f waiting on condition [0x00007fee15e4e000]
  417. java.lang.Thread.State: WAITING (parking)
  418. at sun.misc.Unsafe.park(Native Method)
  419. - parking to wait for <0x000000079347c5c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  420. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  421. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  422. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  423. at org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1282)
  424. at java.lang.Thread.run(Thread.java:745)
  425.  
  426. "sync.1" prio=10 tid=0x00007fee3109c000 nid=0x3b8e waiting on condition [0x00007fee15f4f000]
  427. java.lang.Thread.State: WAITING (parking)
  428. at sun.misc.Unsafe.park(Native Method)
  429. - parking to wait for <0x000000079347c610> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  430. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  431. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  432. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  433. at org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1282)
  434. at java.lang.Thread.run(Thread.java:745)
  435.  
  436. "sync.0" prio=10 tid=0x00007fee31095000 nid=0x3b8d waiting on condition [0x00007fee16050000]
  437. java.lang.Thread.State: WAITING (parking)
  438. at sun.misc.Unsafe.park(Native Method)
  439. - parking to wait for <0x000000079347c598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  440. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  441. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  442. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  443. at org.apache.hadoop.hbase.regionserver.wal.FSHLog$SyncRunner.run(FSHLog.java:1282)
  444. at java.lang.Thread.run(Thread.java:745)
  445.  
  446. "regionserver//R1:16020.append-pool1-t1" prio=10 tid=0x00007fee31093800 nid=0x3b8c waiting on condition [0x00007fee16151000]
  447. java.lang.Thread.State: WAITING (parking)
  448. at sun.misc.Unsafe.park(Native Method)
  449. - parking to wait for <0x000000079347c520> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  450. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  451. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  452. at com.lmax.disruptor.BlockingWaitStrategy.waitFor(BlockingWaitStrategy.java:45)
  453. at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:55)
  454. at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:123)
  455. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  456. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  457. at java.lang.Thread.run(Thread.java:745)
  458.  
  459. "LeaseRenewer:sas@mycluster" daemon prio=10 tid=0x00007fee3105c000 nid=0x3b88 waiting on condition [0x00007fee16353000]
  460. java.lang.Thread.State: TIMED_WAITING (sleeping)
  461. at java.lang.Thread.sleep(Native Method)
  462. at org.apache.hadoop.hdfs.LeaseRenewer.run(LeaseRenewer.java:438)
  463. at org.apache.hadoop.hdfs.LeaseRenewer.access$700(LeaseRenewer.java:71)
  464. at org.apache.hadoop.hdfs.LeaseRenewer$1.run(LeaseRenewer.java:298)
  465. at java.lang.Thread.run(Thread.java:745)
  466.  
  467. "IPC Parameter Sending Thread #0" daemon prio=10 tid=0x00007fee3101b800 nid=0x3b84 waiting on condition [0x00007fee16555000]
  468. java.lang.Thread.State: TIMED_WAITING (parking)
  469. at sun.misc.Unsafe.park(Native Method)
  470. - parking to wait for <0x0000000793158b48> (a java.util.concurrent.SynchronousQueue$TransferStack)
  471. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  472. at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
  473. at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
  474. at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
  475. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  476. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  477. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  478. at java.lang.Thread.run(Thread.java:745)
  479.  
  480. "LruBlockCacheStatsExecutor" daemon prio=10 tid=0x00007fee3100d000 nid=0x3b82 waiting on condition [0x00007fee16757000]
  481. java.lang.Thread.State: TIMED_WAITING (parking)
  482. at sun.misc.Unsafe.park(Native Method)
  483. - parking to wait for <0x0000000793460ad8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  484. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  485. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  486. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
  487. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  488. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  489. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  490. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  491. at java.lang.Thread.run(Thread.java:745)
  492.  
  493. "regionserver//R1:16020.LruBlockCache.EvictionThread" daemon prio=10 tid=0x00007fee31007000 nid=0x3b81 in Object.wait() [0x00007fee16858000]
  494. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  495. at java.lang.Object.wait(Native Method)
  496. at org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:791)
  497. - locked <0x00000007934656c0> (a org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread)
  498. at java.lang.Thread.run(Thread.java:745)
  499.  
  500. "IPC Client (209179201) connection to /Master:16020 from sas" daemon prio=10 tid=0x00007fee30ff8000 nid=0x3b80 in Object.wait() [0x00007fee16959000]
  501. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  502. at java.lang.Object.wait(Native Method)
  503. at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.waitForWork(RpcClientImpl.java:537)
  504. - locked <0x0000000792d79640> (a org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection)
  505. at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:552)
  506.  
  507. "JvmPauseMonitor" daemon prio=10 tid=0x00007fee30f5c000 nid=0x3b7f waiting on condition [0x00007fee16a5a000]
  508. java.lang.Thread.State: TIMED_WAITING (sleeping)
  509. at java.lang.Thread.sleep(Native Method)
  510. at org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:159)
  511. at java.lang.Thread.run(Thread.java:745)
  512.  
  513. "regionserver//R1:16020-EventThread" daemon prio=10 tid=0x00007fee30f3a000 nid=0x3b7e waiting on condition [0x00007fee16b5b000]
  514. java.lang.Thread.State: WAITING (parking)
  515. at sun.misc.Unsafe.park(Native Method)
  516. - parking to wait for <0x000000079325c6d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  517. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  518. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  519. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  520. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  521.  
  522. "regionserver//R1:16020-SendThread(ZK:2191)" daemon prio=10 tid=0x00007fee30f19800 nid=0x3b7d runnable [0x00007fee16c5c000]
  523. java.lang.Thread.State: RUNNABLE
  524. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  525. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  526. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  527. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  528. - locked <0x000000079325c6c0> (a sun.nio.ch.Util$2)
  529. - locked <0x000000079325c678> (a java.util.Collections$UnmodifiableSet)
  530. - locked <0x00000007933055e0> (a sun.nio.ch.EPollSelectorImpl)
  531. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  532. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
  533. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
  534.  
  535. "regionserver//R1:16020" prio=10 tid=0x00007fee30ee8800 nid=0x3b7c in Object.wait() [0x00007fee16d5d000]
  536. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  537. at java.lang.Object.wait(Native Method)
  538. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  539. - locked <0x0000000792b35fa0> (a java.lang.Object)
  540. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:56)
  541. at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:881)
  542. at java.lang.Thread.run(Thread.java:745)
  543.  
  544. "Timer-0" daemon prio=10 tid=0x00007fee30dd9800 nid=0x3b7b in Object.wait() [0x00007fee16e5e000]
  545. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  546. at java.lang.Object.wait(Native Method)
  547. at java.util.TimerThread.mainLoop(Timer.java:552)
  548. - locked <0x00000007932f18e8> (a java.util.TaskQueue)
  549. at java.util.TimerThread.run(Timer.java:505)
  550.  
  551. "1915826467@qtp-843966615-1 - Acceptor0 [email protected]:16030" daemon prio=10 tid=0x00007fee30df3800 nid=0x3b7a runnable [0x00007fee16f5f000]
  552. java.lang.Thread.State: RUNNABLE
  553. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  554. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  555. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  556. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  557. - locked <0x00000007932c6de8> (a sun.nio.ch.Util$2)
  558. - locked <0x00000007932c6e00> (a java.util.Collections$UnmodifiableSet)
  559. - locked <0x00000007931aa5d8> (a sun.nio.ch.EPollSelectorImpl)
  560. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  561. at org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)
  562. at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)
  563. at org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
  564. at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
  565. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
  566.  
  567. "ReplicationRpcServer.handler=2,queue=0,port=16020" daemon prio=10 tid=0x00007fee30da4000 nid=0x3b76 waiting on condition [0x00007fee17161000]
  568. java.lang.Thread.State: WAITING (parking)
  569. at sun.misc.Unsafe.park(Native Method)
  570. - parking to wait for <0x0000000792e04a40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  571. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  572. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  573. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  574. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  575. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  576. at java.lang.Thread.run(Thread.java:745)
  577.  
  578. "ReplicationRpcServer.handler=1,queue=0,port=16020" daemon prio=10 tid=0x00007fee30da2000 nid=0x3b75 waiting on condition [0x00007fee17262000]
  579. java.lang.Thread.State: WAITING (parking)
  580. at sun.misc.Unsafe.park(Native Method)
  581. - parking to wait for <0x0000000792e04a40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  582. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  583. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  584. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  585. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  586. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  587. at java.lang.Thread.run(Thread.java:745)
  588.  
  589. "ReplicationRpcServer.handler=0,queue=0,port=16020" daemon prio=10 tid=0x00007fee30da0000 nid=0x3b74 waiting on condition [0x00007fee17363000]
  590. java.lang.Thread.State: WAITING (parking)
  591. at sun.misc.Unsafe.park(Native Method)
  592. - parking to wait for <0x0000000792e04a40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  593. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  594. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  595. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  596. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  597. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  598. at java.lang.Thread.run(Thread.java:745)
  599.  
  600. "PriorityRpcServer.handler=9,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d9e000 nid=0x3b73 waiting on condition [0x00007fee17464000]
  601. java.lang.Thread.State: WAITING (parking)
  602. at sun.misc.Unsafe.park(Native Method)
  603. - parking to wait for <0x0000000792e048d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  604. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  605. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  606. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  607. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  608. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  609. at java.lang.Thread.run(Thread.java:745)
  610.  
  611. "PriorityRpcServer.handler=8,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d9b800 nid=0x3b72 waiting on condition [0x00007fee17565000]
  612. java.lang.Thread.State: WAITING (parking)
  613. at sun.misc.Unsafe.park(Native Method)
  614. - parking to wait for <0x0000000792df25e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  615. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  616. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  617. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  618. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  619. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  620. at java.lang.Thread.run(Thread.java:745)
  621.  
  622. "PriorityRpcServer.handler=7,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d99800 nid=0x3b71 waiting on condition [0x00007fee17666000]
  623. java.lang.Thread.State: WAITING (parking)
  624. at sun.misc.Unsafe.park(Native Method)
  625. - parking to wait for <0x0000000792e048d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  626. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  627. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  628. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  629. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  630. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  631. at java.lang.Thread.run(Thread.java:745)
  632.  
  633. "PriorityRpcServer.handler=6,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d97800 nid=0x3b70 waiting on condition [0x00007fee17767000]
  634. java.lang.Thread.State: WAITING (parking)
  635. at sun.misc.Unsafe.park(Native Method)
  636. - parking to wait for <0x0000000792df25e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  637. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  638. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  639. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  640. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  641. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  642. at java.lang.Thread.run(Thread.java:745)
  643.  
  644. "PriorityRpcServer.handler=5,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d95800 nid=0x3b6f waiting on condition [0x00007fee17868000]
  645. java.lang.Thread.State: WAITING (parking)
  646. at sun.misc.Unsafe.park(Native Method)
  647. - parking to wait for <0x0000000792e048d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  648. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  649. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  650. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  651. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  652. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  653. at java.lang.Thread.run(Thread.java:745)
  654.  
  655. "PriorityRpcServer.handler=4,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d93800 nid=0x3b6e waiting on condition [0x00007fee17969000]
  656. java.lang.Thread.State: WAITING (parking)
  657. at sun.misc.Unsafe.park(Native Method)
  658. - parking to wait for <0x0000000792df25e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  659. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  660. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  661. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  662. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  663. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  664. at java.lang.Thread.run(Thread.java:745)
  665.  
  666. "PriorityRpcServer.handler=3,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d91000 nid=0x3b6d waiting on condition [0x00007fee17a6a000]
  667. java.lang.Thread.State: WAITING (parking)
  668. at sun.misc.Unsafe.park(Native Method)
  669. - parking to wait for <0x0000000792e048d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  670. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  671. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  672. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  673. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  674. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  675. at java.lang.Thread.run(Thread.java:745)
  676.  
  677. "PriorityRpcServer.handler=2,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d8f000 nid=0x3b6c waiting on condition [0x00007fee17b6b000]
  678. java.lang.Thread.State: WAITING (parking)
  679. at sun.misc.Unsafe.park(Native Method)
  680. - parking to wait for <0x0000000792df25e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  681. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  682. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  683. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  684. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  685. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  686. at java.lang.Thread.run(Thread.java:745)
  687.  
  688. "PriorityRpcServer.handler=1,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d8d000 nid=0x3b6b waiting on condition [0x00007fee17c6c000]
  689. java.lang.Thread.State: WAITING (parking)
  690. at sun.misc.Unsafe.park(Native Method)
  691. - parking to wait for <0x0000000792e048d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  692. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  693. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  694. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  695. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  696. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  697. at java.lang.Thread.run(Thread.java:745)
  698.  
  699. "PriorityRpcServer.handler=0,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d8b000 nid=0x3b6a waiting on condition [0x00007fee17d6d000]
  700. java.lang.Thread.State: WAITING (parking)
  701. at sun.misc.Unsafe.park(Native Method)
  702. - parking to wait for <0x0000000792df25e8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  703. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  704. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  705. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  706. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  707. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  708. at java.lang.Thread.run(Thread.java:745)
  709.  
  710. "B.defaultRpcServer.handler=29,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d89000 nid=0x3b69 waiting on condition [0x00007fee17e6e000]
  711. java.lang.Thread.State: WAITING (parking)
  712. at sun.misc.Unsafe.park(Native Method)
  713. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  714. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  715. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  716. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  717. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  718. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  719. at java.lang.Thread.run(Thread.java:745)
  720.  
  721. "B.defaultRpcServer.handler=28,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d87000 nid=0x3b68 waiting on condition [0x00007fee17f6f000]
  722. java.lang.Thread.State: WAITING (parking)
  723. at sun.misc.Unsafe.park(Native Method)
  724. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  725. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  726. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  727. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  728. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  729. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  730. at java.lang.Thread.run(Thread.java:745)
  731.  
  732. "B.defaultRpcServer.handler=27,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d84800 nid=0x3b67 waiting on condition [0x00007fee18070000]
  733. java.lang.Thread.State: WAITING (parking)
  734. at sun.misc.Unsafe.park(Native Method)
  735. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  736. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  737. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  738. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  739. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  740. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  741. at java.lang.Thread.run(Thread.java:745)
  742.  
  743. "B.defaultRpcServer.handler=26,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d82800 nid=0x3b66 waiting on condition [0x00007fee18171000]
  744. java.lang.Thread.State: WAITING (parking)
  745. at sun.misc.Unsafe.park(Native Method)
  746. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  747. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  748. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  749. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  750. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  751. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  752. at java.lang.Thread.run(Thread.java:745)
  753.  
  754. "B.defaultRpcServer.handler=25,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d80800 nid=0x3b65 waiting on condition [0x00007fee18272000]
  755. java.lang.Thread.State: WAITING (parking)
  756. at sun.misc.Unsafe.park(Native Method)
  757. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  758. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  759. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  760. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  761. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  762. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  763. at java.lang.Thread.run(Thread.java:745)
  764.  
  765. "B.defaultRpcServer.handler=24,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d7e800 nid=0x3b64 waiting on condition [0x00007fee18373000]
  766. java.lang.Thread.State: WAITING (parking)
  767. at sun.misc.Unsafe.park(Native Method)
  768. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  769. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  770. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  771. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  772. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  773. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  774. at java.lang.Thread.run(Thread.java:745)
  775.  
  776. "B.defaultRpcServer.handler=23,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d7c800 nid=0x3b63 waiting on condition [0x00007fee18474000]
  777. java.lang.Thread.State: WAITING (parking)
  778. at sun.misc.Unsafe.park(Native Method)
  779. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  780. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  781. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  782. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  783. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  784. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  785. at java.lang.Thread.run(Thread.java:745)
  786.  
  787. "B.defaultRpcServer.handler=22,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d7a000 nid=0x3b62 waiting on condition [0x00007fee18575000]
  788. java.lang.Thread.State: WAITING (parking)
  789. at sun.misc.Unsafe.park(Native Method)
  790. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  791. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  792. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  793. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  794. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  795. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  796. at java.lang.Thread.run(Thread.java:745)
  797.  
  798. "B.defaultRpcServer.handler=21,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d78000 nid=0x3b61 waiting on condition [0x00007fee18676000]
  799. java.lang.Thread.State: WAITING (parking)
  800. at sun.misc.Unsafe.park(Native Method)
  801. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  802. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  803. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  804. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  805. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  806. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  807. at java.lang.Thread.run(Thread.java:745)
  808.  
  809. "B.defaultRpcServer.handler=20,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d76000 nid=0x3b60 waiting on condition [0x00007fee18777000]
  810. java.lang.Thread.State: WAITING (parking)
  811. at sun.misc.Unsafe.park(Native Method)
  812. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  813. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  814. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  815. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  816. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  817. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  818. at java.lang.Thread.run(Thread.java:745)
  819.  
  820. "B.defaultRpcServer.handler=19,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d74000 nid=0x3b5f waiting on condition [0x00007fee18878000]
  821. java.lang.Thread.State: WAITING (parking)
  822. at sun.misc.Unsafe.park(Native Method)
  823. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  824. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  825. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  826. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  827. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  828. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  829. at java.lang.Thread.run(Thread.java:745)
  830.  
  831. "B.defaultRpcServer.handler=18,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d71800 nid=0x3b5e waiting on condition [0x00007fee18979000]
  832. java.lang.Thread.State: WAITING (parking)
  833. at sun.misc.Unsafe.park(Native Method)
  834. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  835. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  836. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  837. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  838. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  839. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  840. at java.lang.Thread.run(Thread.java:745)
  841.  
  842. "B.defaultRpcServer.handler=17,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d6f800 nid=0x3b5d waiting on condition [0x00007fee18a7a000]
  843. java.lang.Thread.State: WAITING (parking)
  844. at sun.misc.Unsafe.park(Native Method)
  845. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  846. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  847. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  848. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  849. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  850. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  851. at java.lang.Thread.run(Thread.java:745)
  852.  
  853. "B.defaultRpcServer.handler=16,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d6d800 nid=0x3b5c waiting on condition [0x00007fee18b7b000]
  854. java.lang.Thread.State: WAITING (parking)
  855. at sun.misc.Unsafe.park(Native Method)
  856. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  857. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  858. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  859. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  860. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  861. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  862. at java.lang.Thread.run(Thread.java:745)
  863.  
  864. "B.defaultRpcServer.handler=15,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d6b800 nid=0x3b5b waiting on condition [0x00007fee18c7c000]
  865. java.lang.Thread.State: WAITING (parking)
  866. at sun.misc.Unsafe.park(Native Method)
  867. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  868. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  869. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  870. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  871. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  872. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  873. at java.lang.Thread.run(Thread.java:745)
  874.  
  875. "B.defaultRpcServer.handler=14,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d69800 nid=0x3b5a waiting on condition [0x00007fee18d7d000]
  876. java.lang.Thread.State: WAITING (parking)
  877. at sun.misc.Unsafe.park(Native Method)
  878. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  879. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  880. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  881. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  882. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  883. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  884. at java.lang.Thread.run(Thread.java:745)
  885.  
  886. "B.defaultRpcServer.handler=13,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d67800 nid=0x3b59 waiting on condition [0x00007fee18e7e000]
  887. java.lang.Thread.State: WAITING (parking)
  888. at sun.misc.Unsafe.park(Native Method)
  889. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  890. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  891. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  892. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  893. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  894. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  895. at java.lang.Thread.run(Thread.java:745)
  896.  
  897. "B.defaultRpcServer.handler=12,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d65000 nid=0x3b58 waiting on condition [0x00007fee18f7f000]
  898. java.lang.Thread.State: WAITING (parking)
  899. at sun.misc.Unsafe.park(Native Method)
  900. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  901. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  902. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  903. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  904. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  905. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  906. at java.lang.Thread.run(Thread.java:745)
  907.  
  908. "B.defaultRpcServer.handler=11,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d63000 nid=0x3b57 waiting on condition [0x00007fee19080000]
  909. java.lang.Thread.State: WAITING (parking)
  910. at sun.misc.Unsafe.park(Native Method)
  911. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  912. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  913. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  914. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  915. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  916. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  917. at java.lang.Thread.run(Thread.java:745)
  918.  
  919. "B.defaultRpcServer.handler=10,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d61000 nid=0x3b56 waiting on condition [0x00007fee19181000]
  920. java.lang.Thread.State: WAITING (parking)
  921. at sun.misc.Unsafe.park(Native Method)
  922. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  923. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  924. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  925. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  926. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  927. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  928. at java.lang.Thread.run(Thread.java:745)
  929.  
  930. "B.defaultRpcServer.handler=9,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d5f000 nid=0x3b55 waiting on condition [0x00007fee19282000]
  931. java.lang.Thread.State: WAITING (parking)
  932. at sun.misc.Unsafe.park(Native Method)
  933. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  934. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  935. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  936. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  937. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  938. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  939. at java.lang.Thread.run(Thread.java:745)
  940.  
  941. "B.defaultRpcServer.handler=8,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d5d000 nid=0x3b54 waiting on condition [0x00007fee19383000]
  942. java.lang.Thread.State: WAITING (parking)
  943. at sun.misc.Unsafe.park(Native Method)
  944. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  945. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  946. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  947. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  948. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  949. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  950. at java.lang.Thread.run(Thread.java:745)
  951.  
  952. "B.defaultRpcServer.handler=7,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d5b000 nid=0x3b53 waiting on condition [0x00007fee19484000]
  953. java.lang.Thread.State: WAITING (parking)
  954. at sun.misc.Unsafe.park(Native Method)
  955. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  956. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  957. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  958. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  959. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  960. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  961. at java.lang.Thread.run(Thread.java:745)
  962.  
  963. "B.defaultRpcServer.handler=6,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d58800 nid=0x3b52 waiting on condition [0x00007fee19585000]
  964. java.lang.Thread.State: WAITING (parking)
  965. at sun.misc.Unsafe.park(Native Method)
  966. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  967. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  968. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  969. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  970. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  971. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  972. at java.lang.Thread.run(Thread.java:745)
  973.  
  974. "B.defaultRpcServer.handler=5,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d56800 nid=0x3b51 waiting on condition [0x00007fee19686000]
  975. java.lang.Thread.State: WAITING (parking)
  976. at sun.misc.Unsafe.park(Native Method)
  977. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  978. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  979. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  980. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  981. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  982. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  983. at java.lang.Thread.run(Thread.java:745)
  984.  
  985. "B.defaultRpcServer.handler=4,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d54800 nid=0x3b50 waiting on condition [0x00007fee19787000]
  986. java.lang.Thread.State: WAITING (parking)
  987. at sun.misc.Unsafe.park(Native Method)
  988. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  989. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  990. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  991. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  992. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  993. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  994. at java.lang.Thread.run(Thread.java:745)
  995.  
  996. "B.defaultRpcServer.handler=3,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d52800 nid=0x3b4f waiting on condition [0x00007fee19888000]
  997. java.lang.Thread.State: WAITING (parking)
  998. at sun.misc.Unsafe.park(Native Method)
  999. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  1000. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  1001. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  1002. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  1003. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  1004. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  1005. at java.lang.Thread.run(Thread.java:745)
  1006.  
  1007. "B.defaultRpcServer.handler=2,queue=2,port=16020" daemon prio=10 tid=0x00007fee30d50000 nid=0x3b4e waiting on condition [0x00007fee19989000]
  1008. java.lang.Thread.State: WAITING (parking)
  1009. at sun.misc.Unsafe.park(Native Method)
  1010. - parking to wait for <0x0000000792e0c158> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  1011. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  1012. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  1013. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  1014. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  1015. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  1016. at java.lang.Thread.run(Thread.java:745)
  1017.  
  1018. "B.defaultRpcServer.handler=1,queue=1,port=16020" daemon prio=10 tid=0x00007fee30d4e000 nid=0x3b4d waiting on condition [0x00007fee19a8a000]
  1019. java.lang.Thread.State: WAITING (parking)
  1020. at sun.misc.Unsafe.park(Native Method)
  1021. - parking to wait for <0x0000000792e0c0f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  1022. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  1023. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  1024. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  1025. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  1026. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  1027. at java.lang.Thread.run(Thread.java:745)
  1028.  
  1029. "B.defaultRpcServer.handler=0,queue=0,port=16020" daemon prio=10 tid=0x00007fee30d4a800 nid=0x3b4c waiting on condition [0x00007fee19b8b000]
  1030. java.lang.Thread.State: WAITING (parking)
  1031. at sun.misc.Unsafe.park(Native Method)
  1032. - parking to wait for <0x0000000792e0c0e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  1033. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  1034. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  1035. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  1036. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  1037. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  1038. at java.lang.Thread.run(Thread.java:745)
  1039.  
  1040. "RpcServer.listener,port=16020" daemon prio=10 tid=0x00007fee30d49000 nid=0x3b4b runnable [0x00007fee19c8c000]
  1041. java.lang.Thread.State: RUNNABLE
  1042. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1043. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1044. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1045. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1046. - locked <0x0000000792e00000> (a sun.nio.ch.Util$2)
  1047. - locked <0x0000000792dfffe8> (a java.util.Collections$UnmodifiableSet)
  1048. - locked <0x0000000792dde4d0> (a sun.nio.ch.EPollSelectorImpl)
  1049. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1050. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1051. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.run(RpcServer.java:674)
  1052.  
  1053. "RpcServer.responder" daemon prio=10 tid=0x00007fee30d47800 nid=0x3b4a runnable [0x00007fee19d8d000]
  1054. java.lang.Thread.State: RUNNABLE
  1055. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1056. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1057. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1058. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1059. - locked <0x00000007931f2e00> (a sun.nio.ch.Util$2)
  1060. - locked <0x00000007931f2de8> (a java.util.Collections$UnmodifiableSet)
  1061. - locked <0x00000007932318d0> (a sun.nio.ch.EPollSelectorImpl)
  1062. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1063. at org.apache.hadoop.hbase.ipc.RpcServer$Responder.doRunLoop(RpcServer.java:913)
  1064. at org.apache.hadoop.hbase.ipc.RpcServer$Responder.run(RpcServer.java:860)
  1065.  
  1066. "main-EventThread" daemon prio=10 tid=0x00007fee30d0f000 nid=0x3b49 waiting on condition [0x00007fee19e8e000]
  1067. java.lang.Thread.State: WAITING (parking)
  1068. at sun.misc.Unsafe.park(Native Method)
  1069. - parking to wait for <0x00000007931b9f50> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  1070. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  1071. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  1072. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  1073. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  1074.  
  1075. "main-SendThread(ZK:2191)" daemon prio=10 tid=0x00007fee30d11800 nid=0x3b48 runnable [0x00007fee19f8f000]
  1076. java.lang.Thread.State: RUNNABLE
  1077. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1078. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1079. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1080. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1081. - locked <0x00000007932c7718> (a sun.nio.ch.Util$2)
  1082. - locked <0x00000007932c7700> (a java.util.Collections$UnmodifiableSet)
  1083. - locked <0x00000007931aa620> (a sun.nio.ch.EPollSelectorImpl)
  1084. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1085. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
  1086. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
  1087.  
  1088. "Thread-5" daemon prio=10 tid=0x00007fee30cb1000 nid=0x3b47 runnable [0x00007fee1a090000]
  1089. java.lang.Thread.State: RUNNABLE
  1090. at org.apache.hadoop.net.unix.DomainSocketWatcher.doPoll0(Native Method)
  1091. at org.apache.hadoop.net.unix.DomainSocketWatcher.access$800(DomainSocketWatcher.java:52)
  1092. at org.apache.hadoop.net.unix.DomainSocketWatcher$1.run(DomainSocketWatcher.java:457)
  1093. at java.lang.Thread.run(Thread.java:745)
  1094.  
  1095. "Timer for 'HBase' metrics system" daemon prio=10 tid=0x00007fee30aaf800 nid=0x3b44 in Object.wait() [0x00007fee1a7b6000]
  1096. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  1097. at java.lang.Object.wait(Native Method)
  1098. at java.util.TimerThread.mainLoop(Timer.java:552)
  1099. - locked <0x0000000792fc5920> (a java.util.TaskQueue)
  1100. at java.util.TimerThread.run(Timer.java:505)
  1101.  
  1102. "RpcServer.reader=9,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee30a4b000 nid=0x3b43 runnable [0x00007fee1a8b7000]
  1103. java.lang.Thread.State: RUNNABLE
  1104. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1105. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1106. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1107. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1108. - locked <0x0000000792e91ca8> (a sun.nio.ch.Util$2)
  1109. - locked <0x0000000792e05fe8> (a java.util.Collections$UnmodifiableSet)
  1110. - locked <0x0000000792df4f08> (a sun.nio.ch.EPollSelectorImpl)
  1111. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1112. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1113. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1114. - locked <0x0000000792e06000> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1115. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1116. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1117. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1118. at java.lang.Thread.run(Thread.java:745)
  1119.  
  1120. "RpcServer.reader=8,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee30a30000 nid=0x3b42 runnable [0x00007fee1a9b8000]
  1121. java.lang.Thread.State: RUNNABLE
  1122. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1123. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1124. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1125. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1126. - locked <0x0000000792e05fb8> (a sun.nio.ch.Util$2)
  1127. - locked <0x0000000792e05fd0> (a java.util.Collections$UnmodifiableSet)
  1128. - locked <0x0000000792dfa7d0> (a sun.nio.ch.EPollSelectorImpl)
  1129. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1130. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1131. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1132. - locked <0x0000000792e05f88> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1133. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1134. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1135. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1136. at java.lang.Thread.run(Thread.java:745)
  1137.  
  1138. "RpcServer.reader=7,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee30a15000 nid=0x3b41 runnable [0x00007fee1aab9000]
  1139. java.lang.Thread.State: RUNNABLE
  1140. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1141. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1142. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1143. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1144. - locked <0x0000000792e05fa0> (a sun.nio.ch.Util$2)
  1145. - locked <0x0000000792e05f58> (a java.util.Collections$UnmodifiableSet)
  1146. - locked <0x0000000792dde2d8> (a sun.nio.ch.EPollSelectorImpl)
  1147. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1148. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1149. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1150. - locked <0x0000000792e05f70> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1151. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1152. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1153. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1154. at java.lang.Thread.run(Thread.java:745)
  1155.  
  1156. "RpcServer.reader=6,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee309f9800 nid=0x3b40 runnable [0x00007fee1abba000]
  1157. java.lang.Thread.State: RUNNABLE
  1158. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1159. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1160. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1161. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1162. - locked <0x0000000792e05f28> (a sun.nio.ch.Util$2)
  1163. - locked <0x0000000792e05f40> (a java.util.Collections$UnmodifiableSet)
  1164. - locked <0x0000000792dde368> (a sun.nio.ch.EPollSelectorImpl)
  1165. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1166. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1167. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1168. - locked <0x0000000792e05ef8> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1169. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1170. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1171. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1172. at java.lang.Thread.run(Thread.java:745)
  1173.  
  1174. "RpcServer.reader=5,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee309de800 nid=0x3b3f runnable [0x00007fee1acbb000]
  1175. java.lang.Thread.State: RUNNABLE
  1176. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1177. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1178. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1179. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1180. - locked <0x0000000792e05f10> (a sun.nio.ch.Util$2)
  1181. - locked <0x0000000792e05ec8> (a java.util.Collections$UnmodifiableSet)
  1182. - locked <0x0000000792dde3f8> (a sun.nio.ch.EPollSelectorImpl)
  1183. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1184. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1185. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1186. - locked <0x0000000792e05ee0> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1187. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1188. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1189. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1190. at java.lang.Thread.run(Thread.java:745)
  1191.  
  1192. "RpcServer.reader=4,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee30928800 nid=0x3b3e runnable [0x00007fee1adbc000]
  1193. java.lang.Thread.State: RUNNABLE
  1194. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1195. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1196. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1197. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1198. - locked <0x0000000792e05e98> (a sun.nio.ch.Util$2)
  1199. - locked <0x0000000792e05eb0> (a java.util.Collections$UnmodifiableSet)
  1200. - locked <0x0000000792dde488> (a sun.nio.ch.EPollSelectorImpl)
  1201. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1202. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1203. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1204. - locked <0x0000000792e05e80> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1205. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1206. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1207. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1208. at java.lang.Thread.run(Thread.java:745)
  1209.  
  1210. "RpcServer.reader=3,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee30927000 nid=0x3b3c runnable [0x00007fee1aebd000]
  1211. java.lang.Thread.State: RUNNABLE
  1212. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1213. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1214. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1215. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1216. - locked <0x0000000792dcf400> (a sun.nio.ch.Util$2)
  1217. - locked <0x0000000792dcf418> (a java.util.Collections$UnmodifiableSet)
  1218. - locked <0x0000000792db46a0> (a sun.nio.ch.EPollSelectorImpl)
  1219. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1220. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1221. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1222. - locked <0x0000000792dcf430> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1223. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1224. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1225. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1226. at java.lang.Thread.run(Thread.java:745)
  1227.  
  1228. "RpcServer.reader=2,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee30925800 nid=0x3b3b runnable [0x00007fee1afbe000]
  1229. java.lang.Thread.State: RUNNABLE
  1230. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1231. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1232. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1233. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1234. - locked <0x0000000792dcf448> (a sun.nio.ch.Util$2)
  1235. - locked <0x0000000792dcf460> (a java.util.Collections$UnmodifiableSet)
  1236. - locked <0x0000000792db4610> (a sun.nio.ch.EPollSelectorImpl)
  1237. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1238. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1239. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1240. - locked <0x0000000792dcf388> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1241. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1242. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1243. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1244. at java.lang.Thread.run(Thread.java:745)
  1245.  
  1246. "RpcServer.reader=1,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee30924800 nid=0x3b3a runnable [0x00007fee1b0bf000]
  1247. java.lang.Thread.State: RUNNABLE
  1248. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1249. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1250. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1251. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1252. - locked <0x0000000792dcf3a0> (a sun.nio.ch.Util$2)
  1253. - locked <0x0000000792dcf3b8> (a java.util.Collections$UnmodifiableSet)
  1254. - locked <0x0000000792db4580> (a sun.nio.ch.EPollSelectorImpl)
  1255. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1256. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1257. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1258. - locked <0x0000000792dcf3d0> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1259. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1260. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1261. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1262. at java.lang.Thread.run(Thread.java:745)
  1263.  
  1264. "RpcServer.reader=0,bindAddress=R1,port=16020" daemon prio=10 tid=0x00007fee30924000 nid=0x3b39 runnable [0x00007fee1b3c8000]
  1265. java.lang.Thread.State: RUNNABLE
  1266. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1267. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1268. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1269. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1270. - locked <0x0000000792dcf3e8> (a sun.nio.ch.Util$2)
  1271. - locked <0x0000000792dcf310> (a java.util.Collections$UnmodifiableSet)
  1272. - locked <0x0000000792db44f0> (a sun.nio.ch.EPollSelectorImpl)
  1273. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1274. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1275. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1276. - locked <0x0000000792dcf328> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1277. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1278. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1279. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1280. at java.lang.Thread.run(Thread.java:745)
  1281.  
  1282. "Service Thread" daemon prio=10 tid=0x00007fee30116000 nid=0x3b30 runnable [0x0000000000000000]
  1283. java.lang.Thread.State: RUNNABLE
  1284.  
  1285. "C2 CompilerThread1" daemon prio=10 tid=0x00007fee30113800 nid=0x3b2f waiting on condition [0x0000000000000000]
  1286. java.lang.Thread.State: RUNNABLE
  1287.  
  1288. "C2 CompilerThread0" daemon prio=10 tid=0x00007fee30111000 nid=0x3b2e waiting on condition [0x0000000000000000]
  1289. java.lang.Thread.State: RUNNABLE
  1290.  
  1291. "Signal Dispatcher" daemon prio=10 tid=0x00007fee3010e800 nid=0x3b2d runnable [0x0000000000000000]
  1292. java.lang.Thread.State: RUNNABLE
  1293.  
  1294. "Surrogate Locker Thread (Concurrent GC)" daemon prio=10 tid=0x00007fee30104800 nid=0x3b2c waiting on condition [0x0000000000000000]
  1295. java.lang.Thread.State: RUNNABLE
  1296.  
  1297. "Finalizer" daemon prio=10 tid=0x00007fee300ed000 nid=0x3b2b in Object.wait() [0x00007fee2260e000]
  1298. java.lang.Thread.State: WAITING (on object monitor)
  1299. at java.lang.Object.wait(Native Method)
  1300. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
  1301. - locked <0x0000000792b84fc0> (a java.lang.ref.ReferenceQueue$Lock)
  1302. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
  1303. at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
  1304.  
  1305. "Reference Handler" daemon prio=10 tid=0x00007fee300e9000 nid=0x3b2a in Object.wait() [0x00007fee2270f000]
  1306. java.lang.Thread.State: WAITING (on object monitor)
  1307. at java.lang.Object.wait(Native Method)
  1308. at java.lang.Object.wait(Object.java:503)
  1309. at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
  1310. - locked <0x0000000792b84fd8> (a java.lang.ref.Reference$Lock)
  1311.  
  1312. "main" prio=10 tid=0x00007fee3000c000 nid=0x3b23 in Object.wait() [0x00007fee37e9f000]
  1313. java.lang.Thread.State: WAITING (on object monitor)
  1314. at java.lang.Object.wait(Native Method)
  1315. - waiting on <0x0000000792b46ad8> (a java.lang.Thread)
  1316. at java.lang.Thread.join(Thread.java:1281)
  1317. - locked <0x0000000792b46ad8> (a java.lang.Thread)
  1318. at java.lang.Thread.join(Thread.java:1355)
  1319. at org.apache.hadoop.hbase.util.HasThread.join(HasThread.java:89)
  1320. at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66)
  1321. at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87)
  1322. at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
  1323. at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
  1324. at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2502)
  1325.  
  1326. "VM Thread" prio=10 tid=0x00007fee300e6800 nid=0x3b29 runnable
  1327.  
  1328. "Gang worker#0 (Parallel GC Threads)" prio=10 tid=0x00007fee3001d000 nid=0x3b24 runnable
  1329.  
  1330. "Gang worker#1 (Parallel GC Threads)" prio=10 tid=0x00007fee3001f000 nid=0x3b25 runnable
  1331.  
  1332. "Gang worker#2 (Parallel GC Threads)" prio=10 tid=0x00007fee30021000 nid=0x3b26 runnable
  1333.  
  1334. "Gang worker#3 (Parallel GC Threads)" prio=10 tid=0x00007fee30023000 nid=0x3b27 runnable
  1335.  
  1336. "Concurrent Mark-Sweep GC Thread" prio=10 tid=0x00007fee300a3000 nid=0x3b28 runnable
  1337. "VM Periodic Task Thread" prio=10 tid=0x00007fee30121000 nid=0x3b31 waiting on condition
  1338.  
  1339. JNI global references: 456
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!