API tools faq
paste
Guest User

HMaster jstack

a guest
Jun 15th, 2015
323
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 80.53 KB | None | 0 0
raw download clone embed print report
  1. 2015-06-15 16:28:20
  2. Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.55-b03 mixed mode):
  3.  
  4. "hconnection-0x1cba556e-shared--pool3-t508" daemon prio=10 tid=0x0000000000955800 nid=0x1fa waiting on condition [0x00007f2ab66d4000]
  5. java.lang.Thread.State: TIMED_WAITING (parking)
  6. at sun.misc.Unsafe.park(Native Method)
  7. - parking to wait for <0x00000007934dc990> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  8. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  9. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  10. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  11. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  12. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  13. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  14. at java.lang.Thread.run(Thread.java:745)
  15.  
  16. "IPC Client (234212480) connection to /R1:16020 from sas" daemon prio=10 tid=0x00000000008ed800 nid=0x1f8 in Object.wait() [0x00007f2ab65d3000]
  17. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  18. at java.lang.Object.wait(Native Method)
  19. - waiting on <0x000000077eab7f50> (a org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection)
  20. at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.waitForWork(RpcClientImpl.java:537)
  21. - locked <0x000000077eab7f50> (a org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection)
  22. at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:552)
  23.  
  24. "AM.ZK.Worker-pool2-t111" daemon prio=10 tid=0x0000000000967000 nid=0x181 waiting on condition [0x00007f2aaef5d000]
  25. java.lang.Thread.State: TIMED_WAITING (parking)
  26. at sun.misc.Unsafe.park(Native Method)
  27. - parking to wait for <0x0000000793699c60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  28. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  29. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  30. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  31. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  32. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  33. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  34. at java.lang.Thread.run(Thread.java:745)
  35.  
  36. "AM.ZK.Worker-pool2-t110" daemon prio=10 tid=0x00007f2acc163000 nid=0x180 waiting on condition [0x00007f2ab2997000]
  37. java.lang.Thread.State: TIMED_WAITING (parking)
  38. at sun.misc.Unsafe.park(Native Method)
  39. - parking to wait for <0x0000000793699c60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  40. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  41. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  42. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  43. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  44. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  45. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  46. at java.lang.Thread.run(Thread.java:745)
  47.  
  48. "AM.ZK.Worker-pool2-t109" daemon prio=10 tid=0x00007f2acc139800 nid=0x17f waiting on condition [0x00007f2ab61cf000]
  49. java.lang.Thread.State: TIMED_WAITING (parking)
  50. at sun.misc.Unsafe.park(Native Method)
  51. - parking to wait for <0x0000000793699c60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  52. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  53. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  54. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  55. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  56. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  57. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  58. at java.lang.Thread.run(Thread.java:745)
  59.  
  60. "AM.ZK.Worker-pool2-t108" daemon prio=10 tid=0x0000000000f6d800 nid=0x16e waiting on condition [0x00007f2ab57c5000]
  61. java.lang.Thread.State: TIMED_WAITING (parking)
  62. at sun.misc.Unsafe.park(Native Method)
  63. - parking to wait for <0x0000000793699c60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  64. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  65. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  66. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  67. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  68. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  69. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  70. at java.lang.Thread.run(Thread.java:745)
  71.  
  72. "AM.ZK.Worker-pool2-t107" daemon prio=10 tid=0x00007f2acc174000 nid=0x16d waiting on condition [0x00007f2ab1a88000]
  73. java.lang.Thread.State: TIMED_WAITING (parking)
  74. at sun.misc.Unsafe.park(Native Method)
  75. - parking to wait for <0x0000000793699c60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  76. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  77. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  78. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  79. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  80. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  81. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  82. at java.lang.Thread.run(Thread.java:745)
  83.  
  84. "AM.ZK.Worker-pool2-t106" daemon prio=10 tid=0x00007f2acc13c000 nid=0x16c waiting on condition [0x00007f2ab5cca000]
  85. java.lang.Thread.State: TIMED_WAITING (parking)
  86. at sun.misc.Unsafe.park(Native Method)
  87. - parking to wait for <0x0000000793699c60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  88. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  89. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  90. at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
  91. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  92. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  93. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  94. at java.lang.Thread.run(Thread.java:745)
  95.  
  96. "1769728929@qtp-579590681-84" daemon prio=10 tid=0x00007f2ac413b000 nid=0x5c19 in Object.wait() [0x00007f2ab68d6000]
  97. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  98. at java.lang.Object.wait(Native Method)
  99. - waiting on <0x000000078023b2d0> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
  100. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  101. - locked <0x000000078023b2d0> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
  102.  
  103. "Attach Listener" daemon prio=10 tid=0x00007f2ad47f8000 nid=0x5a54 waiting on condition [0x0000000000000000]
  104. java.lang.Thread.State: RUNNABLE
  105.  
  106. "MASTER_TABLE_OPERATIONS-R2:16020-0" prio=10 tid=0x00007f2acc171800 nid=0x73a5 waiting on condition [0x00007f2aba00d000]
  107. java.lang.Thread.State: WAITING (parking)
  108. at sun.misc.Unsafe.park(Native Method)
  109. - parking to wait for <0x00000007939cecd8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  110. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  111. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  112. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  113. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  114. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  115. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  116. at java.lang.Thread.run(Thread.java:745)
  117.  
  118. "IPC Parameter Sending Thread #97" daemon prio=10 tid=0x0000000000bd5800 nid=0x4c30 waiting on condition [0x00007f2ab6fdd000]
  119. java.lang.Thread.State: TIMED_WAITING (parking)
  120. at sun.misc.Unsafe.park(Native Method)
  121. - parking to wait for <0x0000000793045ee0> (a java.util.concurrent.SynchronousQueue$TransferStack)
  122. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  123. at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
  124. at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
  125. at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
  126. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  127. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  128. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  129. at java.lang.Thread.run(Thread.java:745)
  130.  
  131. "1897850152@qtp-579590681-9-EventThread" daemon prio=10 tid=0x0000000000c83800 nid=0x5a86 waiting on condition [0x00007f2ab85f3000]
  132. java.lang.Thread.State: WAITING (parking)
  133. at sun.misc.Unsafe.park(Native Method)
  134. - parking to wait for <0x0000000793beaf70> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  135. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  136. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  137. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  138. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  139.  
  140. "1897850152@qtp-579590681-9-SendThread(ZK1:2191)" daemon prio=10 tid=0x0000000000990000 nid=0x5a85 runnable [0x00007f2ab83f1000]
  141. java.lang.Thread.State: RUNNABLE
  142. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  143. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  144. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  145. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  146. - locked <0x0000000793b7faa8> (a sun.nio.ch.Util$2)
  147. - locked <0x0000000793b7fac0> (a java.util.Collections$UnmodifiableSet)
  148. - locked <0x0000000793be9078> (a sun.nio.ch.EPollSelectorImpl)
  149. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  150. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
  151. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
  152.  
  153. "MASTER_SERVER_OPERATIONS-R2:16020-1" prio=10 tid=0x0000000000946800 nid=0x283c waiting on condition [0x00007f2ab77e5000]
  154. java.lang.Thread.State: WAITING (parking)
  155. at sun.misc.Unsafe.park(Native Method)
  156. - parking to wait for <0x00000007939cf1a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  157. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  158. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  159. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  160. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  161. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  162. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  163. at java.lang.Thread.run(Thread.java:745)
  164.  
  165. "MASTER_META_SERVER_OPERATIONS-R2:16020-0" prio=10 tid=0x00007f2acc008800 nid=0x2837 waiting on condition [0x00007f2ab84f2000]
  166. java.lang.Thread.State: WAITING (parking)
  167. at sun.misc.Unsafe.park(Native Method)
  168. - parking to wait for <0x00000007939cee70> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  169. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  170. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  171. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  172. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  173. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  174. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  175. at java.lang.Thread.run(Thread.java:745)
  176.  
  177. "MASTER_SERVER_OPERATIONS-R2:16020-0" prio=10 tid=0x00007f2acc0dd000 nid=0x2741 waiting on condition [0x00007f2ab9603000]
  178. java.lang.Thread.State: WAITING (parking)
  179. at sun.misc.Unsafe.park(Native Method)
  180. - parking to wait for <0x00000007939cf1a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  181. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  182. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  183. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  184. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  185. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  186. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  187. at java.lang.Thread.run(Thread.java:745)
  188.  
  189. "CatalogJanitor-R2:16020" daemon prio=10 tid=0x00007f2ac47f4800 nid=0x2736 in Object.wait() [0x00007f2ab80ee000]
  190. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  191. at java.lang.Object.wait(Native Method)
  192. - waiting on <0x0000000793557488> (a java.lang.Object)
  193. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  194. - locked <0x0000000793557488> (a java.lang.Object)
  195. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  196. at java.lang.Thread.run(Thread.java:745)
  197.  
  198. "R2,16020,1432798527949-BalancerChore" daemon prio=10 tid=0x00007f2ac4355000 nid=0x2735 in Object.wait() [0x00007f2ab81ef000]
  199. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  200. at java.lang.Object.wait(Native Method)
  201. - waiting on <0x00000007934f2230> (a java.lang.Object)
  202. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  203. - locked <0x00000007934f2230> (a java.lang.Object)
  204. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  205. at java.lang.Thread.run(Thread.java:745)
  206.  
  207. "R2,16020,1432798527949-ClusterStatusChore" daemon prio=10 tid=0x00007f2ac47f3800 nid=0x2734 in Object.wait() [0x00007f2ab82f0000]
  208. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  209. at java.lang.Object.wait(Native Method)
  210. - waiting on <0x00000007934dc378> (a java.lang.Object)
  211. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  212. - locked <0x00000007934dc378> (a java.lang.Object)
  213. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  214. at java.lang.Thread.run(Thread.java:745)
  215.  
  216. "R2:16020.archivedHFileCleaner" daemon prio=10 tid=0x00007f2ac43ab800 nid=0x272d in Object.wait() [0x00007f2ab89f7000]
  217. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  218. at java.lang.Object.wait(Native Method)
  219. - waiting on <0x00000007934dc390> (a java.lang.Object)
  220. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  221. - locked <0x00000007934dc390> (a java.lang.Object)
  222. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  223. at java.lang.Thread.run(Thread.java:745)
  224.  
  225. "snapshot-hfile-cleaner-cache-refresher" daemon prio=10 tid=0x00007f2ac43a9000 nid=0x272c in Object.wait() [0x00007f2ab8af8000]
  226. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  227. at java.lang.Object.wait(Native Method)
  228. - waiting on <0x00000007934f2248> (a java.util.TaskQueue)
  229. at java.util.TimerThread.mainLoop(Timer.java:552)
  230. - locked <0x00000007934f2248> (a java.util.TaskQueue)
  231. at java.util.TimerThread.run(Timer.java:505)
  232.  
  233. "R2:16020.oldLogCleaner" daemon prio=10 tid=0x00007f2ac43a7000 nid=0x272b in Object.wait() [0x00007f2ab8bf9000]
  234. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  235. at java.lang.Object.wait(Native Method)
  236. - waiting on <0x00000007935574a0> (a java.lang.Object)
  237. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  238. - locked <0x00000007935574a0> (a java.lang.Object)
  239. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  240. at java.lang.Thread.run(Thread.java:745)
  241.  
  242. "snapshot-log-cleaner-cache-refresher" daemon prio=10 tid=0x00007f2ac4811800 nid=0x272a in Object.wait() [0x00007f2ab8cfa000]
  243. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  244. at java.lang.Object.wait(Native Method)
  245. - waiting on <0x00000007934dc3a8> (a java.util.TaskQueue)
  246. at java.util.TimerThread.mainLoop(Timer.java:552)
  247. - locked <0x00000007934dc3a8> (a java.util.TaskQueue)
  248. at java.util.TimerThread.run(Timer.java:505)
  249.  
  250. "R2:16020.activeMasterManager-EventThread" daemon prio=10 tid=0x00007f2ac43a4800 nid=0x2729 waiting on condition [0x00007f2ab8dfb000]
  251. java.lang.Thread.State: WAITING (parking)
  252. at sun.misc.Unsafe.park(Native Method)
  253. - parking to wait for <0x00000007935574b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  254. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  255. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  256. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  257. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  258.  
  259. "R2:16020.activeMasterManager-SendThread(ZK1:2191)" daemon prio=10 tid=0x00007f2ac43a3800 nid=0x2728 runnable [0x00007f2ab8efc000]
  260. java.lang.Thread.State: RUNNABLE
  261. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  262. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  263. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  264. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  265. - locked <0x00000007934dc3d8> (a sun.nio.ch.Util$2)
  266. - locked <0x00000007934dc3f0> (a java.util.Collections$UnmodifiableSet)
  267. - locked <0x00000007938752d0> (a sun.nio.ch.EPollSelectorImpl)
  268. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  269. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
  270. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
  271.  
  272. "R2:16020.activeMasterManager-EventThread" daemon prio=10 tid=0x00007f2ac4343800 nid=0x2727 waiting on condition [0x00007f2ab8ffd000]
  273. java.lang.Thread.State: WAITING (parking)
  274. at sun.misc.Unsafe.park(Native Method)
  275. - parking to wait for <0x00000007936de2c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  276. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  277. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  278. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  279. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  280.  
  281. "R2:16020.activeMasterManager-SendThread(ZK1:2191)" daemon prio=10 tid=0x00007f2ac4342800 nid=0x2726 runnable [0x00007f2ab90fe000]
  282. java.lang.Thread.State: RUNNABLE
  283. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  284. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  285. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  286. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  287. - locked <0x00000007936e2378> (a sun.nio.ch.Util$2)
  288. - locked <0x00000007936e2390> (a java.util.Collections$UnmodifiableSet)
  289. - locked <0x000000079368aba0> (a sun.nio.ch.EPollSelectorImpl)
  290. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  291. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
  292. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
  293.  
  294. "R2,16020,1432798527949.splitLogManagerTimeoutMonitor" daemon prio=10 tid=0x00007f2ac414a800 nid=0x2725 in Object.wait() [0x00007f2ab9300000]
  295. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  296. at java.lang.Object.wait(Native Method)
  297. - waiting on <0x00000007937ae8f0> (a java.lang.Object)
  298. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  299. - locked <0x00000007937ae8f0> (a java.lang.Object)
  300. at org.apache.hadoop.hbase.Chore.run(Chore.java:88)
  301. at java.lang.Thread.run(Thread.java:745)
  302.  
  303. "org.apache.hadoop.hdfs.PeerCache@8e5e447" daemon prio=10 tid=0x00007f2ac4860000 nid=0x2721 waiting on condition [0x00007f2ab9401000]
  304. java.lang.Thread.State: TIMED_WAITING (sleeping)
  305. at java.lang.Thread.sleep(Native Method)
  306. at org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:244)
  307. at org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:41)
  308. at org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:119)
  309. at java.lang.Thread.run(Thread.java:745)
  310.  
  311. "1499159915@qtp-266095327-2" prio=10 tid=0x00000000006d0000 nid=0x2702 in Object.wait() [0x00007f2ab9b08000]
  312. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  313. at java.lang.Object.wait(Native Method)
  314. - waiting on <0x0000000793305ce0> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
  315. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626)
  316. - locked <0x0000000793305ce0> (a org.mortbay.thread.QueuedThreadPool$PoolThread)
  317.  
  318. "JvmPauseMonitor" daemon prio=10 tid=0x00007f2acc048800 nid=0x26f0 waiting on condition [0x00007f2ab9c09000]
  319. java.lang.Thread.State: TIMED_WAITING (sleeping)
  320. at java.lang.Thread.sleep(Native Method)
  321. at org.apache.hadoop.hbase.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:159)
  322. at java.lang.Thread.run(Thread.java:745)
  323.  
  324. "master//R2:16020-EventThread" daemon prio=10 tid=0x00007f2acc027800 nid=0x26ef waiting on condition [0x00007f2ab9d0a000]
  325. java.lang.Thread.State: WAITING (parking)
  326. at sun.misc.Unsafe.park(Native Method)
  327. - parking to wait for <0x0000000793330d40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  328. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  329. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  330. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  331. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  332.  
  333. "master//R2:16020-SendThread(ZK1:2191)" daemon prio=10 tid=0x00007f2acc025800 nid=0x26ee runnable [0x00007f2ab9e0b000]
  334. java.lang.Thread.State: RUNNABLE
  335. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  336. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  337. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  338. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  339. - locked <0x0000000793330d88> (a sun.nio.ch.Util$2)
  340. - locked <0x0000000793330da0> (a java.util.Collections$UnmodifiableSet)
  341. - locked <0x0000000793336260> (a sun.nio.ch.EPollSelectorImpl)
  342. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  343. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
  344. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
  345.  
  346. "master//R2:16020" prio=10 tid=0x00007f2ad506f800 nid=0x26ed in Object.wait() [0x00007f2ab9f0c000]
  347. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  348. at java.lang.Object.wait(Native Method)
  349. - waiting on <0x0000000792dff688> (a java.lang.Object)
  350. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:92)
  351. - locked <0x0000000792dff688> (a java.lang.Object)
  352. at org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:56)
  353. at org.apache.hadoop.hbase.master.HMaster.waitForMasterActive(HMaster.java:444)
  354. at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:722)
  355. at org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:675)
  356. at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:808)
  357. at java.lang.Thread.run(Thread.java:745)
  358.  
  359. "627983756@qtp-266095327-1 - Acceptor0 [email protected]:16010" prio=10 tid=0x00007f2ad503a800 nid=0x26eb runnable [0x00007f2aba10e000]
  360. java.lang.Thread.State: RUNNABLE
  361. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  362. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  363. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  364. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  365. - locked <0x0000000793333d10> (a sun.nio.ch.Util$2)
  366. - locked <0x0000000793333d28> (a java.util.Collections$UnmodifiableSet)
  367. - locked <0x00000007933368d8> (a sun.nio.ch.EPollSelectorImpl)
  368. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  369. at org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)
  370. at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)
  371. at org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
  372. at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
  373. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
  374.  
  375. "Timer-0" daemon prio=10 tid=0x00007f2ad4f1b800 nid=0x26e9 in Object.wait() [0x00007f2aba310000]
  376. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  377. at java.lang.Object.wait(Native Method)
  378. - waiting on <0x0000000793333da0> (a java.util.TaskQueue)
  379. at java.util.TimerThread.mainLoop(Timer.java:552)
  380. - locked <0x0000000793333da0> (a java.util.TaskQueue)
  381. at java.util.TimerThread.run(Timer.java:505)
  382.  
  383. "1929438414@qtp-579590681-1 - Acceptor0 [email protected]:16030" daemon prio=10 tid=0x00007f2ad4ee2800 nid=0x26e8 runnable [0x00007f2aba411000]
  384. java.lang.Thread.State: RUNNABLE
  385. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  386. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  387. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  388. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  389. - locked <0x0000000793333dd0> (a sun.nio.ch.Util$2)
  390. - locked <0x0000000793333de8> (a java.util.Collections$UnmodifiableSet)
  391. - locked <0x0000000793336968> (a sun.nio.ch.EPollSelectorImpl)
  392. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  393. at org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498)
  394. at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192)
  395. at org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
  396. at org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
  397. at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
  398.  
  399. "ReplicationRpcServer.handler=2,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4eba800 nid=0x26e6 waiting on condition [0x00007f2aba613000]
  400. java.lang.Thread.State: WAITING (parking)
  401. at sun.misc.Unsafe.park(Native Method)
  402. - parking to wait for <0x0000000792e2b520> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  403. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  404. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  405. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  406. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  407. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  408. at java.lang.Thread.run(Thread.java:745)
  409.  
  410. "ReplicationRpcServer.handler=1,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4eb8800 nid=0x26e5 waiting on condition [0x00007f2aba714000]
  411. java.lang.Thread.State: WAITING (parking)
  412. at sun.misc.Unsafe.park(Native Method)
  413. - parking to wait for <0x0000000792e2b520> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  414. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  415. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  416. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  417. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  418. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  419. at java.lang.Thread.run(Thread.java:745)
  420.  
  421. "ReplicationRpcServer.handler=0,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4eb6800 nid=0x26e4 waiting on condition [0x00007f2aba815000]
  422. java.lang.Thread.State: WAITING (parking)
  423. at sun.misc.Unsafe.park(Native Method)
  424. - parking to wait for <0x0000000792e2b520> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  425. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  426. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  427. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  428. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  429. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  430. at java.lang.Thread.run(Thread.java:745)
  431.  
  432. "PriorityRpcServer.handler=9,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4eb4800 nid=0x26e3 waiting on condition [0x00007f2aba916000]
  433. java.lang.Thread.State: WAITING (parking)
  434. at sun.misc.Unsafe.park(Native Method)
  435. - parking to wait for <0x0000000792e2b418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  436. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  437. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  438. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  439. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  440. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  441. at java.lang.Thread.run(Thread.java:745)
  442.  
  443. "PriorityRpcServer.handler=8,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4eb2000 nid=0x26e2 waiting on condition [0x00007f2abaa17000]
  444. java.lang.Thread.State: WAITING (parking)
  445. at sun.misc.Unsafe.park(Native Method)
  446. - parking to wait for <0x0000000792e022b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  447. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  448. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  449. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  450. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  451. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  452. at java.lang.Thread.run(Thread.java:745)
  453.  
  454. "PriorityRpcServer.handler=7,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4eb0000 nid=0x26e1 waiting on condition [0x00007f2abab18000]
  455. java.lang.Thread.State: WAITING (parking)
  456. at sun.misc.Unsafe.park(Native Method)
  457. - parking to wait for <0x0000000792e2b418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  458. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  459. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  460. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  461. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  462. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  463. at java.lang.Thread.run(Thread.java:745)
  464.  
  465. "PriorityRpcServer.handler=6,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4eae000 nid=0x26e0 waiting on condition [0x00007f2abac19000]
  466. java.lang.Thread.State: WAITING (parking)
  467. at sun.misc.Unsafe.park(Native Method)
  468. - parking to wait for <0x0000000792e022b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  469. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  470. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  471. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  472. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  473. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  474. at java.lang.Thread.run(Thread.java:745)
  475.  
  476. "PriorityRpcServer.handler=5,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4eac000 nid=0x26df waiting on condition [0x00007f2abad1a000]
  477. java.lang.Thread.State: WAITING (parking)
  478. at sun.misc.Unsafe.park(Native Method)
  479. - parking to wait for <0x0000000792e2b418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  480. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  481. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  482. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  483. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  484. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  485. at java.lang.Thread.run(Thread.java:745)
  486.  
  487. "PriorityRpcServer.handler=4,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4eaa000 nid=0x26de waiting on condition [0x00007f2abae1b000]
  488. java.lang.Thread.State: WAITING (parking)
  489. at sun.misc.Unsafe.park(Native Method)
  490. - parking to wait for <0x0000000792e022b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  491. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  492. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  493. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  494. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  495. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  496. at java.lang.Thread.run(Thread.java:745)
  497.  
  498. "PriorityRpcServer.handler=3,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4ea8000 nid=0x26dd waiting on condition [0x00007f2abaf1c000]
  499. java.lang.Thread.State: WAITING (parking)
  500. at sun.misc.Unsafe.park(Native Method)
  501. - parking to wait for <0x0000000792e2b418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  502. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  503. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  504. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  505. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  506. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  507. at java.lang.Thread.run(Thread.java:745)
  508.  
  509. "PriorityRpcServer.handler=2,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4ea5800 nid=0x26dc waiting on condition [0x00007f2abb01d000]
  510. java.lang.Thread.State: WAITING (parking)
  511. at sun.misc.Unsafe.park(Native Method)
  512. - parking to wait for <0x0000000792e022b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  513. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  514. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  515. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  516. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  517. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  518. at java.lang.Thread.run(Thread.java:745)
  519.  
  520. "PriorityRpcServer.handler=1,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4ea3800 nid=0x26db waiting on condition [0x00007f2abb11e000]
  521. java.lang.Thread.State: WAITING (parking)
  522. at sun.misc.Unsafe.park(Native Method)
  523. - parking to wait for <0x0000000792e2b418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  524. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  525. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  526. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  527. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  528. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  529. at java.lang.Thread.run(Thread.java:745)
  530.  
  531. "PriorityRpcServer.handler=0,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4ea1800 nid=0x26da waiting on condition [0x00007f2abb21f000]
  532. java.lang.Thread.State: WAITING (parking)
  533. at sun.misc.Unsafe.park(Native Method)
  534. - parking to wait for <0x0000000792e022b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  535. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  536. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  537. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  538. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  539. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  540. at java.lang.Thread.run(Thread.java:745)
  541.  
  542. "B.defaultRpcServer.handler=29,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e9f800 nid=0x26d9 waiting on condition [0x00007f2abb320000]
  543. java.lang.Thread.State: WAITING (parking)
  544. at sun.misc.Unsafe.park(Native Method)
  545. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  546. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  547. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  548. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  549. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  550. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  551. at java.lang.Thread.run(Thread.java:745)
  552.  
  553. "B.defaultRpcServer.handler=28,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e9d800 nid=0x26d8 waiting on condition [0x00007f2abb421000]
  554. java.lang.Thread.State: WAITING (parking)
  555. at sun.misc.Unsafe.park(Native Method)
  556. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  557. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  558. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  559. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  560. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  561. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  562. at java.lang.Thread.run(Thread.java:745)
  563.  
  564. "B.defaultRpcServer.handler=27,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e9b000 nid=0x26d7 waiting on condition [0x00007f2abb522000]
  565. java.lang.Thread.State: WAITING (parking)
  566. at sun.misc.Unsafe.park(Native Method)
  567. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  568. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  569. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  570. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  571. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  572. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  573. at java.lang.Thread.run(Thread.java:745)
  574.  
  575. "B.defaultRpcServer.handler=26,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e99000 nid=0x26d6 waiting on condition [0x00007f2abb623000]
  576. java.lang.Thread.State: WAITING (parking)
  577. at sun.misc.Unsafe.park(Native Method)
  578. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  579. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  580. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  581. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  582. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  583. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  584. at java.lang.Thread.run(Thread.java:745)
  585.  
  586. "B.defaultRpcServer.handler=25,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e97000 nid=0x26d5 waiting on condition [0x00007f2abb724000]
  587. java.lang.Thread.State: WAITING (parking)
  588. at sun.misc.Unsafe.park(Native Method)
  589. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  590. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  591. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  592. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  593. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  594. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  595. at java.lang.Thread.run(Thread.java:745)
  596.  
  597. "B.defaultRpcServer.handler=24,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e95000 nid=0x26d4 waiting on condition [0x00007f2abb825000]
  598. java.lang.Thread.State: WAITING (parking)
  599. at sun.misc.Unsafe.park(Native Method)
  600. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  601. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  602. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  603. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  604. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  605. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  606. at java.lang.Thread.run(Thread.java:745)
  607.  
  608. "B.defaultRpcServer.handler=23,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e92800 nid=0x26d3 waiting on condition [0x00007f2abb926000]
  609. java.lang.Thread.State: WAITING (parking)
  610. at sun.misc.Unsafe.park(Native Method)
  611. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  612. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  613. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  614. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  615. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  616. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  617. at java.lang.Thread.run(Thread.java:745)
  618.  
  619. "B.defaultRpcServer.handler=22,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e90800 nid=0x26d2 waiting on condition [0x00007f2abba27000]
  620. java.lang.Thread.State: WAITING (parking)
  621. at sun.misc.Unsafe.park(Native Method)
  622. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  623. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  624. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  625. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  626. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  627. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  628. at java.lang.Thread.run(Thread.java:745)
  629.  
  630. "B.defaultRpcServer.handler=21,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e8e800 nid=0x26d1 waiting on condition [0x00007f2abbb28000]
  631. java.lang.Thread.State: WAITING (parking)
  632. at sun.misc.Unsafe.park(Native Method)
  633. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  634. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  635. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  636. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  637. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  638. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  639. at java.lang.Thread.run(Thread.java:745)
  640.  
  641. "B.defaultRpcServer.handler=20,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e8c800 nid=0x26d0 waiting on condition [0x00007f2abbc29000]
  642. java.lang.Thread.State: WAITING (parking)
  643. at sun.misc.Unsafe.park(Native Method)
  644. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  645. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  646. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  647. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  648. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  649. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  650. at java.lang.Thread.run(Thread.java:745)
  651.  
  652. "B.defaultRpcServer.handler=19,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e8a800 nid=0x26cf waiting on condition [0x00007f2abbd2a000]
  653. java.lang.Thread.State: WAITING (parking)
  654. at sun.misc.Unsafe.park(Native Method)
  655. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  656. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  657. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  658. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  659. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  660. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  661. at java.lang.Thread.run(Thread.java:745)
  662.  
  663. "B.defaultRpcServer.handler=18,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e88800 nid=0x26ce waiting on condition [0x00007f2abbe2b000]
  664. java.lang.Thread.State: WAITING (parking)
  665. at sun.misc.Unsafe.park(Native Method)
  666. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  667. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  668. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  669. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  670. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  671. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  672. at java.lang.Thread.run(Thread.java:745)
  673.  
  674. "B.defaultRpcServer.handler=17,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e86000 nid=0x26cd waiting on condition [0x00007f2abbf2c000]
  675. java.lang.Thread.State: WAITING (parking)
  676. at sun.misc.Unsafe.park(Native Method)
  677. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  678. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  679. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  680. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  681. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  682. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  683. at java.lang.Thread.run(Thread.java:745)
  684.  
  685. "B.defaultRpcServer.handler=16,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e84000 nid=0x26cc waiting on condition [0x00007f2abc02d000]
  686. java.lang.Thread.State: WAITING (parking)
  687. at sun.misc.Unsafe.park(Native Method)
  688. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  689. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  690. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  691. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  692. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  693. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  694. at java.lang.Thread.run(Thread.java:745)
  695.  
  696. "B.defaultRpcServer.handler=15,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e82000 nid=0x26cb waiting on condition [0x00007f2abc12e000]
  697. java.lang.Thread.State: WAITING (parking)
  698. at sun.misc.Unsafe.park(Native Method)
  699. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  700. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  701. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  702. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  703. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  704. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  705. at java.lang.Thread.run(Thread.java:745)
  706.  
  707. "B.defaultRpcServer.handler=14,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e80000 nid=0x26ca waiting on condition [0x00007f2abc22f000]
  708. java.lang.Thread.State: WAITING (parking)
  709. at sun.misc.Unsafe.park(Native Method)
  710. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  711. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  712. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  713. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  714. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  715. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  716. at java.lang.Thread.run(Thread.java:745)
  717.  
  718. "B.defaultRpcServer.handler=13,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e7e000 nid=0x26c9 waiting on condition [0x00007f2abc330000]
  719. java.lang.Thread.State: WAITING (parking)
  720. at sun.misc.Unsafe.park(Native Method)
  721. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  722. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  723. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  724. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  725. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  726. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  727. at java.lang.Thread.run(Thread.java:745)
  728.  
  729. "B.defaultRpcServer.handler=12,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e7c000 nid=0x26c8 waiting on condition [0x00007f2abc431000]
  730. java.lang.Thread.State: WAITING (parking)
  731. at sun.misc.Unsafe.park(Native Method)
  732. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  733. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  734. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  735. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  736. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  737. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  738. at java.lang.Thread.run(Thread.java:745)
  739.  
  740. "B.defaultRpcServer.handler=11,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e79800 nid=0x26c7 waiting on condition [0x00007f2abc532000]
  741. java.lang.Thread.State: WAITING (parking)
  742. at sun.misc.Unsafe.park(Native Method)
  743. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  744. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  745. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  746. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  747. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  748. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  749. at java.lang.Thread.run(Thread.java:745)
  750.  
  751. "B.defaultRpcServer.handler=10,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e77800 nid=0x26c6 waiting on condition [0x00007f2abc633000]
  752. java.lang.Thread.State: WAITING (parking)
  753. at sun.misc.Unsafe.park(Native Method)
  754. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  755. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  756. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  757. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  758. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  759. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  760. at java.lang.Thread.run(Thread.java:745)
  761.  
  762. "B.defaultRpcServer.handler=9,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e75800 nid=0x26c5 waiting on condition [0x00007f2abc734000]
  763. java.lang.Thread.State: WAITING (parking)
  764. at sun.misc.Unsafe.park(Native Method)
  765. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  766. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  767. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  768. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  769. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  770. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  771. at java.lang.Thread.run(Thread.java:745)
  772.  
  773. "B.defaultRpcServer.handler=8,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e73800 nid=0x26c4 waiting on condition [0x00007f2abc835000]
  774. java.lang.Thread.State: WAITING (parking)
  775. at sun.misc.Unsafe.park(Native Method)
  776. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  777. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  778. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  779. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  780. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  781. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  782. at java.lang.Thread.run(Thread.java:745)
  783.  
  784. "B.defaultRpcServer.handler=7,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e71000 nid=0x26c3 waiting on condition [0x00007f2abc936000]
  785. java.lang.Thread.State: WAITING (parking)
  786. at sun.misc.Unsafe.park(Native Method)
  787. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  788. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  789. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  790. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  791. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  792. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  793. at java.lang.Thread.run(Thread.java:745)
  794.  
  795. "B.defaultRpcServer.handler=6,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e6f000 nid=0x26c2 waiting on condition [0x00007f2abca37000]
  796. java.lang.Thread.State: WAITING (parking)
  797. at sun.misc.Unsafe.park(Native Method)
  798. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  799. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  800. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  801. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  802. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  803. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  804. at java.lang.Thread.run(Thread.java:745)
  805.  
  806. "B.defaultRpcServer.handler=5,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e6d000 nid=0x26c1 waiting on condition [0x00007f2abcb38000]
  807. java.lang.Thread.State: WAITING (parking)
  808. at sun.misc.Unsafe.park(Native Method)
  809. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  810. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  811. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  812. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  813. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  814. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  815. at java.lang.Thread.run(Thread.java:745)
  816.  
  817. "B.defaultRpcServer.handler=4,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e6b000 nid=0x26c0 waiting on condition [0x00007f2abcc39000]
  818. java.lang.Thread.State: WAITING (parking)
  819. at sun.misc.Unsafe.park(Native Method)
  820. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  821. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  822. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  823. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  824. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  825. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  826. at java.lang.Thread.run(Thread.java:745)
  827.  
  828. "B.defaultRpcServer.handler=3,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e69000 nid=0x26bf waiting on condition [0x00007f2abcd3a000]
  829. java.lang.Thread.State: WAITING (parking)
  830. at sun.misc.Unsafe.park(Native Method)
  831. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  832. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  833. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  834. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  835. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  836. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  837. at java.lang.Thread.run(Thread.java:745)
  838.  
  839. "B.defaultRpcServer.handler=2,queue=2,port=16020" daemon prio=10 tid=0x00007f2ad4e66800 nid=0x26be waiting on condition [0x00007f2abce3b000]
  840. java.lang.Thread.State: WAITING (parking)
  841. at sun.misc.Unsafe.park(Native Method)
  842. - parking to wait for <0x0000000792cf50e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  843. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  844. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  845. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  846. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  847. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  848. at java.lang.Thread.run(Thread.java:745)
  849.  
  850. "B.defaultRpcServer.handler=1,queue=1,port=16020" daemon prio=10 tid=0x00007f2ad4e65000 nid=0x26bd waiting on condition [0x00007f2abcf3c000]
  851. java.lang.Thread.State: WAITING (parking)
  852. at sun.misc.Unsafe.park(Native Method)
  853. - parking to wait for <0x0000000792cf4ff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  854. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  855. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  856. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  857. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  858. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  859. at java.lang.Thread.run(Thread.java:745)
  860.  
  861. "B.defaultRpcServer.handler=0,queue=0,port=16020" daemon prio=10 tid=0x00007f2ad4e42800 nid=0x26bc waiting on condition [0x00007f2abd03d000]
  862. java.lang.Thread.State: WAITING (parking)
  863. at sun.misc.Unsafe.park(Native Method)
  864. - parking to wait for <0x0000000792cf5038> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  865. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  866. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  867. at org.apache.hadoop.hbase.util.BoundedPriorityBlockingQueue.take(BoundedPriorityBlockingQueue.java:213)
  868. at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:127)
  869. at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
  870. at java.lang.Thread.run(Thread.java:745)
  871.  
  872. "RpcServer.listener,port=16020" daemon prio=10 tid=0x00007f2ad4e40800 nid=0x26bb runnable [0x00007f2abd13e000]
  873. java.lang.Thread.State: RUNNABLE
  874. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  875. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  876. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  877. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  878. - locked <0x0000000792cf4b70> (a sun.nio.ch.Util$2)
  879. - locked <0x0000000792cf4b58> (a java.util.Collections$UnmodifiableSet)
  880. - locked <0x0000000792cdb168> (a sun.nio.ch.EPollSelectorImpl)
  881. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  882. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  883. at org.apache.hadoop.hbase.ipc.RpcServer$Listener.run(RpcServer.java:674)
  884.  
  885. "RpcServer.responder" daemon prio=10 tid=0x00007f2ad4e3f800 nid=0x26ba runnable [0x00007f2abd23f000]
  886. java.lang.Thread.State: RUNNABLE
  887. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  888. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  889. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  890. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  891. - locked <0x00000007932247b0> (a sun.nio.ch.Util$2)
  892. - locked <0x0000000793224798> (a java.util.Collections$UnmodifiableSet)
  893. - locked <0x0000000793238738> (a sun.nio.ch.EPollSelectorImpl)
  894. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  895. at org.apache.hadoop.hbase.ipc.RpcServer$Responder.doRunLoop(RpcServer.java:913)
  896. at org.apache.hadoop.hbase.ipc.RpcServer$Responder.run(RpcServer.java:860)
  897.  
  898. "main-EventThread" daemon prio=10 tid=0x00007f2ad4e34000 nid=0x26b9 waiting on condition [0x00007f2abd340000]
  899. java.lang.Thread.State: WAITING (parking)
  900. at sun.misc.Unsafe.park(Native Method)
  901. - parking to wait for <0x00000007933319b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  902. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  903. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  904. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  905. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  906.  
  907. "main-SendThread(ZK1:2191)" daemon prio=10 tid=0x00007f2ad4e33000 nid=0x26b8 runnable [0x00007f2abd441000]
  908. java.lang.Thread.State: RUNNABLE
  909. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  910. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  911. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  912. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  913. - locked <0x000000079323b628> (a sun.nio.ch.Util$2)
  914. - locked <0x000000079323b670> (a java.util.Collections$UnmodifiableSet)
  915. - locked <0x000000079332a9f0> (a sun.nio.ch.EPollSelectorImpl)
  916. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  917. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
  918. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
  919.  
  920. "Thread-5" daemon prio=10 tid=0x00007f2ad4dd2800 nid=0x26b7 runnable [0x00007f2abd542000]
  921. java.lang.Thread.State: RUNNABLE
  922. at org.apache.hadoop.net.unix.DomainSocketWatcher.doPoll0(Native Method)
  923. at org.apache.hadoop.net.unix.DomainSocketWatcher.access$800(DomainSocketWatcher.java:52)
  924. at org.apache.hadoop.net.unix.DomainSocketWatcher$1.run(DomainSocketWatcher.java:457)
  925. at java.lang.Thread.run(Thread.java:745)
  926.  
  927. "Timer for 'HBase' metrics system" daemon prio=10 tid=0x00007f2ad4a7e000 nid=0x26b6 in Object.wait() [0x00007f2abdc68000]
  928. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  929. at java.lang.Object.wait(Native Method)
  930. - waiting on <0x00000007930ad5a0> (a java.util.TaskQueue)
  931. at java.util.TimerThread.mainLoop(Timer.java:552)
  932. - locked <0x00000007930ad5a0> (a java.util.TaskQueue)
  933. at java.util.TimerThread.run(Timer.java:505)
  934.  
  935. "RpcServer.reader=9,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad4a2b800 nid=0x26b5 runnable [0x00007f2abdd69000]
  936. java.lang.Thread.State: RUNNABLE
  937. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  938. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  939. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  940. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  941. - locked <0x0000000792dfb540> (a sun.nio.ch.Util$2)
  942. - locked <0x0000000792dfb558> (a java.util.Collections$UnmodifiableSet)
  943. - locked <0x0000000792e1b048> (a sun.nio.ch.EPollSelectorImpl)
  944. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  945. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  946. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  947. - locked <0x0000000792dfb510> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  948. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  949. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  950. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  951. at java.lang.Thread.run(Thread.java:745)
  952.  
  953. "RpcServer.reader=8,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad4a10800 nid=0x26b4 runnable [0x00007f2abde6a000]
  954. java.lang.Thread.State: RUNNABLE
  955. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  956. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  957. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  958. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  959. - locked <0x0000000792d54dc0> (a sun.nio.ch.Util$2)
  960. - locked <0x0000000792d54dd8> (a java.util.Collections$UnmodifiableSet)
  961. - locked <0x0000000792cf9248> (a sun.nio.ch.EPollSelectorImpl)
  962. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  963. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  964. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  965. - locked <0x0000000792d54df0> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  966. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  967. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  968. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  969. at java.lang.Thread.run(Thread.java:745)
  970.  
  971. "RpcServer.reader=7,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad49f5000 nid=0x26b3 runnable [0x00007f2abdf6b000]
  972. java.lang.Thread.State: RUNNABLE
  973. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  974. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  975. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  976. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  977. - locked <0x0000000792dfb528> (a sun.nio.ch.Util$2)
  978. - locked <0x0000000792dfb4e0> (a java.util.Collections$UnmodifiableSet)
  979. - locked <0x0000000792dfa608> (a sun.nio.ch.EPollSelectorImpl)
  980. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  981. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  982. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  983. - locked <0x0000000792dfb4f8> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  984. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  985. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  986. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  987. at java.lang.Thread.run(Thread.java:745)
  988.  
  989. "RpcServer.reader=6,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad49da000 nid=0x26b2 runnable [0x00007f2abe06c000]
  990. java.lang.Thread.State: RUNNABLE
  991. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  992. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  993. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  994. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  995. - locked <0x0000000792dfb4b0> (a sun.nio.ch.Util$2)
  996. - locked <0x0000000792dfb4c8> (a java.util.Collections$UnmodifiableSet)
  997. - locked <0x0000000792dfa698> (a sun.nio.ch.EPollSelectorImpl)
  998. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  999. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1000. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1001. - locked <0x0000000792dfb480> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1002. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1003. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1004. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1005. at java.lang.Thread.run(Thread.java:745)
  1006.  
  1007. "RpcServer.reader=5,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad49bf800 nid=0x26b1 runnable [0x00007f2abe16d000]
  1008. java.lang.Thread.State: RUNNABLE
  1009. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1010. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1011. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1012. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1013. - locked <0x0000000792d54e08> (a sun.nio.ch.Util$2)
  1014. - locked <0x0000000792d54e20> (a java.util.Collections$UnmodifiableSet)
  1015. - locked <0x0000000792cf91b8> (a sun.nio.ch.EPollSelectorImpl)
  1016. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1017. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1018. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1019. - locked <0x0000000792d54d48> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1020. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1021. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1022. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1023. at java.lang.Thread.run(Thread.java:745)
  1024.  
  1025. "RpcServer.reader=4,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad49a5000 nid=0x26b0 runnable [0x00007f2ac81a5000]
  1026. java.lang.Thread.State: RUNNABLE
  1027. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1028. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1029. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1030. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1031. - locked <0x0000000792dfb498> (a sun.nio.ch.Util$2)
  1032. - locked <0x0000000792dfb450> (a java.util.Collections$UnmodifiableSet)
  1033. - locked <0x0000000792dfa728> (a sun.nio.ch.EPollSelectorImpl)
  1034. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1035. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1036. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1037. - locked <0x0000000792dfb468> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1038. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1039. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1040. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1041. at java.lang.Thread.run(Thread.java:745)
  1042.  
  1043. "RpcServer.reader=3,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad498a800 nid=0x26af runnable [0x00007f2ac82a6000]
  1044. java.lang.Thread.State: RUNNABLE
  1045. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1046. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1047. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1048. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1049. - locked <0x0000000792d54d60> (a sun.nio.ch.Util$2)
  1050. - locked <0x0000000792d54d78> (a java.util.Collections$UnmodifiableSet)
  1051. - locked <0x0000000792cf9128> (a sun.nio.ch.EPollSelectorImpl)
  1052. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1053. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1054. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1055. - locked <0x0000000792d54d90> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1056. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1057. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1058. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1059. at java.lang.Thread.run(Thread.java:745)
  1060.  
  1061. "RpcServer.reader=2,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad496f800 nid=0x26ae runnable [0x00007f2ac83a7000]
  1062. java.lang.Thread.State: RUNNABLE
  1063. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1064. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1065. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1066. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1067. - locked <0x0000000792dfb420> (a sun.nio.ch.Util$2)
  1068. - locked <0x0000000792dfb438> (a java.util.Collections$UnmodifiableSet)
  1069. - locked <0x0000000792cdb240> (a sun.nio.ch.EPollSelectorImpl)
  1070. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1071. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1072. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1073. - locked <0x0000000792dfb3f0> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1074. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1075. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1076. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1077. at java.lang.Thread.run(Thread.java:745)
  1078.  
  1079. "RpcServer.reader=1,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad4955800 nid=0x26ad runnable [0x00007f2ac84a8000]
  1080. java.lang.Thread.State: RUNNABLE
  1081. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1082. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1083. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1084. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1085. - locked <0x0000000792d54da8> (a sun.nio.ch.Util$2)
  1086. - locked <0x0000000792d54cd0> (a java.util.Collections$UnmodifiableSet)
  1087. - locked <0x0000000792cf9098> (a sun.nio.ch.EPollSelectorImpl)
  1088. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1089. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1090. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1091. - locked <0x0000000792d54ce8> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1092. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1093. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1094. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1095. at java.lang.Thread.run(Thread.java:745)
  1096.  
  1097. "RpcServer.reader=0,bindAddress=R2,port=16020" daemon prio=10 tid=0x00007f2ad493c000 nid=0x26ac runnable [0x00007f2ad0347000]
  1098. java.lang.Thread.State: RUNNABLE
  1099. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  1100. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
  1101. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  1102. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  1103. - locked <0x0000000792dfb408> (a sun.nio.ch.Util$2)
  1104. - locked <0x0000000792dfb3c0> (a java.util.Collections$UnmodifiableSet)
  1105. - locked <0x0000000792cdb120> (a sun.nio.ch.EPollSelectorImpl)
  1106. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  1107. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
  1108. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:571)
  1109. - locked <0x0000000792dfb390> (a org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader)
  1110. at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:558)
  1111. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  1112. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  1113. at java.lang.Thread.run(Thread.java:745)
  1114.  
  1115. "Service Thread" daemon prio=10 tid=0x00007f2ad4116000 nid=0x26a4 runnable [0x0000000000000000]
  1116. java.lang.Thread.State: RUNNABLE
  1117.  
  1118. "C2 CompilerThread1" daemon prio=10 tid=0x00007f2ad4113000 nid=0x26a3 waiting on condition [0x0000000000000000]
  1119. java.lang.Thread.State: RUNNABLE
  1120.  
  1121. "C2 CompilerThread0" daemon prio=10 tid=0x00007f2ad4111000 nid=0x26a2 waiting on condition [0x0000000000000000]
  1122. java.lang.Thread.State: RUNNABLE
  1123.  
  1124. "Signal Dispatcher" daemon prio=10 tid=0x00007f2ad410e800 nid=0x26a1 runnable [0x0000000000000000]
  1125. java.lang.Thread.State: RUNNABLE
  1126.  
  1127. "Surrogate Locker Thread (Concurrent GC)" daemon prio=10 tid=0x00007f2ad4104800 nid=0x26a0 waiting on condition [0x0000000000000000]
  1128. java.lang.Thread.State: RUNNABLE
  1129.  
  1130. "Finalizer" daemon prio=10 tid=0x00007f2ad40ed000 nid=0x269f in Object.wait() [0x00007f2ad8744000]
  1131. java.lang.Thread.State: WAITING (on object monitor)
  1132. at java.lang.Object.wait(Native Method)
  1133. - waiting on <0x0000000792b5f518> (a java.lang.ref.ReferenceQueue$Lock)
  1134. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
  1135. - locked <0x0000000792b5f518> (a java.lang.ref.ReferenceQueue$Lock)
  1136. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
  1137. at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
  1138.  
  1139. "Reference Handler" daemon prio=10 tid=0x00007f2ad40e9000 nid=0x269e in Object.wait() [0x00007f2ad8845000]
  1140. java.lang.Thread.State: WAITING (on object monitor)
  1141. at java.lang.Object.wait(Native Method)
  1142. - waiting on <0x0000000792b5f428> (a java.lang.ref.Reference$Lock)
  1143. at java.lang.Object.wait(Object.java:503)
  1144. at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
  1145. - locked <0x0000000792b5f428> (a java.lang.ref.Reference$Lock)
  1146.  
  1147. "main" prio=10 tid=0x00007f2ad400c000 nid=0x2697 in Object.wait() [0x00007f2adb45e000]
  1148. java.lang.Thread.State: WAITING (on object monitor)
  1149. at java.lang.Object.wait(Native Method)
  1150. - waiting on <0x0000000792c32620> (a java.lang.Thread)
  1151. at java.lang.Thread.join(Thread.java:1281)
  1152. - locked <0x0000000792c32620> (a java.lang.Thread)
  1153. at java.lang.Thread.join(Thread.java:1355)
  1154. at org.apache.hadoop.hbase.util.HasThread.join(HasThread.java:89)
  1155. at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:204)
  1156. at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
  1157. at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
  1158. at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
  1159. at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1996)
  1160.  
  1161. "VM Thread" prio=10 tid=0x00007f2ad40e6800 nid=0x269d runnable
  1162.  
  1163. "Gang worker#0 (Parallel GC Threads)" prio=10 tid=0x00007f2ad401d000 nid=0x2698 runnable
  1164.  
  1165. "Gang worker#1 (Parallel GC Threads)" prio=10 tid=0x00007f2ad401f000 nid=0x2699 runnable
  1166.  
  1167. "Gang worker#2 (Parallel GC Threads)" prio=10 tid=0x00007f2ad4021000 nid=0x269a runnable
  1168.  
  1169. "Gang worker#3 (Parallel GC Threads)" prio=10 tid=0x00007f2ad4023000 nid=0x269b runnable
  1170.  
  1171. "Concurrent Mark-Sweep GC Thread" prio=10 tid=0x00007f2ad40a3000 nid=0x269c runnable
  1172. "VM Periodic Task Thread" prio=10 tid=0x00007f2ad4129000 nid=0x26a5 waiting on condition
  1173.  
  1174. JNI global references: 258
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!