API tools faq
paste
Advertisement
tha-dude

es_client_hangs_addTransportAddress

tha-dude
Mar 27th, 2014
61
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 37.19 KB | None | 0 0
raw download clone embed print report
  1. 2014-03-27 12:48:19
  2. Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.0-b56 mixed mode):
  3.  
  4. "elasticsearch[Sun Girl][management][T#5]" daemon prio=10 tid=0x00007ff9d804f000 nid=0x4d91 waiting on condition [0x00007ff9c3d50000]
  5. java.lang.Thread.State: TIMED_WAITING (parking)
  6. at sun.misc.Unsafe.park(Native Method)
  7. - parking to wait for <0x00000000a28302c0> (a org.elasticsearch.common.util.concurrent.EsExecutors$ExecutorScalingQueue)
  8. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  9. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:702)
  10. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.xfer(LinkedTransferQueue.java:615)
  11. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.poll(LinkedTransferQueue.java:1117)
  12. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  13. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  14. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  15. at java.lang.Thread.run(Thread.java:724)
  16.  
  17. "elasticsearch[Sun Girl][management][T#4]" daemon prio=10 tid=0x00007ff9d804d800 nid=0x4d90 waiting on condition [0x00007ff9c3e51000]
  18. java.lang.Thread.State: TIMED_WAITING (parking)
  19. at sun.misc.Unsafe.park(Native Method)
  20. - parking to wait for <0x00000000a28302c0> (a org.elasticsearch.common.util.concurrent.EsExecutors$ExecutorScalingQueue)
  21. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  22. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:702)
  23. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.xfer(LinkedTransferQueue.java:615)
  24. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.poll(LinkedTransferQueue.java:1117)
  25. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  26. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  27. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  28. at java.lang.Thread.run(Thread.java:724)
  29.  
  30. "elasticsearch[Sun Girl][management][T#3]" daemon prio=10 tid=0x00007ff9d804c000 nid=0x4d8f in Object.wait() [0x00007ff9c3f52000]
  31. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  32. at java.lang.Object.wait(Native Method)
  33. - waiting on <0x000000009b69db70> (a org.elasticsearch.common.netty.channel.DefaultChannelFuture)
  34. at java.lang.Object.wait(Object.java:461)
  35. at org.elasticsearch.common.netty.channel.DefaultChannelFuture.await0(DefaultChannelFuture.java:311)
  36. - locked <0x000000009b69db70> (a org.elasticsearch.common.netty.channel.DefaultChannelFuture)
  37. at org.elasticsearch.common.netty.channel.DefaultChannelFuture.awaitUninterruptibly(DefaultChannelFuture.java:285)
  38. at org.elasticsearch.transport.netty.NettyTransport.connectToChannelsLight(NettyTransport.java:681)
  39. at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:643)
  40. at org.elasticsearch.transport.netty.NettyTransport.connectToNodeLight(NettyTransport.java:610)
  41. at org.elasticsearch.transport.TransportService.connectToNodeLight(TransportService.java:133)
  42. at org.elasticsearch.client.transport.TransportClientNodesService$SniffNodesSampler$1.run(TransportClientNodesService.java:425)
  43. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  44. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  45. at java.lang.Thread.run(Thread.java:724)
  46.  
  47. "elasticsearch[Sun Girl][management][T#2]" daemon prio=10 tid=0x00007ff9d804a800 nid=0x4d8e waiting on condition [0x00007ff9c4053000]
  48. java.lang.Thread.State: TIMED_WAITING (parking)
  49. at sun.misc.Unsafe.park(Native Method)
  50. - parking to wait for <0x00000000a28302c0> (a org.elasticsearch.common.util.concurrent.EsExecutors$ExecutorScalingQueue)
  51. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  52. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:702)
  53. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.xfer(LinkedTransferQueue.java:615)
  54. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.poll(LinkedTransferQueue.java:1117)
  55. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  56. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  57. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  58. at java.lang.Thread.run(Thread.java:724)
  59.  
  60. "elasticsearch[Sun Girl][generic][T#1]" daemon prio=10 tid=0x00007ff9d40f9800 nid=0x4d36 waiting for monitor entry [0x00007ff9c55d2000]
  61. java.lang.Thread.State: BLOCKED (on object monitor)
  62. at org.elasticsearch.client.transport.TransportClientNodesService$NodeSampler.sample(TransportClientNodesService.java:298)
  63. - waiting to lock <0x00000000a29072a8> (a java.lang.Object)
  64. at org.elasticsearch.client.transport.TransportClientNodesService$ScheduledNodeSampler.run(TransportClientNodesService.java:334)
  65. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  66. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  67. at java.lang.Thread.run(Thread.java:724)
  68.  
  69. "elasticsearch[Sun Girl][transport_client_timer][T#1]{Hashed wheel timer #1}" daemon prio=10 tid=0x0000000002108000 nid=0x4d35 waiting on condition [0x00007ff9c4154000]
  70. java.lang.Thread.State: TIMED_WAITING (sleeping)
  71. at java.lang.Thread.sleep(Native Method)
  72. at org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:483)
  73. at org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:392)
  74. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  75. at java.lang.Thread.run(Thread.java:724)
  76.  
  77. "elasticsearch[Sun Girl][management][T#1]" daemon prio=10 tid=0x00007ff9dd07d000 nid=0x4d34 waiting on condition [0x00007ff9c4255000]
  78. java.lang.Thread.State: TIMED_WAITING (parking)
  79. at sun.misc.Unsafe.park(Native Method)
  80. - parking to wait for <0x00000000a28302c0> (a org.elasticsearch.common.util.concurrent.EsExecutors$ExecutorScalingQueue)
  81. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  82. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:702)
  83. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.xfer(LinkedTransferQueue.java:615)
  84. at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.poll(LinkedTransferQueue.java:1117)
  85. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  86. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  87. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  88. at java.lang.Thread.run(Thread.java:724)
  89.  
  90. "elasticsearch[Sun Girl][transport_client_boss][T#1]{New I/O boss #9}" daemon prio=10 tid=0x00007ff9dd03d000 nid=0x4d33 runnable [0x00007ff9c4356000]
  91. java.lang.Thread.State: RUNNABLE
  92. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  93. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  94. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  95. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  96. - locked <0x00000000a2907440> (a sun.nio.ch.Util$2)
  97. - locked <0x00000000a2907450> (a java.util.Collections$UnmodifiableSet)
  98. - locked <0x00000000a29073f8> (a sun.nio.ch.EPollSelectorImpl)
  99. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  100. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  101. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  102. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  103. at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
  104. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  105. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  106. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  107. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  108. at java.lang.Thread.run(Thread.java:724)
  109.  
  110. "elasticsearch[Sun Girl][transport_client_worker][T#8]{New I/O worker #8}" daemon prio=10 tid=0x00007ff9dd33e000 nid=0x4d32 runnable [0x00007ff9c4457000]
  111. java.lang.Thread.State: RUNNABLE
  112. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  113. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  114. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  115. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  116. - locked <0x00000000a2830760> (a sun.nio.ch.Util$2)
  117. - locked <0x00000000a2830770> (a java.util.Collections$UnmodifiableSet)
  118. - locked <0x00000000a2830718> (a sun.nio.ch.EPollSelectorImpl)
  119. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  120. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  121. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  122. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  123. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
  124. at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
  125. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  126. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  127. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  128. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  129. at java.lang.Thread.run(Thread.java:724)
  130.  
  131. "elasticsearch[Sun Girl][transport_client_worker][T#7]{New I/O worker #7}" daemon prio=10 tid=0x00007ff9dc24f800 nid=0x4d31 runnable [0x00007ff9c4558000]
  132. java.lang.Thread.State: RUNNABLE
  133. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  134. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  135. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  136. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  137. - locked <0x00000000a29076c0> (a sun.nio.ch.Util$2)
  138. - locked <0x00000000a29076d0> (a java.util.Collections$UnmodifiableSet)
  139. - locked <0x00000000a2907678> (a sun.nio.ch.EPollSelectorImpl)
  140. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  141. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  142. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  143. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  144. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
  145. at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
  146. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  147. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  148. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  149. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  150. at java.lang.Thread.run(Thread.java:724)
  151.  
  152. "elasticsearch[Sun Girl][transport_client_worker][T#6]{New I/O worker #6}" daemon prio=10 tid=0x00007ff9dc24e000 nid=0x4d30 runnable [0x00007ff9c4659000]
  153. java.lang.Thread.State: RUNNABLE
  154. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  155. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  156. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  157. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  158. - locked <0x00000000a2830ac0> (a sun.nio.ch.Util$2)
  159. - locked <0x00000000a2830ab0> (a java.util.Collections$UnmodifiableSet)
  160. - locked <0x00000000a2830a28> (a sun.nio.ch.EPollSelectorImpl)
  161. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  162. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  163. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  164. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  165. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
  166. at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
  167. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  168. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  169. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  170. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  171. at java.lang.Thread.run(Thread.java:724)
  172.  
  173. "elasticsearch[Sun Girl][transport_client_worker][T#5]{New I/O worker #5}" daemon prio=10 tid=0x00007ff9dc256000 nid=0x4d2f runnable [0x00007ff9c475a000]
  174. java.lang.Thread.State: RUNNABLE
  175. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  176. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  177. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  178. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  179. - locked <0x00000000a2907a78> (a sun.nio.ch.Util$2)
  180. - locked <0x00000000a2907a68> (a java.util.Collections$UnmodifiableSet)
  181. - locked <0x00000000a29079e0> (a sun.nio.ch.EPollSelectorImpl)
  182. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  183. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  184. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  185. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  186. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
  187. at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
  188. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  189. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  190. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  191. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  192. at java.lang.Thread.run(Thread.java:724)
  193.  
  194. "elasticsearch[Sun Girl][transport_client_worker][T#4]{New I/O worker #4}" daemon prio=10 tid=0x00007ff9dc254800 nid=0x4d2e runnable [0x00007ff9c485b000]
  195. java.lang.Thread.State: RUNNABLE
  196. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  197. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  198. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  199. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  200. - locked <0x00000000a29de198> (a sun.nio.ch.Util$2)
  201. - locked <0x00000000a29de1a8> (a java.util.Collections$UnmodifiableSet)
  202. - locked <0x00000000a29de150> (a sun.nio.ch.EPollSelectorImpl)
  203. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  204. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  205. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  206. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  207. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
  208. at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
  209. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  210. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  211. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  212. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  213. at java.lang.Thread.run(Thread.java:724)
  214.  
  215. "elasticsearch[Sun Girl][transport_client_worker][T#3]{New I/O worker #3}" daemon prio=10 tid=0x00007ff9dc259000 nid=0x4d2d runnable [0x00007ff9c495c000]
  216. java.lang.Thread.State: RUNNABLE
  217. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  218. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  219. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  220. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  221. - locked <0x00000000a29de380> (a sun.nio.ch.Util$2)
  222. - locked <0x00000000a29de390> (a java.util.Collections$UnmodifiableSet)
  223. - locked <0x00000000a29de338> (a sun.nio.ch.EPollSelectorImpl)
  224. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  225. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  226. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  227. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  228. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
  229. at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
  230. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  231. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  232. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  233. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  234. at java.lang.Thread.run(Thread.java:724)
  235.  
  236. "elasticsearch[Sun Girl][transport_client_worker][T#2]{New I/O worker #2}" daemon prio=10 tid=0x00007ff9dc258000 nid=0x4d2c runnable [0x00007ff9c4c5f000]
  237. java.lang.Thread.State: RUNNABLE
  238. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  239. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  240. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  241. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  242. - locked <0x00000000a2ab51e8> (a sun.nio.ch.Util$2)
  243. - locked <0x00000000a2ab51f8> (a java.util.Collections$UnmodifiableSet)
  244. - locked <0x00000000a2ab51a0> (a sun.nio.ch.EPollSelectorImpl)
  245. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  246. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  247. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  248. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  249. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
  250. at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
  251. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  252. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  253. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  254. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  255. at java.lang.Thread.run(Thread.java:724)
  256.  
  257. "elasticsearch[Sun Girl][transport_client_worker][T#1]{New I/O worker #1}" daemon prio=10 tid=0x00007ff9dc253000 nid=0x4d2b runnable [0x00007ff9c56d3000]
  258. java.lang.Thread.State: RUNNABLE
  259. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  260. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  261. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  262. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  263. - locked <0x00000000a29de568> (a sun.nio.ch.Util$2)
  264. - locked <0x00000000a29de578> (a java.util.Collections$UnmodifiableSet)
  265. - locked <0x00000000a29de520> (a sun.nio.ch.EPollSelectorImpl)
  266. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  267. at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68)
  268. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415)
  269. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212)
  270. at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
  271. at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
  272. at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  273. at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
  274. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  275. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  276. at java.lang.Thread.run(Thread.java:724)
  277.  
  278. "elasticsearch[Sun Girl][scheduler][T#1]" daemon prio=10 tid=0x00007ff9dc248000 nid=0x4d2a waiting on condition [0x00007ff9c5265000]
  279. java.lang.Thread.State: TIMED_WAITING (parking)
  280. at sun.misc.Unsafe.park(Native Method)
  281. - parking to wait for <0x00000000a2909cc8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  282. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  283. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
  284. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
  285. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  286. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  287. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  288. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  289. at java.lang.Thread.run(Thread.java:724)
  290.  
  291. "elasticsearch[Sun Girl][[timer]]" daemon prio=10 tid=0x00007ff9dc23c000 nid=0x4d29 waiting on condition [0x00007ff9c54d1000]
  292. java.lang.Thread.State: TIMED_WAITING (sleeping)
  293. at java.lang.Thread.sleep(Native Method)
  294. at org.elasticsearch.threadpool.ThreadPool$EstimatedTimeThread.run(ThreadPool.java:514)
  295.  
  296. "ReplicaSetStatus:Updater" daemon prio=10 tid=0x00007ff9d4360800 nid=0x4d27 waiting on condition [0x00007ff9c4a5d000]
  297. java.lang.Thread.State: TIMED_WAITING (sleeping)
  298. at java.lang.Thread.sleep(Native Method)
  299. at com.mongodb.ReplicaSetStatus$Updater.run(ReplicaSetStatus.java:749)
  300.  
  301. "MongoCleaner348440535" daemon prio=10 tid=0x00007ff9dc36c000 nid=0x4d26 waiting on condition [0x00007ff9c4b5e000]
  302. java.lang.Thread.State: TIMED_WAITING (sleeping)
  303. at java.lang.Thread.sleep(Native Method)
  304. at com.mongodb.Mongo$CursorCleanerThread.run(Mongo.java:770)
  305.  
  306. "GC Daemon" daemon prio=10 tid=0x00007ff9dcee0000 nid=0x4d24 in Object.wait() [0x00007ff9c4d60000]
  307. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  308. at java.lang.Object.wait(Native Method)
  309. - waiting on <0x00000000c9996708> (a sun.misc.GC$LatencyLock)
  310. at sun.misc.GC$Daemon.run(GC.java:117)
  311. - locked <0x00000000c9996708> (a sun.misc.GC$LatencyLock)
  312.  
  313. "RMI RenewClean-[10.240.6.39:54520]" daemon prio=10 tid=0x00007ff9dcedf000 nid=0x4d23 in Object.wait() [0x00007ff9c4e61000]
  314. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  315. at java.lang.Object.wait(Native Method)
  316. - waiting on <0x00000000c9996720> (a java.lang.ref.ReferenceQueue$Lock)
  317. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
  318. - locked <0x00000000c9996720> (a java.lang.ref.ReferenceQueue$Lock)
  319. at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:535)
  320. at java.lang.Thread.run(Thread.java:724)
  321.  
  322. "RMI Scheduler(0)" daemon prio=10 tid=0x00007ff9dcabc000 nid=0x4d22 waiting on condition [0x00007ff9c4f62000]
  323. java.lang.Thread.State: WAITING (parking)
  324. at sun.misc.Unsafe.park(Native Method)
  325. - parking to wait for <0x00000000b0a69810> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  326. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  327. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  328. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
  329. at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
  330. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  331. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  332. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  333. at java.lang.Thread.run(Thread.java:724)
  334.  
  335. "Timer-0" daemon prio=10 tid=0x00007ff9dd3c2000 nid=0x4d21 in Object.wait() [0x00007ff9c5063000]
  336. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  337. at java.lang.Object.wait(Native Method)
  338. - waiting on <0x00000000c9996780> (a java.util.TaskQueue)
  339. at java.util.TimerThread.mainLoop(Timer.java:552)
  340. - locked <0x00000000c9996780> (a java.util.TaskQueue)
  341. at java.util.TimerThread.run(Timer.java:505)
  342.  
  343. "SpillThread" daemon prio=10 tid=0x00007ff9dd536000 nid=0x4d12 waiting on condition [0x00007ff9c5164000]
  344. java.lang.Thread.State: WAITING (parking)
  345. at sun.misc.Unsafe.park(Native Method)
  346. - parking to wait for <0x00000000b0e163f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  347. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  348. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  349. at org.apache.hadoop.mapred.MapTask$MapOutputBuffer$SpillThread.run(MapTask.java:1218)
  350.  
  351. "main-EventThread" daemon prio=10 tid=0x00007ff9dcb64800 nid=0x4d0b waiting on condition [0x00007ff9c57d4000]
  352. java.lang.Thread.State: WAITING (parking)
  353. at sun.misc.Unsafe.park(Native Method)
  354. - parking to wait for <0x00000000b0c72c00> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  355. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  356. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
  357. at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
  358. at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
  359.  
  360. "main-SendThread(ezbig-002.c.silent-window-270.internal:2181)" daemon prio=10 tid=0x00007ff9dcb64000 nid=0x4d0a runnable [0x00007ff9c58d5000]
  361. java.lang.Thread.State: RUNNABLE
  362. at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
  363. at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:257)
  364. at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
  365. at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
  366. - locked <0x00000000b0c72c48> (a sun.nio.ch.Util$2)
  367. - locked <0x00000000b0c72c60> (a java.util.Collections$UnmodifiableSet)
  368. - locked <0x00000000b0be3068> (a sun.nio.ch.EPollSelectorImpl)
  369. at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
  370. at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
  371. at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
  372.  
  373. "communication thread" daemon prio=10 tid=0x00007ff9dcfd7000 nid=0x4d02 in Object.wait() [0x00007ff9c59d6000]
  374. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  375. at java.lang.Object.wait(Native Method)
  376. - waiting on <0x00000000b0c53c40> (a java.lang.Object)
  377. at org.apache.hadoop.mapred.Task$TaskReporter.run(Task.java:659)
  378. - locked <0x00000000b0c53c40> (a java.lang.Object)
  379. at java.lang.Thread.run(Thread.java:724)
  380.  
  381. "Timer thread for monitoring jvm" daemon prio=10 tid=0x00007ff9dc429800 nid=0x4d01 in Object.wait() [0x00007ff9c5cdd000]
  382. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  383. at java.lang.Object.wait(Native Method)
  384. - waiting on <0x00000000b0c72c78> (a java.util.TaskQueue)
  385. at java.util.TimerThread.mainLoop(Timer.java:552)
  386. - locked <0x00000000b0c72c78> (a java.util.TaskQueue)
  387. at java.util.TimerThread.run(Timer.java:505)
  388.  
  389. "IPC Parameter Sending Thread #0" daemon prio=10 tid=0x00007ff9dcd84800 nid=0x4cef waiting on condition [0x00007ff9c5dde000]
  390. java.lang.Thread.State: TIMED_WAITING (parking)
  391. at sun.misc.Unsafe.park(Native Method)
  392. - parking to wait for <0x00000000afb485a8> (a java.util.concurrent.SynchronousQueue$TransferStack)
  393. at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
  394. at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
  395. at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
  396. at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
  397. at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
  398. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
  399. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  400. at java.lang.Thread.run(Thread.java:724)
  401.  
  402. "IPC Client (549107024) connection to /127.0.0.1:33887 from job_201403201304_1043" daemon prio=10 tid=0x00007ff9dcc5b800 nid=0x4cee in Object.wait() [0x00007ff9c5edf000]
  403. java.lang.Thread.State: TIMED_WAITING (on object monitor)
  404. at java.lang.Object.wait(Native Method)
  405. - waiting on <0x00000000afb4fbc8> (a org.apache.hadoop.ipc.Client$Connection)
  406. at org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:803)
  407. - locked <0x00000000afb4fbc8> (a org.apache.hadoop.ipc.Client$Connection)
  408. at org.apache.hadoop.ipc.Client$Connection.run(Client.java:846)
  409.  
  410. "Thread for syncLogs" daemon prio=10 tid=0x00007ff9dcbf0000 nid=0x4ced waiting on condition [0x00007ff9c5fe0000]
  411. java.lang.Thread.State: TIMED_WAITING (sleeping)
  412. at java.lang.Thread.sleep(Native Method)
  413. at org.apache.hadoop.mapred.Child$3.run(Child.java:156)
  414.  
  415. "RMI TCP Accept-0" daemon prio=10 tid=0x00007ff9dc8b2000 nid=0x4ceb runnable [0x00007ff9c66de000]
  416. java.lang.Thread.State: RUNNABLE
  417. at java.net.PlainSocketImpl.socketAccept(Native Method)
  418. at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
  419. at java.net.ServerSocket.implAccept(ServerSocket.java:530)
  420. at java.net.ServerSocket.accept(ServerSocket.java:498)
  421. at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
  422. at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:388)
  423. at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:360)
  424. at java.lang.Thread.run(Thread.java:724)
  425.  
  426. "RMI TCP Accept-0" daemon prio=10 tid=0x00007ff9dc8a2000 nid=0x4cea runnable [0x00007ff9c67df000]
  427. java.lang.Thread.State: RUNNABLE
  428. at java.net.PlainSocketImpl.socketAccept(Native Method)
  429. at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
  430. at java.net.ServerSocket.implAccept(ServerSocket.java:530)
  431. at java.net.ServerSocket.accept(ServerSocket.java:498)
  432. at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:388)
  433. at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:360)
  434. at java.lang.Thread.run(Thread.java:724)
  435.  
  436. "Service Thread" daemon prio=10 tid=0x00007ff9dc211800 nid=0x4ce9 runnable [0x0000000000000000]
  437. java.lang.Thread.State: RUNNABLE
  438.  
  439. "C2 CompilerThread1" daemon prio=10 tid=0x00007ff9dc20e800 nid=0x4ce8 waiting on condition [0x0000000000000000]
  440. java.lang.Thread.State: RUNNABLE
  441.  
  442. "C2 CompilerThread0" daemon prio=10 tid=0x00007ff9dc200800 nid=0x4ce7 waiting on condition [0x0000000000000000]
  443. java.lang.Thread.State: RUNNABLE
  444.  
  445. "VM JFR Buffer Thread" daemon prio=10 tid=0x00007ff9dc20d000 nid=0x4ce6 waiting on condition [0x0000000000000000]
  446. java.lang.Thread.State: RUNNABLE
  447.  
  448. "JFR request timer" daemon prio=10 tid=0x00007ff9dc12b800 nid=0x4ce2 in Object.wait() [0x00007ff9c8192000]
  449. java.lang.Thread.State: WAITING (on object monitor)
  450. at java.lang.Object.wait(Native Method)
  451. - waiting on <0x00000000afb56360> (a java.util.TaskQueue)
  452. at java.lang.Object.wait(Object.java:503)
  453. at java.util.TimerThread.mainLoop(Timer.java:526)
  454. - locked <0x00000000afb56360> (a java.util.TaskQueue)
  455. at java.util.TimerThread.run(Timer.java:505)
  456.  
  457. "Signal Dispatcher" daemon prio=10 tid=0x00007ff9dc125800 nid=0x4ce1 waiting on condition [0x0000000000000000]
  458. java.lang.Thread.State: RUNNABLE
  459.  
  460. "Surrogate Locker Thread (Concurrent GC)" daemon prio=10 tid=0x00007ff9dc123800 nid=0x4ce0 waiting on condition [0x0000000000000000]
  461. java.lang.Thread.State: RUNNABLE
  462.  
  463. "Finalizer" daemon prio=10 tid=0x00007ff9dc0f3000 nid=0x4cdf in Object.wait() [0x00007ff9cef67000]
  464. java.lang.Thread.State: WAITING (on object monitor)
  465. at java.lang.Object.wait(Native Method)
  466. - waiting on <0x00000000afb56378> (a java.lang.ref.ReferenceQueue$Lock)
  467. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
  468. - locked <0x00000000afb56378> (a java.lang.ref.ReferenceQueue$Lock)
  469. at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
  470. at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
  471.  
  472. "Reference Handler" daemon prio=10 tid=0x00007ff9dc0ef000 nid=0x4cde in Object.wait() [0x00007ff9cf068000]
  473. java.lang.Thread.State: WAITING (on object monitor)
  474. at java.lang.Object.wait(Native Method)
  475. - waiting on <0x00000000afb56390> (a java.lang.ref.Reference$Lock)
  476. at java.lang.Object.wait(Object.java:503)
  477. at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
  478. - locked <0x00000000afb56390> (a java.lang.ref.Reference$Lock)
  479.  
  480. "main" prio=10 tid=0x00007ff9dc012000 nid=0x4cd7 waiting on condition [0x00007ff9e3ed9000]
  481. java.lang.Thread.State: WAITING (parking)
  482. at sun.misc.Unsafe.park(Native Method)
  483. - parking to wait for <0x000000009b518ba0> (a java.util.concurrent.CountDownLatch$Sync)
  484. at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  485. at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
  486. at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
  487. at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
  488. at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236)
  489. at org.elasticsearch.client.transport.TransportClientNodesService$SniffNodesSampler.doSample(TransportClientNodesService.java:472)
  490. at org.elasticsearch.client.transport.TransportClientNodesService$NodeSampler.sample(TransportClientNodesService.java:301)
  491. - locked <0x00000000a29072a8> (a java.lang.Object)
  492. at org.elasticsearch.client.transport.TransportClientNodesService.addTransportAddresses(TransportClientNodesService.java:169)
  493. - locked <0x00000000a29072a8> (a java.lang.Object)
  494. at org.elasticsearch.client.transport.TransportClient.addTransportAddress(TransportClient.java:237)
  495. // removed
  496. at com.xxxxxx.data.jobs.XXXXX.XXXXXMapper.setup(XXXXXMapper.java:43)
  497. at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:138)
  498. at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
  499. at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
  500. at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
  501. at java.security.AccessController.doPrivileged(Native Method)
  502. at javax.security.auth.Subject.doAs(Subject.java:415)
  503. at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)
  504. at org.apache.hadoop.mapred.Child.main(Child.java:262)
  505.  
  506. "VM Thread" prio=10 tid=0x00007ff9dc0ec800 nid=0x4cdd runnable
  507.  
  508. "Gang worker#0 (Parallel GC Threads)" prio=10 tid=0x00007ff9dc023800 nid=0x4cd8 runnable
  509.  
  510. "Gang worker#1 (Parallel GC Threads)" prio=10 tid=0x00007ff9dc025000 nid=0x4cd9 runnable
  511.  
  512. "Gang worker#2 (Parallel GC Threads)" prio=10 tid=0x00007ff9dc027000 nid=0x4cda runnable
  513.  
  514. "Gang worker#3 (Parallel GC Threads)" prio=10 tid=0x00007ff9dc029000 nid=0x4cdb runnable
  515.  
  516. "Concurrent Mark-Sweep GC Thread" prio=10 tid=0x00007ff9dc0a9000 nid=0x4cdc runnable
  517. "VM Periodic Task Thread" prio=10 tid=0x00007ff9dc8b3000 nid=0x4cec waiting on condition
  518.  
  519. JNI global references: 247
  520.  
  521. Heap
  522. par new generation total 125120K, used 40053K [0x000000009ae00000, 0x00000000a35c0000, 0x00000000afac0000)
  523. eden space 111232K, 31% used [0x000000009ae00000, 0x000000009d00e7d0, 0x00000000a1aa0000)
  524. from space 13888K, 37% used [0x00000000a2830000, 0x00000000a2d3efd0, 0x00000000a35c0000)
  525. to space 13888K, 0% used [0x00000000a1aa0000, 0x00000000a1aa0000, 0x00000000a2830000)
  526. concurrent mark-sweep generation total 637548K, used 427433K [0x00000000afac0000, 0x00000000d695b000, 0x00000000fae00000)
  527. concurrent-mark-sweep perm gen total 43164K, used 39593K [0x00000000fae00000, 0x00000000fd827000, 0x0000000100000000)
  528.  
  529. [jfr][ERROR][1801.026] Repository could not be removed at shutdown: /disk/mapred/local/taskTracker/jenkins/jobcache/job_201403201304_1043/attempt_201403201304_1043_m_000018_0/work/tmp/2014_03_27_12_18_19_19668
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!