Pastebin
API
tools
faq
paste
Login
Sign up
Please fix the following errors:
New Paste
Syntax Highlighting
Basic info: Date taken: Mon Apr 18 19:04:16 IST 2016 File: C:\Users\rkalhans\Desktop\visualVM\java_pid3448.hprof File size: 5,420.6 MB Total bytes: 5,669,661,223 Total classes: 6,630 Total instances: 1,920,482 Classloaders: 13 GC roots: 1,650 Number of objects pending for finalization: 0 Heap dumped on OutOfMemoryError exception Thread causing OutOfMemoryError exception: elasticsearch[ES-NODE-Q01][http_server_worker][T#3]{New I/O worker #13} Environment: OS: Windows Server 2012 (6.2) Architecture: amd64 64bit Java Home: C:\zulu\jre Java Version: 1.7.0_25 JVM: OpenJDK 64-Bit Server VM (23.25-b03, mixed mode) Java Vendor: Azul Systems, Inc. System properties: Show System Properties Threads at the heap dump: "elasticsearch[ES-NODE-Q01][transport_client_worker][T#3]{New I/O worker #3}" daemon prio=5 tid=19 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: java.util.Collections$UnmodifiableSet#6354 Local Variable: sun.nio.ch.Util$2#4 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#4 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#3 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#14 Local Variable: java.lang.String#42710 Local Variable: java.lang.String#42709 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#13 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#9 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][[http_server_boss.default]][T#1]{New I/O server boss #10}" daemon prio=5 tid=27 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: sun.nio.ch.Util$2#6 Local Variable: java.util.Collections$UnmodifiableSet#6356 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) at org.elasticsearch.common.netty.channel.socket.nio.NioServerBoss.select(NioServerBoss.java:163) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#6 at org.elasticsearch.common.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioServerBoss#1 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#7 Local Variable: java.lang.String#42689 Local Variable: java.lang.String#42688 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: java.util.concurrent.ThreadPoolExecutor#4 Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#6 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#11 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][[http_server_worker.default]][T#2]{New I/O worker #7}" daemon prio=5 tid=24 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: java.util.Collections$UnmodifiableSet#6360 Local Variable: sun.nio.ch.Util$2#10 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#10 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#8 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#10 Local Variable: java.lang.String#42698 Local Variable: java.lang.String#42697 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#9 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#15 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][transport_client_worker][T#4]{New I/O worker #4}" daemon prio=5 tid=20 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: java.util.Collections$UnmodifiableSet#6355 Local Variable: sun.nio.ch.Util$2#5 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#5 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#4 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42706 Local Variable: java.lang.String#42707 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#13 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#12 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#10 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][http_server_boss][T#1]{New I/O server boss #15}" daemon prio=5 tid=40 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: java.util.Collections$UnmodifiableSet#6361 Local Variable: sun.nio.ch.Util$2#11 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) at org.elasticsearch.common.netty.channel.socket.nio.NioServerBoss.select(NioServerBoss.java:163) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#11 at org.elasticsearch.common.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioServerBoss#2 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42671 Local Variable: java.lang.String#42670 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#2 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#1 Local Variable: java.util.concurrent.ThreadPoolExecutor#6 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#16 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][transport_client_worker][T#2]{New I/O worker #2}" daemon prio=5 tid=18 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: java.util.Collections$UnmodifiableSet#6352 Local Variable: sun.nio.ch.Util$2#2 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#2 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#1 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42713 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#15 Local Variable: java.lang.String#42712 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#14 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#7 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][[http_server_worker.default]][T#3]{New I/O worker #8}" daemon prio=5 tid=25 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: java.util.Collections$UnmodifiableSet#6357 Local Variable: sun.nio.ch.Util$2#7 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#7 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#5 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#9 Local Variable: java.lang.String#42695 Local Variable: java.lang.String#42694 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#8 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#13 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][master_mapping_updater]" prio=5 tid=16 TIMED_WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:731) Local Variable: java.util.concurrent.LinkedTransferQueue$Node#1 Local Variable: java.util.concurrent.LinkedTransferQueue$Node#13 Local Variable: java.util.concurrent.ThreadLocalRandom#2 at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:644) at java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1145) Local Variable: java.util.concurrent.TimeUnit$5#1 Local Variable: java.util.concurrent.LinkedTransferQueue#5 at org.elasticsearch.cluster.action.index.MappingUpdatedAction$MasterMappingUpdater.run(MappingUpdatedAction.java:382) Local Variable: java.util.HashMap#7358 "elasticsearch[ES-NODE-Q01][transport_client_worker][T#1]{New I/O worker #1}" daemon prio=5 tid=17 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: java.util.Collections$UnmodifiableSet#6353 Local Variable: sun.nio.ch.Util$2#3 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#3 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#2 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#16 Local Variable: java.lang.String#42716 Local Variable: java.lang.String#42715 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: java.util.concurrent.ThreadPoolExecutor#3 Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#15 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#8 at java.lang.Thread.run(Thread.java:724) "Keep-Alive-Timer" daemon prio=8 tid=1166 TIMED_WAITING at java.lang.Thread.sleep(Native Method) at sun.net.www.http.KeepAliveCache.run(KeepAliveCache.java:172) Local Variable: sun.net.www.http.KeepAliveCache#1 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][transport_client_timer][T#1]{Hashed wheel timer #1}" daemon prio=5 tid=21 TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:445) at org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:364) Local Variable: org.elasticsearch.common.netty.util.HashedWheelTimer$Worker#1 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42685 Local Variable: java.lang.String#42684 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#1 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][transport_client_boss][T#1]{New I/O boss #5}" daemon prio=5 tid=22 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: java.util.Collections$UnmodifiableSet#6351 Local Variable: sun.nio.ch.Util$2#1 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#1 at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss#1 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42703 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#12 Local Variable: java.lang.String#42704 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#11 Local Variable: java.util.concurrent.ThreadPoolExecutor#2 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#6 at java.lang.Thread.run(Thread.java:724) "Reference Handler" daemon prio=10 tid=2 WAITING at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133) "Attach Listener" daemon prio=5 tid=6 RUNNABLE "Signal Dispatcher" daemon prio=9 tid=5 RUNNABLE "elasticsearch[ES-NODE-Q01][generic][T#264]" daemon prio=5 tid=1167 TIMED_WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) Local Variable: java.util.concurrent.SynchronousQueue$TransferStack$SNode#4 at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#2 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][http_server_worker][T#2]{New I/O worker #12}" daemon prio=5 tid=37 RUNNABLE at org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer.duplicate(BigEndianHeapChannelBuffer.java:116) Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#146744 at org.elasticsearch.common.netty.buffer.HeapChannelBuffer.slice(HeapChannelBuffer.java:191) at org.elasticsearch.common.netty.buffer.AbstractChannelBuffer.slice(AbstractChannelBuffer.java:498) at org.elasticsearch.common.netty.buffer.ChannelBuffers.wrappedBuffer(ChannelBuffers.java:441) Local Variable: java.util.ArrayList#666 Local Variable: org.elasticsearch.common.netty.buffer.ChannelBuffer[]#313 Local Variable: java.nio.ByteOrder#1 at org.elasticsearch.common.netty.buffer.ChannelBuffers.wrappedBuffer(ChannelBuffers.java:396) at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.appendToCumulation(HttpChunkAggregator.java:214) at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:175) Local Variable: org.elasticsearch.common.netty.handler.codec.http.DefaultHttpRequest#21 Local Variable: org.elasticsearch.common.netty.buffer.CompositeChannelBuffer#210 Local Variable: org.elasticsearch.common.netty.handler.codec.http.DefaultHttpChunk#87 Local Variable: org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator#8 Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext#53 at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.handler.codec.http.HttpContentDecoder.messageReceived(HttpContentDecoder.java:135) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) Local Variable: org.elasticsearch.common.netty.channel.UpstreamMessageEvent#99 at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459) at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536) Local Variable: java.net.InetSocketAddress#30 Local Variable: org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoderBuffer#8 at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) Local Variable: org.elasticsearch.common.netty.handler.codec.http.HttpRequestDecoder#8 Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#112444 Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext#51 at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline#8 Local Variable: org.elasticsearch.common.netty.channel.UpstreamMessageEvent#80 at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioAcceptedSocketChannel#8 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) Local Variable: sun.nio.ch.SelectionKeyImpl#7 Local Variable: java.util.HashMap$KeyIterator#9 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) Local Variable: sun.nio.ch.WindowsSelectorImpl#15 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#11 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42680 Local Variable: java.lang.String#42679 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#5 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#4 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#20 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][search][T#1]" daemon prio=5 tid=51 WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:735) Local Variable: java.util.concurrent.LinkedTransferQueue$Node#2 Local Variable: java.util.concurrent.LinkedTransferQueue#1 Local Variable: java.util.concurrent.LinkedTransferQueue$Node#3 at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:644) at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1137) at org.elasticsearch.common.util.concurrent.SizeBlockingQueue.take(SizeBlockingQueue.java:162) Local Variable: org.elasticsearch.common.util.concurrent.SizeBlockingQueue#1 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) Local Variable: org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor#1 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#3 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][[http_server_worker.default]][T#1]{New I/O worker #6}" daemon prio=5 tid=23 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: sun.nio.ch.Util$2#9 Local Variable: java.util.Collections$UnmodifiableSet#6359 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#9 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#7 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42700 Local Variable: java.lang.String#42701 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#11 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: java.util.concurrent.ThreadPoolExecutor#5 Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#10 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#14 at java.lang.Thread.run(Thread.java:724) "Finalizer" daemon prio=8 tid=3 WAITING at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135) Local Variable: java.lang.ref.ReferenceQueue#150 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189) "elasticsearch[ES-NODE-Q01][http_server_worker][T#1]{New I/O worker #11}" daemon prio=5 tid=36 RUNNABLE at org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer.duplicate(BigEndianHeapChannelBuffer.java:116) Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#146449 at org.elasticsearch.common.netty.buffer.HeapChannelBuffer.slice(HeapChannelBuffer.java:191) at org.elasticsearch.common.netty.buffer.AbstractChannelBuffer.slice(AbstractChannelBuffer.java:498) at org.elasticsearch.common.netty.buffer.CompositeChannelBuffer.decompose(CompositeChannelBuffer.java:100) Local Variable: java.util.ArrayList#665 at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.appendToCumulation(HttpChunkAggregator.java:210) Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#145962 at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:175) Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext#473 Local Variable: org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator#68 Local Variable: org.elasticsearch.common.netty.buffer.CompositeChannelBuffer#216 Local Variable: org.elasticsearch.common.netty.handler.codec.http.DefaultHttpRequest#31 Local Variable: org.elasticsearch.common.netty.handler.codec.http.DefaultHttpChunk#93 at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.handler.codec.http.HttpContentDecoder.messageReceived(HttpContentDecoder.java:135) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) Local Variable: org.elasticsearch.common.netty.channel.UpstreamMessageEvent#105 at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459) at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536) Local Variable: java.net.InetSocketAddress#282 Local Variable: org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoderBuffer#68 at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#56339 Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext#471 Local Variable: org.elasticsearch.common.netty.handler.codec.http.HttpRequestDecoder#68 at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) Local Variable: org.elasticsearch.common.netty.channel.UpstreamMessageEvent#45 Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline#68 at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioAcceptedSocketChannel#68 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) Local Variable: java.util.HashMap$KeyIterator#11 Local Variable: sun.nio.ch.SelectionKeyImpl#67 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) Local Variable: sun.nio.ch.WindowsSelectorImpl#12 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#9 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42683 Local Variable: java.lang.String#42682 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#6 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#5 Local Variable: java.util.concurrent.ThreadPoolExecutor#7 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#19 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][listener][T#1]" daemon prio=5 tid=50 WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:735) Local Variable: java.util.concurrent.ThreadLocalRandom#1 Local Variable: java.util.concurrent.LinkedTransferQueue$Node#10 Local Variable: java.util.concurrent.LinkedTransferQueue$Node#15 Local Variable: java.util.concurrent.LinkedTransferQueue#2 at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:644) at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1137) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) Local Variable: org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor#2 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#4 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][[http_server_worker.default]][T#4]{New I/O worker #9}" daemon prio=5 tid=26 RUNNABLE at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:295) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:277) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:158) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) Local Variable: sun.nio.ch.Util$2#8 Local Variable: java.util.Collections$UnmodifiableSet#6358 at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:434) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) Local Variable: sun.nio.ch.WindowsSelectorImpl#8 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#6 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#8 Local Variable: java.lang.String#42692 Local Variable: java.lang.String#42691 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#7 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#12 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][http_server_worker][T#4]{New I/O worker #14}" daemon prio=5 tid=39 RUNNABLE at org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer.duplicate(BigEndianHeapChannelBuffer.java:116) Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#143559 at org.elasticsearch.common.netty.buffer.HeapChannelBuffer.slice(HeapChannelBuffer.java:191) at org.elasticsearch.common.netty.buffer.AbstractChannelBuffer.slice(AbstractChannelBuffer.java:498) at org.elasticsearch.common.netty.buffer.ChannelBuffers.wrappedBuffer(ChannelBuffers.java:441) Local Variable: java.util.ArrayList#664 Local Variable: org.elasticsearch.common.netty.buffer.ChannelBuffer[]#311 at org.elasticsearch.common.netty.buffer.ChannelBuffers.wrappedBuffer(ChannelBuffers.java:396) at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.appendToCumulation(HttpChunkAggregator.java:214) at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:175) Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext#382 Local Variable: org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator#55 Local Variable: org.elasticsearch.common.netty.buffer.CompositeChannelBuffer#214 Local Variable: org.elasticsearch.common.netty.handler.codec.http.DefaultHttpRequest#30 Local Variable: org.elasticsearch.common.netty.handler.codec.http.DefaultHttpChunk#91 at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.handler.codec.http.HttpContentDecoder.messageReceived(HttpContentDecoder.java:135) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) Local Variable: org.elasticsearch.common.netty.channel.UpstreamMessageEvent#103 at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459) at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536) Local Variable: org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoderBuffer#55 Local Variable: java.net.InetSocketAddress#220 at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext#380 Local Variable: org.elasticsearch.common.netty.handler.codec.http.HttpRequestDecoder#55 Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#60219 at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline#55 Local Variable: org.elasticsearch.common.netty.channel.UpstreamMessageEvent#50 at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioAcceptedSocketChannel#55 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) Local Variable: java.util.HashMap$KeyIterator#10 Local Variable: sun.nio.ch.SelectionKeyImpl#55 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) Local Variable: sun.nio.ch.WindowsSelectorImpl#14 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#12 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: java.lang.String#42674 Local Variable: java.lang.String#42673 Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#3 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#2 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#18 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][[timer]]" daemon prio=5 tid=10 TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.elasticsearch.threadpool.ThreadPool$EstimatedTimeThread.run(ThreadPool.java:586) "elasticsearch[ES-NODE-Q01][http_server_worker][T#3]{New I/O worker #13}" daemon prio=5 tid=38 RUNNABLE at java.lang.OutOfMemoryError.<init>(OutOfMemoryError.java:48) at org.elasticsearch.common.netty.buffer.HeapChannelBuffer.<init>(HeapChannelBuffer.java:42) at org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer.<init>(BigEndianHeapChannelBuffer.java:34) at org.elasticsearch.common.netty.buffer.ChannelBuffers.buffer(ChannelBuffers.java:134) at org.elasticsearch.common.netty.buffer.HeapChannelBufferFactory.getBuffer(HeapChannelBufferFactory.java:68) at org.elasticsearch.common.netty.buffer.CompositeChannelBuffer.copy(CompositeChannelBuffer.java:568) at org.elasticsearch.common.netty.buffer.AbstractChannelBuffer.copy(AbstractChannelBuffer.java:494) at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.appendToCumulation(HttpChunkAggregator.java:208) Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#13357 at org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:175) Local Variable: org.elasticsearch.common.netty.handler.codec.http.DefaultHttpRequest#20 Local Variable: org.elasticsearch.common.netty.handler.codec.http.DefaultHttpChunk#2 Local Variable: org.elasticsearch.common.netty.handler.codec.http.HttpChunkAggregator#40 Local Variable: org.elasticsearch.common.netty.buffer.CompositeChannelBuffer#174 Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext#277 at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.handler.codec.http.HttpContentDecoder.messageReceived(HttpContentDecoder.java:135) at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) Local Variable: org.elasticsearch.common.netty.channel.UpstreamMessageEvent#2 at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459) at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536) Local Variable: org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoderBuffer#40 Local Variable: java.net.InetSocketAddress#154 at org.elasticsearch.common.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435) Local Variable: org.elasticsearch.common.netty.buffer.BigEndianHeapChannelBuffer#13356 Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext#275 Local Variable: org.elasticsearch.common.netty.handler.codec.http.HttpRequestDecoder#40 at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) at org.elasticsearch.common.netty.OpenChannelsHandler.handleUpstream(OpenChannelsHandler.java:74) at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) Local Variable: org.elasticsearch.common.netty.channel.UpstreamMessageEvent#1 Local Variable: org.elasticsearch.common.netty.channel.DefaultChannelPipeline#40 at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioAcceptedSocketChannel#40 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) Local Variable: java.util.HashMap$KeyIterator#1 Local Variable: sun.nio.ch.SelectionKeyImpl#39 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) Local Variable: sun.nio.ch.WindowsSelectorImpl#13 at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) Local Variable: org.elasticsearch.common.netty.channel.socket.nio.NioWorker#10 at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) Local Variable: org.elasticsearch.common.netty.util.ThreadRenamingRunnable#4 Local Variable: java.lang.String#42677 Local Variable: java.lang.String#42676 at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) Local Variable: org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1#3 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#17 at java.lang.Thread.run(Thread.java:724) "elasticsearch[keepAlive/1.7.1-SNAPSHOT]" prio=5 tid=42 WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) Local Variable: java.util.concurrent.locks.AbstractQueuedSynchronizer$Node#10 Local Variable: java.util.concurrent.locks.AbstractQueuedSynchronizer$Node#11 at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) Local Variable: java.util.concurrent.CountDownLatch$Sync#4 at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236) Local Variable: java.util.concurrent.CountDownLatch#2 at org.elasticsearch.bootstrap.Bootstrap$4.run(Bootstrap.java:267) Local Variable: org.elasticsearch.bootstrap.Bootstrap$4#1 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][generic][T#260]" daemon prio=5 tid=1155 TIMED_WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) Local Variable: java.util.concurrent.SynchronousQueue$TransferStack#1 Local Variable: java.util.concurrent.SynchronousQueue$TransferStack$SNode#2 at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) Local Variable: java.util.concurrent.SynchronousQueue#1 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) Local Variable: org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor#4 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#1 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][management][T#1]" daemon prio=5 tid=44 TIMED_WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:731) Local Variable: java.util.concurrent.LinkedTransferQueue$Node#8 Local Variable: java.util.concurrent.LinkedTransferQueue$Node#14 at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:644) at java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1145) Local Variable: java.util.concurrent.TimeUnit$1#1 Local Variable: org.elasticsearch.common.util.concurrent.EsExecutors$ExecutorScalingQueue#4 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) Local Variable: org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor#7 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#22 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][search][T#2]" daemon prio=5 tid=52 WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:735) Local Variable: java.util.concurrent.LinkedTransferQueue$Node#4 at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:644) at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1137) at org.elasticsearch.common.util.concurrent.SizeBlockingQueue.take(SizeBlockingQueue.java:162) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#21 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][search][T#4]" daemon prio=5 tid=54 WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:735) Local Variable: java.util.concurrent.LinkedTransferQueue$Node#9 at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:644) at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1137) at org.elasticsearch.common.util.concurrent.SizeBlockingQueue.take(SizeBlockingQueue.java:162) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#25 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][[ttl_expire]]" daemon prio=5 tid=13 TIMED_WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2176) Local Variable: java.util.concurrent.locks.AbstractQueuedSynchronizer$Node#5 Local Variable: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject#10 at org.elasticsearch.indices.ttl.IndicesTTLService$Notifier.await(IndicesTTLService.java:342) Local Variable: org.elasticsearch.indices.ttl.IndicesTTLService$Notifier#1 at org.elasticsearch.indices.ttl.IndicesTTLService$PurgerThread.run(IndicesTTLService.java:148) "elasticsearch[ES-NODE-Q01][search][T#3]" daemon prio=5 tid=53 WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:735) Local Variable: java.util.concurrent.LinkedTransferQueue$Node#5 at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:644) at java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1137) at org.elasticsearch.common.util.concurrent.SizeBlockingQueue.take(SizeBlockingQueue.java:162) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#24 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][management][T#2]" daemon prio=5 tid=122 TIMED_WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:731) Local Variable: java.util.concurrent.LinkedTransferQueue$Node#7 at java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:644) at java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1145) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#26 at java.lang.Thread.run(Thread.java:724) "DestroyJavaVM" prio=5 tid=43 RUNNABLE "elasticsearch[ES-NODE-Q01][clusterService#updateTask][T#1]" daemon prio=5 tid=28 WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) Local Variable: java.util.concurrent.locks.AbstractQueuedSynchronizer$Node#2 Local Variable: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject#21 at java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:537) Local Variable: java.util.concurrent.PriorityBlockingQueue#1 Local Variable: java.util.concurrent.locks.ReentrantLock#77 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) Local Variable: org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor#1 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#23 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][marvel.exporters]" daemon prio=5 tid=15 TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.elasticsearch.marvel.agent.AgentService$ExportingWorker.run(AgentService.java:248) Local Variable: org.elasticsearch.marvel.agent.AgentService$ExportingWorker#1 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][keep_alive]" daemon prio=5 tid=669 TIMED_WAITING at java.lang.Thread.sleep(Native Method) at org.elasticsearch.marvel.agent.exporter.ESExporter$ConnectionKeepAliveWorker.run(ESExporter.java:788) Local Variable: org.elasticsearch.marvel.agent.exporter.ESExporter$ConnectionKeepAliveWorker#1 at java.lang.Thread.run(Thread.java:724) "elasticsearch[ES-NODE-Q01][scheduler][T#1]" daemon prio=5 tid=12 TIMED_WAITING at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) Local Variable: java.util.concurrent.locks.AbstractQueuedSynchronizer$Node#4 Local Variable: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject#5 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090) Local Variable: java.util.concurrent.locks.ReentrantLock#17 at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) Local Variable: java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue#1 at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) Local Variable: java.util.concurrent.ScheduledThreadPoolExecutor#1 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) Local Variable: java.util.concurrent.ThreadPoolExecutor$Worker#5 at java.lang.Thread.run(Thread.java:724)
Optional Paste Settings
Category:
None
Cryptocurrency
Cybersecurity
Fixit
Food
Gaming
Haiku
Help
History
Housing
Jokes
Legal
Money
Movies
Music
Pets
Photo
Science
Software
Source Code
Spirit
Sports
Travel
TV
Writing
Tags:
Syntax Highlighting:
None
Bash
C
C#
C++
CSS
HTML
JSON
Java
JavaScript
Lua
Markdown (PRO members only)
Objective C
PHP
Perl
Python
Ruby
Swift
4CS
6502 ACME Cross Assembler
6502 Kick Assembler
6502 TASM/64TASS
ABAP
AIMMS
ALGOL 68
APT Sources
ARM
ASM (NASM)
ASP
ActionScript
ActionScript 3
Ada
Apache Log
AppleScript
Arduino
Asymptote
AutoIt
Autohotkey
Avisynth
Awk
BASCOM AVR
BNF
BOO
Bash
Basic4GL
Batch
BibTeX
Blitz Basic
Blitz3D
BlitzMax
BrainFuck
C
C (WinAPI)
C Intermediate Language
C for Macs
C#
C++
C++ (WinAPI)
C++ (with Qt extensions)
C: Loadrunner
CAD DCL
CAD Lisp
CFDG
CMake
COBOL
CSS
Ceylon
ChaiScript
Chapel
Clojure
Clone C
Clone C++
CoffeeScript
ColdFusion
Cuesheet
D
DCL
DCPU-16
DCS
DIV
DOT
Dart
Delphi
Delphi Prism (Oxygene)
Diff
E
ECMAScript
EPC
Easytrieve
Eiffel
Email
Erlang
Euphoria
F#
FO Language
Falcon
Filemaker
Formula One
Fortran
FreeBasic
FreeSWITCH
GAMBAS
GDB
GDScript
Game Maker
Genero
Genie
GetText
Go
Godot GLSL
Groovy
GwBasic
HQ9 Plus
HTML
HTML 5
Haskell
Haxe
HicEst
IDL
INI file
INTERCAL
IO
ISPF Panel Definition
Icon
Inno Script
J
JCL
JSON
Java
Java 5
JavaScript
Julia
KSP (Kontakt Script)
KiXtart
Kotlin
LDIF
LLVM
LOL Code
LScript
Latex
Liberty BASIC
Linden Scripting
Lisp
Loco Basic
Logtalk
Lotus Formulas
Lotus Script
Lua
M68000 Assembler
MIX Assembler
MK-61/52
MPASM
MXML
MagikSF
Make
MapBasic
Markdown (PRO members only)
MatLab
Mercury
MetaPost
Modula 2
Modula 3
Motorola 68000 HiSoft Dev
MySQL
Nagios
NetRexx
Nginx
Nim
NullSoft Installer
OCaml
OCaml Brief
Oberon 2
Objeck Programming Langua
Objective C
Octave
Open Object Rexx
OpenBSD PACKET FILTER
OpenGL Shading
Openoffice BASIC
Oracle 11
Oracle 8
Oz
PARI/GP
PCRE
PHP
PHP Brief
PL/I
PL/SQL
POV-Ray
ParaSail
Pascal
Pawn
Per
Perl
Perl 6
Phix
Pic 16
Pike
Pixel Bender
PostScript
PostgreSQL
PowerBuilder
PowerShell
ProFTPd
Progress
Prolog
Properties
ProvideX
Puppet
PureBasic
PyCon
Python
Python for S60
QBasic
QML
R
RBScript
REBOL
REG
RPM Spec
Racket
Rails
Rexx
Robots
Roff Manpage
Ruby
Ruby Gnuplot
Rust
SAS
SCL
SPARK
SPARQL
SQF
SQL
SSH Config
Scala
Scheme
Scilab
SdlBasic
Smalltalk
Smarty
StandardML
StoneScript
SuperCollider
Swift
SystemVerilog
T-SQL
TCL
TeXgraph
Tera Term
TypeScript
TypoScript
UPC
Unicon
UnrealScript
Urbi
VB.NET
VBScript
VHDL
VIM
Vala
Vedit
VeriLog
Visual Pro Log
VisualBasic
VisualFoxPro
WHOIS
WhiteSpace
Winbatch
XBasic
XML
XPP
Xojo
Xorg Config
YAML
YARA
Z80 Assembler
ZXBasic
autoconf
jQuery
mIRC
newLISP
q/kdb+
thinBasic
Paste Expiration:
Never
Burn after read
10 Minutes
1 Hour
1 Day
1 Week
2 Weeks
1 Month
6 Months
1 Year
Paste Exposure:
Public
Unlisted
Private
Folder:
(members only)
Password
NEW
Enabled
Disabled
Burn after read
NEW
Paste Name / Title:
Create New Paste
Hello
Guest
Sign Up
or
Login
Sign in with Facebook
Sign in with Twitter
Sign in with Google
You are currently not logged in, this means you can not edit or delete anything you paste.
Sign Up
or
Login
Public Pastes
TestingCustomCSS_Ignore
CSS | 3 hours ago | 0.21 KB
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the
Cookies Policy
.
OK, I Understand
Not a member of Pastebin yet?
Sign Up
, it unlocks many cool features!
