API tools faq
paste
Guest User

ES hot threads

a guest
Mar 30th, 2016
175
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 12.11 KB | None | 0 0
raw download clone embed print report
  1. ::: [shopo-elasticsearch-prd-sg2-05][RVZf_q7YTFK54A89A-ydYA][shopo-elasticsearch-prd-sg2-05.sd.int][inet[/16.0.0.166:9300]]{master=true}
  2.    Hot threads at 2016-03-30T08:10:02.692Z, interval=500ms, busiestThreads=10000, ignoreIdleThreads=true:
  3.  
  4.     0.0% (114.3micros out of 500ms) cpu usage by thread 'elasticsearch[shopo-elasticsearch-prd-sg2-05][transport_client_timer][T#1]{Hashed wheel timer #1}'
  5.      10/10 snapshots sharing following 5 elements
  6.        java.lang.Thread.sleep(Native Method)
  7.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:445)
  8.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:364)
  9.        org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  10.        java.lang.Thread.run(Thread.java:745)
  11.  
  12.     0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
  13.      unique snapshot
  14.      unique snapshot
  15.      unique snapshot
  16.      unique snapshot
  17.      unique snapshot
  18.      unique snapshot
  19.      unique snapshot
  20.      unique snapshot
  21.      unique snapshot
  22.      unique snapshot
  23.  
  24.     0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/1.5.2]'
  25.      10/10 snapshots sharing following 8 elements
  26.        sun.misc.Unsafe.park(Native Method)
  27.        java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  28.        java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
  29.        java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
  30.        java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
  31.        java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236)
  32.        org.elasticsearch.bootstrap.Bootstrap$4.run(Bootstrap.java:235)
  33.        java.lang.Thread.run(Thread.java:745)
  34.  
  35. ::: [shopo-elasticsearch-prd-sg2-06][o5DUVvSsRGSImpaqwvFung][shopo-elasticsearch-prd-sg2-06.sd.int][inet[/16.0.1.119:9300]]{master=true}
  36.    Hot threads at 2016-03-30T08:10:02.692Z, interval=500ms, busiestThreads=10000, ignoreIdleThreads=true:
  37.  
  38.     0.0% (63.7micros out of 500ms) cpu usage by thread 'elasticsearch[shopo-elasticsearch-prd-sg2-06][transport_client_timer][T#1]{Hashed wheel timer #1}'
  39.      10/10 snapshots sharing following 5 elements
  40.        java.lang.Thread.sleep(Native Method)
  41.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:445)
  42.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:364)
  43.        org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  44.        java.lang.Thread.run(Thread.java:745)
  45.  
  46.     0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
  47.      unique snapshot
  48.      unique snapshot
  49.      unique snapshot
  50.      unique snapshot
  51.      unique snapshot
  52.      unique snapshot
  53.      unique snapshot
  54.      unique snapshot
  55.      unique snapshot
  56.      unique snapshot
  57.  
  58.     0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/1.5.2]'
  59.      10/10 snapshots sharing following 8 elements
  60.        sun.misc.Unsafe.park(Native Method)
  61.        java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  62.        java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
  63.        java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
  64.        java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
  65.        java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236)
  66.        org.elasticsearch.bootstrap.Bootstrap$4.run(Bootstrap.java:235)
  67.        java.lang.Thread.run(Thread.java:745)
  68.  
  69. ::: [shopo-elasticsearch-prd-sg2-01][A1Hp-VvbQAiQvnUoU3vpIA][shopo-elasticsearch-prd-sg2-01.sd.int][inet[/16.0.1.78:9300]]{master=true}
  70.    Hot threads at 2016-03-30T08:10:02.692Z, interval=500ms, busiestThreads=10000, ignoreIdleThreads=true:
  71.  
  72.     0.0% (178.3micros out of 500ms) cpu usage by thread 'elasticsearch[shopo-elasticsearch-prd-sg2-01][transport_client_timer][T#1]{Hashed wheel timer #1}'
  73.      10/10 snapshots sharing following 5 elements
  74.        java.lang.Thread.sleep(Native Method)
  75.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:445)
  76.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:364)
  77.        org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  78.        java.lang.Thread.run(Thread.java:745)
  79.  
  80.     0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
  81.      unique snapshot
  82.      unique snapshot
  83.      unique snapshot
  84.      unique snapshot
  85.      unique snapshot
  86.      unique snapshot
  87.      unique snapshot
  88.      unique snapshot
  89.      unique snapshot
  90.      unique snapshot
  91.  
  92.     0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/1.5.2]'
  93.      10/10 snapshots sharing following 8 elements
  94.        sun.misc.Unsafe.park(Native Method)
  95.        java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  96.        java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
  97.        java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
  98.        java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
  99.        java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236)
  100.        org.elasticsearch.bootstrap.Bootstrap$4.run(Bootstrap.java:235)
  101.        java.lang.Thread.run(Thread.java:745)
  102.  
  103. ::: [shopo-elasticsearch-prd-sg2-02][mFf4bkbtT8iwBByQ9qv2Pg][shopo-elasticsearch-prd-sg2-02.sd.int][inet[/16.0.1.169:9300]]{master=true}
  104.    Hot threads at 2016-03-30T08:10:02.692Z, interval=500ms, busiestThreads=10000, ignoreIdleThreads=true:
  105.  
  106.     0.0% (183.5micros out of 500ms) cpu usage by thread 'elasticsearch[shopo-elasticsearch-prd-sg2-02][transport_client_timer][T#1]{Hashed wheel timer #1}'
  107.      10/10 snapshots sharing following 5 elements
  108.        java.lang.Thread.sleep(Native Method)
  109.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:445)
  110.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:364)
  111.        org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  112.        java.lang.Thread.run(Thread.java:745)
  113.  
  114.     0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
  115.      unique snapshot
  116.      unique snapshot
  117.      unique snapshot
  118.      unique snapshot
  119.      unique snapshot
  120.      unique snapshot
  121.      unique snapshot
  122.      unique snapshot
  123.      unique snapshot
  124.      unique snapshot
  125.  
  126.     0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/1.5.2]'
  127.      10/10 snapshots sharing following 8 elements
  128.        sun.misc.Unsafe.park(Native Method)
  129.        java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  130.        java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
  131.        java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
  132.        java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
  133.        java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236)
  134.        org.elasticsearch.bootstrap.Bootstrap$4.run(Bootstrap.java:235)
  135.        java.lang.Thread.run(Thread.java:745)
  136.  
  137.     0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[shopo-elasticsearch-prd-sg2-02][search][T#18]'
  138.      5/10 snapshots sharing following 2 elements
  139.        java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  140.        java.lang.Thread.run(Thread.java:745)
  141.  
  142. ::: [shopo-elasticsearch-prd-sg2-04][lXC1UewNQZC-_tJjAT7fcg][shopo-elasticsearch-prd-sg2-04.sd.int][inet[/16.0.1.246:9300]]{master=true}
  143.    Hot threads at 2016-03-30T08:10:02.691Z, interval=500ms, busiestThreads=10000, ignoreIdleThreads=true:
  144.  
  145.     0.0% (84.6micros out of 500ms) cpu usage by thread 'elasticsearch[shopo-elasticsearch-prd-sg2-04][transport_client_timer][T#1]{Hashed wheel timer #1}'
  146.      10/10 snapshots sharing following 5 elements
  147.        java.lang.Thread.sleep(Native Method)
  148.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:445)
  149.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:364)
  150.        org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  151.        java.lang.Thread.run(Thread.java:745)
  152.  
  153.     0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/1.5.2]'
  154.      10/10 snapshots sharing following 8 elements
  155.        sun.misc.Unsafe.park(Native Method)
  156.        java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  157.        java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
  158.        java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
  159.        java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
  160.        java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236)
  161.        org.elasticsearch.bootstrap.Bootstrap$4.run(Bootstrap.java:235)
  162.        java.lang.Thread.run(Thread.java:745)
  163.  
  164.     0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
  165.      unique snapshot
  166.      unique snapshot
  167.      unique snapshot
  168.      unique snapshot
  169.      unique snapshot
  170.      unique snapshot
  171.      unique snapshot
  172.      unique snapshot
  173.      unique snapshot
  174.      unique snapshot
  175.  
  176. ::: [shopo-elasticsearch-prd-sg2-03][xIAJJOtuSGqOdIeto_DBNg][shopo-elasticsearch-prd-sg2-03.sd.int][inet[/16.0.1.77:9300]]{master=true}
  177.    Hot threads at 2016-03-30T08:10:02.718Z, interval=500ms, busiestThreads=10000, ignoreIdleThreads=true:
  178.  
  179.     0.0% (96.6micros out of 500ms) cpu usage by thread 'elasticsearch[shopo-elasticsearch-prd-sg2-03][transport_client_timer][T#1]{Hashed wheel timer #1}'
  180.      10/10 snapshots sharing following 5 elements
  181.        java.lang.Thread.sleep(Native Method)
  182.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:445)
  183.        org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:364)
  184.        org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
  185.        java.lang.Thread.run(Thread.java:745)
  186.  
  187.     0.0% (0s out of 500ms) cpu usage by thread 'DestroyJavaVM'
  188.      unique snapshot
  189.      unique snapshot
  190.      unique snapshot
  191.      unique snapshot
  192.      unique snapshot
  193.      unique snapshot
  194.      unique snapshot
  195.      unique snapshot
  196.      unique snapshot
  197.      unique snapshot
  198.  
  199.     0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[keepAlive/1.5.2]'
  200.      10/10 snapshots sharing following 8 elements
  201.        sun.misc.Unsafe.park(Native Method)
  202.        java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
  203.        java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
  204.        java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994)
  205.        java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303)
  206.        java.util.concurrent.CountDownLatch.await(CountDownLatch.java:236)
  207.        org.elasticsearch.bootstrap.Bootstrap$4.run(Bootstrap.java:235)
  208.        java.lang.Thread.run(Thread.java:745)
  209.  
  210.     0.0% (0s out of 500ms) cpu usage by thread 'elasticsearch[shopo-elasticsearch-prd-sg2-03][search][T#6]'
  211.      4/10 snapshots sharing following 2 elements
  212.        java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  213.        java.lang.Thread.run(Thread.java:745)
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!