API tools faq
paste
MF57

Untitled

MF57
Jan 8th, 2020
310
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 244.74 KB | None | 0 0
raw download clone embed print report
  1. OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
  2. [2020-01-07T15:35:07,089][INFO ][o.e.e.NodeEnvironment ] [es-master-6f6bf6f789-jn4rd] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/mapper/system-root)]], net usable_space [233.2gb], net total_space [438.1gb], types [ext4]
  3. [2020-01-07T15:35:07,092][INFO ][o.e.e.NodeEnvironment ] [es-master-6f6bf6f789-jn4rd] heap size [503.6mb], compressed ordinary object pointers [true]
  4. [2020-01-07T15:35:07,695][INFO ][o.e.n.Node ] [es-master-6f6bf6f789-jn4rd] node name [es-master-6f6bf6f789-jn4rd], node ID [-fjNWXc7S5aAgQD02KksZA]
  5. [2020-01-07T15:35:07,696][INFO ][o.e.n.Node ] [es-master-6f6bf6f789-jn4rd] version[6.7.1], pid[1], build[default/docker/2f32220/2019-04-02T15:59:27.961366Z], OS[Linux/4.15.0-47-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/12/12+33]
  6. [2020-01-07T15:35:07,696][INFO ][o.e.n.Node ] [es-master-6f6bf6f789-jn4rd] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-5463979547568560432, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -XX:UseAVX=2, -Des.cgroups.hierarchy.override=/, -Xms512m, -Xmx512m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker]
  7. [2020-01-07T15:35:09,978][WARN ][o.e.d.c.s.Settings ] [es-master-6f6bf6f789-jn4rd] [http.enabled] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version.
  8. [2020-01-07T15:35:13,052][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [aggs-matrix-stats]
  9. [2020-01-07T15:35:13,053][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [analysis-common]
  10. [2020-01-07T15:35:13,053][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [ingest-common]
  11. [2020-01-07T15:35:13,053][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [ingest-geoip]
  12. [2020-01-07T15:35:13,054][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [ingest-user-agent]
  13. [2020-01-07T15:35:13,054][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [lang-expression]
  14. [2020-01-07T15:35:13,054][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [lang-mustache]
  15. [2020-01-07T15:35:13,054][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [lang-painless]
  16. [2020-01-07T15:35:13,054][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [mapper-extras]
  17. [2020-01-07T15:35:13,055][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [parent-join]
  18. [2020-01-07T15:35:13,055][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [percolator]
  19. [2020-01-07T15:35:13,055][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [rank-eval]
  20. [2020-01-07T15:35:13,055][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [reindex]
  21. [2020-01-07T15:35:13,055][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [repository-url]
  22. [2020-01-07T15:35:13,056][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [transport-netty4]
  23. [2020-01-07T15:35:13,056][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [tribe]
  24. [2020-01-07T15:35:13,056][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-ccr]
  25. [2020-01-07T15:35:13,056][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-core]
  26. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-deprecation]
  27. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-graph]
  28. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-ilm]
  29. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-logstash]
  30. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-ml]
  31. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-monitoring]
  32. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-rollup]
  33. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-security]
  34. [2020-01-07T15:35:13,057][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-sql]
  35. [2020-01-07T15:35:13,058][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-upgrade]
  36. [2020-01-07T15:35:13,058][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] loaded module [x-pack-watcher]
  37. [2020-01-07T15:35:13,058][INFO ][o.e.p.PluginsService ] [es-master-6f6bf6f789-jn4rd] no plugins loaded
  38. [2020-01-07T15:35:23,756][INFO ][o.e.x.s.a.s.FileRolesStore] [es-master-6f6bf6f789-jn4rd] parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]
  39. [2020-01-07T15:35:25,779][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [es-master-6f6bf6f789-jn4rd] [controller/71] [Main.cc@109] controller (64 bit): Version 6.7.1 (Build e1f492de67a719) Copyright (c) 2019 Elasticsearch BV
  40. [2020-01-07T15:35:29,057][INFO ][o.e.d.DiscoveryModule ] [es-master-6f6bf6f789-jn4rd] using discovery type [zen] and host providers [settings]
  41. [2020-01-07T15:35:31,159][INFO ][o.e.n.Node ] [es-master-6f6bf6f789-jn4rd] initialized
  42. [2020-01-07T15:35:31,160][INFO ][o.e.n.Node ] [es-master-6f6bf6f789-jn4rd] starting ...
  43. [2020-01-07T15:35:31,655][INFO ][o.e.t.TransportService ] [es-master-6f6bf6f789-jn4rd] publish_address {10.0.29.5:9300}, bound_addresses {10.0.29.5:9300}, {[fe80::1c42:4cff:fe8b:be8c]:9300}
  44. [2020-01-07T15:35:32,258][INFO ][o.e.b.BootstrapChecks ] [es-master-6f6bf6f789-jn4rd] bound or publishing to a non-loopback address, enforcing bootstrap checks
  45. [2020-01-07T15:35:35,858][INFO ][o.e.c.s.MasterService ] [es-master-6f6bf6f789-jn4rd] zen-disco-elected-as-master ([2] nodes joined)[{es-client-86655db574-xlbxv}{50MgfM3JT36dN3PlHQ9PyQ}{Gj5PmQxmQFCrbNP-XubYWQ}{10.0.89.61}{10.0.89.61:9300}{ml.machine_memory=67203874816, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}, {es-master-6f6bf6f789-zwwpk}{mClpfKwKSeSmHOF7zg2vZA}{cSs7kzFwSKenI-Hd8sy9ug}{10.1.103.104}{10.1.103.104:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}], zen-disco-node-join[{es-data-1}{DI9tF3lrREWe7EEV7gbDOw}{v_5C8Ew8Td2iQgouQS8OSA}{10.0.6.76}{10.0.6.76:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}], reason: new_master {es-master-6f6bf6f789-jn4rd}{-fjNWXc7S5aAgQD02KksZA}{K63vOxfBRMCEMuEAR_hXng}{10.0.29.5}{10.0.29.5:9300}{ml.machine_memory=67203874816, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}, added {{es-client-86655db574-xlbxv}{50MgfM3JT36dN3PlHQ9PyQ}{Gj5PmQxmQFCrbNP-XubYWQ}{10.0.89.61}{10.0.89.61:9300}{ml.machine_memory=67203874816, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},{es-master-6f6bf6f789-zwwpk}{mClpfKwKSeSmHOF7zg2vZA}{cSs7kzFwSKenI-Hd8sy9ug}{10.1.103.104}{10.1.103.104:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},{es-data-1}{DI9tF3lrREWe7EEV7gbDOw}{v_5C8Ew8Td2iQgouQS8OSA}{10.0.6.76}{10.0.6.76:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}
  46. [2020-01-07T15:35:36,045][INFO ][o.e.c.s.ClusterApplierService] [es-master-6f6bf6f789-jn4rd] new_master {es-master-6f6bf6f789-jn4rd}{-fjNWXc7S5aAgQD02KksZA}{K63vOxfBRMCEMuEAR_hXng}{10.0.29.5}{10.0.29.5:9300}{ml.machine_memory=67203874816, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true}, added {{es-client-86655db574-xlbxv}{50MgfM3JT36dN3PlHQ9PyQ}{Gj5PmQxmQFCrbNP-XubYWQ}{10.0.89.61}{10.0.89.61:9300}{ml.machine_memory=67203874816, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},{es-master-6f6bf6f789-zwwpk}{mClpfKwKSeSmHOF7zg2vZA}{cSs7kzFwSKenI-Hd8sy9ug}{10.1.103.104}{10.1.103.104:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},{es-data-1}{DI9tF3lrREWe7EEV7gbDOw}{v_5C8Ew8Td2iQgouQS8OSA}{10.0.6.76}{10.0.6.76:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}, reason: apply cluster state (from master [master {es-master-6f6bf6f789-jn4rd}{-fjNWXc7S5aAgQD02KksZA}{K63vOxfBRMCEMuEAR_hXng}{10.0.29.5}{10.0.29.5:9300}{ml.machine_memory=67203874816, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true} committed version [1] source [zen-disco-elected-as-master ([2] nodes joined)[{es-client-86655db574-xlbxv}{50MgfM3JT36dN3PlHQ9PyQ}{Gj5PmQxmQFCrbNP-XubYWQ}{10.0.89.61}{10.0.89.61:9300}{ml.machine_memory=67203874816, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}, {es-master-6f6bf6f789-zwwpk}{mClpfKwKSeSmHOF7zg2vZA}{cSs7kzFwSKenI-Hd8sy9ug}{10.1.103.104}{10.1.103.104:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}], zen-disco-node-join[{es-data-1}{DI9tF3lrREWe7EEV7gbDOw}{v_5C8Ew8Td2iQgouQS8OSA}{10.0.6.76}{10.0.6.76:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}]]])
  47. [2020-01-07T15:35:36,165][INFO ][o.e.h.n.Netty4HttpServerTransport] [es-master-6f6bf6f789-jn4rd] publish_address {10.0.29.5:9200}, bound_addresses {10.0.29.5:9200}, {[fe80::1c42:4cff:fe8b:be8c]:9200}
  48. [2020-01-07T15:35:36,165][INFO ][o.e.n.Node ] [es-master-6f6bf6f789-jn4rd] started
  49. [2020-01-07T15:35:36,668][INFO ][o.e.c.s.MasterService ] [es-master-6f6bf6f789-jn4rd] zen-disco-node-join[{es-data-0}{jaHZGOANQpiKAe9M7ImsYw}{hm_vauyRT96oNRV0wpj2Nw}{10.1.194.113}{10.1.194.113:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}], reason: added {{es-data-0}{jaHZGOANQpiKAe9M7ImsYw}{hm_vauyRT96oNRV0wpj2Nw}{10.1.194.113}{10.1.194.113:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}
  50. [2020-01-07T15:35:36,838][INFO ][o.e.c.s.ClusterApplierService] [es-master-6f6bf6f789-jn4rd] added {{es-data-0}{jaHZGOANQpiKAe9M7ImsYw}{hm_vauyRT96oNRV0wpj2Nw}{10.1.194.113}{10.1.194.113:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}, reason: apply cluster state (from master [master {es-master-6f6bf6f789-jn4rd}{-fjNWXc7S5aAgQD02KksZA}{K63vOxfBRMCEMuEAR_hXng}{10.0.29.5}{10.0.29.5:9300}{ml.machine_memory=67203874816, xpack.installed=true, ml.max_open_jobs=20, ml.enabled=true} committed version [2] source [zen-disco-node-join[{es-data-0}{jaHZGOANQpiKAe9M7ImsYw}{hm_vauyRT96oNRV0wpj2Nw}{10.1.194.113}{10.1.194.113:9300}{ml.machine_memory=270133903360, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}]]])
  51. [2020-01-07T15:35:39,867][WARN ][o.e.g.GatewayService ] [es-master-6f6bf6f789-jn4rd] Recovery failed
  52. java.lang.IllegalStateException: alias [mongo] has more than one write index [mongo-2020.01.03-000033,mongo-2019.08.29-000015]
  53. at org.elasticsearch.cluster.metadata.AliasOrIndex$Alias.computeAndValidateWriteIndex(AliasOrIndex.java:173) ~[elasticsearch-6.7.1.jar:6.7.1]
  54. at org.elasticsearch.cluster.metadata.MetaData$Builder.lambda$buildAliasAndIndexLookup$1(MetaData.java:1158) ~[elasticsearch-6.7.1.jar:6.7.1]
  55. at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) ~[?:?]
  56. at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:177) ~[?:?]
  57. at java.util.TreeMap$ValueSpliterator.forEachRemaining(TreeMap.java:2890) ~[?:?]
  58. at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
  59. at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
  60. at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) ~[?:?]
  61. at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173) ~[?:?]
  62. at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
  63. at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497) ~[?:?]
  64. at org.elasticsearch.cluster.metadata.MetaData$Builder.buildAliasAndIndexLookup(MetaData.java:1158) ~[elasticsearch-6.7.1.jar:6.7.1]
  65. at org.elasticsearch.cluster.metadata.MetaData$Builder.build(MetaData.java:1122) ~[elasticsearch-6.7.1.jar:6.7.1]
  66. at org.elasticsearch.cluster.ClusterState$Builder.metaData(ClusterState.java:657) ~[elasticsearch-6.7.1.jar:6.7.1]
  67. at org.elasticsearch.gateway.Gateway.upgradeAndArchiveUnknownOrInvalidSettings(Gateway.java:158) ~[elasticsearch-6.7.1.jar:6.7.1]
  68. at org.elasticsearch.gateway.Gateway.performStateRecovery(Gateway.java:141) ~[elasticsearch-6.7.1.jar:6.7.1]
  69. at org.elasticsearch.gateway.GatewayService$1.doRun(GatewayService.java:227) [elasticsearch-6.7.1.jar:6.7.1]
  70. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:751) [elasticsearch-6.7.1.jar:6.7.1]
  71. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  72. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  73. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  74. at java.lang.Thread.run(Thread.java:835) [?:?]
  75. [2020-01-07T15:35:39,875][INFO ][o.e.g.GatewayService ] [es-master-6f6bf6f789-jn4rd] metadata state not restored, reason: state recovery failed: alias [mongo] has more than one write index [mongo-2020.01.03-000033,mongo-2019.08.29-000015]
  76. [2020-01-07T15:35:41,172][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  77. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  78. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  79. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  80. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  81. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  82. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  83. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  84. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  85. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  86. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  87. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  88. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  89. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  90. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  91. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  92. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  93. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  94. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  95. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  96. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  97. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  98. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  99. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  100. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  101. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  102. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  103. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  104. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  105. at java.lang.Thread.run(Thread.java:835) [?:?]
  106. [2020-01-07T15:35:51,176][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  107. [2020-01-07T15:35:51,180][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  108. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  109. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  110. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  111. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  112. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  113. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  114. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  115. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  116. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  117. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  118. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  119. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  120. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  121. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  122. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  123. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  124. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  125. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  126. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  127. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  128. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  129. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  130. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  131. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  132. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  133. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  134. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  135. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  136. at java.lang.Thread.run(Thread.java:835) [?:?]
  137. [2020-01-07T15:35:51,264][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  138. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  139. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  140. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  141. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  142. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  143. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  144. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  145. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  146. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  147. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  148. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  149. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  150. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  151. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  152. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  153. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  154. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  155. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  156. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  157. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  158. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  159. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  160. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  161. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  162. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  163. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  164. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  165. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  166. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  167. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  168. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  169. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  170. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  171. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  172. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  173. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  174. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  175. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  176. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  177. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  178. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  179. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  180. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  181. at java.lang.Thread.run(Thread.java:835) [?:?]
  182. [2020-01-07T15:35:51,459][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  183. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  184. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  185. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  186. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  187. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  188. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  189. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  190. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  191. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  192. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  193. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  194. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  195. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  196. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  197. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  198. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  199. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  200. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  201. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  202. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  203. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  204. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  205. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  206. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  207. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  208. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  209. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  210. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  211. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  212. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  213. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  214. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  215. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  216. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  217. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  218. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  219. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  220. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  221. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  222. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  223. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  224. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  225. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  226. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  227. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  228. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  229. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  230. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  231. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  232. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  233. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  234. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  235. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  236. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  237. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  238. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  239. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  240. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  241. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  242. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  243. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  244. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  245. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  246. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  247. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  248. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  249. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  250. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  251. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  252. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  253. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  254. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  255. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  256. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  257. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  258. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  259. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  260. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  261. at java.lang.Thread.run(Thread.java:835) [?:?]
  262. [2020-01-07T15:36:01,168][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  263. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  264. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  265. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  266. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  267. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  268. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  269. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  270. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  271. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  272. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  273. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  274. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  275. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  276. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  277. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  278. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  279. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  280. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  281. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  282. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  283. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  284. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  285. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  286. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  287. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  288. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  289. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  290. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  291. at java.lang.Thread.run(Thread.java:835) [?:?]
  292. [2020-01-07T15:36:11,173][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  293. [2020-01-07T15:36:11,175][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  294. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  295. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  296. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  297. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  298. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  299. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  300. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  301. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  302. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  303. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  304. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  305. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  306. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  307. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  308. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  309. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  310. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  311. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  312. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  313. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  314. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  315. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  316. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  317. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  318. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  319. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  320. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  321. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  322. at java.lang.Thread.run(Thread.java:835) [?:?]
  323. [2020-01-07T15:36:11,189][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  324. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  325. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  326. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  327. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  328. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  329. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  330. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  331. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  332. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  333. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  334. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  335. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  336. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  337. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  338. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  339. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  340. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  341. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  342. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  343. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  344. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  345. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  346. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  347. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  348. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  349. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  350. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  351. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  352. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  353. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  354. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  355. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  356. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  357. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  358. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  359. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  360. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  361. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  362. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  363. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  364. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  365. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  366. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  367. at java.lang.Thread.run(Thread.java:835) [?:?]
  368. [2020-01-07T15:36:11,216][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  369. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  370. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  371. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  372. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  373. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  374. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  375. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  376. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  377. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  378. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  379. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  380. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  381. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  382. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  383. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  384. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  385. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  386. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  387. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  388. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  389. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  390. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  391. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  392. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  393. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  394. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  395. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  396. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  397. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  398. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  399. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  400. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  401. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  402. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  403. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  404. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  405. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  406. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  407. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  408. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  409. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  410. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  411. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  412. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  413. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  414. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  415. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  416. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  417. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  418. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  419. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  420. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  421. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  422. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  423. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  424. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  425. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  426. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  427. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  428. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  429. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  430. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  431. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  432. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  433. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  434. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  435. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  436. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  437. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  438. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  439. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  440. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  441. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  442. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  443. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  444. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  445. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  446. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  447. at java.lang.Thread.run(Thread.java:835) [?:?]
  448. [2020-01-07T15:36:21,168][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  449. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  450. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  451. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  452. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  453. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  454. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  455. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  456. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  457. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  458. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  459. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  460. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  461. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  462. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  463. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  464. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  465. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  466. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  467. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  468. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  469. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  470. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  471. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  472. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  473. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  474. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  475. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  476. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  477. at java.lang.Thread.run(Thread.java:835) [?:?]
  478. [2020-01-07T15:36:31,173][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  479. [2020-01-07T15:36:31,174][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  480. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  481. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  482. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  483. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  484. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  485. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  486. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  487. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  488. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  489. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  490. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  491. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  492. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  493. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  494. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  495. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  496. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  497. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  498. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  499. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  500. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  501. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  502. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  503. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  504. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  505. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  506. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  507. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  508. at java.lang.Thread.run(Thread.java:835) [?:?]
  509. [2020-01-07T15:36:31,188][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  510. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  511. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  512. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  513. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  514. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  515. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  516. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  517. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  518. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  519. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  520. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  521. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  522. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  523. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  524. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  525. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  526. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  527. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  528. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  529. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  530. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  531. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  532. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  533. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  534. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  535. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  536. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  537. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  538. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  539. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  540. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  541. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  542. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  543. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  544. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  545. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  546. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  547. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  548. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  549. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  550. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  551. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  552. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  553. at java.lang.Thread.run(Thread.java:835) [?:?]
  554. [2020-01-07T15:36:31,210][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  555. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  556. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  557. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  558. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  559. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  560. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  561. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  562. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  563. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  564. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  565. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  566. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  567. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  568. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  569. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  570. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  571. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  572. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  573. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  574. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  575. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  576. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  577. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  578. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  579. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  580. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  581. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  582. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  583. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  584. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  585. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  586. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  587. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  588. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  589. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  590. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  591. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  592. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  593. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  594. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  595. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  596. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  597. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  598. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  599. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  600. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  601. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  602. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  603. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  604. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  605. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  606. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  607. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  608. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  609. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  610. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  611. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  612. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  613. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  614. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  615. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  616. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  617. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  618. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  619. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  620. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  621. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  622. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  623. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  624. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  625. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  626. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  627. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  628. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  629. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  630. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  631. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  632. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  633. at java.lang.Thread.run(Thread.java:835) [?:?]
  634. [2020-01-07T15:36:41,168][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  635. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  636. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  637. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  638. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  639. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  640. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  641. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  642. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  643. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  644. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  645. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  646. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  647. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  648. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  649. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  650. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  651. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  652. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  653. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  654. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  655. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  656. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  657. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  658. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  659. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  660. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  661. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  662. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  663. at java.lang.Thread.run(Thread.java:835) [?:?]
  664. [2020-01-07T15:36:51,171][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  665. [2020-01-07T15:36:51,173][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  666. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  667. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  668. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  669. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  670. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  671. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  672. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  673. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  674. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  675. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  676. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  677. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  678. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  679. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  680. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  681. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  682. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  683. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  684. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  685. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  686. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  687. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  688. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  689. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  690. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  691. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  692. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  693. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  694. at java.lang.Thread.run(Thread.java:835) [?:?]
  695. [2020-01-07T15:36:51,183][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  696. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  697. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  698. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  699. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  700. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  701. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  702. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  703. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  704. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  705. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  706. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  707. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  708. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  709. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  710. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  711. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  712. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  713. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  714. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  715. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  716. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  717. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  718. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  719. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  720. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  721. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  722. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  723. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  724. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  725. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  726. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  727. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  728. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  729. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  730. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  731. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  732. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  733. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  734. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  735. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  736. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  737. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  738. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  739. at java.lang.Thread.run(Thread.java:835) [?:?]
  740. [2020-01-07T15:36:51,206][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  741. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  742. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  743. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  744. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  745. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  746. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  747. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  748. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  749. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  750. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  751. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  752. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  753. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  754. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  755. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  756. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  757. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  758. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  759. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  760. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  761. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  762. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  763. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  764. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  765. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  766. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  767. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  768. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  769. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  770. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  771. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  772. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  773. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  774. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  775. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  776. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  777. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  778. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  779. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  780. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  781. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  782. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  783. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  784. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  785. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  786. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  787. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  788. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  789. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  790. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  791. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  792. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  793. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  794. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  795. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  796. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  797. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  798. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  799. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  800. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  801. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  802. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  803. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  804. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  805. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  806. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  807. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  808. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  809. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  810. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  811. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  812. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  813. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  814. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  815. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  816. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  817. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  818. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  819. at java.lang.Thread.run(Thread.java:835) [?:?]
  820. [2020-01-07T15:37:01,169][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  821. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  822. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  823. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  824. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  825. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  826. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  827. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  828. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  829. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  830. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  831. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  832. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  833. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  834. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  835. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  836. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  837. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  838. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  839. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  840. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  841. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  842. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  843. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  844. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  845. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  846. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  847. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  848. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  849. at java.lang.Thread.run(Thread.java:835) [?:?]
  850. [2020-01-07T15:37:11,173][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  851. [2020-01-07T15:37:11,176][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  852. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  853. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  854. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  855. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  856. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  857. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  858. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  859. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  860. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  861. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  862. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  863. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  864. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  865. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  866. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  867. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  868. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  869. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  870. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  871. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  872. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  873. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  874. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  875. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  876. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  877. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  878. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  879. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  880. at java.lang.Thread.run(Thread.java:835) [?:?]
  881. [2020-01-07T15:37:11,190][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  882. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  883. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  884. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  885. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  886. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  887. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  888. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  889. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  890. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  891. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  892. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  893. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  894. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  895. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  896. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  897. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  898. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  899. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  900. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  901. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  902. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  903. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  904. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  905. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  906. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  907. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  908. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  909. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  910. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  911. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  912. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  913. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  914. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  915. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  916. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  917. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  918. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  919. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  920. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  921. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  922. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  923. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  924. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  925. at java.lang.Thread.run(Thread.java:835) [?:?]
  926. [2020-01-07T15:37:11,212][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  927. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  928. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  929. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  930. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  931. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  932. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  933. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  934. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  935. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  936. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  937. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  938. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  939. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  940. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  941. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  942. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  943. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  944. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  945. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  946. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  947. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  948. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  949. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  950. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  951. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  952. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  953. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  954. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  955. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  956. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  957. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  958. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  959. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  960. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  961. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  962. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  963. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  964. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  965. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  966. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  967. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  968. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  969. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  970. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  971. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  972. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  973. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  974. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  975. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  976. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  977. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  978. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  979. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  980. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  981. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  982. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  983. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  984. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  985. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  986. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  987. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  988. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  989. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  990. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  991. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  992. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  993. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  994. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  995. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  996. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  997. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  998. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  999. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  1000. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  1001. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  1002. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  1003. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  1004. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  1005. at java.lang.Thread.run(Thread.java:835) [?:?]
  1006. [2020-01-07T15:37:21,170][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  1007. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1008. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1009. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  1010. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  1011. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1012. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1013. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1014. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1015. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1016. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1017. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1018. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1019. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1020. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1021. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1022. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1023. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1024. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1025. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1026. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1027. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1028. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1029. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1030. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1031. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1032. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1033. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1034. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1035. at java.lang.Thread.run(Thread.java:835) [?:?]
  1036. [2020-01-07T15:37:31,173][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  1037. [2020-01-07T15:37:31,174][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  1038. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1039. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1040. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  1041. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  1042. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1043. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1044. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1045. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1046. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1047. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1048. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1049. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1050. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1051. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1052. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1053. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1054. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1055. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1056. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1057. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1058. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1059. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1060. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1061. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1062. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1063. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1064. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1065. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1066. at java.lang.Thread.run(Thread.java:835) [?:?]
  1067. [2020-01-07T15:37:31,184][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  1068. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1069. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1070. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1071. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1072. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1073. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1074. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1075. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1076. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1077. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1078. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1079. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1080. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1081. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1082. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1083. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1084. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1085. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1086. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1087. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1088. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1089. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1090. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1091. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1092. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1093. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1094. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1095. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1096. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1097. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1098. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1099. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1100. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  1101. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1102. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1103. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1104. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1105. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1106. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1107. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1108. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1109. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1110. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1111. at java.lang.Thread.run(Thread.java:835) [?:?]
  1112. [2020-01-07T15:37:31,255][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  1113. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1114. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1115. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1116. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1117. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1118. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1119. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1120. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1121. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1122. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1123. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1124. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1125. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1126. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1127. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1128. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1129. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1130. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1131. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1132. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1133. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1134. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1135. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1136. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1137. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1138. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1139. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1140. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1141. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1142. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1143. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1144. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1145. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  1146. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  1147. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  1148. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  1149. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  1150. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  1151. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  1152. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1153. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  1154. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1155. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  1156. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  1157. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  1158. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  1159. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  1160. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1161. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1162. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  1163. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  1164. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  1165. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  1166. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  1167. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  1168. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  1169. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1170. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1171. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1172. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  1173. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  1174. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1175. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1176. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1177. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  1178. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1179. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1180. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1181. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  1182. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1183. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1184. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  1185. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  1186. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  1187. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  1188. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  1189. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  1190. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  1191. at java.lang.Thread.run(Thread.java:835) [?:?]
  1192. [2020-01-07T15:37:41,170][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  1193. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1194. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1195. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  1196. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  1197. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1198. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1199. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1200. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1201. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1202. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1203. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1204. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1205. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1206. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1207. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1208. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1209. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1210. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1211. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1212. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1213. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1214. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1215. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1216. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1217. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1218. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1219. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1220. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1221. at java.lang.Thread.run(Thread.java:835) [?:?]
  1222. [2020-01-07T15:37:51,173][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  1223. [2020-01-07T15:37:51,176][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  1224. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1225. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1226. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  1227. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  1228. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1229. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1230. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1231. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1232. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1233. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1234. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1235. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1236. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1237. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1238. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1239. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1240. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1241. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1242. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1243. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1244. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1245. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1246. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1247. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1248. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1249. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1250. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1251. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1252. at java.lang.Thread.run(Thread.java:835) [?:?]
  1253. [2020-01-07T15:37:51,187][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  1254. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1255. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1256. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1257. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1258. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1259. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1260. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1261. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1262. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1263. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1264. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1265. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1266. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1267. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1268. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1269. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1270. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1271. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1272. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1273. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1274. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1275. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1276. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1277. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1278. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1279. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1280. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1281. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1282. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1283. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1284. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1285. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1286. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  1287. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1288. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1289. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1290. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1291. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1292. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1293. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1294. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1295. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1296. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1297. at java.lang.Thread.run(Thread.java:835) [?:?]
  1298. [2020-01-07T15:37:51,204][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  1299. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1300. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1301. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1302. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1303. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1304. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1305. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1306. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1307. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1308. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1309. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1310. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1311. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1312. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1313. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1314. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1315. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1316. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1317. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1318. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1319. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1320. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1321. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1322. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1323. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1324. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1325. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1326. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1327. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1328. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1329. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1330. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1331. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  1332. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  1333. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  1334. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  1335. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  1336. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  1337. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  1338. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1339. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  1340. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1341. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  1342. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  1343. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  1344. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  1345. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  1346. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1347. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1348. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  1349. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  1350. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  1351. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  1352. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  1353. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  1354. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  1355. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1356. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1357. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1358. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  1359. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  1360. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1361. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1362. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1363. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  1364. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1365. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1366. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1367. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  1368. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1369. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1370. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  1371. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  1372. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  1373. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  1374. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  1375. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  1376. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  1377. at java.lang.Thread.run(Thread.java:835) [?:?]
  1378. [2020-01-07T15:38:01,171][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  1379. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1380. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1381. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  1382. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  1383. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1384. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1385. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1386. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1387. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1388. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1389. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1390. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1391. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1392. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1393. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1394. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1395. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1396. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1397. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1398. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1399. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1400. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1401. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1402. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1403. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1404. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1405. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1406. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1407. at java.lang.Thread.run(Thread.java:835) [?:?]
  1408. [2020-01-07T15:38:11,173][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  1409. [2020-01-07T15:38:11,175][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  1410. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1411. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1412. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  1413. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  1414. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1415. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1416. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1417. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1418. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1419. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1420. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1421. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1422. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1423. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1424. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1425. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1426. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1427. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1428. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1429. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1430. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1431. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1432. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1433. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1434. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1435. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1436. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1437. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1438. at java.lang.Thread.run(Thread.java:835) [?:?]
  1439. [2020-01-07T15:38:11,183][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  1440. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1441. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1442. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1443. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1444. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1445. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1446. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1447. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1448. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1449. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1450. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1451. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1452. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1453. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1454. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1455. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1456. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1457. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1458. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1459. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1460. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1461. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1462. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1463. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1464. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1465. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1466. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1467. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1468. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1469. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1470. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1471. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1472. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  1473. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1474. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1475. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1476. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1477. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1478. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1479. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1480. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1481. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1482. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1483. at java.lang.Thread.run(Thread.java:835) [?:?]
  1484. [2020-01-07T15:38:11,265][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  1485. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1486. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1487. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1488. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1489. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1490. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1491. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1492. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1493. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1494. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1495. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1496. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1497. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1498. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1499. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1500. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1501. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1502. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1503. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1504. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1505. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1506. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1507. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1508. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1509. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1510. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1511. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1512. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1513. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1514. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1515. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1516. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1517. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  1518. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  1519. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  1520. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  1521. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  1522. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  1523. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  1524. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1525. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  1526. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1527. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  1528. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  1529. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  1530. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  1531. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  1532. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1533. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1534. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  1535. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  1536. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  1537. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  1538. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  1539. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  1540. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  1541. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1542. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1543. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1544. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  1545. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  1546. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1547. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1548. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1549. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  1550. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1551. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1552. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1553. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  1554. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1555. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1556. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  1557. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  1558. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  1559. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  1560. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  1561. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  1562. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  1563. at java.lang.Thread.run(Thread.java:835) [?:?]
  1564. [2020-01-07T15:38:21,171][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  1565. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1566. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1567. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  1568. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  1569. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1570. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1571. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1572. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1573. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1574. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1575. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1576. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1577. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1578. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1579. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1580. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1581. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1582. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1583. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1584. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1585. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1586. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1587. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1588. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1589. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1590. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1591. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1592. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1593. at java.lang.Thread.run(Thread.java:835) [?:?]
  1594. [2020-01-07T15:38:31,175][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  1595. [2020-01-07T15:38:31,176][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  1596. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1597. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1598. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  1599. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  1600. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1601. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1602. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1603. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1604. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1605. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1606. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1607. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1608. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1609. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1610. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1611. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1612. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1613. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1614. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1615. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1616. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1617. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1618. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1619. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1620. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1621. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1622. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1623. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1624. at java.lang.Thread.run(Thread.java:835) [?:?]
  1625. [2020-01-07T15:38:31,186][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  1626. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1627. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1628. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1629. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1630. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1631. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1632. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1633. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1634. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1635. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1636. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1637. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1638. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1639. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1640. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1641. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1642. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1643. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1644. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1645. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1646. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1647. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1648. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1649. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1650. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1651. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1652. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1653. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1654. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1655. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1656. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1657. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1658. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  1659. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1660. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1661. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1662. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1663. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1664. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1665. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1666. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1667. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1668. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1669. at java.lang.Thread.run(Thread.java:835) [?:?]
  1670. [2020-01-07T15:38:31,259][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  1671. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1672. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1673. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1674. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1675. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1676. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1677. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1678. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1679. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1680. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1681. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1682. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1683. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1684. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1685. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1686. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1687. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1688. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1689. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1690. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1691. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1692. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1693. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1694. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1695. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1696. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1697. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1698. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1699. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1700. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1701. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1702. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1703. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  1704. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  1705. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  1706. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  1707. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  1708. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  1709. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  1710. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1711. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  1712. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1713. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  1714. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  1715. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  1716. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  1717. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  1718. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1719. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1720. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  1721. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  1722. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  1723. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  1724. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  1725. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  1726. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  1727. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1728. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1729. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1730. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  1731. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  1732. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1733. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1734. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1735. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  1736. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1737. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1738. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1739. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  1740. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1741. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1742. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  1743. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  1744. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  1745. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  1746. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  1747. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  1748. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  1749. at java.lang.Thread.run(Thread.java:835) [?:?]
  1750. [2020-01-07T15:38:41,172][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  1751. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1752. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1753. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  1754. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  1755. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1756. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1757. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1758. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1759. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1760. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1761. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1762. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1763. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1764. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1765. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1766. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1767. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1768. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1769. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1770. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1771. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1772. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1773. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1774. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1775. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1776. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1777. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1778. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1779. at java.lang.Thread.run(Thread.java:835) [?:?]
  1780. [2020-01-07T15:38:51,174][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  1781. [2020-01-07T15:38:51,176][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  1782. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1783. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1784. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  1785. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  1786. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1787. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1788. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1789. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1790. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1791. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1792. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1793. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1794. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1795. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1796. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1797. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1798. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1799. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1800. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1801. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1802. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1803. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1804. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1805. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1806. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1807. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1808. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1809. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1810. at java.lang.Thread.run(Thread.java:835) [?:?]
  1811. [2020-01-07T15:38:51,185][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  1812. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1813. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1814. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1815. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1816. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1817. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1818. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1819. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1820. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1821. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1822. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1823. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1824. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1825. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1826. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1827. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1828. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1829. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1830. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1831. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1832. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1833. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1834. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1835. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1836. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1837. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1838. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1839. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1840. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1841. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1842. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1843. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1844. at org.elasticsearch.xpack.core.ml.client.MachineLearningClient.getJobsStats(MachineLearningClient.java:209) ~[x-pack-core-6.7.1.jar:6.7.1]
  1845. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:78) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1846. at org.elasticsearch.xpack.monitoring.collector.ml.JobStatsCollector.doCollect(JobStatsCollector.java:38) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1847. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1848. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1849. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1850. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1851. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1852. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1853. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1854. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1855. at java.lang.Thread.run(Thread.java:835) [?:?]
  1856. [2020-01-07T15:38:51,255][ERROR][o.e.x.m.c.c.ClusterStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [cluster_stats] failed to collect data
  1857. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1858. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1859. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
  1860. at org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:298) ~[elasticsearch-6.7.1.jar:6.7.1]
  1861. at org.elasticsearch.action.search.TransportSearchAction.lambda$doExecute$4(TransportSearchAction.java:194) ~[elasticsearch-6.7.1.jar:6.7.1]
  1862. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1863. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:114) ~[elasticsearch-6.7.1.jar:6.7.1]
  1864. at org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1865. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:216) ~[elasticsearch-6.7.1.jar:6.7.1]
  1866. at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:70) ~[elasticsearch-6.7.1.jar:6.7.1]
  1867. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1868. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1869. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1870. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1871. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1872. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1873. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1874. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1875. at org.elasticsearch.client.support.AbstractClient.search(AbstractClient.java:537) ~[elasticsearch-6.7.1.jar:6.7.1]
  1876. at org.elasticsearch.xpack.core.ClientHelper.executeAsyncWithOrigin(ClientHelper.java:82) ~[?:?]
  1877. at org.elasticsearch.xpack.ml.job.persistence.JobConfigProvider.expandJobsIdsWithoutMissingCheck(JobConfigProvider.java:655) ~[?:?]
  1878. at org.elasticsearch.xpack.ml.job.JobManager.expandJobIds(JobManager.java:260) ~[?:?]
  1879. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:78) ~[?:?]
  1880. at org.elasticsearch.xpack.ml.action.TransportGetJobsStatsAction.doExecute(TransportGetJobsStatsAction.java:52) ~[?:?]
  1881. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1882. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1883. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1884. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1885. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1886. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1887. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1888. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1889. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet$Retriever.execute(MachineLearningFeatureSet.java:210) ~[?:?]
  1890. at org.elasticsearch.xpack.ml.MachineLearningFeatureSet.usage(MachineLearningFeatureSet.java:141) ~[?:?]
  1891. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction.lambda$masterOperation$0(TransportXPackUsageAction.java:71) ~[?:?]
  1892. at org.elasticsearch.xpack.core.common.IteratingActionListener.onResponse(IteratingActionListener.java:117) ~[?:?]
  1893. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:76) ~[?:?]
  1894. at org.elasticsearch.xpack.core.action.TransportXPackUsageAction$2.onResponse(TransportXPackUsageAction.java:71) ~[?:?]
  1895. at org.elasticsearch.xpack.watcher.WatcherFeatureSet.lambda$usage$0(WatcherFeatureSet.java:86) ~[?:?]
  1896. at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:61) ~[elasticsearch-6.7.1.jar:6.7.1]
  1897. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:85) ~[elasticsearch-6.7.1.jar:6.7.1]
  1898. at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1899. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.finishHim(TransportNodesAction.java:251) ~[elasticsearch-6.7.1.jar:6.7.1]
  1900. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.onOperation(TransportNodesAction.java:228) ~[elasticsearch-6.7.1.jar:6.7.1]
  1901. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction.access$100(TransportNodesAction.java:151) ~[elasticsearch-6.7.1.jar:6.7.1]
  1902. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:205) ~[elasticsearch-6.7.1.jar:6.7.1]
  1903. at org.elasticsearch.action.support.nodes.TransportNodesAction$AsyncAction$1.handleResponse(TransportNodesAction.java:195) ~[elasticsearch-6.7.1.jar:6.7.1]
  1904. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1905. at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1098) ~[elasticsearch-6.7.1.jar:6.7.1]
  1906. at org.elasticsearch.transport.TcpTransport$1.doRun(TcpTransport.java:985) ~[elasticsearch-6.7.1.jar:6.7.1]
  1907. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.7.1.jar:6.7.1]
  1908. at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) ~[elasticsearch-6.7.1.jar:6.7.1]
  1909. at org.elasticsearch.transport.TcpTransport.handleResponse(TcpTransport.java:977) ~[elasticsearch-6.7.1.jar:6.7.1]
  1910. at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:952) ~[elasticsearch-6.7.1.jar:6.7.1]
  1911. at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:763) ~[elasticsearch-6.7.1.jar:6.7.1]
  1912. at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:53) ~[?:?]
  1913. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1914. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1915. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1916. at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[?:?]
  1917. at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[?:?]
  1918. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1919. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1920. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1921. at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
  1922. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1923. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1924. at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
  1925. at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[?:?]
  1926. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
  1927. at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
  1928. at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[?:?]
  1929. at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
  1930. at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:656) ~[?:?]
  1931. at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:556) ~[?:?]
  1932. at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:510) ~[?:?]
  1933. at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:470) ~[?:?]
  1934. at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[?:?]
  1935. at java.lang.Thread.run(Thread.java:835) [?:?]
  1936. [2020-01-07T15:39:01,173][ERROR][o.e.x.m.c.i.IndexRecoveryCollector] [es-master-6f6bf6f789-jn4rd] collector [index_recovery] failed to collect data
  1937. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1938. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1939. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:116) ~[elasticsearch-6.7.1.jar:6.7.1]
  1940. at org.elasticsearch.action.admin.indices.recovery.TransportRecoveryAction.checkGlobalBlock(TransportRecoveryAction.java:52) ~[elasticsearch-6.7.1.jar:6.7.1]
  1941. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1942. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1943. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1944. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1945. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1946. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1947. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1948. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1949. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1950. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1951. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1952. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1953. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1954. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1955. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1956. at org.elasticsearch.xpack.monitoring.collector.indices.IndexRecoveryCollector.doCollect(IndexRecoveryCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1957. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1958. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1959. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1960. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1961. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1962. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1963. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1964. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1965. at java.lang.Thread.run(Thread.java:835) [?:?]
  1966. [2020-01-07T15:39:11,175][ERROR][o.e.x.m.c.c.StatsCollector] [es-master-6f6bf6f789-jn4rd] collector [ccr_stats] timed out when collecting data
  1967. [2020-01-07T15:39:11,176][ERROR][o.e.x.m.c.i.IndexStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [index-stats] failed to collect data
  1968. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1969. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  1970. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:72) ~[elasticsearch-6.7.1.jar:6.7.1]
  1971. at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.checkGlobalBlock(TransportIndicesStatsAction.java:49) ~[elasticsearch-6.7.1.jar:6.7.1]
  1972. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction$AsyncAction.<init>(TransportBroadcastByNodeAction.java:258) ~[elasticsearch-6.7.1.jar:6.7.1]
  1973. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:236) ~[elasticsearch-6.7.1.jar:6.7.1]
  1974. at org.elasticsearch.action.support.broadcast.node.TransportBroadcastByNodeAction.doExecute(TransportBroadcastByNodeAction.java:78) ~[elasticsearch-6.7.1.jar:6.7.1]
  1975. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.7.1.jar:6.7.1]
  1976. at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:120) ~[?:?]
  1977. at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.7.1.jar:6.7.1]
  1978. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.7.1.jar:6.7.1]
  1979. at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) ~[elasticsearch-6.7.1.jar:6.7.1]
  1980. at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
  1981. at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) ~[elasticsearch-6.7.1.jar:6.7.1]
  1982. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403) ~[elasticsearch-6.7.1.jar:6.7.1]
  1983. at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:391) ~[elasticsearch-6.7.1.jar:6.7.1]
  1984. at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1262) ~[elasticsearch-6.7.1.jar:6.7.1]
  1985. at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:46) ~[elasticsearch-6.7.1.jar:6.7.1]
  1986. at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:60) ~[elasticsearch-6.7.1.jar:6.7.1]
  1987. at org.elasticsearch.xpack.monitoring.collector.indices.IndexStatsCollector.doCollect(IndexStatsCollector.java:73) ~[x-pack-monitoring-6.7.1.jar:6.7.1]
  1988. at org.elasticsearch.xpack.monitoring.collector.Collector.collect(Collector.java:85) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1989. at org.elasticsearch.xpack.monitoring.MonitoringService$MonitoringExecution$1.doRun(MonitoringService.java:272) [x-pack-monitoring-6.7.1.jar:6.7.1]
  1990. at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-6.7.1.jar:6.7.1]
  1991. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  1992. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  1993. at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
  1994. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  1995. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  1996. at java.lang.Thread.run(Thread.java:835) [?:?]
  1997. [2020-01-07T15:39:11,181][ERROR][o.e.x.m.c.m.JobStatsCollector] [es-master-6f6bf6f789-jn4rd] collector [job_stats] failed to collect data
  1998. org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
  1999. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
  2000. at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedRaiseException(ClusterBlocks.java:177) ~[elasticsearch-6.7.1.jar:6.7.1]
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!