API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Aug 28th, 2015
238
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 143.01 KB | None | 0 0
raw download clone embed print report
  1. [2015-08-25 13:05:30,280][INFO ][node ] [logstash_tud] stopping ...
  2. [2015-08-25 13:05:30,448][INFO ][node ] [logstash_tud] stopped
  3. [2015-08-25 13:05:30,448][INFO ][node ] [logstash_tud] closing ...
  4. [2015-08-25 13:05:30,651][INFO ][node ] [logstash_tud] closed
  5. [2015-08-25 13:05:59,523][INFO ][node ] [logstash_tud] version[1.6.0], pid[6528], build[cdd3ac4/2015-06-09T13:36:34Z]
  6. [2015-08-25 13:05:59,524][INFO ][node ] [logstash_tud] initializing ...
  7. [2015-08-25 13:05:59,524][DEBUG][node ] [logstash_tud] using home [/opt/elkapp/elasticsearch], config [/opt/elkapp/elasticsearch/config], data [[/opt/elkdata/elasticsearch]], logs [/opt/elkdata/elasticsearch/logs], work [/opt/elkdata/elasticsearch/tmp], plugins [/opt/elkapp/elasticsearch/plugins]
  8. [2015-08-25 13:05:59,531][DEBUG][plugins ] [logstash_tud] [/opt/elkapp/elasticsearch/plugins] directory does not exist.
  9. [2015-08-25 13:05:59,532][DEBUG][plugins ] [logstash_tud] [/opt/elkapp/elasticsearch/plugins] directory does not exist.
  10. [2015-08-25 13:05:59,532][INFO ][plugins ] [logstash_tud] loaded [], sites []
  11. [2015-08-25 13:05:59,578][DEBUG][common.compress.lzf ] using encoder [VanillaChunkDecoder] and decoder[{}]
  12. [2015-08-25 13:05:59,614][DEBUG][env ] [logstash_tud] using node location [[org.elasticsearch.env.NodeEnvironment$NodePath@5a8e6209]], local_node_id [0]
  13. [2015-08-25 13:05:59,628][DEBUG][env ] [logstash_tud] node data locations details:
  14. -> /opt/elkdata/elasticsearch/elasticsearch/nodes/0, free_space [462.4gb], usable_space [414.4gb], total_space [944.8gb], mount [/opt/elkdata (/dev/mapper/ccblst01vg-elkdata)], type [ext4]
  15. [2015-08-25 13:05:59,641][DEBUG][threadpool ] [logstash_tud] creating thread_pool [generic], type [cached], keep_alive [30s]
  16. [2015-08-25 13:05:59,655][DEBUG][threadpool ] [logstash_tud] creating thread_pool [index], type [fixed], size [2], queue_size [200]
  17. [2015-08-25 13:05:59,661][DEBUG][threadpool ] [logstash_tud] creating thread_pool [bulk], type [fixed], size [2], queue_size [50]
  18. [2015-08-25 13:05:59,661][DEBUG][threadpool ] [logstash_tud] creating thread_pool [get], type [fixed], size [2], queue_size [1k]
  19. [2015-08-25 13:05:59,662][DEBUG][threadpool ] [logstash_tud] creating thread_pool [search], type [fixed], size [4], queue_size [1k]
  20. [2015-08-25 13:05:59,662][DEBUG][threadpool ] [logstash_tud] creating thread_pool [suggest], type [fixed], size [2], queue_size [1k]
  21. [2015-08-25 13:05:59,662][DEBUG][threadpool ] [logstash_tud] creating thread_pool [percolate], type [fixed], size [2], queue_size [1k]
  22. [2015-08-25 13:05:59,663][DEBUG][threadpool ] [logstash_tud] creating thread_pool [management], type [scaling], min [1], size [5], keep_alive [5m]
  23. [2015-08-25 13:05:59,664][DEBUG][threadpool ] [logstash_tud] creating thread_pool [listener], type [fixed], size [1], queue_size [null]
  24. [2015-08-25 13:05:59,664][DEBUG][threadpool ] [logstash_tud] creating thread_pool [flush], type [scaling], min [1], size [1], keep_alive [5m]
  25. [2015-08-25 13:05:59,664][DEBUG][threadpool ] [logstash_tud] creating thread_pool [merge], type [scaling], min [1], size [1], keep_alive [5m]
  26. [2015-08-25 13:05:59,665][DEBUG][threadpool ] [logstash_tud] creating thread_pool [refresh], type [scaling], min [1], size [1], keep_alive [5m]
  27. [2015-08-25 13:05:59,665][DEBUG][threadpool ] [logstash_tud] creating thread_pool [warmer], type [scaling], min [1], size [1], keep_alive [5m]
  28. [2015-08-25 13:05:59,665][DEBUG][threadpool ] [logstash_tud] creating thread_pool [snapshot], type [scaling], min [1], size [1], keep_alive [5m]
  29. [2015-08-25 13:05:59,665][DEBUG][threadpool ] [logstash_tud] creating thread_pool [optimize], type [fixed], size [1], queue_size [null]
  30. [2015-08-25 13:05:59,666][DEBUG][threadpool ] [logstash_tud] creating thread_pool [fetch_shard_started], type [scaling], min [1], size [4], keep_alive [5m]
  31. [2015-08-25 13:05:59,666][DEBUG][threadpool ] [logstash_tud] creating thread_pool [fetch_shard_store], type [scaling], min [1], size [4], keep_alive [5m]
  32. [2015-08-25 13:06:01,503][DEBUG][monitor.jvm ] [logstash_tud] enabled [true], last_gc_enabled [false], interval [1s], gc_threshold [{default=GcThreshold{name='default', warnThreshold=10000, infoThreshold=5000, debugThreshold=2000}, young=GcThreshold{name='young', warnThreshold=1000, infoThreshold=700, debugThreshold=400}, old=GcThreshold{name='old', warnThreshold=10000, infoThreshold=5000, debugThreshold=2000}}]
  33. [2015-08-25 13:06:02,012][DEBUG][monitor.os ] [logstash_tud] Using probe [org.elasticsearch.monitor.os.SigarOsProbe@5a6482a9] with refresh_interval [1s]
  34. [2015-08-25 13:06:02,016][DEBUG][monitor.process ] [logstash_tud] Using probe [org.elasticsearch.monitor.process.SigarProcessProbe@b967222] with refresh_interval [1s]
  35. [2015-08-25 13:06:02,020][DEBUG][monitor.jvm ] [logstash_tud] Using refresh_interval [1s]
  36. [2015-08-25 13:06:02,021][DEBUG][monitor.network ] [logstash_tud] Using probe [org.elasticsearch.monitor.network.SigarNetworkProbe@336365bc] with refresh_interval [5s]
  37. [2015-08-25 13:06:02,025][DEBUG][monitor.network ] [logstash_tud] net_info
  38. host [server.company.com]
  39. eth0 display_name [eth0]
  40. address [/xxx.xxx.xxx.xxx]
  41. mtu [1500] multicast [true] ptp [false] loopback [false] up [true] virtual [false]
  42. lo display_name [lo]
  43. address [/127.0.0.1]
  44. mtu [65536] multicast [false] ptp [false] loopback [true] up [true] virtual [false]
  45.  
  46. [2015-08-25 13:06:02,029][DEBUG][monitor.fs ] [logstash_tud] Using probe [org.elasticsearch.monitor.fs.SigarFsProbe@3721177d] with refresh_interval [1s]
  47. [2015-08-25 13:06:02,035][DEBUG][common.netty ] using gathering [true]
  48. [2015-08-25 13:06:02,068][DEBUG][discovery.zen.elect ] [logstash_tud] using minimum_master_nodes [-1]
  49. [2015-08-25 13:06:02,070][DEBUG][discovery.zen.ping.multicast] [logstash_tud] using group [224.2.2.4], with port [54328], ttl [3], and address [null]
  50. [2015-08-25 13:06:02,076][DEBUG][discovery.zen.ping.unicast] [logstash_tud] using initial hosts [], with concurrent_connects [10]
  51. [2015-08-25 13:06:02,077][DEBUG][discovery.zen ] [logstash_tud] using ping.timeout [3s], join.timeout [1m], master_election.filter_client [true], master_election.filter_data [false]
  52. [2015-08-25 13:06:02,078][DEBUG][discovery.zen.fd ] [logstash_tud] [master] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
  53. [2015-08-25 13:06:02,081][DEBUG][discovery.zen.fd ] [logstash_tud] [node ] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
  54. [2015-08-25 13:06:02,360][DEBUG][script ] [logstash_tud] using script cache with max_size [100], expire [null]
  55. [2015-08-25 13:06:02,366][DEBUG][cluster.routing.allocation.decider] [logstash_tud] using node_concurrent_recoveries [2], node_initial_primaries_recoveries [4]
  56. [2015-08-25 13:06:02,367][DEBUG][cluster.routing.allocation.decider] [logstash_tud] using [cluster.routing.allocation.allow_rebalance] with [indices_all_active]
  57. [2015-08-25 13:06:02,367][DEBUG][cluster.routing.allocation.decider] [logstash_tud] using [cluster_concurrent_rebalance] with [2]
  58. [2015-08-25 13:06:02,369][DEBUG][indices.recovery ] [logstash_tud] using max_bytes_per_sec[40mb], concurrent_streams [3], file_chunk_size [512kb], translog_size [512kb], translog_ops [1000], and compress [true]
  59. [2015-08-25 13:06:02,453][DEBUG][gateway.local ] [logstash_tud] using initial_shards [quorum]
  60. [2015-08-25 13:06:02,563][DEBUG][http.netty ] [logstash_tud] using max_chunk_size[8kb], max_header_size[8kb], max_initial_line_length[4kb], max_content_length[100mb], receive_predictor[512kb->512kb], pipelining[true], pipelining_max_events[10000]
  61. [2015-08-25 13:06:02,669][DEBUG][indices.store ] [logstash_tud] using indices.store.throttle.type [MERGE], with index.store.throttle.max_bytes_per_sec [20mb]
  62. [2015-08-25 13:06:02,670][DEBUG][indices.memory ] [logstash_tud] using index_buffer_size [1.5gb], with min_shard_index_buffer_size [4mb], max_shard_index_buffer_size [512mb], shard_inactive_time [5m]
  63. [2015-08-25 13:06:02,671][DEBUG][indices.cache.filter ] [logstash_tud] using [node] weighted filter cache with size [10%], actual_size [1.5gb], expire [null], clean_interval [1m]
  64. [2015-08-25 13:06:02,672][DEBUG][indices.fielddata.cache ] [logstash_tud] using size [-1] [-1b], expire [null]
  65. [2015-08-25 13:06:02,683][DEBUG][bulk.udp ] [logstash_tud] using enabled [false], host [null], port [9700-9800], bulk_actions [1000], bulk_size [5mb], flush_interval [5s], concurrent_requests [4]
  66. [2015-08-25 13:06:02,867][INFO ][node ] [logstash_tud] initialized
  67. [2015-08-25 13:06:02,868][INFO ][node ] [logstash_tud] starting ...
  68. [2015-08-25 13:06:02,896][DEBUG][netty.channel.socket.nio.SelectorUtil] Using select timeout of 500
  69. [2015-08-25 13:06:02,896][DEBUG][netty.channel.socket.nio.SelectorUtil] Epoll-bug workaround enabled = false
  70. [2015-08-25 13:06:02,934][DEBUG][transport.netty ] [logstash_tud] using profile[default], worker_count[4], port[9300-9400], bind_host[null], publish_host[null], compress[false], connect_timeout[30s], connections_per_node[2/3/6/1/1], receive_predictor[512kb->512kb]
  71. [2015-08-25 13:06:02,959][DEBUG][transport.netty ] [logstash_tud] Bound profile [default] to address [/0.0.0.0:9300]
  72. [2015-08-25 13:06:02,961][INFO ][transport ] [logstash_tud] bound_address {inet[/0.0.0.0:9300]}, publish_address {inet[/xxx.xxx.xxx.xxx:9300]}
  73. [2015-08-25 13:06:02,975][INFO ][discovery ] [logstash_tud] elasticsearch/16Zw6DZaQsGV511PbWd55Q
  74. [2015-08-25 13:06:02,975][DEBUG][cluster.service ] [logstash_tud] processing [initial_join]: execute
  75. [2015-08-25 13:06:02,976][DEBUG][cluster.service ] [logstash_tud] processing [initial_join]: took 0s no change in cluster_state
  76. [2015-08-25 13:06:03,041][DEBUG][transport.netty ] [logstash_tud] connected to node [[logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true}]
  77. [2015-08-25 13:06:06,739][DEBUG][discovery.zen ] [logstash_tud] filtered ping responses: (filter_client[true], filter_data[false]) {none}
  78. [2015-08-25 13:06:06,742][DEBUG][cluster.service ] [logstash_tud] processing [zen-disco-join (elected_as_master)]: execute
  79. [2015-08-25 13:06:06,760][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [1], source [zen-disco-join (elected_as_master)]
  80. [2015-08-25 13:06:06,762][INFO ][cluster.service ] [logstash_tud] new_master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true}, reason: zen-disco-join (elected_as_master)
  81. [2015-08-25 13:06:06,763][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 1
  82. [2015-08-25 13:06:06,775][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 1
  83. [2015-08-25 13:06:06,780][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  84. [2015-08-25 13:06:06,781][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  85. [2015-08-25 13:06:06,783][DEBUG][cluster.service ] [logstash_tud] processing [zen-disco-join (elected_as_master)]: took 40ms done applying updated cluster_state (version: 1)
  86. [2015-08-25 13:06:06,786][DEBUG][gateway.none ] [logstash_tud] performing state recovery
  87. [2015-08-25 13:06:06,788][DEBUG][cluster.service ] [logstash_tud] processing [local-gateway-elected-state]: execute
  88. [2015-08-25 13:06:06,790][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [2], source [local-gateway-elected-state]
  89. [2015-08-25 13:06:06,791][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 2
  90. [2015-08-25 13:06:06,791][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 2
  91. [2015-08-25 13:06:06,810][INFO ][gateway ] [logstash_tud] recovered [0] indices into cluster_state
  92. [2015-08-25 13:06:06,813][DEBUG][cluster.service ] [logstash_tud] processing [local-gateway-elected-state]: took 23ms done applying updated cluster_state (version: 2)
  93. [2015-08-25 13:06:06,813][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  94. [2015-08-25 13:06:06,813][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  95. [2015-08-25 13:06:06,821][INFO ][http ] [logstash_tud] bound_address {inet[/0.0.0.0:9200]}, publish_address {inet[/xxx.xxx.xxx.xxx:9200]}
  96. [2015-08-25 13:06:06,822][INFO ][node ] [logstash_tud] started
  97. [2015-08-25 13:06:16,777][DEBUG][cluster.service ] [logstash_tud] processing [routing-table-updater]: execute
  98. [2015-08-25 13:06:16,778][DEBUG][cluster.service ] [logstash_tud] processing [routing-table-updater]: took 0s no change in cluster_state
  99. [2015-08-25 13:09:05,390][DEBUG][action.admin.cluster.health] [logstash_tud] observer: timeout notification from cluster service. timeout setting [5s], time since start [5s]
  100. [2015-08-25 13:09:06,224][DEBUG][cluster.service ] [logstash_tud] processing [create-index-template [logstash], cause [api]]: execute
  101. [2015-08-25 13:09:06,225][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [3], source [create-index-template [logstash], cause [api]]
  102. [2015-08-25 13:09:06,225][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 3
  103. [2015-08-25 13:09:06,225][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 3
  104. [2015-08-25 13:09:06,227][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  105. [2015-08-25 13:09:06,227][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  106. [2015-08-25 13:09:06,227][DEBUG][cluster.service ] [logstash_tud] processing [create-index-template [logstash], cause [api]]: took 2ms done applying updated cluster_state (version: 3)
  107. [2015-08-25 13:09:07,446][DEBUG][cluster.service ] [logstash_tud] processing [create-index [logstash-2015.08.25], cause [auto(bulk api)]]: execute
  108. [2015-08-25 13:09:07,453][DEBUG][indices ] [logstash_tud] creating Index [logstash-2015.08.25], shards [5]/[1]
  109. [2015-08-25 13:09:07,856][DEBUG][index.mapper ] [logstash_tud] [logstash-2015.08.25] using dynamic[true], default mapping: default_mapping_location[null], loaded_from[jar:file:/opt/elkapp/elasticsearch/lib/elasticsearch-1.6.0.jar!/org/elasticsearch/index/mapper/default-mapping.json], default percolator mapping: location[null], loaded_from[null]
  110. [2015-08-25 13:09:07,856][DEBUG][index.cache.query.parser.resident] [logstash_tud] [logstash-2015.08.25] using [resident] query cache with max_size [100], expire [null]
  111. [2015-08-25 13:09:07,887][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using index.store.throttle.type [node], with index.store.throttle.max_bytes_per_sec [0b]
  112. [2015-08-25 13:09:08,168][INFO ][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] creating index, cause [auto(bulk api)], templates [logstash], shards [5]/[1], mappings [cluster_b_io_log_pattern, _default_, cluster_c_io_log_pattern, cluster_a_error_log_pattern]
  113. [2015-08-25 13:09:08,204][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing ... (reason [cleaning up after validating index on master])
  114. [2015-08-25 13:09:08,206][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing index service (reason [cleaning up after validating index on master])
  115. [2015-08-25 13:09:08,206][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing index cache (reason [cleaning up after validating index on master])
  116. [2015-08-25 13:09:08,206][DEBUG][index.cache.filter.weighted] [logstash_tud] [logstash-2015.08.25] full cache clear, reason [close]
  117. [2015-08-25 13:09:08,206][DEBUG][index.cache.fixedbitset ] [logstash_tud] [logstash-2015.08.25] clearing all bitsets because [close]
  118. [2015-08-25 13:09:08,206][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] clearing index field data (reason [cleaning up after validating index on master])
  119. [2015-08-25 13:09:08,207][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing analysis service (reason [cleaning up after validating index on master])
  120. [2015-08-25 13:09:08,207][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing index engine (reason [cleaning up after validating index on master])
  121. [2015-08-25 13:09:08,207][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing index gateway (reason [cleaning up after validating index on master])
  122. [2015-08-25 13:09:08,207][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing mapper service (reason [cleaning up after validating index on master])
  123. [2015-08-25 13:09:08,208][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing index query parser service (reason [cleaning up after validating index on master])
  124. [2015-08-25 13:09:08,208][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closing index service (reason [cleaning up after validating index on master])
  125. [2015-08-25 13:09:08,209][DEBUG][indices ] [logstash_tud] [logstash-2015.08.25] closed... (reason [cleaning up after validating index on master])
  126. [2015-08-25 13:09:08,211][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [4], source [create-index [logstash-2015.08.25], cause [auto(bulk api)]]
  127. [2015-08-25 13:09:08,211][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 4
  128. [2015-08-25 13:09:08,211][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 4
  129. [2015-08-25 13:09:08,211][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25] creating index
  130. [2015-08-25 13:09:08,212][DEBUG][indices ] [logstash_tud] creating Index [logstash-2015.08.25], shards [5]/[1]
  131. [2015-08-25 13:09:08,249][DEBUG][index.mapper ] [logstash_tud] [logstash-2015.08.25] using dynamic[true], default mapping: default_mapping_location[null], loaded_from[jar:file:/opt/elkapp/elasticsearch/lib/elasticsearch-1.6.0.jar!/org/elasticsearch/index/mapper/default-mapping.json], default percolator mapping: location[null], loaded_from[null]
  132. [2015-08-25 13:09:08,250][DEBUG][index.cache.query.parser.resident] [logstash_tud] [logstash-2015.08.25] using [resident] query cache with max_size [100], expire [null]
  133. [2015-08-25 13:09:08,251][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using index.store.throttle.type [node], with index.store.throttle.max_bytes_per_sec [0b]
  134. [2015-08-25 13:09:08,253][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25] adding mapping [_default_], source [{"_default_":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}}}}}]
  135. [2015-08-25 13:09:08,259][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25] adding mapping [cluster_c_io_log_pattern], source [{"cluster_c_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}}}}}]
  136. [2015-08-25 13:09:08,264][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25] adding mapping [cluster_b_io_log_pattern], source [{"cluster_b_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}}}}}]
  137. [2015-08-25 13:09:08,269][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25] adding mapping [cluster_a_error_log_pattern], source [{"cluster_a_error_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}}}}}]
  138. [2015-08-25 13:09:08,274][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25][0] creating shard
  139. [2015-08-25 13:09:08,276][DEBUG][index ] [logstash_tud] [logstash-2015.08.25] creating shard_id [logstash-2015.08.25][0]
  140. [2015-08-25 13:09:08,407][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/0/index] as shard's index location
  141. [2015-08-25 13:09:08,418][DEBUG][index.store ] [logstash_tud] [logstash-2015.08.25][0] store stats are refreshed with refresh_interval [10s]
  142. [2015-08-25 13:09:08,419][DEBUG][index.merge.scheduler ] [logstash_tud] [logstash-2015.08.25][0] using [concurrent] merge scheduler with max_thread_count[1], max_merge_count[3]
  143. [2015-08-25 13:09:08,419][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/0/translog] as shard's translog location
  144. [2015-08-25 13:09:08,427][DEBUG][index.deletionpolicy ] [logstash_tud] [logstash-2015.08.25][0] Using [keep_only_last] deletion policy
  145. [2015-08-25 13:09:08,431][DEBUG][index.merge.policy ] [logstash_tud] [logstash-2015.08.25][0] using [tiered] merge mergePolicy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[10], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[10.0], reclaim_deletes_weight[2.0]
  146. [2015-08-25 13:09:08,433][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][0] state: [CREATED]
  147. [2015-08-25 13:09:08,434][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][0] scheduling optimizer / merger every 1s
  148. [2015-08-25 13:09:08,435][DEBUG][index.translog ] [logstash_tud] [logstash-2015.08.25][0] interval [5s], flush_threshold_ops [2147483647], flush_threshold_size [512mb], flush_threshold_period [30m]
  149. [2015-08-25 13:09:08,444][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][0] state: [CREATED]->[RECOVERING], reason [from gateway]
  150. [2015-08-25 13:09:08,445][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25][3] creating shard
  151. [2015-08-25 13:09:08,445][DEBUG][index ] [logstash_tud] [logstash-2015.08.25] creating shard_id [logstash-2015.08.25][3]
  152. [2015-08-25 13:09:08,456][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][0] starting recovery from _none_ ...
  153. [2015-08-25 13:09:08,459][DEBUG][index.gateway.none ] [logstash_tud] [logstash-2015.08.25][0] cleaning shard content before creation
  154. [2015-08-25 13:09:08,472][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/3/index] as shard's index location
  155. [2015-08-25 13:09:08,474][DEBUG][index.store ] [logstash_tud] [logstash-2015.08.25][3] store stats are refreshed with refresh_interval [10s]
  156. [2015-08-25 13:09:08,475][DEBUG][index.merge.scheduler ] [logstash_tud] [logstash-2015.08.25][3] using [concurrent] merge scheduler with max_thread_count[1], max_merge_count[3]
  157. [2015-08-25 13:09:08,475][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/3/translog] as shard's translog location
  158. [2015-08-25 13:09:08,488][DEBUG][index.deletionpolicy ] [logstash_tud] [logstash-2015.08.25][3] Using [keep_only_last] deletion policy
  159. [2015-08-25 13:09:08,488][DEBUG][index.merge.policy ] [logstash_tud] [logstash-2015.08.25][3] using [tiered] merge mergePolicy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[10], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[10.0], reclaim_deletes_weight[2.0]
  160. [2015-08-25 13:09:08,489][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][3] state: [CREATED]
  161. [2015-08-25 13:09:08,489][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][3] scheduling optimizer / merger every 1s
  162. [2015-08-25 13:09:08,489][DEBUG][index.translog ] [logstash_tud] [logstash-2015.08.25][3] interval [5s], flush_threshold_ops [2147483647], flush_threshold_size [512mb], flush_threshold_period [30m]
  163. [2015-08-25 13:09:08,490][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][3] state: [CREATED]->[RECOVERING], reason [from gateway]
  164. [2015-08-25 13:09:08,500][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25][1] creating shard
  165. [2015-08-25 13:09:08,500][DEBUG][index ] [logstash_tud] [logstash-2015.08.25] creating shard_id [logstash-2015.08.25][1]
  166. [2015-08-25 13:09:08,509][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][3] starting recovery from _none_ ...
  167. [2015-08-25 13:09:08,509][DEBUG][index.gateway.none ] [logstash_tud] [logstash-2015.08.25][3] cleaning shard content before creation
  168. [2015-08-25 13:09:08,529][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/1/index] as shard's index location
  169. [2015-08-25 13:09:08,531][DEBUG][index.store ] [logstash_tud] [logstash-2015.08.25][1] store stats are refreshed with refresh_interval [10s]
  170. [2015-08-25 13:09:08,531][DEBUG][index.merge.scheduler ] [logstash_tud] [logstash-2015.08.25][1] using [concurrent] merge scheduler with max_thread_count[1], max_merge_count[3]
  171. [2015-08-25 13:09:08,531][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/1/translog] as shard's translog location
  172. [2015-08-25 13:09:08,532][DEBUG][index.deletionpolicy ] [logstash_tud] [logstash-2015.08.25][1] Using [keep_only_last] deletion policy
  173. [2015-08-25 13:09:08,532][DEBUG][index.merge.policy ] [logstash_tud] [logstash-2015.08.25][1] using [tiered] merge mergePolicy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[10], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[10.0], reclaim_deletes_weight[2.0]
  174. [2015-08-25 13:09:08,532][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][1] state: [CREATED]
  175. [2015-08-25 13:09:08,553][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][1] scheduling optimizer / merger every 1s
  176. [2015-08-25 13:09:08,554][DEBUG][index.translog ] [logstash_tud] [logstash-2015.08.25][1] interval [5s], flush_threshold_ops [2147483647], flush_threshold_size [512mb], flush_threshold_period [30m]
  177. [2015-08-25 13:09:08,554][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][1] state: [CREATED]->[RECOVERING], reason [from gateway]
  178. [2015-08-25 13:09:08,564][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25][2] creating shard
  179. [2015-08-25 13:09:08,565][DEBUG][index ] [logstash_tud] [logstash-2015.08.25] creating shard_id [logstash-2015.08.25][2]
  180. [2015-08-25 13:09:08,570][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/2/index] as shard's index location
  181. [2015-08-25 13:09:08,571][DEBUG][index.store ] [logstash_tud] [logstash-2015.08.25][2] store stats are refreshed with refresh_interval [10s]
  182. [2015-08-25 13:09:08,571][DEBUG][index.merge.scheduler ] [logstash_tud] [logstash-2015.08.25][2] using [concurrent] merge scheduler with max_thread_count[1], max_merge_count[3]
  183. [2015-08-25 13:09:08,571][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/2/translog] as shard's translog location
  184. [2015-08-25 13:09:08,572][DEBUG][index.deletionpolicy ] [logstash_tud] [logstash-2015.08.25][2] Using [keep_only_last] deletion policy
  185. [2015-08-25 13:09:08,572][DEBUG][index.merge.policy ] [logstash_tud] [logstash-2015.08.25][2] using [tiered] merge mergePolicy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[10], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[10.0], reclaim_deletes_weight[2.0]
  186. [2015-08-25 13:09:08,572][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][2] state: [CREATED]
  187. [2015-08-25 13:09:08,572][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][2] scheduling optimizer / merger every 1s
  188. [2015-08-25 13:09:08,572][DEBUG][index.translog ] [logstash_tud] [logstash-2015.08.25][2] interval [5s], flush_threshold_ops [2147483647], flush_threshold_size [512mb], flush_threshold_period [30m]
  189. [2015-08-25 13:09:08,573][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][2] state: [CREATED]->[RECOVERING], reason [from gateway]
  190. [2015-08-25 13:09:08,573][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][1] starting recovery from _none_ ...
  191. [2015-08-25 13:09:08,576][DEBUG][index.gateway.none ] [logstash_tud] [logstash-2015.08.25][1] cleaning shard content before creation
  192. [2015-08-25 13:09:08,594][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][2] starting recovery from _none_ ...
  193. [2015-08-25 13:09:08,595][DEBUG][index.gateway.none ] [logstash_tud] [logstash-2015.08.25][2] cleaning shard content before creation
  194. [2015-08-25 13:09:08,645][DEBUG][index.engine ] [logstash_tud] [logstash-2015.08.25][3] [[logstash-2015.08.25][3]] skipping check for 3x segments
  195. [2015-08-25 13:09:08,645][DEBUG][index.engine ] [logstash_tud] [logstash-2015.08.25][0] [[logstash-2015.08.25][0]] skipping check for 3x segments
  196. [2015-08-25 13:09:08,677][DEBUG][index.engine ] [logstash_tud] [logstash-2015.08.25][1] [[logstash-2015.08.25][1]] skipping check for 3x segments
  197. [2015-08-25 13:09:08,679][DEBUG][index.engine ] [logstash_tud] [logstash-2015.08.25][2] [[logstash-2015.08.25][2]] skipping check for 3x segments
  198. [2015-08-25 13:09:08,757][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][2] scheduling refresher every 5s
  199. [2015-08-25 13:09:08,758][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][1] scheduling refresher every 5s
  200. [2015-08-25 13:09:08,755][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][0] scheduling refresher every 5s
  201. [2015-08-25 13:09:08,755][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][3] scheduling refresher every 5s
  202. [2015-08-25 13:09:08,759][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][2] state: [RECOVERING]->[POST_RECOVERY], reason [post recovery from gateway]
  203. [2015-08-25 13:09:08,759][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][2] recovery completed from [_none_], took [186ms]
  204. [2015-08-25 13:09:08,759][DEBUG][cluster.action.shard ] [logstash_tud] sending shard started for [logstash-2015.08.25][2], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  205. [2015-08-25 13:09:08,759][DEBUG][cluster.action.shard ] [logstash_tud] received shard started for [logstash-2015.08.25][2], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  206. [2015-08-25 13:09:08,760][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][1] state: [RECOVERING]->[POST_RECOVERY], reason [post recovery from gateway]
  207. [2015-08-25 13:09:08,760][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][1] recovery completed from [_none_], took [206ms]
  208. [2015-08-25 13:09:08,760][DEBUG][cluster.service ] [logstash_tud] processing [create-index [logstash-2015.08.25], cause [auto(bulk api)]]: took 1.3s done applying updated cluster_state (version: 4)
  209. [2015-08-25 13:09:08,761][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][2], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: execute
  210. [2015-08-25 13:09:08,767][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][0] state: [RECOVERING]->[POST_RECOVERY], reason [post recovery from gateway]
  211. [2015-08-25 13:09:08,767][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][0] recovery completed from [_none_], took [323ms]
  212. [2015-08-25 13:09:08,767][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][3] state: [RECOVERING]->[POST_RECOVERY], reason [post recovery from gateway]
  213. [2015-08-25 13:09:08,767][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][3] recovery completed from [_none_], took [277ms]
  214. [2015-08-25 13:09:08,760][DEBUG][cluster.action.shard ] [logstash_tud] sending shard started for [logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  215. [2015-08-25 13:09:08,768][DEBUG][cluster.action.shard ] [logstash_tud] received shard started for [logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  216. [2015-08-25 13:09:08,768][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  217. [2015-08-25 13:09:08,768][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  218. [2015-08-25 13:09:08,767][DEBUG][cluster.action.shard ] [logstash_tud] sending shard started for [logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  219. [2015-08-25 13:09:08,769][DEBUG][cluster.action.shard ] [logstash_tud] received shard started for [logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  220. [2015-08-25 13:09:08,767][DEBUG][cluster.action.shard ] [logstash_tud] sending shard started for [logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  221. [2015-08-25 13:09:08,771][DEBUG][cluster.action.shard ] [logstash_tud] received shard started for [logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  222. [2015-08-25 13:09:08,761][DEBUG][cluster.action.shard ] [logstash_tud] [logstash-2015.08.25][2] will apply shard started [logstash-2015.08.25][2], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  223. [2015-08-25 13:09:08,772][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [5], source [shard-started ([logstash-2015.08.25][2], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]
  224. [2015-08-25 13:09:08,772][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 5
  225. [2015-08-25 13:09:08,772][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 5
  226. [2015-08-25 13:09:08,772][DEBUG][indices.cluster ] [logstash_tud] [logstash-2015.08.25][4] creating shard
  227. [2015-08-25 13:09:08,772][DEBUG][index ] [logstash_tud] [logstash-2015.08.25] creating shard_id [logstash-2015.08.25][4]
  228. [2015-08-25 13:09:08,778][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/4/index] as shard's index location
  229. [2015-08-25 13:09:08,779][DEBUG][index.store ] [logstash_tud] [logstash-2015.08.25][4] store stats are refreshed with refresh_interval [10s]
  230. [2015-08-25 13:09:08,780][DEBUG][index.merge.scheduler ] [logstash_tud] [logstash-2015.08.25][4] using [concurrent] merge scheduler with max_thread_count[1], max_merge_count[3]
  231. [2015-08-25 13:09:08,780][DEBUG][index.store.fs ] [logstash_tud] [logstash-2015.08.25] using [/opt/elkdata/elasticsearch/elasticsearch/nodes/0/indices/logstash-2015.08.25/4/translog] as shard's translog location
  232. [2015-08-25 13:09:08,780][DEBUG][index.deletionpolicy ] [logstash_tud] [logstash-2015.08.25][4] Using [keep_only_last] deletion policy
  233. [2015-08-25 13:09:08,780][DEBUG][index.merge.policy ] [logstash_tud] [logstash-2015.08.25][4] using [tiered] merge mergePolicy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[10], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[10.0], reclaim_deletes_weight[2.0]
  234. [2015-08-25 13:09:08,781][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][4] state: [CREATED]
  235. [2015-08-25 13:09:08,781][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][4] scheduling optimizer / merger every 1s
  236. [2015-08-25 13:09:08,781][DEBUG][index.translog ] [logstash_tud] [logstash-2015.08.25][4] interval [5s], flush_threshold_ops [2147483647], flush_threshold_size [512mb], flush_threshold_period [30m]
  237. [2015-08-25 13:09:08,781][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][4] state: [CREATED]->[RECOVERING], reason [from gateway]
  238. [2015-08-25 13:09:08,782][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][4] starting recovery from _none_ ...
  239. [2015-08-25 13:09:08,783][DEBUG][index.gateway.none ] [logstash_tud] [logstash-2015.08.25][4] cleaning shard content before creation
  240. [2015-08-25 13:09:08,794][DEBUG][cluster.action.shard ] [logstash_tud] sending shard started for [logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  241. [2015-08-25 13:09:08,794][DEBUG][cluster.action.shard ] [logstash_tud] received shard started for [logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  242. [2015-08-25 13:09:08,794][DEBUG][cluster.action.shard ] [logstash_tud] sending shard started for [logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  243. [2015-08-25 13:09:08,794][DEBUG][cluster.action.shard ] [logstash_tud] received shard started for [logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  244. [2015-08-25 13:09:08,794][DEBUG][cluster.action.shard ] [logstash_tud] sending shard started for [logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  245. [2015-08-25 13:09:08,794][DEBUG][cluster.action.shard ] [logstash_tud] received shard started for [logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  246. [2015-08-25 13:09:08,796][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][2] state: [POST_RECOVERY]->[STARTED], reason [global state is [STARTED]]
  247. [2015-08-25 13:09:08,796][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][2], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: took 35ms done applying updated cluster_state (version: 5)
  248. [2015-08-25 13:09:08,796][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: execute
  249. [2015-08-25 13:09:08,796][DEBUG][cluster.action.shard ] [logstash_tud] [logstash-2015.08.25][1] will apply shard started [logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  250. [2015-08-25 13:09:08,796][DEBUG][cluster.action.shard ] [logstash_tud] [logstash-2015.08.25][0] will apply shard started [logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  251. [2015-08-25 13:09:08,796][DEBUG][cluster.action.shard ] [logstash_tud] [logstash-2015.08.25][3] will apply shard started [logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  252. [2015-08-25 13:09:08,796][DEBUG][cluster.action.shard ] [logstash_tud] [logstash-2015.08.25][0] will apply shard started [logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  253. [2015-08-25 13:09:08,805][DEBUG][index.engine ] [logstash_tud] [logstash-2015.08.25][4] [[logstash-2015.08.25][4]] skipping check for 3x segments
  254. [2015-08-25 13:09:08,806][DEBUG][cluster.action.shard ] [logstash_tud] [logstash-2015.08.25][3] will apply shard started [logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  255. [2015-08-25 13:09:08,807][DEBUG][cluster.action.shard ] [logstash_tud] [logstash-2015.08.25][1] will apply shard started [logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]
  256. [2015-08-25 13:09:08,808][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [6], source [shard-started ([logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]
  257. [2015-08-25 13:09:08,808][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 6
  258. [2015-08-25 13:09:08,808][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 6
  259. [2015-08-25 13:09:08,806][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  260. [2015-08-25 13:09:08,817][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  261. [2015-08-25 13:09:08,830][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][0] state: [POST_RECOVERY]->[STARTED], reason [global state is [STARTED]]
  262. [2015-08-25 13:09:08,841][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][3] state: [POST_RECOVERY]->[STARTED], reason [global state is [STARTED]]
  263. [2015-08-25 13:09:08,842][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][1] state: [POST_RECOVERY]->[STARTED], reason [global state is [STARTED]]
  264. [2015-08-25 13:09:08,843][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: took 46ms done applying updated cluster_state (version: 6)
  265. [2015-08-25 13:09:08,854][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: execute
  266. [2015-08-25 13:09:08,854][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: took 0s no change in cluster_state
  267. [2015-08-25 13:09:08,854][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: execute
  268. [2015-08-25 13:09:08,854][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: took 0s no change in cluster_state
  269. [2015-08-25 13:09:08,854][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]]: execute
  270. [2015-08-25 13:09:08,855][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][0], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]]: took 0s no change in cluster_state
  271. [2015-08-25 13:09:08,855][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]]: execute
  272. [2015-08-25 13:09:08,855][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][3], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]]: took 0s no change in cluster_state
  273. [2015-08-25 13:09:08,855][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]]: execute
  274. [2015-08-25 13:09:08,855][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][1], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [master [logstash_tud][16Zw6DZaQsGV511PbWd55Q][server.company.com][inet[/xxx.xxx.xxx.xxx:9300]]{master=true} marked shard as initializing, but shard state is [POST_RECOVERY], mark shard as started]]: took 0s no change in cluster_state
  275. [2015-08-25 13:09:08,843][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  276. [2015-08-25 13:09:08,856][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  277. [2015-08-25 13:09:08,971][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][4] scheduling refresher every 5s
  278. [2015-08-25 13:09:08,984][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][4] state: [RECOVERING]->[POST_RECOVERY], reason [post recovery from gateway]
  279. [2015-08-25 13:09:08,984][DEBUG][index.gateway ] [logstash_tud] [logstash-2015.08.25][4] recovery completed from [_none_], took [203ms]
  280. [2015-08-25 13:09:08,984][DEBUG][cluster.action.shard ] [logstash_tud] sending shard started for [logstash-2015.08.25][4], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  281. [2015-08-25 13:09:08,984][DEBUG][cluster.action.shard ] [logstash_tud] received shard started for [logstash-2015.08.25][4], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  282. [2015-08-25 13:09:08,986][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][4], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: execute
  283. [2015-08-25 13:09:08,986][DEBUG][cluster.action.shard ] [logstash_tud] [logstash-2015.08.25][4] will apply shard started [logstash-2015.08.25][4], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING], indexUUID [1es7cHymSH6OY8XCnotPng], reason [after recovery from gateway]
  284. [2015-08-25 13:09:08,987][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [7], source [shard-started ([logstash-2015.08.25][4], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]
  285. [2015-08-25 13:09:08,988][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 7
  286. [2015-08-25 13:09:08,988][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 7
  287. [2015-08-25 13:09:08,989][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][4] state: [POST_RECOVERY]->[STARTED], reason [global state is [STARTED]]
  288. [2015-08-25 13:09:08,989][DEBUG][cluster.service ] [logstash_tud] processing [shard-started ([logstash-2015.08.25][4], node[16Zw6DZaQsGV511PbWd55Q], [P], s[INITIALIZING]), reason [after recovery from gateway]]: took 3ms done applying updated cluster_state (version: 7)
  289. [2015-08-25 13:09:08,989][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  290. [2015-08-25 13:09:08,989][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  291. [2015-08-25 13:09:09,178][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [1]]: execute
  292. [2015-08-25 13:09:09,187][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_c_io_log_pattern] (dynamic) with source [{"cluster_c_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  293. [2015-08-25 13:09:09,187][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [8], source [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [1]]
  294. [2015-08-25 13:09:09,187][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 8
  295. [2015-08-25 13:09:09,187][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 8
  296. [2015-08-25 13:09:09,188][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [1]]: took 9ms done applying updated cluster_state (version: 8)
  297. [2015-08-25 13:09:09,189][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  298. [2015-08-25 13:09:09,211][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  299. [2015-08-25 13:09:09,200][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [2]]: execute
  300. [2015-08-25 13:09:09,223][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_b_io_log_pattern] (dynamic) with source [{"cluster_b_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  301. [2015-08-25 13:09:09,199][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_c_io_log_pattern] and source [{"cluster_c_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  302. [2015-08-25 13:09:09,227][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_a_error_log_pattern] (dynamic) with source [{"cluster_a_error_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"tags":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  303. [2015-08-25 13:09:09,256][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [9], source [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [2]]
  304. [2015-08-25 13:09:09,256][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 9
  305. [2015-08-25 13:09:09,256][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 9
  306. [2015-08-25 13:09:09,257][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [2]]: took 38ms done applying updated cluster_state (version: 9)
  307. [2015-08-25 13:09:09,257][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_error_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [3]]: execute
  308. [2015-08-25 13:09:09,257][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_error_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [3]]: took 0s no change in cluster_state
  309. [2015-08-25 13:09:09,257][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  310. [2015-08-25 13:09:09,257][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  311. [2015-08-25 13:09:09,257][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_b_io_log_pattern] and source [{"cluster_b_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  312. [2015-08-25 13:09:09,258][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_a_error_log_pattern] and source [{"cluster_a_error_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"tags":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  313. [2015-08-25 13:09:10,739][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [4]]: execute
  314. [2015-08-25 13:09:10,794][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_a_io_log_pattern] (dynamic) with source [{"cluster_a_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"msgtypeII":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  315. [2015-08-25 13:09:10,795][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [10], source [update-mapping [logstash-2015.08.25][cluster_a_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [4]]
  316. [2015-08-25 13:09:10,796][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 10
  317. [2015-08-25 13:09:10,796][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 10
  318. [2015-08-25 13:09:10,798][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [4]]: took 28ms done applying updated cluster_state (version: 10)
  319. [2015-08-25 13:09:10,798][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [5]]: execute
  320. [2015-08-25 13:09:10,798][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [5]]: took 0s no change in cluster_state
  321. [2015-08-25 13:09:10,802][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  322. [2015-08-25 13:09:10,846][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  323. [2015-08-25 13:09:10,802][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_a_io_log_pattern] and source [{"cluster_a_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"msgtypeII":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  324. [2015-08-25 13:09:10,847][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_a_io_log_pattern] and source [{"cluster_a_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"msgtypeII":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  325. [2015-08-25 13:09:12,972][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [6]]: execute
  326. [2015-08-25 13:09:12,998][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_b_io_log_pattern] (dynamic) with source [{"cluster_b_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  327. [2015-08-25 13:09:12,999][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [11], source [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [6]]
  328. [2015-08-25 13:09:12,999][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 11
  329. [2015-08-25 13:09:12,999][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 11
  330. [2015-08-25 13:09:13,001][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [6]]: took 27ms done applying updated cluster_state (version: 11)
  331. [2015-08-25 13:09:13,002][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  332. [2015-08-25 13:09:13,004][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  333. [2015-08-25 13:09:13,002][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_b_io_log_pattern] and source [{"cluster_b_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  334. [2015-08-25 13:09:14,023][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [7]]: execute
  335. [2015-08-25 13:09:14,050][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_c_io_log_pattern] (dynamic) with source [{"cluster_c_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  336. [2015-08-25 13:09:14,051][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [12], source [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [7]]
  337. [2015-08-25 13:09:14,051][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 12
  338. [2015-08-25 13:09:14,051][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 12
  339. [2015-08-25 13:09:14,052][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [7]]: took 28ms done applying updated cluster_state (version: 12)
  340. [2015-08-25 13:09:14,052][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  341. [2015-08-25 13:09:14,074][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  342. [2015-08-25 13:09:14,056][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_c_io_log_pattern] and source [{"cluster_c_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  343. [2015-08-25 13:09:19,576][DEBUG][monitor.jvm ] [logstash_tud] [gc][young][196][2] duration [485ms], collections [1]/[1.4s], total [485ms]/[610ms], memory [148.9mb]->[36.6mb]/[15.9gb], all_pools {[young] [123mb]->[3.3mb]/[133.1mb]}{[survivor] [16.6mb]->[15.7mb]/[16.6mb]}{[old] [9.2mb]->[17.5mb]/[15.8gb]}
  344. [2015-08-25 13:09:22,368][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [8]]: execute
  345. [2015-08-25 13:09:22,387][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_b_io_log_pattern] (dynamic) with source [{"cluster_b_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"msgtypeII":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  346. [2015-08-25 13:09:22,388][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [13], source [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [8]]
  347. [2015-08-25 13:09:22,388][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 13
  348. [2015-08-25 13:09:22,388][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 13
  349. [2015-08-25 13:09:22,390][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  350. [2015-08-25 13:09:22,404][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  351. [2015-08-25 13:09:22,391][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_b_io_log_pattern] and source [{"cluster_b_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"msgtypeII":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  352. [2015-08-25 13:09:22,391][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_b_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [8]]: took 21ms done applying updated cluster_state (version: 13)
  353. [2015-08-25 13:09:22,405][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_app_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [9]]: execute
  354. [2015-08-25 13:09:22,414][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_a_app_log_pattern] (dynamic) with source [{"cluster_a_app_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifapplogtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msg":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  355. [2015-08-25 13:09:22,433][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_b_of_formcenter_log_pattern] (dynamic) with source [{"cluster_b_of_formcenter_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"ofclass":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofcontainerinfo":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"offunction":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofinfo":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofip":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofrequestlog":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofrmcentertimestamp":{"type":"date","format":"dateOptionalTime"},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  356. [2015-08-25 13:09:22,444][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [14], source [update-mapping [logstash-2015.08.25][cluster_a_app_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [9]]
  357. [2015-08-25 13:09:22,444][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 14
  358. [2015-08-25 13:09:22,444][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 14
  359. [2015-08-25 13:09:22,446][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_app_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [9]]: took 41ms done applying updated cluster_state (version: 14)
  360. [2015-08-25 13:09:22,446][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_b_of_formcenter_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [10]]: execute
  361. [2015-08-25 13:09:22,446][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_b_of_formcenter_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [10]]: took 0s no change in cluster_state
  362. [2015-08-25 13:09:22,457][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  363. [2015-08-25 13:09:22,459][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  364. [2015-08-25 13:09:22,458][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_a_app_log_pattern] and source [{"cluster_a_app_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifapplogtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msg":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  365. [2015-08-25 13:09:22,459][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_b_of_formcenter_log_pattern] and source [{"cluster_b_of_formcenter_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"ofclass":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofcontainerinfo":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"offunction":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofinfo":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofip":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofrequestlog":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"ofrmcentertimestamp":{"type":"date","format":"dateOptionalTime"},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  366. [2015-08-25 13:09:23,428][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_of_formcenter_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [11]]: execute
  367. [2015-08-25 13:09:23,431][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_a_of_formcenter_log_pattern] (dynamic) with source [{"cluster_a_of_formcenter_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"tags":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  368. [2015-08-25 13:09:23,431][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [15], source [update-mapping [logstash-2015.08.25][cluster_a_of_formcenter_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [11]]
  369. [2015-08-25 13:09:23,431][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 15
  370. [2015-08-25 13:09:23,431][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 15
  371. [2015-08-25 13:09:23,432][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_of_formcenter_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [11]]: took 3ms done applying updated cluster_state (version: 15)
  372. [2015-08-25 13:09:23,432][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_a_of_formcenter_log_pattern] and source [{"cluster_a_of_formcenter_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"tags":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  373. [2015-08-25 13:09:23,439][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  374. [2015-08-25 13:09:23,439][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  375. [2015-08-25 13:09:24,506][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [12]]: execute
  376. [2015-08-25 13:09:24,555][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_c_io_log_pattern] (dynamic) with source [{"cluster_c_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"msgtypeII":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  377. [2015-08-25 13:09:24,562][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_a_main_log_pattern] (dynamic) with source [{"cluster_a_main_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"tags":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  378. [2015-08-25 13:09:24,563][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [16], source [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [12]]
  379. [2015-08-25 13:09:24,563][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 16
  380. [2015-08-25 13:09:24,564][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 16
  381. [2015-08-25 13:09:24,567][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_c_io_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [12]]: took 21ms done applying updated cluster_state (version: 16)
  382. [2015-08-25 13:09:24,567][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_main_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [13]]: execute
  383. [2015-08-25 13:09:24,567][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_main_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [13]]: took 0s no change in cluster_state
  384. [2015-08-25 13:09:24,568][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_c_io_log_pattern] and source [{"cluster_c_io_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"cifiologtimestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"container_nr":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"http_status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"inorout":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msgtype":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"msgtypeII":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"port":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"responsetotal":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"sys":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"url":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  385. [2015-08-25 13:09:24,569][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_a_main_log_pattern] and source [{"cluster_a_main_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"tags":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  386. [2015-08-25 13:09:24,569][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  387. [2015-08-25 13:09:24,586][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  388. [2015-08-25 13:09:26,705][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_main_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [14]]: execute
  389. [2015-08-25 13:09:26,758][DEBUG][cluster.metadata ] [logstash_tud] [logstash-2015.08.25] update_mapping [cluster_a_main_log_pattern] (dynamic) with source [{"cluster_a_main_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"femainlogtimestamp":{"type":"date","format":"dateOptionalTime"},"function":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msg":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  390. [2015-08-25 13:09:26,758][DEBUG][cluster.service ] [logstash_tud] cluster state updated, version [17], source [update-mapping [logstash-2015.08.25][cluster_a_main_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [14]]
  391. [2015-08-25 13:09:26,758][DEBUG][cluster.service ] [logstash_tud] publishing cluster state version 17
  392. [2015-08-25 13:09:26,758][DEBUG][cluster.service ] [logstash_tud] set local cluster state to version 17
  393. [2015-08-25 13:09:26,772][DEBUG][cluster.service ] [logstash_tud] processing [update-mapping [logstash-2015.08.25][cluster_a_main_log_pattern] / node [16Zw6DZaQsGV511PbWd55Q], order [14]]: took 16ms done applying updated cluster_state (version: 17)
  394. [2015-08-25 13:09:26,772][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: execute
  395. [2015-08-25 13:09:26,773][DEBUG][river.cluster ] [logstash_tud] processing [reroute_rivers_node_changed]: no change in cluster_state
  396. [2015-08-25 13:09:26,772][DEBUG][cluster.action.index ] [logstash_tud] successfully updated master with mapping update: index [logstash-2015.08.25], indexUUID [1es7cHymSH6OY8XCnotPng], type [cluster_a_main_log_pattern] and source [{"cluster_a_main_log_pattern":{"dynamic_templates":[{"message_field":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string"},"match":"message","match_mapping_type":"string"}},{"string_fields":{"mapping":{"index":"analyzed","omit_norms":true,"type":"string","fields":{"raw":{"ignore_above":256,"index":"not_analyzed","type":"string"}}},"match":"*","match_mapping_type":"string"}}],"_all":{"enabled":true,"omit_norms":true},"properties":{"@timestamp":{"type":"date","format":"dateOptionalTime"},"@version":{"type":"string","index":"not_analyzed"},"clustermember":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"femainlogtimestamp":{"type":"date","format":"dateOptionalTime"},"function":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"geoip":{"dynamic":"true","properties":{"location":{"type":"geo_point"}}},"globalrequest_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"host":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"info":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"jsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"message":{"type":"string","norms":{"enabled":false}},"msg":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"path":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"qsession_id":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"randomchar":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"status":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"timestamp":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"type":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}},"userid_hash":{"type":"string","norms":{"enabled":false},"fields":{"raw":{"type":"string","index":"not_analyzed","ignore_above":256}}}}}}]
  397. [2015-08-25 13:09:32,876][DEBUG][indices.memory ] [logstash_tud] recalculating shard indexing buffer (reason=[[ADDED]]), total is [1.5gb] with [5] active shards, each shard set to indexing=[327.3mb], translog=[64kb]
  398. [2015-08-25 13:09:32,877][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][0] updating index_buffer_size from [64mb] to [327.3mb]
  399. [2015-08-25 13:09:32,877][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][1] updating index_buffer_size from [64mb] to [327.3mb]
  400. [2015-08-25 13:09:32,878][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][2] updating index_buffer_size from [64mb] to [327.3mb]
  401. [2015-08-25 13:09:32,878][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][3] updating index_buffer_size from [64mb] to [327.3mb]
  402. [2015-08-25 13:09:32,878][DEBUG][index.shard ] [logstash_tud] [logstash-2015.08.25][4] updating index_buffer_size from [64mb] to [327.3mb]
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!