API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Aug 1st, 2019
70
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 49.92 KB | None | 0 0
raw download clone embed print report
  1. Thread.exclusive is deprecated, use Thread::Mutex
  2. WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults
  3. Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console
  4. [DEBUG] 2019-08-01 18:25:24.435 [main] scaffold - Found module {:module_name=>"fb_apache", :directory=>"/usr/share/logstash/modules/fb_apache/configuration"}
  5. [DEBUG] 2019-08-01 18:25:24.442 [main] registry - Adding plugin to the registry {:name=>"fb_apache", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0x6b4b6cd6 @directory="/usr/share/logstash/modules/fb_apache/configuration", @module_name="fb_apache", @kibana_version_parts=["6", "0", "0"]>}
  6. [DEBUG] 2019-08-01 18:25:24.449 [main] scaffold - Found module {:module_name=>"netflow", :directory=>"/usr/share/logstash/modules/netflow/configuration"}
  7. [DEBUG] 2019-08-01 18:25:24.455 [main] registry - Adding plugin to the registry {:name=>"netflow", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0x7d5fb53a @directory="/usr/share/logstash/modules/netflow/configuration", @module_name="netflow", @kibana_version_parts=["6", "0", "0"]>}
  8. [DEBUG] 2019-08-01 18:25:25.300 [LogStash::Runner] runner - -------- Logstash Settings (* means modified) ---------
  9. [DEBUG] 2019-08-01 18:25:25.301 [LogStash::Runner] runner - node.name: "elk-test2"
  10. [DEBUG] 2019-08-01 18:25:25.301 [LogStash::Runner] runner - *path.config: "/etc/logstash/conf.d/postgresql.conf"
  11. [DEBUG] 2019-08-01 18:25:25.301 [LogStash::Runner] runner - path.data: "/usr/share/logstash/data"
  12. [DEBUG] 2019-08-01 18:25:25.301 [LogStash::Runner] runner - modules.cli: []
  13. [DEBUG] 2019-08-01 18:25:25.301 [LogStash::Runner] runner - modules: []
  14. [DEBUG] 2019-08-01 18:25:25.301 [LogStash::Runner] runner - modules_list: []
  15. [DEBUG] 2019-08-01 18:25:25.301 [LogStash::Runner] runner - modules_variable_list: []
  16. [DEBUG] 2019-08-01 18:25:25.307 [LogStash::Runner] runner - modules_setup: false
  17. [DEBUG] 2019-08-01 18:25:25.307 [LogStash::Runner] runner - config.test_and_exit: false
  18. [DEBUG] 2019-08-01 18:25:25.307 [LogStash::Runner] runner - config.reload.automatic: false
  19. [DEBUG] 2019-08-01 18:25:25.307 [LogStash::Runner] runner - config.reload.interval: 3000000000
  20. [DEBUG] 2019-08-01 18:25:25.308 [LogStash::Runner] runner - config.support_escapes: false
  21. [DEBUG] 2019-08-01 18:25:25.308 [LogStash::Runner] runner - config.field_reference.parser: "STRICT"
  22. [DEBUG] 2019-08-01 18:25:25.308 [LogStash::Runner] runner - metric.collect: true
  23. [DEBUG] 2019-08-01 18:25:25.308 [LogStash::Runner] runner - pipeline.id: "main"
  24. [DEBUG] 2019-08-01 18:25:25.308 [LogStash::Runner] runner - pipeline.system: false
  25. [DEBUG] 2019-08-01 18:25:25.308 [LogStash::Runner] runner - pipeline.workers: 1
  26. [DEBUG] 2019-08-01 18:25:25.308 [LogStash::Runner] runner - pipeline.batch.size: 125
  27. [DEBUG] 2019-08-01 18:25:25.308 [LogStash::Runner] runner - pipeline.batch.delay: 50
  28. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - pipeline.unsafe_shutdown: false
  29. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - pipeline.java_execution: true
  30. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - pipeline.reloadable: true
  31. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - pipeline.plugin_classloaders: false
  32. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - path.plugins: []
  33. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - config.debug: false
  34. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - *log.level: "debug" (default: "info")
  35. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - version: false
  36. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - help: false
  37. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - log.format: "plain"
  38. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - http.host: "127.0.0.1"
  39. [DEBUG] 2019-08-01 18:25:25.309 [LogStash::Runner] runner - http.port: 9600..9700
  40. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - http.environment: "production"
  41. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.type: "memory"
  42. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.drain: false
  43. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.page_capacity: 67108864
  44. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.max_bytes: 1073741824
  45. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.max_events: 0
  46. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.checkpoint.acks: 1024
  47. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.checkpoint.writes: 1024
  48. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.checkpoint.interval: 1000
  49. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - queue.checkpoint.retry: false
  50. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - dead_letter_queue.enable: false
  51. [DEBUG] 2019-08-01 18:25:25.310 [LogStash::Runner] runner - dead_letter_queue.max_bytes: 1073741824
  52. [DEBUG] 2019-08-01 18:25:25.311 [LogStash::Runner] runner - slowlog.threshold.warn: -1
  53. [DEBUG] 2019-08-01 18:25:25.311 [LogStash::Runner] runner - slowlog.threshold.info: -1
  54. [DEBUG] 2019-08-01 18:25:25.311 [LogStash::Runner] runner - slowlog.threshold.debug: -1
  55. [DEBUG] 2019-08-01 18:25:25.311 [LogStash::Runner] runner - slowlog.threshold.trace: -1
  56. [DEBUG] 2019-08-01 18:25:25.311 [LogStash::Runner] runner - keystore.classname: "org.logstash.secret.store.backend.JavaKeyStore"
  57. [DEBUG] 2019-08-01 18:25:25.311 [LogStash::Runner] runner - keystore.file: "/usr/share/logstash/config/logstash.keystore"
  58. [DEBUG] 2019-08-01 18:25:25.311 [LogStash::Runner] runner - path.queue: "/usr/share/logstash/data/queue"
  59. [DEBUG] 2019-08-01 18:25:25.312 [LogStash::Runner] runner - path.dead_letter_queue: "/usr/share/logstash/data/dead_letter_queue"
  60. [DEBUG] 2019-08-01 18:25:25.312 [LogStash::Runner] runner - path.settings: "/usr/share/logstash/config"
  61. [DEBUG] 2019-08-01 18:25:25.312 [LogStash::Runner] runner - path.logs: "/usr/share/logstash/logs"
  62. [DEBUG] 2019-08-01 18:25:25.312 [LogStash::Runner] runner - xpack.management.enabled: false
  63. [DEBUG] 2019-08-01 18:25:25.312 [LogStash::Runner] runner - xpack.management.logstash.poll_interval: 5000000000
  64. [DEBUG] 2019-08-01 18:25:25.312 [LogStash::Runner] runner - xpack.management.pipeline.id: ["main"]
  65. [DEBUG] 2019-08-01 18:25:25.312 [LogStash::Runner] runner - xpack.management.elasticsearch.username: "logstash_system"
  66. [DEBUG] 2019-08-01 18:25:25.312 [LogStash::Runner] runner - xpack.management.elasticsearch.hosts: ["https://localhost:9200"]
  67. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.management.elasticsearch.ssl.verification_mode: "certificate"
  68. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.management.elasticsearch.sniffing: false
  69. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.enabled: false
  70. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.elasticsearch.hosts: ["http://localhost:9200"]
  71. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.collection.interval: 10000000000
  72. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.collection.timeout_interval: 600000000000
  73. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.elasticsearch.username: "logstash_system"
  74. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.elasticsearch.ssl.verification_mode: "certificate"
  75. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.elasticsearch.sniffing: false
  76. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.collection.pipeline.details.enabled: true
  77. [DEBUG] 2019-08-01 18:25:25.313 [LogStash::Runner] runner - xpack.monitoring.collection.config.enabled: true
  78. [DEBUG] 2019-08-01 18:25:25.314 [LogStash::Runner] runner - node.uuid: ""
  79. [DEBUG] 2019-08-01 18:25:25.314 [LogStash::Runner] runner - --------------- Logstash Settings -------------------
  80. [WARN ] 2019-08-01 18:25:25.402 [LogStash::Runner] multilocal - Ignoring the 'pipelines.yml' file because modules or command line options are specified
  81. [INFO ] 2019-08-01 18:25:25.420 [LogStash::Runner] runner - Starting Logstash {"logstash.version"=>"7.3.0"}
  82. [DEBUG] 2019-08-01 18:25:25.517 [LogStash::Runner] agent - Setting up metric collection
  83. [DEBUG] 2019-08-01 18:25:25.645 [LogStash::Runner] os - Starting {:polling_interval=>5, :polling_timeout=>120}
  84. [DEBUG] 2019-08-01 18:25:26.261 [LogStash::Runner] jvm - Starting {:polling_interval=>5, :polling_timeout=>120}
  85. [DEBUG] 2019-08-01 18:25:26.483 [LogStash::Runner] jvm - collector name {:name=>"ParNew"}
  86. [DEBUG] 2019-08-01 18:25:26.490 [LogStash::Runner] jvm - collector name {:name=>"ConcurrentMarkSweep"}
  87. [DEBUG] 2019-08-01 18:25:26.543 [LogStash::Runner] persistentqueue - Starting {:polling_interval=>5, :polling_timeout=>120}
  88. [DEBUG] 2019-08-01 18:25:26.579 [LogStash::Runner] deadletterqueue - Starting {:polling_interval=>5, :polling_timeout=>120}
  89. [DEBUG] 2019-08-01 18:25:26.721 [Ruby-0-Thread-1: /usr/share/logstash/lib/bootstrap/environment.rb:6] agent - Starting agent
  90. [DEBUG] 2019-08-01 18:25:26.851 [Ruby-0-Thread-1: /usr/share/logstash/lib/bootstrap/environment.rb:6] configpathloader - Skipping the following files while reading config since they don't match the specified glob pattern {:files=>[]}
  91. [DEBUG] 2019-08-01 18:25:26.854 [Ruby-0-Thread-1: /usr/share/logstash/lib/bootstrap/environment.rb:6] configpathloader - Reading config file {:config_file=>"/etc/logstash/conf.d/postgresql.conf"}
  92. [DEBUG] 2019-08-01 18:25:26.945 [Ruby-0-Thread-1: /usr/share/logstash/lib/bootstrap/environment.rb:6] agent - Converging pipelines state {:actions_count=>1}
  93. [DEBUG] 2019-08-01 18:25:26.968 [Converge PipelineAction::Create<main>] agent - Executing action {:action=>LogStash::PipelineAction::Create/pipeline_id:main}
  94. [DEBUG] 2019-08-01 18:25:28.851 [Converge PipelineAction::Create<main>] Reflections - going to scan these urls:
  95. jar:file:/usr/share/logstash/logstash-core/lib/jars/logstash-core.jar!/
  96. [INFO ] 2019-08-01 18:25:28.948 [Converge PipelineAction::Create<main>] Reflections - Reflections took 92 ms to scan 1 urls, producing 19 keys and 39 values
  97. [DEBUG] 2019-08-01 18:25:28.975 [Converge PipelineAction::Create<main>] Reflections - expanded subtype co.elastic.logstash.api.Plugin -> co.elastic.logstash.api.Codec
  98. [DEBUG] 2019-08-01 18:25:28.976 [Converge PipelineAction::Create<main>] Reflections - expanded subtype co.elastic.logstash.api.Plugin -> co.elastic.logstash.api.Input
  99. [DEBUG] 2019-08-01 18:25:28.976 [Converge PipelineAction::Create<main>] Reflections - expanded subtype org.jruby.RubyBasicObject -> org.jruby.RubyObject
  100. [DEBUG] 2019-08-01 18:25:28.976 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.lang.Cloneable -> org.jruby.RubyBasicObject
  101. [DEBUG] 2019-08-01 18:25:28.976 [Converge PipelineAction::Create<main>] Reflections - expanded subtype org.jruby.runtime.builtin.IRubyObject -> org.jruby.RubyBasicObject
  102. [DEBUG] 2019-08-01 18:25:28.976 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.io.Serializable -> org.jruby.RubyBasicObject
  103. [DEBUG] 2019-08-01 18:25:28.976 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.lang.Comparable -> org.jruby.RubyBasicObject
  104. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype org.jruby.runtime.marshal.CoreObjectType -> org.jruby.RubyBasicObject
  105. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype org.jruby.runtime.builtin.InstanceVariables -> org.jruby.RubyBasicObject
  106. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype org.jruby.runtime.builtin.InternalVariables -> org.jruby.RubyBasicObject
  107. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype co.elastic.logstash.api.Plugin -> co.elastic.logstash.api.Output
  108. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype co.elastic.logstash.api.Metric -> co.elastic.logstash.api.NamespacedMetric
  109. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.security.SecureClassLoader -> java.net.URLClassLoader
  110. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.lang.ClassLoader -> java.security.SecureClassLoader
  111. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.io.Closeable -> java.net.URLClassLoader
  112. [DEBUG] 2019-08-01 18:25:28.977 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.lang.AutoCloseable -> java.io.Closeable
  113. [DEBUG] 2019-08-01 18:25:28.978 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.lang.Comparable -> java.lang.Enum
  114. [DEBUG] 2019-08-01 18:25:28.978 [Converge PipelineAction::Create<main>] Reflections - expanded subtype java.io.Serializable -> java.lang.Enum
  115. [DEBUG] 2019-08-01 18:25:28.978 [Converge PipelineAction::Create<main>] Reflections - expanded subtype co.elastic.logstash.api.Plugin -> co.elastic.logstash.api.Filter
  116. [DEBUG] 2019-08-01 18:25:29.153 [Converge PipelineAction::Create<main>] registry - On demand adding plugin to the registry {:name=>"jdbc", :type=>"input", :class=>LogStash::Inputs::Jdbc}
  117. [DEBUG] 2019-08-01 18:25:29.549 [Converge PipelineAction::Create<main>] registry - On demand adding plugin to the registry {:name=>"plain", :type=>"codec", :class=>LogStash::Codecs::Plain}
  118. [DEBUG] 2019-08-01 18:25:29.591 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@id = "plain_486c8290-6966-4d74-b3be-5982423a0e1c"
  119. [DEBUG] 2019-08-01 18:25:29.598 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@enable_metric = true
  120. [DEBUG] 2019-08-01 18:25:29.599 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@charset = "UTF-8"
  121. [DEBUG] 2019-08-01 18:25:29.644 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_user = "doadmin"
  122. [DEBUG] 2019-08-01 18:25:29.656 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_password = <password>
  123. [DEBUG] 2019-08-01 18:25:29.656 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@statement = "SELECT * FROM pg_stat_database"
  124. [DEBUG] 2019-08-01 18:25:29.657 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_driver_library = ""
  125. [DEBUG] 2019-08-01 18:25:29.657 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_connection_string = "<redacted>"
  126. [DEBUG] 2019-08-01 18:25:29.657 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@id = "3c2445e7b1afc5ab4f0895519eab7525354f00b0684765f7490dba9991501940"
  127. [DEBUG] 2019-08-01 18:25:29.657 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_driver_class = "org.postgresql.Driver"
  128. [DEBUG] 2019-08-01 18:25:29.657 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@type = "pg_stat_database"
  129. [DEBUG] 2019-08-01 18:25:29.657 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@enable_metric = true
  130. [DEBUG] 2019-08-01 18:25:29.680 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@codec = <LogStash::Codecs::Plain id=>"plain_486c8290-6966-4d74-b3be-5982423a0e1c", enable_metric=>true, charset=>"UTF-8">
  131. [DEBUG] 2019-08-01 18:25:29.681 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@add_field = {}
  132. [DEBUG] 2019-08-01 18:25:29.682 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_paging_enabled = false
  133. [DEBUG] 2019-08-01 18:25:29.683 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_page_size = 100000
  134. [DEBUG] 2019-08-01 18:25:29.687 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_validate_connection = false
  135. [DEBUG] 2019-08-01 18:25:29.687 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_validation_timeout = 3600
  136. [DEBUG] 2019-08-01 18:25:29.687 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_pool_timeout = 5
  137. [DEBUG] 2019-08-01 18:25:29.687 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@sequel_opts = {}
  138. [DEBUG] 2019-08-01 18:25:29.687 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@sql_log_level = "info"
  139. [DEBUG] 2019-08-01 18:25:29.687 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@connection_retry_attempts = 1
  140. [DEBUG] 2019-08-01 18:25:29.691 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@connection_retry_attempts_wait_time = 0.5
  141. [DEBUG] 2019-08-01 18:25:29.691 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@parameters = {}
  142. [DEBUG] 2019-08-01 18:25:29.692 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@last_run_metadata_path = "/root/.logstash_jdbc_last_run"
  143. [DEBUG] 2019-08-01 18:25:29.692 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@use_column_value = false
  144. [DEBUG] 2019-08-01 18:25:29.695 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@tracking_column_type = "numeric"
  145. [DEBUG] 2019-08-01 18:25:29.695 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@clean_run = false
  146. [DEBUG] 2019-08-01 18:25:29.695 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@record_last_run = true
  147. [DEBUG] 2019-08-01 18:25:29.696 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@lowercase_column_names = true
  148. [DEBUG] 2019-08-01 18:25:29.696 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@columns_charset = {}
  149. [DEBUG] 2019-08-01 18:25:29.805 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@id = "plain_f454da1b-9ca1-448c-bede-a96dacd3c943"
  150. [DEBUG] 2019-08-01 18:25:29.805 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@enable_metric = true
  151. [DEBUG] 2019-08-01 18:25:29.805 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@charset = "UTF-8"
  152. [DEBUG] 2019-08-01 18:25:29.813 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_user = "doadmin"
  153. [DEBUG] 2019-08-01 18:25:29.823 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_password = <password>
  154. [DEBUG] 2019-08-01 18:25:29.823 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@statement = "SELECT * FROM pg_stat_user_tables"
  155. [DEBUG] 2019-08-01 18:25:29.823 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_driver_library = ""
  156. [DEBUG] 2019-08-01 18:25:29.823 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_connection_string = "<redacted>"
  157. [DEBUG] 2019-08-01 18:25:29.824 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@id = "80d482adbd6de986ebc49e5cbb56940a997c4d5739b3242545aa80a88b322aa6"
  158. [DEBUG] 2019-08-01 18:25:29.824 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_driver_class = "org.postgresql.Driver"
  159. [DEBUG] 2019-08-01 18:25:29.824 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@type = "pg_stat_user_tables"
  160. [DEBUG] 2019-08-01 18:25:29.824 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@enable_metric = true
  161. [DEBUG] 2019-08-01 18:25:29.825 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@codec = <LogStash::Codecs::Plain id=>"plain_f454da1b-9ca1-448c-bede-a96dacd3c943", enable_metric=>true, charset=>"UTF-8">
  162. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@add_field = {}
  163. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_paging_enabled = false
  164. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_page_size = 100000
  165. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_validate_connection = false
  166. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_validation_timeout = 3600
  167. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_pool_timeout = 5
  168. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@sequel_opts = {}
  169. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@sql_log_level = "info"
  170. [DEBUG] 2019-08-01 18:25:29.831 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@connection_retry_attempts = 1
  171. [DEBUG] 2019-08-01 18:25:29.832 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@connection_retry_attempts_wait_time = 0.5
  172. [DEBUG] 2019-08-01 18:25:29.833 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@parameters = {}
  173. [DEBUG] 2019-08-01 18:25:29.834 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@last_run_metadata_path = "/root/.logstash_jdbc_last_run"
  174. [DEBUG] 2019-08-01 18:25:29.834 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@use_column_value = false
  175. [DEBUG] 2019-08-01 18:25:29.834 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@tracking_column_type = "numeric"
  176. [DEBUG] 2019-08-01 18:25:29.834 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@clean_run = false
  177. [DEBUG] 2019-08-01 18:25:29.834 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@record_last_run = true
  178. [DEBUG] 2019-08-01 18:25:29.834 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@lowercase_column_names = true
  179. [DEBUG] 2019-08-01 18:25:29.834 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@columns_charset = {}
  180. [DEBUG] 2019-08-01 18:25:29.860 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@id = "plain_62a8bda7-4a0f-43c0-b6b4-8ff25aeef798"
  181. [DEBUG] 2019-08-01 18:25:29.867 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@enable_metric = true
  182. [DEBUG] 2019-08-01 18:25:29.867 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@charset = "UTF-8"
  183. [DEBUG] 2019-08-01 18:25:29.875 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_user = "doadmin"
  184. [DEBUG] 2019-08-01 18:25:29.875 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_password = <password>
  185. [DEBUG] 2019-08-01 18:25:29.875 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@statement = "SELECT * FROM pg_stat_user_indexes"
  186. [DEBUG] 2019-08-01 18:25:29.875 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_driver_library = ""
  187. [DEBUG] 2019-08-01 18:25:29.876 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_connection_string = "<redacted>"
  188. [DEBUG] 2019-08-01 18:25:29.876 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@id = "b9ec94e0e26abcd202ab3b3df491248453d17a7f8600a5e8c3f42e19b335d072"
  189. [DEBUG] 2019-08-01 18:25:29.877 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_driver_class = "org.postgresql.Driver"
  190. [DEBUG] 2019-08-01 18:25:29.877 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@type = "pg_stat_user_indexes"
  191. [DEBUG] 2019-08-01 18:25:29.877 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@enable_metric = true
  192. [DEBUG] 2019-08-01 18:25:29.878 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@codec = <LogStash::Codecs::Plain id=>"plain_62a8bda7-4a0f-43c0-b6b4-8ff25aeef798", enable_metric=>true, charset=>"UTF-8">
  193. [DEBUG] 2019-08-01 18:25:29.878 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@add_field = {}
  194. [DEBUG] 2019-08-01 18:25:29.878 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_paging_enabled = false
  195. [DEBUG] 2019-08-01 18:25:29.878 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_page_size = 100000
  196. [DEBUG] 2019-08-01 18:25:29.878 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_validate_connection = false
  197. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_validation_timeout = 3600
  198. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@jdbc_pool_timeout = 5
  199. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@sequel_opts = {}
  200. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@sql_log_level = "info"
  201. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@connection_retry_attempts = 1
  202. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@connection_retry_attempts_wait_time = 0.5
  203. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@parameters = {}
  204. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@last_run_metadata_path = "/root/.logstash_jdbc_last_run"
  205. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@use_column_value = false
  206. [DEBUG] 2019-08-01 18:25:29.879 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@tracking_column_type = "numeric"
  207. [DEBUG] 2019-08-01 18:25:29.880 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@clean_run = false
  208. [DEBUG] 2019-08-01 18:25:29.880 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@record_last_run = true
  209. [DEBUG] 2019-08-01 18:25:29.880 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@lowercase_column_names = true
  210. [DEBUG] 2019-08-01 18:25:29.880 [Converge PipelineAction::Create<main>] jdbc - config LogStash::Inputs::Jdbc/@columns_charset = {}
  211. [DEBUG] 2019-08-01 18:25:29.890 [Converge PipelineAction::Create<main>] registry - On demand adding plugin to the registry {:name=>"elasticsearch", :type=>"output", :class=>LogStash::Outputs::ElasticSearch}
  212. [DEBUG] 2019-08-01 18:25:30.022 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@id = "plain_ad6f9d78-675e-4ee9-9525-3d2543d0f568"
  213. [DEBUG] 2019-08-01 18:25:30.031 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@enable_metric = true
  214. [DEBUG] 2019-08-01 18:25:30.031 [Converge PipelineAction::Create<main>] plain - config LogStash::Codecs::Plain/@charset = "UTF-8"
  215. [WARN ] 2019-08-01 18:25:30.069 [Converge PipelineAction::Create<main>] elasticsearch - You are using a deprecated config setting "document_type" set in elasticsearch. Deprecated settings will continue to work, but are scheduled for removal from logstash in the future. Document types are being deprecated in Elasticsearch 6.0, and removed entirely in 7.0. You should avoid this feature If you have any questions about this, please visit the #logstash channel on freenode irc. {:name=>"document_type", :plugin=><LogStash::Outputs::ElasticSearch index=>"pg_statistics", id=>"137717fbbfcf0416ef43a8f90b531af7716b6e5e47b557c5d8207e0aacbcb13f", hosts=>[http://localhost:9200], document_type=>"%{type}", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_ad6f9d78-675e-4ee9-9525-3d2543d0f568", enable_metric=>true, charset=>"UTF-8">, workers=>1, manage_template=>true, template_name=>"logstash", template_overwrite=>false, doc_as_upsert=>false, script_type=>"inline", script_lang=>"painless", script_var_name=>"event", scripted_upsert=>false, retry_initial_interval=>2, retry_max_interval=>64, retry_on_conflict=>1, ilm_enabled=>"auto", ilm_rollover_alias=>"logstash", ilm_pattern=>"{now/d}-000001", ilm_policy=>"logstash-policy", action=>"index", ssl_certificate_verification=>true, sniffing=>false, sniffing_delay=>5, timeout=>60, pool_max=>1000, pool_max_per_route=>100, resurrect_delay=>5, validate_after_inactivity=>10000, http_compression=>false>}
  216. [DEBUG] 2019-08-01 18:25:30.095 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@index = "pg_statistics"
  217. [DEBUG] 2019-08-01 18:25:30.095 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@id = "137717fbbfcf0416ef43a8f90b531af7716b6e5e47b557c5d8207e0aacbcb13f"
  218. [DEBUG] 2019-08-01 18:25:30.096 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@hosts = [http://localhost:9200]
  219. [DEBUG] 2019-08-01 18:25:30.097 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@document_type = "%{type}"
  220. [DEBUG] 2019-08-01 18:25:30.097 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@enable_metric = true
  221. [DEBUG] 2019-08-01 18:25:30.102 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@codec = <LogStash::Codecs::Plain id=>"plain_ad6f9d78-675e-4ee9-9525-3d2543d0f568", enable_metric=>true, charset=>"UTF-8">
  222. [DEBUG] 2019-08-01 18:25:30.103 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@workers = 1
  223. [DEBUG] 2019-08-01 18:25:30.103 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@manage_template = true
  224. [DEBUG] 2019-08-01 18:25:30.103 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@template_name = "logstash"
  225. [DEBUG] 2019-08-01 18:25:30.103 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@template_overwrite = false
  226. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@parent = nil
  227. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@join_field = nil
  228. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@upsert = ""
  229. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@doc_as_upsert = false
  230. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@script = ""
  231. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@script_type = "inline"
  232. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@script_lang = "painless"
  233. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@script_var_name = "event"
  234. [DEBUG] 2019-08-01 18:25:30.104 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@scripted_upsert = false
  235. [DEBUG] 2019-08-01 18:25:30.105 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@retry_initial_interval = 2
  236. [DEBUG] 2019-08-01 18:25:30.105 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@retry_max_interval = 64
  237. [DEBUG] 2019-08-01 18:25:30.105 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@retry_on_conflict = 1
  238. [DEBUG] 2019-08-01 18:25:30.106 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@pipeline = nil
  239. [DEBUG] 2019-08-01 18:25:30.106 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@ilm_enabled = "auto"
  240. [DEBUG] 2019-08-01 18:25:30.106 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@ilm_rollover_alias = "logstash"
  241. [DEBUG] 2019-08-01 18:25:30.106 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@ilm_pattern = "{now/d}-000001"
  242. [DEBUG] 2019-08-01 18:25:30.107 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@ilm_policy = "logstash-policy"
  243. [DEBUG] 2019-08-01 18:25:30.107 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@action = "index"
  244. [DEBUG] 2019-08-01 18:25:30.107 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@ssl_certificate_verification = true
  245. [DEBUG] 2019-08-01 18:25:30.108 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@sniffing = false
  246. [DEBUG] 2019-08-01 18:25:30.108 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@sniffing_delay = 5
  247. [DEBUG] 2019-08-01 18:25:30.109 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@timeout = 60
  248. [DEBUG] 2019-08-01 18:25:30.110 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@failure_type_logging_whitelist = []
  249. [DEBUG] 2019-08-01 18:25:30.110 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@pool_max = 1000
  250. [DEBUG] 2019-08-01 18:25:30.110 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@pool_max_per_route = 100
  251. [DEBUG] 2019-08-01 18:25:30.111 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@resurrect_delay = 5
  252. [DEBUG] 2019-08-01 18:25:30.111 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@validate_after_inactivity = 10000
  253. [DEBUG] 2019-08-01 18:25:30.111 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@http_compression = false
  254. [DEBUG] 2019-08-01 18:25:30.119 [Converge PipelineAction::Create<main>] elasticsearch - config LogStash::Outputs::ElasticSearch/@custom_headers = {}
  255. [DEBUG] 2019-08-01 18:25:30.227 [Converge PipelineAction::Create<main>] javapipeline - Starting pipeline {:pipeline_id=>"main"}
  256. [DEBUG] 2019-08-01 18:25:30.338 [[main]-pipeline-manager] elasticsearch - Normalizing http path {:path=>nil, :normalized=>nil}
  257. [INFO ] 2019-08-01 18:25:31.179 [[main]-pipeline-manager] elasticsearch - Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[http://localhost:9200/]}}
  258. [DEBUG] 2019-08-01 18:25:31.198 [[main]-pipeline-manager] elasticsearch - Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>http://localhost:9200/, :path=>"/"}
  259. [DEBUG] 2019-08-01 18:25:31.591 [pool-3-thread-1] jvm - collector name {:name=>"ParNew"}
  260. [DEBUG] 2019-08-01 18:25:31.597 [pool-3-thread-1] jvm - collector name {:name=>"ConcurrentMarkSweep"}
  261. [WARN ] 2019-08-01 18:25:31.749 [[main]-pipeline-manager] elasticsearch - Restored connection to ES instance {:url=>"http://localhost:9200/"}
  262. [INFO ] 2019-08-01 18:25:32.207 [[main]-pipeline-manager] elasticsearch - ES Output version determined {:es_version=>7}
  263. [WARN ] 2019-08-01 18:25:32.215 [[main]-pipeline-manager] elasticsearch - Detected a 6.x and above cluster: the `type` event field won't be used to determine the document _type {:es_version=>7}
  264. [INFO ] 2019-08-01 18:25:32.314 [[main]-pipeline-manager] elasticsearch - New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["http://localhost:9200"]}
  265. [INFO ] 2019-08-01 18:25:32.521 [Ruby-0-Thread-5: :1] elasticsearch - Using default mapping template
  266. [WARN ] 2019-08-01 18:25:32.580 [[main]-pipeline-manager] LazyDelegatingGauge - A gauge metric of an unknown type (org.jruby.specialized.RubyArrayOneObject) has been create for key: cluster_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team.
  267. [INFO ] 2019-08-01 18:25:32.584 [[main]-pipeline-manager] javapipeline - Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>1, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>125, :thread=>"#<Thread:0x4f46d135 run>"}
  268. [INFO ] 2019-08-01 18:25:32.697 [Ruby-0-Thread-5: :1] elasticsearch - Attempting to install template {:manage_template=>{"index_patterns"=>"logstash-*", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s", "number_of_shards"=>1}, "mappings"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"*", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}
  269. [DEBUG] 2019-08-01 18:25:32.781 [Ruby-0-Thread-5: :1] elasticsearch - Found existing Elasticsearch template. Skipping template management {:name=>"logstash"}
  270. [INFO ] 2019-08-01 18:25:33.150 [[main]-pipeline-manager] javapipeline - Pipeline started {"pipeline.id"=>"main"}
  271. [DEBUG] 2019-08-01 18:25:33.217 [Converge PipelineAction::Create<main>] javapipeline - Pipeline started successfully {:pipeline_id=>"main", :thread=>"#<Thread:0x4f46d135 run>"}
  272. [DEBUG] 2019-08-01 18:25:33.293 [logstash-pipeline-flush] PeriodicFlush - Pushing flush onto pipeline.
  273. [INFO ] 2019-08-01 18:25:33.454 [Ruby-0-Thread-1: /usr/share/logstash/lib/bootstrap/environment.rb:6] agent - Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
  274. [DEBUG] 2019-08-01 18:25:33.580 [Api Webserver] agent - Starting puma
  275. [DEBUG] 2019-08-01 18:25:33.622 [Api Webserver] agent - Trying to start WebServer {:port=>9600}
  276. [DEBUG] 2019-08-01 18:25:33.832 [Api Webserver] service - [api-service] start
  277. [INFO ] 2019-08-01 18:25:34.648 [Api Webserver] agent - Successfully started Logstash API endpoint {:port=>9600}
  278. [ERROR] 2019-08-01 18:25:35.361 [[main]<jdbc] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.
  279. Pipeline_id:main
  280. Plugin: <LogStash::Inputs::Jdbc jdbc_user=>"doadmin", jdbc_password=><password>, statement=>"SELECT * FROM pg_stat_user_indexes", jdbc_connection_string=>"<redacted>", id=>"b9ec94e0e26abcd202ab3b3df491248453d17a7f8600a5e8c3f42e19b335d072", jdbc_driver_class=>"org.postgresql.Driver", type=>"pg_stat_user_indexes", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_62a8bda7-4a0f-43c0-b6b4-8ff25aeef798", enable_metric=>true, charset=>"UTF-8">, jdbc_paging_enabled=>false, jdbc_page_size=>100000, jdbc_validate_connection=>false, jdbc_validation_timeout=>3600, jdbc_pool_timeout=>5, sql_log_level=>"info", connection_retry_attempts=>1, connection_retry_attempts_wait_time=>0.5, parameters=>{"sql_last_value"=>1970-01-01 00:00:00 UTC}, last_run_metadata_path=>"/root/.logstash_jdbc_last_run", use_column_value=>false, tracking_column_type=>"numeric", clean_run=>false, record_last_run=>true, lowercase_column_names=>true>
  281. Error: undefined method `to_sym' for nil:NilClass
  282. Exception: NoMethodError
  283. Stack: /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/database/connecting.rb:17:in `adapter_class'
  284. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/database/connecting.rb:36:in `connect'
  285. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/core.rb:121:in `connect'
  286. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:115:in `block in jdbc_connect'
  287. org/jruby/RubyKernel.java:1425:in `loop'
  288. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:112:in `jdbc_connect'
  289. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:165:in `open_jdbc_connection'
  290. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:221:in `execute_statement'
  291. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:277:in `execute_query'
  292. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:263:in `run'
  293. /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:309:in `inputworker'
  294. /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:302:in `block in start_input'
  295. [ERROR] 2019-08-01 18:25:35.362 [[main]<jdbc] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.
  296. Pipeline_id:main
  297. Plugin: <LogStash::Inputs::Jdbc jdbc_user=>"doadmin", jdbc_password=><password>, statement=>"SELECT * FROM pg_stat_user_tables", jdbc_connection_string=>"<redacted>", id=>"80d482adbd6de986ebc49e5cbb56940a997c4d5739b3242545aa80a88b322aa6", jdbc_driver_class=>"org.postgresql.Driver", type=>"pg_stat_user_tables", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_f454da1b-9ca1-448c-bede-a96dacd3c943", enable_metric=>true, charset=>"UTF-8">, jdbc_paging_enabled=>false, jdbc_page_size=>100000, jdbc_validate_connection=>false, jdbc_validation_timeout=>3600, jdbc_pool_timeout=>5, sql_log_level=>"info", connection_retry_attempts=>1, connection_retry_attempts_wait_time=>0.5, parameters=>{"sql_last_value"=>1970-01-01 00:00:00 UTC}, last_run_metadata_path=>"/root/.logstash_jdbc_last_run", use_column_value=>false, tracking_column_type=>"numeric", clean_run=>false, record_last_run=>true, lowercase_column_names=>true>
  298. Error: undefined method `to_sym' for nil:NilClass
  299. Exception: NoMethodError
  300. Stack: /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/database/connecting.rb:17:in `adapter_class'
  301. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/database/connecting.rb:36:in `connect'
  302. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/core.rb:121:in `connect'
  303. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:115:in `block in jdbc_connect'
  304. org/jruby/RubyKernel.java:1425:in `loop'
  305. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:112:in `jdbc_connect'
  306. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:165:in `open_jdbc_connection'
  307. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:221:in `execute_statement'
  308. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:277:in `execute_query'
  309. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:263:in `run'
  310. /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:309:in `inputworker'
  311. /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:302:in `block in start_input'
  312. [ERROR] 2019-08-01 18:25:35.362 [[main]<jdbc] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.
  313. Pipeline_id:main
  314. Plugin: <LogStash::Inputs::Jdbc jdbc_user=>"doadmin", jdbc_password=><password>, statement=>"SELECT * FROM pg_stat_database", jdbc_connection_string=>"<redacted>", id=>"3c2445e7b1afc5ab4f0895519eab7525354f00b0684765f7490dba9991501940", jdbc_driver_class=>"org.postgresql.Driver", type=>"pg_stat_database", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_486c8290-6966-4d74-b3be-5982423a0e1c", enable_metric=>true, charset=>"UTF-8">, jdbc_paging_enabled=>false, jdbc_page_size=>100000, jdbc_validate_connection=>false, jdbc_validation_timeout=>3600, jdbc_pool_timeout=>5, sql_log_level=>"info", connection_retry_attempts=>1, connection_retry_attempts_wait_time=>0.5, parameters=>{"sql_last_value"=>1970-01-01 00:00:00 UTC}, last_run_metadata_path=>"/root/.logstash_jdbc_last_run", use_column_value=>false, tracking_column_type=>"numeric", clean_run=>false, record_last_run=>true, lowercase_column_names=>true>
  315. Error: undefined method `to_sym' for nil:NilClass
  316. Exception: NoMethodError
  317. Stack: /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/database/connecting.rb:17:in `adapter_class'
  318. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/database/connecting.rb:36:in `connect'
  319. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/core.rb:121:in `connect'
  320. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:115:in `block in jdbc_connect'
  321. org/jruby/RubyKernel.java:1425:in `loop'
  322. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:112:in `jdbc_connect'
  323. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:165:in `open_jdbc_connection'
  324. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:221:in `execute_statement'
  325. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:277:in `execute_query'
  326. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:263:in `run'
  327. /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:309:in `inputworker'
  328. /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:302:in `block in start_input'
  329. [DEBUG] 2019-08-01 18:25:32.825 [[main]>worker0] CompiledPipeline - Compiled output
  330. P[output-elasticsearch{"hosts"=>"http://localhost:9200", "document_type"=>"%{type}", "index"=>"pg_statistics"}|[str]pipeline:37:2:```
  331. elasticsearch {
  332. hosts => "http://localhost:9200"
  333. document_type => "%{type}"
  334. index => "pg_statistics"
  335. }
  336. ```]
  337. into
  338. org.logstash.config.ir.compiler.ComputeStepSyntaxElement@c96a6eaa
  339. [DEBUG] 2019-08-01 18:25:36.371 [[main]<jdbc] jdbc - Closing {:plugin=>"LogStash::Inputs::Jdbc"}
  340. [DEBUG] 2019-08-01 18:25:36.371 [[main]<jdbc] jdbc - Closing {:plugin=>"LogStash::Inputs::Jdbc"}
  341. [DEBUG] 2019-08-01 18:25:36.381 [[main]<jdbc] pluginmetadata - Removing metadata for plugin 3c2445e7b1afc5ab4f0895519eab7525354f00b0684765f7490dba9991501940
  342. [DEBUG] 2019-08-01 18:25:36.388 [[main]<jdbc] pluginmetadata - Removing metadata for plugin b9ec94e0e26abcd202ab3b3df491248453d17a7f8600a5e8c3f42e19b335d072
  343. [DEBUG] 2019-08-01 18:25:36.370 [[main]<jdbc] jdbc - Closing {:plugin=>"LogStash::Inputs::Jdbc"}
  344. [DEBUG] 2019-08-01 18:25:36.399 [[main]<jdbc] pluginmetadata - Removing metadata for plugin 80d482adbd6de986ebc49e5cbb56940a997c4d5739b3242545aa80a88b322aa6
  345. [ERROR] 2019-08-01 18:25:36.405 [[main]<jdbc] javapipeline - A plugin had an unrecoverable error. Will restart this plugin.
  346. Pipeline_id:main
  347. Plugin: <LogStash::Inputs::Jdbc jdbc_user=>"doadmin", jdbc_password=><password>, statement=>"SELECT * FROM pg_stat_database", jdbc_connection_string=>"<redacted>", id=>"3c2445e7b1afc5ab4f0895519eab7525354f00b0684765f7490dba9991501940", jdbc_driver_class=>"org.postgresql.Driver", type=>"pg_stat_database", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_486c8290-6966-4d74-b3be-5982423a0e1c", enable_metric=>true, charset=>"UTF-8">, jdbc_paging_enabled=>false, jdbc_page_size=>100000, jdbc_validate_connection=>false, jdbc_validation_timeout=>3600, jdbc_pool_timeout=>5, sql_log_level=>"info", connection_retry_attempts=>1, connection_retry_attempts_wait_time=>0.5, parameters=>{"sql_last_value"=>1970-01-01 00:00:00 UTC}, last_run_metadata_path=>"/root/.logstash_jdbc_last_run", use_column_value=>false, tracking_column_type=>"numeric", clean_run=>false, record_last_run=>true, lowercase_column_names=>true>
  348. Error: undefined method `to_sym' for nil:NilClass
  349. Exception: NoMethodError
  350. Stack: /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/database/connecting.rb:17:in `adapter_class'
  351. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/database/connecting.rb:36:in `connect'
  352. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/sequel-5.22.0/lib/sequel/core.rb:121:in `connect'
  353. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:115:in `block in jdbc_connect'
  354. org/jruby/RubyKernel.java:1425:in `loop'
  355. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:112:in `jdbc_connect'
  356. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:165:in `open_jdbc_connection'
  357. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/plugin_mixins/jdbc/jdbc.rb:221:in `execute_statement'
  358. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:277:in `execute_query'
  359. /usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-input-jdbc-4.3.13/lib/logstash/inputs/jdbc.rb:263:in `run'
  360. /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:309:in `inputworker'
  361. /usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:302:in `block in start_input'
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!