API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Oct 16th, 2017
140
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 16.30 KB | None | 0 0
raw download clone embed print report
  1. [2017-10-16T15:56:29,118][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"/usr/share/logstash/modules/fb_apache/configuration"}
  2. [2017-10-16T15:56:29,122][DEBUG][logstash.plugins.registry] Adding plugin to the registry {:name=>"fb_apache", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0x4f2ed590 @kibana_version_parts=["5", "6", "0"], @module_name="fb_apache", @directory="/usr/share/logstash/modules/fb_apache/configuration">}
  3. [2017-10-16T15:56:29,123][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"/usr/share/logstash/modules/netflow/configuration"}
  4. [2017-10-16T15:56:29,124][DEBUG][logstash.plugins.registry] Adding plugin to the registry {:name=>"netflow", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0xb732fcc @kibana_version_parts=["5", "6", "0"], @module_name="netflow", @directory="/usr/share/logstash/modules/netflow/configuration">}
  5. [2017-10-16T15:56:29,292][DEBUG][logstash.agent ] Agent: Configuring metric collection
  6. [2017-10-16T15:56:29,295][DEBUG][logstash.instrument.periodicpoller.os] PeriodicPoller: Starting {:polling_interval=>5, :polling_timeout=>120}
  7. [2017-10-16T15:56:29,420][DEBUG][logstash.instrument.periodicpoller.jvm] PeriodicPoller: Starting {:polling_interval=>5, :polling_timeout=>120}
  8. [2017-10-16T15:56:29,507][DEBUG][logstash.instrument.periodicpoller.persistentqueue] PeriodicPoller: Starting {:polling_interval=>5, :polling_timeout=>120}
  9. [2017-10-16T15:56:29,508][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] PeriodicPoller: Starting {:polling_interval=>5, :polling_timeout=>120}
  10. [2017-10-16T15:56:29,529][DEBUG][logstash.agent ] Reading config file {:config_file=>"/opt/experis-cyber/sys-monitor/logstash-sys-monitor.conf"}
  11. [2017-10-16T15:56:29,709][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"file", :type=>"input", :class=>LogStash::Inputs::File}
  12. [2017-10-16T15:56:29,733][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"plain", :type=>"codec", :class=>LogStash::Codecs::Plain}
  13. [2017-10-16T15:56:29,750][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@id = "plain_2c3eb918-337a-4935-bf78-bfe3ab709129"
  14. [2017-10-16T15:56:29,750][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@enable_metric = true
  15. [2017-10-16T15:56:29,750][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@charset = "UTF-8"
  16. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@path = ["/usr/share/logstash/log/monitor-sys-1506979201881.json"]
  17. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@sincedb_path = "/dev/null"
  18. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@start_position = "beginning"
  19. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@id = "9e9162561d919c7b40b4a16e9f4e8e6e81267f8d-1"
  20. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@enable_metric = true
  21. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@codec = <LogStash::Codecs::Plain id=>"plain_2c3eb918-337a-4935-bf78-bfe3ab709129", enable_metric=>true, charset=>"UTF-8">
  22. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@add_field = {}
  23. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@stat_interval = 1
  24. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@discover_interval = 15
  25. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@sincedb_write_interval = 15
  26. [2017-10-16T15:56:29,754][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@delimiter = "\n"
  27. [2017-10-16T15:56:29,754][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@close_older = 3600
  28. [2017-10-16T15:56:29,933][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"elasticsearch", :type=>"output", :class=>LogStash::Outputs::ElasticSearch}
  29. [2017-10-16T15:56:29,968][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@id = "plain_ddd82ced-4bda-414a-a9c2-d70ea27bde23"
  30. [2017-10-16T15:56:29,969][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@enable_metric = true
  31. [2017-10-16T15:56:29,969][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@charset = "UTF-8"
  32. [2017-10-16T15:56:30,012][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@hosts = [//10.10.20.13:9200]
  33. [2017-10-16T15:56:30,012][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@index = "monitor"
  34. [2017-10-16T15:56:30,012][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@id = "9e9162561d919c7b40b4a16e9f4e8e6e81267f8d-2"
  35. [2017-10-16T15:56:30,012][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@enable_metric = true
  36. [2017-10-16T15:56:30,013][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@codec = <LogStash::Codecs::Plain id=>"plain_ddd82ced-4bda-414a-a9c2-d70ea27bde23", enable_metric=>true, charset=>"UTF-8">
  37. [2017-10-16T15:56:30,013][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@workers = 1
  38. [2017-10-16T15:56:30,013][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@manage_template = true
  39. [2017-10-16T15:56:30,013][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@template_name = "logstash"
  40. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@template_overwrite = false
  41. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@parent = nil
  42. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@idle_flush_time = 1
  43. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@upsert = ""
  44. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@doc_as_upsert = false
  45. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@script = ""
  46. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@script_type = "inline"
  47. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@script_lang = "painless"
  48. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@script_var_name = "event"
  49. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@scripted_upsert = false
  50. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@retry_initial_interval = 2
  51. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@retry_max_interval = 64
  52. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@retry_on_conflict = 1
  53. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@pipeline = nil
  54. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@action = "index"
  55. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@ssl_certificate_verification = true
  56. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@sniffing = false
  57. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@sniffing_delay = 5
  58. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@timeout = 60
  59. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@failure_type_logging_whitelist = []
  60. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@pool_max = 1000
  61. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@pool_max_per_route = 100
  62. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@resurrect_delay = 5
  63. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@validate_after_inactivity = 10000
  64. [2017-10-16T15:56:30,018][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@http_compression = false
  65. [2017-10-16T15:56:30,044][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"stdout", :type=>"output", :class=>LogStash::Outputs::Stdout}
  66. [2017-10-16T15:56:30,118][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"rubydebug", :type=>"codec", :class=>LogStash::Codecs::RubyDebug}
  67. [2017-10-16T15:56:30,122][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@id = "rubydebug_9c1ee8e6-9fa4-4553-96d1-803214216fd9"
  68. [2017-10-16T15:56:30,122][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@enable_metric = true
  69. [2017-10-16T15:56:30,122][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@metadata = false
  70. [2017-10-16T15:56:30,345][DEBUG][logstash.outputs.stdout ] config LogStash::Outputs::Stdout/@codec = <LogStash::Codecs::RubyDebug id=>"rubydebug_9c1ee8e6-9fa4-4553-96d1-803214216fd9", enable_metric=>true, metadata=>false>
  71. [2017-10-16T15:56:30,345][DEBUG][logstash.outputs.stdout ] config LogStash::Outputs::Stdout/@id = "9e9162561d919c7b40b4a16e9f4e8e6e81267f8d-3"
  72. [2017-10-16T15:56:30,345][DEBUG][logstash.outputs.stdout ] config LogStash::Outputs::Stdout/@enable_metric = true
  73. [2017-10-16T15:56:30,345][DEBUG][logstash.outputs.stdout ] config LogStash::Outputs::Stdout/@workers = 1
  74. [2017-10-16T15:56:30,364][DEBUG][logstash.agent ] starting agent
  75. [2017-10-16T15:56:30,367][DEBUG][logstash.agent ] starting pipeline {:id=>"main"}
  76. [2017-10-16T15:56:30,384][DEBUG][logstash.outputs.elasticsearch] Normalizing http path {:path=>nil, :normalized=>nil}
  77. [2017-10-16T15:56:31,479][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[http://10.10.20.13:9200/]}}
  78. [2017-10-16T15:56:31,480][INFO ][logstash.outputs.elasticsearch] Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>http://10.10.20.13:9200/, :path=>"/"}
  79. [2017-10-16T15:56:31,945][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>"http://10.10.20.13:9200/"}
  80. [2017-10-16T15:56:31,968][INFO ][logstash.outputs.elasticsearch] Using mapping template from {:path=>nil}
  81. [2017-10-16T15:56:32,144][INFO ][logstash.outputs.elasticsearch] Attempting to install template {:manage_template=>{"template"=>"logstash-*", "version"=>50001, "settings"=>{"index.refresh_interval"=>"5s"}, "mappings"=>{"_default_"=>{"_all"=>{"enabled"=>true, "norms"=>false}, "dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"*", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date", "include_in_all"=>false}, "@version"=>{"type"=>"keyword", "include_in_all"=>false}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}}
  82. [2017-10-16T15:56:32,188][DEBUG][logstash.outputs.elasticsearch] Found existing Elasticsearch template. Skipping template management {:name=>"logstash"}
  83. [2017-10-16T15:56:32,189][INFO ][logstash.outputs.elasticsearch] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//10.10.20.13:9200"]}
  84. [2017-10-16T15:56:32,192][INFO ][logstash.pipeline ] Starting pipeline {"id"=>"main", "pipeline.workers"=>1, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>5, "pipeline.max_inflight"=>125}
  85. [2017-10-16T15:56:33,141][INFO ][logstash.pipeline ] Pipeline main started
  86. [2017-10-16T15:56:33,202][DEBUG][logstash.inputs.file ] _globbed_files: /usr/share/logstash/log/monitor-sys-1506979201881.json: glob is: ["/usr/share/logstash/log/monitor-sys-1506979201881.json"]
  87. [2017-10-16T15:56:33,203][DEBUG][logstash.inputs.file ] _discover_file: /usr/share/logstash/log/monitor-sys-1506979201881.json: new: /usr/share/logstash/log/monitor-sys-1506979201881.json (exclude is [])
  88. [2017-10-16T15:56:33,204][DEBUG][logstash.inputs.file ] _open_file: /usr/share/logstash/log/monitor-sys-1506979201881.json: opening
  89. [2017-10-16T15:56:33,205][DEBUG][logstash.inputs.file ] /usr/share/logstash/log/monitor-sys-1506979201881.json: initial create, no sincedb, seeking to beginning of file
  90. [2017-10-16T15:56:33,206][DEBUG][logstash.inputs.file ] writing sincedb (delta since last write = 1508158593)
  91. [2017-10-16T15:56:33,207][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  92. [2017-10-16T15:56:33,208][DEBUG][logstash.agent ] Starting puma
  93. [2017-10-16T15:56:33,211][DEBUG][logstash.agent ] Trying to start WebServer {:port=>9600}
  94. [2017-10-16T15:56:33,212][DEBUG][logstash.api.service ] [api-service] start
  95. [2017-10-16T15:56:33,321][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
  96. [2017-10-16T15:56:34,211][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  97. [2017-10-16T15:56:35,214][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  98. [2017-10-16T15:56:36,223][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  99. [2017-10-16T15:56:37,227][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  100. [2017-10-16T15:56:38,158][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
  101. [2017-10-16T15:56:38,230][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  102. [2017-10-16T15:56:39,233][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  103. [2017-10-16T15:56:40,238][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  104. [2017-10-16T15:56:41,240][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  105. [2017-10-16T15:56:42,243][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  106. [2017-10-16T15:56:43,159][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
  107. [2017-10-16T15:56:43,245][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  108. [2017-10-16T15:56:44,247][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  109. [2017-10-16T15:56:45,250][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  110. [2017-10-16T15:56:46,252][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  111. [2017-10-16T15:56:47,255][DEBUG][logstash.inputs.file ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  112. [2017-10-16T15:56:47,257][DEBUG][logstash.inputs.file ] _globbed_files: /usr/share/logstash/log/monitor-sys-1506979201881.json: glob is: ["/usr/share/logstash/log/monitor-sys-1506979201881.json"]
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!