daily pastebin goal
53%
SHARE
TWEET

Untitled

a guest Oct 16th, 2017 50 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. [2017-10-16T15:56:29,118][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"/usr/share/logstash/modules/fb_apache/configuration"}
  2. [2017-10-16T15:56:29,122][DEBUG][logstash.plugins.registry] Adding plugin to the registry {:name=>"fb_apache", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0x4f2ed590 @kibana_version_parts=["5", "6", "0"], @module_name="fb_apache", @directory="/usr/share/logstash/modules/fb_apache/configuration">}
  3. [2017-10-16T15:56:29,123][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"/usr/share/logstash/modules/netflow/configuration"}
  4. [2017-10-16T15:56:29,124][DEBUG][logstash.plugins.registry] Adding plugin to the registry {:name=>"netflow", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0xb732fcc @kibana_version_parts=["5", "6", "0"], @module_name="netflow", @directory="/usr/share/logstash/modules/netflow/configuration">}
  5. [2017-10-16T15:56:29,292][DEBUG][logstash.agent           ] Agent: Configuring metric collection
  6. [2017-10-16T15:56:29,295][DEBUG][logstash.instrument.periodicpoller.os] PeriodicPoller: Starting {:polling_interval=>5, :polling_timeout=>120}
  7. [2017-10-16T15:56:29,420][DEBUG][logstash.instrument.periodicpoller.jvm] PeriodicPoller: Starting {:polling_interval=>5, :polling_timeout=>120}
  8. [2017-10-16T15:56:29,507][DEBUG][logstash.instrument.periodicpoller.persistentqueue] PeriodicPoller: Starting {:polling_interval=>5, :polling_timeout=>120}
  9. [2017-10-16T15:56:29,508][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] PeriodicPoller: Starting {:polling_interval=>5, :polling_timeout=>120}
  10. [2017-10-16T15:56:29,529][DEBUG][logstash.agent           ] Reading config file {:config_file=>"/opt/experis-cyber/sys-monitor/logstash-sys-monitor.conf"}
  11. [2017-10-16T15:56:29,709][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"file", :type=>"input", :class=>LogStash::Inputs::File}
  12. [2017-10-16T15:56:29,733][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"plain", :type=>"codec", :class=>LogStash::Codecs::Plain}
  13. [2017-10-16T15:56:29,750][DEBUG][logstash.codecs.plain    ] config LogStash::Codecs::Plain/@id = "plain_2c3eb918-337a-4935-bf78-bfe3ab709129"
  14. [2017-10-16T15:56:29,750][DEBUG][logstash.codecs.plain    ] config LogStash::Codecs::Plain/@enable_metric = true
  15. [2017-10-16T15:56:29,750][DEBUG][logstash.codecs.plain    ] config LogStash::Codecs::Plain/@charset = "UTF-8"
  16. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@path = ["/usr/share/logstash/log/monitor-sys-1506979201881.json"]
  17. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@sincedb_path = "/dev/null"
  18. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@start_position = "beginning"
  19. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@id = "9e9162561d919c7b40b4a16e9f4e8e6e81267f8d-1"
  20. [2017-10-16T15:56:29,752][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@enable_metric = true
  21. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@codec = <LogStash::Codecs::Plain id=>"plain_2c3eb918-337a-4935-bf78-bfe3ab709129", enable_metric=>true, charset=>"UTF-8">
  22. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@add_field = {}
  23. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@stat_interval = 1
  24. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@discover_interval = 15
  25. [2017-10-16T15:56:29,753][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@sincedb_write_interval = 15
  26. [2017-10-16T15:56:29,754][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@delimiter = "\n"
  27. [2017-10-16T15:56:29,754][DEBUG][logstash.inputs.file     ] config LogStash::Inputs::File/@close_older = 3600
  28. [2017-10-16T15:56:29,933][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"elasticsearch", :type=>"output", :class=>LogStash::Outputs::ElasticSearch}
  29. [2017-10-16T15:56:29,968][DEBUG][logstash.codecs.plain    ] config LogStash::Codecs::Plain/@id = "plain_ddd82ced-4bda-414a-a9c2-d70ea27bde23"
  30. [2017-10-16T15:56:29,969][DEBUG][logstash.codecs.plain    ] config LogStash::Codecs::Plain/@enable_metric = true
  31. [2017-10-16T15:56:29,969][DEBUG][logstash.codecs.plain    ] config LogStash::Codecs::Plain/@charset = "UTF-8"
  32. [2017-10-16T15:56:30,012][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@hosts = [//10.10.20.13:9200]
  33. [2017-10-16T15:56:30,012][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@index = "monitor"
  34. [2017-10-16T15:56:30,012][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@id = "9e9162561d919c7b40b4a16e9f4e8e6e81267f8d-2"
  35. [2017-10-16T15:56:30,012][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@enable_metric = true
  36. [2017-10-16T15:56:30,013][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@codec = <LogStash::Codecs::Plain id=>"plain_ddd82ced-4bda-414a-a9c2-d70ea27bde23", enable_metric=>true, charset=>"UTF-8">
  37. [2017-10-16T15:56:30,013][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@workers = 1
  38. [2017-10-16T15:56:30,013][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@manage_template = true
  39. [2017-10-16T15:56:30,013][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@template_name = "logstash"
  40. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@template_overwrite = false
  41. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@parent = nil
  42. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@idle_flush_time = 1
  43. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@upsert = ""
  44. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@doc_as_upsert = false
  45. [2017-10-16T15:56:30,014][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@script = ""
  46. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@script_type = "inline"
  47. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@script_lang = "painless"
  48. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@script_var_name = "event"
  49. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@scripted_upsert = false
  50. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@retry_initial_interval = 2
  51. [2017-10-16T15:56:30,015][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@retry_max_interval = 64
  52. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@retry_on_conflict = 1
  53. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@pipeline = nil
  54. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@action = "index"
  55. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@ssl_certificate_verification = true
  56. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@sniffing = false
  57. [2017-10-16T15:56:30,016][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@sniffing_delay = 5
  58. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@timeout = 60
  59. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@failure_type_logging_whitelist = []
  60. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@pool_max = 1000
  61. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@pool_max_per_route = 100
  62. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@resurrect_delay = 5
  63. [2017-10-16T15:56:30,017][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@validate_after_inactivity = 10000
  64. [2017-10-16T15:56:30,018][DEBUG][logstash.outputs.elasticsearch] config LogStash::Outputs::ElasticSearch/@http_compression = false
  65. [2017-10-16T15:56:30,044][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"stdout", :type=>"output", :class=>LogStash::Outputs::Stdout}
  66. [2017-10-16T15:56:30,118][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"rubydebug", :type=>"codec", :class=>LogStash::Codecs::RubyDebug}
  67. [2017-10-16T15:56:30,122][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@id = "rubydebug_9c1ee8e6-9fa4-4553-96d1-803214216fd9"
  68. [2017-10-16T15:56:30,122][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@enable_metric = true
  69. [2017-10-16T15:56:30,122][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@metadata = false
  70. [2017-10-16T15:56:30,345][DEBUG][logstash.outputs.stdout  ] config LogStash::Outputs::Stdout/@codec = <LogStash::Codecs::RubyDebug id=>"rubydebug_9c1ee8e6-9fa4-4553-96d1-803214216fd9", enable_metric=>true, metadata=>false>
  71. [2017-10-16T15:56:30,345][DEBUG][logstash.outputs.stdout  ] config LogStash::Outputs::Stdout/@id = "9e9162561d919c7b40b4a16e9f4e8e6e81267f8d-3"
  72. [2017-10-16T15:56:30,345][DEBUG][logstash.outputs.stdout  ] config LogStash::Outputs::Stdout/@enable_metric = true
  73. [2017-10-16T15:56:30,345][DEBUG][logstash.outputs.stdout  ] config LogStash::Outputs::Stdout/@workers = 1
  74. [2017-10-16T15:56:30,364][DEBUG][logstash.agent           ] starting agent
  75. [2017-10-16T15:56:30,367][DEBUG][logstash.agent           ] starting pipeline {:id=>"main"}
  76. [2017-10-16T15:56:30,384][DEBUG][logstash.outputs.elasticsearch] Normalizing http path {:path=>nil, :normalized=>nil}
  77. [2017-10-16T15:56:31,479][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[http://10.10.20.13:9200/]}}
  78. [2017-10-16T15:56:31,480][INFO ][logstash.outputs.elasticsearch] Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>http://10.10.20.13:9200/, :path=>"/"}
  79. [2017-10-16T15:56:31,945][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>"http://10.10.20.13:9200/"}
  80. [2017-10-16T15:56:31,968][INFO ][logstash.outputs.elasticsearch] Using mapping template from {:path=>nil}
  81. [2017-10-16T15:56:32,144][INFO ][logstash.outputs.elasticsearch] Attempting to install template {:manage_template=>{"template"=>"logstash-*", "version"=>50001, "settings"=>{"index.refresh_interval"=>"5s"}, "mappings"=>{"_default_"=>{"_all"=>{"enabled"=>true, "norms"=>false}, "dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"*", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date", "include_in_all"=>false}, "@version"=>{"type"=>"keyword", "include_in_all"=>false}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}}
  82. [2017-10-16T15:56:32,188][DEBUG][logstash.outputs.elasticsearch] Found existing Elasticsearch template. Skipping template management {:name=>"logstash"}
  83. [2017-10-16T15:56:32,189][INFO ][logstash.outputs.elasticsearch] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//10.10.20.13:9200"]}
  84. [2017-10-16T15:56:32,192][INFO ][logstash.pipeline        ] Starting pipeline {"id"=>"main", "pipeline.workers"=>1, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>5, "pipeline.max_inflight"=>125}
  85. [2017-10-16T15:56:33,141][INFO ][logstash.pipeline        ] Pipeline main started
  86. [2017-10-16T15:56:33,202][DEBUG][logstash.inputs.file     ] _globbed_files: /usr/share/logstash/log/monitor-sys-1506979201881.json: glob is: ["/usr/share/logstash/log/monitor-sys-1506979201881.json"]
  87. [2017-10-16T15:56:33,203][DEBUG][logstash.inputs.file     ] _discover_file: /usr/share/logstash/log/monitor-sys-1506979201881.json: new: /usr/share/logstash/log/monitor-sys-1506979201881.json (exclude is [])
  88. [2017-10-16T15:56:33,204][DEBUG][logstash.inputs.file     ] _open_file: /usr/share/logstash/log/monitor-sys-1506979201881.json: opening
  89. [2017-10-16T15:56:33,205][DEBUG][logstash.inputs.file     ] /usr/share/logstash/log/monitor-sys-1506979201881.json: initial create, no sincedb, seeking to beginning of file
  90. [2017-10-16T15:56:33,206][DEBUG][logstash.inputs.file     ] writing sincedb (delta since last write = 1508158593)
  91. [2017-10-16T15:56:33,207][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  92. [2017-10-16T15:56:33,208][DEBUG][logstash.agent           ] Starting puma
  93. [2017-10-16T15:56:33,211][DEBUG][logstash.agent           ] Trying to start WebServer {:port=>9600}
  94. [2017-10-16T15:56:33,212][DEBUG][logstash.api.service     ] [api-service] start
  95. [2017-10-16T15:56:33,321][INFO ][logstash.agent           ] Successfully started Logstash API endpoint {:port=>9600}
  96. [2017-10-16T15:56:34,211][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  97. [2017-10-16T15:56:35,214][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  98. [2017-10-16T15:56:36,223][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  99. [2017-10-16T15:56:37,227][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  100. [2017-10-16T15:56:38,158][DEBUG][logstash.pipeline        ] Pushing flush onto pipeline
  101. [2017-10-16T15:56:38,230][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  102. [2017-10-16T15:56:39,233][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  103. [2017-10-16T15:56:40,238][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  104. [2017-10-16T15:56:41,240][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  105. [2017-10-16T15:56:42,243][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  106. [2017-10-16T15:56:43,159][DEBUG][logstash.pipeline        ] Pushing flush onto pipeline
  107. [2017-10-16T15:56:43,245][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  108. [2017-10-16T15:56:44,247][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  109. [2017-10-16T15:56:45,250][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  110. [2017-10-16T15:56:46,252][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  111. [2017-10-16T15:56:47,255][DEBUG][logstash.inputs.file     ] each: file grew: /usr/share/logstash/log/monitor-sys-1506979201881.json: old size 0, new size 115
  112. [2017-10-16T15:56:47,257][DEBUG][logstash.inputs.file     ] _globbed_files: /usr/share/logstash/log/monitor-sys-1506979201881.json: glob is: ["/usr/share/logstash/log/monitor-sys-1506979201881.json"]
RAW Paste Data
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy. OK, I Understand
 
Top