API tools faq
paste
Guest User

Filebeat Log - 1

a guest
Dec 26th, 2020
586
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 16.17 KB | None | 0 0
raw download clone embed print report
  1. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$ ./filebeat -e setup
  2. 2020-12-26T23:42:53.920+0530 INFO instance/beat.go:645 Home path: [/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64] Config path: [/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64] Data path: [/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/data] Logs path: [/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/logs]
  3. 2020-12-26T23:42:53.921+0530 INFO instance/beat.go:653 Beat ID: 5317d3f1-4496-4663-b5ba-64cadefa86ee
  4. 2020-12-26T23:42:53.923+0530 INFO [beat] instance/beat.go:981 Beat info {"system_info": {"beat": {"path": {"config": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64", "data": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/data", "home": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64", "logs": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/logs"}, "type": "filebeat", "uuid": "5317d3f1-4496-4663-b5ba-64cadefa86ee"}}}
  5. 2020-12-26T23:42:53.924+0530 INFO [beat] instance/beat.go:990 Build info {"system_info": {"build": {"commit": "1da173a9e716715a7a54bb3ff4db05b5c24fc8ce", "libbeat": "7.10.1", "time": "2020-12-04T23:27:16.000Z", "version": "7.10.1"}}}
  6. 2020-12-26T23:42:53.924+0530 INFO [beat] instance/beat.go:993 Go runtime info {"system_info": {"go": {"os":"darwin","arch":"amd64","max_procs":8,"version":"go1.14.12"}}}
  7. 2020-12-26T23:42:53.925+0530 INFO [beat] instance/beat.go:997 Host info {"system_info": {"host": {"architecture":"x86_64","boot_time":"2020-12-26T10:00:55.727979+05:30","name":"Anujs-MacBook-Pro.local","ip":["127.0.0.1/8","::1/128","fe80::1/64","fe80::8ed:c386:c81f:8556/64","192.168.1.3/24","fe80::90fe:6dff:fea3:9011/64","fe80::90fe:6dff:fea3:9011/64","fe80::9ec:2991:5e09:e319/64","fe80::d176:25eb:47c5:25be/64"],"kernel_version":"20.2.0","mac":["60:f8:1d:cb:f5:18","82:0f:1f:ea:9c:40","82:0f:1f:ea:9c:41","82:0f:1f:ea:9c:40","02:f8:1d:cb:f5:18","92:fe:6d:a3:90:11","92:fe:6d:a3:90:11"],"os":{"family":"darwin","platform":"darwin","name":"Mac OS X","version":"10.16","major":10,"minor":16,"patch":0,"build":"20C69"},"timezone":"IST","timezone_offset_sec":19800,"id":"1358F504-3504-5ADB-9548-DCFAABC04128"}}}
  8. 2020-12-26T23:42:53.925+0530 INFO [beat] instance/beat.go:1026 Process info {"system_info": {"process": {"cwd": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64", "exe": "./filebeat", "name": "filebeat", "pid": 35728, "ppid": 24894, "start_time": "2020-12-26T23:42:53.382+0530"}}}
  9. 2020-12-26T23:42:53.925+0530 INFO instance/beat.go:299 Setup Beat: filebeat; Version: 7.10.1
  10. 2020-12-26T23:42:53.925+0530 INFO [index-management] idxmgmt/std.go:184 Set output.elasticsearch.index to 'filebeat-7.10.1' as ILM is enabled.
  11. 2020-12-26T23:42:53.928+0530 INFO eslegclient/connection.go:99 elasticsearch url: http://localhost:9200
  12. 2020-12-26T23:42:53.930+0530 INFO [publisher] pipeline/module.go:113 Beat name: Anujs-MacBook-Pro.local
  13. 2020-12-26T23:42:53.933+0530 INFO eslegclient/connection.go:99 elasticsearch url: http://localhost:9200
  14. 2020-12-26T23:42:53.942+0530 INFO [esclientleg] eslegclient/connection.go:314 Attempting to connect to Elasticsearch version 7.10.1
  15. Overwriting ILM policy is disabled. Set `setup.ilm.overwrite: true` for enabling.
  16.  
  17. 2020-12-26T23:42:53.974+0530 INFO [index-management] idxmgmt/std.go:261 Auto ILM enable success.
  18. 2020-12-26T23:42:53.975+0530 INFO [index-management.ilm] ilm/std.go:139 do not generate ilm policy: exists=true, overwrite=false
  19. 2020-12-26T23:42:53.975+0530 INFO [index-management] idxmgmt/std.go:274 ILM policy successfully loaded.
  20. 2020-12-26T23:42:53.975+0530 INFO [index-management] idxmgmt/std.go:407 Set setup.template.name to '{filebeat-7.10.1 {now/d}-000001}' as ILM is enabled.
  21. 2020-12-26T23:42:53.975+0530 INFO [index-management] idxmgmt/std.go:412 Set setup.template.pattern to 'filebeat-7.10.1-*' as ILM is enabled.
  22. 2020-12-26T23:42:53.975+0530 INFO [index-management] idxmgmt/std.go:446 Set settings.index.lifecycle.rollover_alias in template to {filebeat-7.10.1 {now/d}-000001} as ILM is enabled.
  23. 2020-12-26T23:42:53.975+0530 INFO [index-management] idxmgmt/std.go:450 Set settings.index.lifecycle.name in template to {filebeat {"policy":{"phases":{"hot":{"actions":{"rollover":{"max_age":"30d","max_size":"50gb"}}}}}}} as ILM is enabled.
  24. 2020-12-26T23:42:53.976+0530 INFO template/load.go:183 Existing template will be overwritten, as overwrite is enabled.
  25. 2020-12-26T23:42:55.195+0530 INFO template/load.go:117 Try loading template filebeat-7.10.1 to Elasticsearch
  26. 2020-12-26T23:42:55.344+0530 INFO template/load.go:109 template with name 'filebeat-7.10.1' loaded.
  27. 2020-12-26T23:42:55.344+0530 INFO [index-management] idxmgmt/std.go:298 Loaded index template.
  28. 2020-12-26T23:42:55.346+0530 INFO [index-management] idxmgmt/std.go:309 Write alias successfully generated.
  29. Index setup finished.
  30. Loading dashboards (Kibana must be running and reachable)
  31. 2020-12-26T23:42:55.346+0530 INFO kibana/client.go:119 Kibana url: http://localhost:5601
  32. 2020-12-26T23:42:56.996+0530 INFO kibana/client.go:119 Kibana url: http://localhost:5601
  33. 2020-12-26T23:44:06.840+0530 INFO instance/beat.go:815 Kibana dashboards successfully loaded.
  34. Loaded dashboards
  35. 2020-12-26T23:44:06.840+0530 WARN [cfgwarn] instance/beat.go:556 DEPRECATED: Setting up ML using Filebeat is going to be removed. Please use the ML app to setup jobs. Will be removed in version: 8.0.0
  36. Setting up ML using setup --machine-learning is going to be removed in 8.0.0. Please use the ML app instead.
  37. See more: https://www.elastic.co/guide/en/machine-learning/current/index.html
  38. 2020-12-26T23:44:06.842+0530 INFO eslegclient/connection.go:99 elasticsearch url: http://localhost:9200
  39. 2020-12-26T23:44:06.845+0530 INFO [esclientleg] eslegclient/connection.go:314 Attempting to connect to Elasticsearch version 7.10.1
  40. 2020-12-26T23:44:06.845+0530 INFO kibana/client.go:119 Kibana url: http://localhost:5601
  41. 2020-12-26T23:44:06.881+0530 WARN fileset/modules.go:421 X-Pack Machine Learning is not enabled
  42. Loaded machine learning job configurations
  43. 2020-12-26T23:44:06.885+0530 INFO eslegclient/connection.go:99 elasticsearch url: http://localhost:9200
  44. 2020-12-26T23:44:06.888+0530 INFO [esclientleg] eslegclient/connection.go:314 Attempting to connect to Elasticsearch version 7.10.1
  45. 2020-12-26T23:44:06.888+0530 INFO cfgfile/reload.go:262 Loading of config files completed.
  46. Loaded Ingest pipelines
  47. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$
  48. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$
  49. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$
  50. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$
  51. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$
  52. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$
  53. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$
  54. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$
  55. Anujs-MacBook-Pro:filebeat-7.10.1-darwin-x86_64 anujaggarwal$ ./filebeat -e
  56. 2020-12-26T23:44:16.784+0530 INFO instance/beat.go:645 Home path: [/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64] Config path: [/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64] Data path: [/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/data] Logs path: [/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/logs]
  57. 2020-12-26T23:44:16.785+0530 INFO instance/beat.go:653 Beat ID: 5317d3f1-4496-4663-b5ba-64cadefa86ee
  58. 2020-12-26T23:44:16.785+0530 INFO [beat] instance/beat.go:981 Beat info {"system_info": {"beat": {"path": {"config": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64", "data": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/data", "home": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64", "logs": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/logs"}, "type": "filebeat", "uuid": "5317d3f1-4496-4663-b5ba-64cadefa86ee"}}}
  59. 2020-12-26T23:44:16.785+0530 INFO [beat] instance/beat.go:990 Build info {"system_info": {"build": {"commit": "1da173a9e716715a7a54bb3ff4db05b5c24fc8ce", "libbeat": "7.10.1", "time": "2020-12-04T23:27:16.000Z", "version": "7.10.1"}}}
  60. 2020-12-26T23:44:16.785+0530 INFO [beat] instance/beat.go:993 Go runtime info {"system_info": {"go": {"os":"darwin","arch":"amd64","max_procs":8,"version":"go1.14.12"}}}
  61. 2020-12-26T23:44:16.786+0530 INFO [beat] instance/beat.go:997 Host info {"system_info": {"host": {"architecture":"x86_64","boot_time":"2020-12-26T10:00:55.727979+05:30","name":"Anujs-MacBook-Pro.local","ip":["127.0.0.1/8","::1/128","fe80::1/64","fe80::8ed:c386:c81f:8556/64","192.168.1.3/24","fe80::90fe:6dff:fea3:9011/64","fe80::90fe:6dff:fea3:9011/64","fe80::9ec:2991:5e09:e319/64","fe80::d176:25eb:47c5:25be/64"],"kernel_version":"20.2.0","mac":["60:f8:1d:cb:f5:18","82:0f:1f:ea:9c:40","82:0f:1f:ea:9c:41","82:0f:1f:ea:9c:40","02:f8:1d:cb:f5:18","92:fe:6d:a3:90:11","92:fe:6d:a3:90:11"],"os":{"family":"darwin","platform":"darwin","name":"Mac OS X","version":"10.16","major":10,"minor":16,"patch":0,"build":"20C69"},"timezone":"IST","timezone_offset_sec":19800,"id":"1358F504-3504-5ADB-9548-DCFAABC04128"}}}
  62. 2020-12-26T23:44:16.786+0530 INFO [beat] instance/beat.go:1026 Process info {"system_info": {"process": {"cwd": "/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64", "exe": "./filebeat", "name": "filebeat", "pid": 35871, "ppid": 24894, "start_time": "2020-12-26T23:44:16.704+0530"}}}
  63. 2020-12-26T23:44:16.786+0530 INFO instance/beat.go:299 Setup Beat: filebeat; Version: 7.10.1
  64. 2020-12-26T23:44:16.786+0530 INFO [index-management] idxmgmt/std.go:184 Set output.elasticsearch.index to 'filebeat-7.10.1' as ILM is enabled.
  65. 2020-12-26T23:44:16.786+0530 INFO eslegclient/connection.go:99 elasticsearch url: http://localhost:9200
  66. 2020-12-26T23:44:16.787+0530 INFO [publisher] pipeline/module.go:113 Beat name: Anujs-MacBook-Pro.local
  67. 2020-12-26T23:44:16.790+0530 INFO instance/beat.go:455 filebeat start running.
  68. 2020-12-26T23:44:16.790+0530 INFO [monitoring] log/log.go:118 Starting metrics logging every 30s
  69. 2020-12-26T23:44:16.791+0530 INFO memlog/store.go:119 Loading data file of '/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/data/registry/filebeat' succeeded. Active transaction id=28055
  70. 2020-12-26T23:44:17.051+0530 INFO memlog/store.go:124 Finished loading transaction log file for '/Users/anujaggarwal/ELK/filebeat-7.10.1-darwin-x86_64/data/registry/filebeat'. Active transaction id=47275
  71. 2020-12-26T23:44:17.058+0530 INFO [registrar] registrar/registrar.go:109 States Loaded from registrar: 2
  72. 2020-12-26T23:44:17.059+0530 INFO [crawler] beater/crawler.go:71 Loading Inputs: 2
  73. 2020-12-26T23:44:17.063+0530 INFO log/input.go:157 Configured paths: [/Applications/MAMP/htdocs/247around-adminp-aws/application/logs/log-2020-12-21.log]
  74. 2020-12-26T23:44:17.064+0530 INFO [crawler] beater/crawler.go:141 Starting input (ID: 13284248347885114322)
  75. 2020-12-26T23:44:17.064+0530 INFO [crawler] beater/crawler.go:108 Loading and starting Inputs completed. Enabled inputs: 1
  76. 2020-12-26T23:44:17.065+0530 INFO cfgfile/reload.go:164 Config reloader started
  77. 2020-12-26T23:44:17.066+0530 INFO cfgfile/reload.go:224 Loading of config files completed.
  78.  
  79.  
  80.  
  81.  
  82. 2020-12-26T23:44:46.798+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":102,"time":{"ms":103}},"total":{"ticks":492,"time":{"ms":497},"value":492},"user":{"ticks":390,"time":{"ms":394}}},"info":{"ephemeral_id":"272edb1d-3cf0-4a0c-b917-dca0eb439734","uptime":{"ms":30070}},"memstats":{"gc_next":17740992,"memory_alloc":15943904,"memory_total":91298272,"rss":51499008},"runtime":{"goroutines":22}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0},"reloads":1,"scans":1},"output":{"type":"elasticsearch"},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"cpu":{"cores":8},"load":{"1":4.4639,"15":3.0835,"5":3.2256,"norm":{"1":0.558,"15":0.3854,"5":0.4032}}}}}}
  83. 2020-12-26T23:45:16.789+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":106,"time":{"ms":3}},"total":{"ticks":505,"time":{"ms":8},"value":505},"user":{"ticks":399,"time":{"ms":5}}},"info":{"ephemeral_id":"272edb1d-3cf0-4a0c-b917-dca0eb439734","uptime":{"ms":60066}},"memstats":{"gc_next":18409968,"memory_alloc":9230864,"memory_total":92675248,"rss":176128},"runtime":{"goroutines":22}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":3.9976,"15":3.0898,"5":3.2344,"norm":{"1":0.4997,"15":0.3862,"5":0.4043}}}}}}
  84. 2020-12-26T23:45:46.786+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":108,"time":{"ms":2}},"total":{"ticks":508,"time":{"ms":3},"value":508},"user":{"ticks":400,"time":{"ms":1}}},"info":{"ephemeral_id":"272edb1d-3cf0-4a0c-b917-dca0eb439734","uptime":{"ms":90065}},"memstats":{"gc_next":18409968,"memory_alloc":10330040,"memory_total":93774424,"rss":24576},"runtime":{"goroutines":22}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":3.4263,"15":3.0732,"5":3.1768,"norm":{"1":0.4283,"15":0.3842,"5":0.3971}}}}}}
  85. 2020-12-26T23:46:16.789+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":110,"time":{"ms":2}},"total":{"ticks":512,"time":{"ms":4},"value":512},"user":{"ticks":402,"time":{"ms":2}}},"info":{"ephemeral_id":"272edb1d-3cf0-4a0c-b917-dca0eb439734","uptime":{"ms":120070}},"memstats":{"gc_next":18409968,"memory_alloc":11429776,"memory_total":94874160,"rss":4096},"runtime":{"goroutines":22}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":3.165,"15":3.0591,"5":3.1299,"norm":{"1":0.3956,"15":0.3824,"5":0.3912}}}}}}
  86. 2020-12-26T23:46:46.786+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":112,"time":{"ms":2}},"total":{"ticks":516,"time":{"ms":4},"value":516},"user":{"ticks":404,"time":{"ms":2}}},"info":{"ephemeral_id":"272edb1d-3cf0-4a0c-b917-dca0eb439734","uptime":{"ms":150068}},"memstats":{"gc_next":18409968,"memory_alloc":12521056,"memory_total":95965440,"rss":4096},"runtime":{"goroutines":22}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":2.9756,"15":3.0444,"5":3.0845,"norm":{"1":0.3719,"15":0.3806,"5":0.3856}}}}}}
  87. 2020-12-26T23:47:16.782+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":185,"time":{"ms":73}},"total":{"ticks":638,"time":{"ms":122},"value":638},"user":{"ticks":453,"time":{"ms":49}}},"info":{"ephemeral_id":"272edb1d-3cf0-4a0c-b917-dca0eb439734","uptime":{"ms":180067}},"memstats":{"gc_next":17840240,"memory_alloc":8920944,"memory_total":97065208},"runtime":{"goroutines":22}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":2.5576,"15":3.0063,"5":2.978,"norm":{"1":0.3197,"15":0.3758,"5":0.3723}}}}}}
  88. 2020-12-26T23:47:46.783+0530 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":187,"time":{"ms":2}},"total":{"ticks":643,"time":{"ms":5},"value":643},"user":{"ticks":456,"time":{"ms":3}}},"info":{"ephemeral_id":"272edb1d-3cf0-4a0c-b917-dca0eb439734","uptime":{"ms":210070}},"memstats":{"gc_next":17840240,"memory_alloc":10029816,"memory_total":98174080},"runtime":{"goroutines":22}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"load":{"1":3.8359,"15":3.1138,"5":3.2744,"norm":{"1":0.4795,"15":0.3892,"5":0.4093}}}}}}
  89.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!