Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2018-09-10T10:19:28.652+0530 INFO instance/beat.go:273 Setup Beat: filebeat; Version: 6.4.0
- 2018-09-10T10:19:28.665+0530 INFO pipeline/module.go:98 Beat name: foohost
- 2018-09-09T01:37:58.772+0530 INFO instance/beat.go:367 filebeat start running.
- 2018-09-09T01:37:58.772+0530 INFO registrar/registrar.go:134 Loading registrar data from /var/lib/filebeat/registry_dns
- 2018-09-09T01:37:58.783+0530 INFO registrar/registrar.go:141 States Loaded from registrar: 12
- 2018-09-09T01:37:58.783+0530 WARN beater/filebeat.go:371 Filebeat is unable to load the Ingest Node pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the Ingest Node pipelines or are using Logstash pipelines, you can ignore this warning.
- 2018-09-09T01:37:58.783+0530 INFO crawler/crawler.go:72 Loading Inputs: 4
- 2018-09-09T01:37:58.784+0530 INFO log/input.go:138 Configured paths: [/var/log/bro/logs/current/dns.log]
- 2018-09-09T01:37:58.784+0530 INFO input/input.go:114 Starting input of type: log; ID: 3184862066852639106
- 2018-09-09T01:37:59.022+0530 INFO log/input.go:138 Configured paths: [/var/log/bro/logs/current/conn.log]
- 2018-09-09T01:37:59.022+0530 INFO input/input.go:114 Starting input of type: log; ID: 2551694298101282442
- 2018-09-09T01:37:59.022+0530 INFO log/input.go:138 Configured paths: [/var/log/bro/logs/current/smtp.log]
- 2018-09-09T01:37:59.022+0530 INFO input/input.go:114 Starting input of type: log; ID: 3759304321200261337
- 2018-09-09T01:37:59.121+0530 INFO log/input.go:138 Configured paths: [/var/log/bro/logs/current/capture_loss.log]
- 2018-09-09T01:37:59.121+0530 INFO input/input.go:114 Starting input of type: log; ID: 9527364469561457996
- 2018-09-09T01:37:59.121+0530 INFO crawler/crawler.go:106 Loading and starting Inputs completed. Enabled inputs: 4
- 2018-09-09T01:37:59.121+0530 INFO cfgfile/reload.go:140 Config reloader started
- 2018-09-09T01:37:59.121+0530 INFO cfgfile/reload.go:195 Loading of config files completed.
- 2018-09-09T01:38:08.796+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/dns.log
- 2018-09-09T01:38:09.022+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/conn.log
- 2018-09-09T01:38:13.981+0530 ERROR pipeline/output.go:91 Failed to connect: dial tcp 10.44.0.51:17000: connect: no route to host
- 2018-09-09T01:38:17.987+0530 ERROR pipeline/output.go:91 Failed to connect: dial tcp 10.44.0.51:17000: connect: no route to host
- 2018-09-09T01:38:22.993+0530 ERROR pipeline/output.go:91 Failed to connect: dial tcp 10.44.0.51:17000: connect: no route to host
- 2018-09-09T01:38:28.774+0530 INFO [monitoring] log/log.go:141 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":50,"time":{"ms":50}},"total":{"ticks":150,"time":{"ms":156},"value":150},"user":{"ticks":100,"time":{"ms":106}}},"info":{"ephemeral_id":"59b14521-6c10-4489-9d24-f2508b794695","uptime":{"ms":30346}},"memstats":{"gc_next":5877488,"memory_alloc":2991352,"memory_total":7747376,"rss":23433216}},"filebeat":{"events":{"active":586,"added":616,"done":30},"harvester":{"open_files":2,"running":2,"started":2}},"libbeat":{"config":{"module":{"running":0},"reloads":1},"output":{"type":"logstash"},"pipeline":{"clients":4,"events":{"active":379,"filtered":237,"published":379,"retry":306,"total":616}}},"registrar":{"states":{"current":14,"update":30},"writes":{"success":30,"total":30}},"system":{"cpu":{"cores":24},"load":{"1":0.51,"15":0.05,"5":0.15,"norm":{"1":0.0213,"15":0.0021,"5":0.0062}}}}}}
- 2018-09-09T01:38:33.999+0530 ERROR pipeline/output.go:91 Failed to connect: dial tcp 10.44.0.51:17000: connect: no route to host
- 2018-09-09T01:38:33.999+0530 INFO [publish] pipeline/retry.go:166 retryer: send wait signal to consumer
- 2018-09-09T01:38:33.999+0530 INFO [publish] pipeline/retry.go:168 done
- 2018-09-09T01:38:53.005+0530 ERROR pipeline/output.go:91 Failed to connect: dial tcp 10.44.0.51:17000: connect: no route to host
- 2018-09-09T01:38:53.005+0530 INFO [publish] pipeline/retry.go:189 retryer: send unwait-signal to consumer
- 2018-09-09T01:38:53.005+0530 INFO [publish] pipeline/retry.go:191 done
- 2018-09-09T01:38:53.005+0530 INFO [publish] pipeline/retry.go:166 retryer: send wait signal to consumer
- 2018-09-09T01:38:53.005+0530 INFO [publish] pipeline/retry.go:168 done
- 2018-09-09T01:38:58.774+0530 INFO [monitoring] log/log.go:141 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":50,"time":{"ms":9}},"total":{"ticks":210,"time":{"ms":66},"value":210},"user":{"ticks":160,"time":{"ms":57}}},"info":{"ephemeral_id":"59b14521-6c10-4489-9d24-f2508b794695","uptime":{"ms":60346}},"memstats":{"gc_next":6908992,"memory_alloc":3860304,"memory_total":10419776,"rss":2396160}},"filebeat":{"events":{"active":598,"added":598},"harvester":{"open_files":2,"running":2}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":4,"events":{"active":861,"filtered":116,"published":482,"retry":12,"total":598}}},"registrar":{"states":{"current":14}},"system":{"load":{"1":0.7,"15":0.08,"5":0.22,"norm":{"1":0.0292,"15":0.0033,"5":0.0092}}}}}}
- 2018-09-09T01:39:28.013+0530 ERROR pipeline/output.go:91 Failed to connect: dial tcp 10.44.0.51:17000: connect: no route to host
- 2018-09-09T01:39:28.013+0530 INFO [publish] pipeline/retry.go:189 retryer: send unwait-signal to consumer
- 2018-09-09T01:39:28.013+0530 INFO [publish] pipeline/retry.go:191 done
- 2018-09-09T01:39:28.013+0530 INFO [publish] pipeline/retry.go:166 retryer: send wait signal to consumer
- 2018-09-09T01:39:28.013+0530 INFO [publish] pipeline/retry.go:168 done
- .....repeated till we started logstash......
- 2018-09-10T10:10:58.915+0530 INFO [monitoring] log/log.go:141 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":3600,"time":{"ms":3}},"total":{"ticks":32690,"time":{"ms":3},"value":32690},"user":{"ticks":29090}},"info":{"ephemeral_id":"59b14521-6c10-4489-9d24-f2508b794695","uptime":{"ms":117180346}},"memstats":{"gc_next":13746112,"memory_alloc":7473432,"memory_total":792947864}},"filebeat":{"harvester":{"open_files":8,"running":4}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":4,"events":{"active":4120,"retry":92}}},"registrar":{"states":{"current":4}},"system":{"load":{"1":3.08,"15":3.39,"5":3.52,"norm":{"1":0.1283,"15":0.1413,"5":0.1467}}}}}}
- 2018-09-10T10:11:28.915+0530 INFO [monitoring] log/log.go:141 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":3600,"time":{"ms":2}},"total":{"ticks":32710,"time":{"ms":23},"value":32710},"user":{"ticks":29110,"time":{"ms":21}}},"info":{"ephemeral_id":"59b14521-6c10-4489-9d24-f2508b794695","uptime":{"ms":117210346}},"memstats":{"gc_next":13743520,"memory_alloc":6880336,"memory_total":793136472,"rss":-49152}},"filebeat":{"harvester":{"open_files":8,"running":4}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":4,"events":{"active":4120}}},"registrar":{"states":{"current":4}},"system":{"load":{"1":3.71,"15":3.43,"5":3.63,"norm":{"1":0.1546,"15":0.1429,"5":0.1513}}}}}}
- 2018-09-10T10:11:30.256+0530 ERROR pipeline/output.go:91 Failed to connect: dial tcp 10.44.0.51:17000: connect: connection refused
- 2018-09-10T10:11:30.256+0530 INFO [publish] pipeline/retry.go:189 retryer: send unwait-signal to consumer
- 2018-09-10T10:11:30.256+0530 INFO [publish] pipeline/retry.go:191 done
- 2018-09-10T10:11:30.256+0530 INFO [publish] pipeline/retry.go:166 retryer: send wait signal to consumer
- 2018-09-10T10:11:30.256+0530 INFO [publish] pipeline/retry.go:168 done
- 2018-09-10T10:11:30.256+0530 INFO [publish] pipeline/retry.go:189 retryer: send unwait-signal to consumer
- 2018-09-10T10:11:30.257+0530 INFO [publish] pipeline/retry.go:191 done
- 2018-09-10T10:11:30.344+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/capture_loss.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.344+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/conn.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.344+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/capture_loss.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.344+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/conn.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.344+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/smtp.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.344+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/capture_loss.log
- 2018-09-10T10:11:30.344+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/smtp.log
- 2018-09-10T10:11:30.345+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/conn.log
- 2018-09-10T10:11:30.345+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/smtp.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.346+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/smtp.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.344+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/dns.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.346+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/capture_loss.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.346+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/dns.log
- 2018-09-10T10:11:30.346+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/dns.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.486+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/smtp.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.486+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/capture_loss.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.785+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/smtp.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:30.787+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/capture_loss.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:31.246+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/smtp.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:31.246+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/capture_loss.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:31.703+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/smtp.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:31.703+0530 ERROR file/states.go:112 State for /var/log/bro/logs/current/capture_loss.log should have been dropped, but couldn't as state is not finished.
- 2018-09-10T10:11:40.345+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/capture_loss.log
- 2018-09-10T10:11:40.346+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/smtp.log
- 2018-09-10T10:11:40.422+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/conn.log
- 2018-09-10T10:11:40.422+0530 INFO log/harvester.go:251 Harvester started for file: /var/log/bro/logs/current/dns.log
- 2018-09-10T10:11:58.916+0530 INFO [monitoring] log/log.go:141 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":4020,"time":{"ms":423}},"total":{"ticks":40860,"time":{"ms":8148},"value":40860},"user":{"ticks":36840,"time":{"ms":7725}}},"info":{"ephemeral_id":"59b14521-6c10-4489-9d24-f2508b794695","uptime":{"ms":117240346}},"memstats":{"gc_next":18655680,"memory_alloc":13554040,"memory_total":1304540264,"rss":15847424}},"filebeat":{"events":{"active":-50,"added":131211,"done":131261},"harvester":{"open_files":12,"running":12,"started":8}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":81350,"active":3072,"batches":86,"total":84422},"read":{"bytes":498},"write":{"bytes":5704782}},"pipeline":{"clients":4,"events":{"active":4118,"filtered":49865,"published":81350,"retry":269,"total":131213},"queue":{"acked":81350}}},"registrar":{"states":{"current":12,"update":131261},"writes":{"success":91,"total":91}},"system":{"load":{"1":3.63,"15":3.44,"5":3.63,"norm":{"1":0.1513,"15":0.1433,"5":0.1513}}}}}}
- 2018-09-10T10:12:28.915+0530 INFO [monitoring] log/log.go:141 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":4610,"time":{"ms":592}},"total":{"ticks":48560,"time":{"ms":7704},"value":48560},"user":{"ticks":43950,"time":{"ms":7112}}},"info":{"ephemeral_id":"59b14521-6c10-4489-9d24-f2508b794695","uptime":{"ms":117270346}},"memstats":{"gc_next":17337360,"memory_alloc":14883968,"memory_total":1779882840,"rss":1310720}},"filebeat":{"events":{"active":-1056,"added":121943,"done":122999},"harvester":{"open_files":12,"running":12}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":79872,"batches":78,"total":79872},"read":{"bytes":468},"write":{"bytes":6027560}},"pipeline":{"clients":4,"events":{"active":4118,"filtered":42073,"published":79872,"total":121945},"queue":{"acked":79872}}},"registrar":{"states":{"current":12,"update":122999},"writes":{"success":78,"total":78}},"system":{"load":{"1":4.31,"15":3.5,"5":3.79,"norm":{"1":0.1796,"15":0.1458,"5":0.1579}}}}}}
Add Comment
Please, Sign In to add comment