Create a new version of paste:

[mtops@localhost conf.d]$ sudo /usr/share/logstash/bin/logstash -f first-pipeline.conf --config.test_and_exit
INFO: Logstash requires a setting file which is typically located in $LS_HOME/config or /etc/logstash. If you installed Logstash through a package and are starting it manually please specify the location to this settings file by passing in "--path.settings=/path/.."
ERROR: Failed to load settings file from "path.settings". Aborting... path.setting=/usr/share/logstash/config, exception=Errno::ENOENT, message=>No such file or directory - /usr/share/logstash/config/logstash.yml
[mtops@localhost conf.d]$ ls /usr/share/logstash
bin  CHANGELOG.md  CONTRIBUTORS  data  Gemfile  Gemfile.jruby-1.9.lock  lib  LICENSE  logstash-core  logstash-core-event-java  logstash-core-plugin-api  NOTICE.TXT  vendor
[mtops@localhost conf.d]$ sudo mkdir /usr/share/logstash/config
[mtops@localhost conf.d]$ ls /usr/share/logstash
bin  CHANGELOG.md  config  CONTRIBUTORS  data  Gemfile  Gemfile.jruby-1.9.lock  lib  LICENSE  logstash-core  logstash-core-event-java  logstash-core-plugin-api  NOTICE.TXT  vendor
[mtops@localhost conf.d]$ ls /etc/logstash
conf.d  jvm.options  log4j2.properties  logstash.yml  startup.options
[mtops@localhost conf.d]$ sudo cp /etc/logstash/logstash.yml /usr/share/logstash/config
[mtops@localhost conf.d]$ sudo /usr/share/logstash/bin/logstash -f first-pipeline.conf --config.test_and_exit
ERROR StatusLogger Unable to access file:///usr/share/logstash/config/log4j2.properties
 java.io.FileNotFoundException: /usr/share/logstash/config/log4j2.properties (No such file or directory)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at java.io.FileInputStream.<init>(FileInputStream.java:93)
        at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
        at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
        at java.net.URL.openStream(URL.java:1045)
        at org.apache.logging.log4j.core.config.ConfigurationFactory.getInputFromUri(ConfigurationFactory.java:299)
        at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:234)
        at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:433)
        at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:237)
        at org.apache.logging.log4j.core.config.Configurator.initialize(Configurator.java:157)
        at org.apache.logging.log4j.core.config.Configurator.initialize(Configurator.java:130)
        at org.apache.logging.log4j.core.config.Configurator.initialize(Configurator.java:100)
        at org.apache.logging.log4j.core.config.Configurator.initialize(Configurator.java:187)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:466)
        at org.jruby.javasupport.JavaMethod.invokeStaticDirect(JavaMethod.java:368)
        at org.jruby.java.invokers.StaticMethodInvoker.call(StaticMethodInvoker.java:61)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:346)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:204)
        at org.jruby.ast.CallTwoArgNode.interpret(CallTwoArgNode.java:59)
        at org.jruby.ast.ClassVarAsgnNode.interpret(ClassVarAsgnNode.java:92)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.IfNode.interpret(IfNode.java:116)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)
        at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)
        at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)
        at org.jruby.runtime.Block.yield(Block.java:142)
        at org.jruby.ext.thread.Mutex.synchronize(Mutex.java:149)
        at org.jruby.ext.thread.Mutex$INVOKER$i$0$0$synchronize.call(Mutex$INVOKER$i$0$0$synchronize.gen)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316)
        at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145)
        at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)
        at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)
        at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
        at org.jruby.ast.IfNode.interpret(IfNode.java:118)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
        at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)
        at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)
        at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:187)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)
        at org.jruby.ast.VCallNode.interpret(VCallNode.java:88)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:204)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:211)
        at org.jruby.runtime.callsite.SuperCallSite.cacheAndCall(SuperCallSite.java:366)
        at org.jruby.runtime.callsite.SuperCallSite.callBlock(SuperCallSite.java:192)
        at org.jruby.runtime.callsite.SuperCallSite.call(SuperCallSite.java:197)
        at org.jruby.runtime.callsite.SuperCallSite.callVarargs(SuperCallSite.java:108)
        at org.jruby.ast.SuperNode.interpret(SuperNode.java:115)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)
        at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)
        at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)
        at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:225)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:219)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:346)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:204)
        at usr.share.logstash.lib.bootstrap.environment.__file__(/usr/share/logstash/lib/bootstrap/environment.rb:68)
        at usr.share.logstash.lib.bootstrap.environment.load(/usr/share/logstash/lib/bootstrap/environment.rb)
        at org.jruby.Ruby.runScript(Ruby.java:857)
        at org.jruby.Ruby.runScript(Ruby.java:850)
        at org.jruby.Ruby.runNormally(Ruby.java:729)
        at org.jruby.Ruby.runFromMain(Ruby.java:578)
        at org.jruby.Main.doRunFromMain(Main.java:393)
        at org.jruby.Main.internalRun(Main.java:288)
        at org.jruby.Main.run(Main.java:217)
        at org.jruby.Main.main(Main.java:197)
ERROR StatusLogger Unable to access file:///usr/share/logstash/config/log4j2.properties
 java.io.FileNotFoundException: /usr/share/logstash/config/log4j2.properties (No such file or directory)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at java.io.FileInputStream.<init>(FileInputStream.java:93)
        at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
        at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
        at java.net.URL.openStream(URL.java:1045)
        at org.apache.logging.log4j.core.config.ConfigurationFactory.getInputFromUri(ConfigurationFactory.java:299)
        at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:234)
        at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:433)
        at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:237)
        at org.apache.logging.log4j.core.config.Configurator.initialize(Configurator.java:157)
        at org.apache.logging.log4j.core.config.Configurator.initialize(Configurator.java:130)
        at org.apache.logging.log4j.core.config.Configurator.initialize(Configurator.java:100)
        at org.apache.logging.log4j.core.config.Configurator.initialize(Configurator.java:187)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:466)
        at org.jruby.javasupport.JavaMethod.invokeStaticDirect(JavaMethod.java:368)
        at org.jruby.java.invokers.StaticMethodInvoker.call(StaticMethodInvoker.java:61)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:346)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:204)
        at org.jruby.ast.CallTwoArgNode.interpret(CallTwoArgNode.java:59)
        at org.jruby.ast.ClassVarAsgnNode.interpret(ClassVarAsgnNode.java:92)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.IfNode.interpret(IfNode.java:116)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)
        at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)
        at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)
        at org.jruby.runtime.Block.yield(Block.java:142)
        at org.jruby.ext.thread.Mutex.synchronize(Mutex.java:149)
        at org.jruby.ext.thread.Mutex$INVOKER$i$0$0$synchronize.call(Mutex$INVOKER$i$0$0$synchronize.gen)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316)
        at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145)
        at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)
        at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)
        at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
        at org.jruby.ast.IfNode.interpret(IfNode.java:118)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
        at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)
        at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)
        at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:187)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)
        at org.jruby.ast.VCallNode.interpret(VCallNode.java:88)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:204)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:211)
        at org.jruby.runtime.callsite.SuperCallSite.cacheAndCall(SuperCallSite.java:366)
        at org.jruby.runtime.callsite.SuperCallSite.callBlock(SuperCallSite.java:192)
        at org.jruby.runtime.callsite.SuperCallSite.call(SuperCallSite.java:197)
        at org.jruby.runtime.callsite.SuperCallSite.callVarargs(SuperCallSite.java:108)
        at org.jruby.ast.SuperNode.interpret(SuperNode.java:115)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)
        at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)
        at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)
        at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)
        at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)
        at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)
        at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:225)
        at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:219)
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:346)
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:204)
        at usr.share.logstash.lib.bootstrap.environment.__file__(/usr/share/logstash/lib/bootstrap/environment.rb:68)
        at usr.share.logstash.lib.bootstrap.environment.load(/usr/share/logstash/lib/bootstrap/environment.rb)
        at org.jruby.Ruby.runScript(Ruby.java:857)
        at org.jruby.Ruby.runScript(Ruby.java:850)
        at org.jruby.Ruby.runNormally(Ruby.java:729)
        at org.jruby.Ruby.runFromMain(Ruby.java:578)
        at org.jruby.Main.doRunFromMain(Main.java:393)
        at org.jruby.Main.internalRun(Main.java:288)
        at org.jruby.Main.run(Main.java:217)
        at org.jruby.Main.main(Main.java:197)
ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console.
Sending Logstash logs to /var/log/logstash which is now configured via log4j2.properties.
Configuration OK
10:56:20.032 [LogStash::Runner] INFO  logstash.runner - Using config.test_and_exit mode. Config Validation Result: OK. Exiting Logstash
[mtops@localhost conf.d]$ ll
total 8
-rw-r--r--. 1 root root 197 Nov  1 10:51 first-pipeline.conf
-rw-r--r--. 1 root root 234 Nov  1 10:50 test.logstash.conf
[mtops@localhost conf.d]$ cd ..
[mtops@localhost logstash]$ ll
total 16
drwxrwxr-x. 2 root root   57 Nov  1 10:51 conf.d
-rw-r--r--. 1 root root 1738 Oct 25 22:10 jvm.options
-rw-r--r--. 1 root root 1333 Oct 25 22:10 log4j2.properties
-rw-r--r--. 1 root root 2829 Oct 31 15:06 logstash.yml
-rw-r--r--. 1 root root 1659 Oct 25 22:10 startup.options
[mtops@localhost logstash]$ sudo cp log4j2.properties /usr/share/logstash/config
[sudo] password for mtops:
[mtops@localhost logstash]$ sudo /usr/share/logstash/bin/logstash -f first-pipeline.conf --config.test_and_exit
Sending Logstash logs to /var/log/logstash which is now configured via log4j2.properties.
[mtops@localhost logstash]$ sudo tail /var/log/logstash/logstash-plain.log
[2016-11-01T10:50:45,788][INFO ][logstash.pipeline        ] Pipeline main started
[2016-11-01T10:50:45,857][INFO ][logstash.agent           ] Successfully started Logstash API endpoint {:port=>9600}
[2016-11-01T10:50:48,806][WARN ][logstash.agent           ] stopping pipeline {:id=>"main"}
[2016-11-01T10:51:50,951][INFO ][logstash.inputs.beats    ] Beats inputs: Starting input listener {:address=>"0.0.0.0:5043"}
[2016-11-01T10:51:51,181][INFO ][logstash.pipeline        ] Starting pipeline {"id"=>"main", "pipeline.workers"=>2, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>5, "pipeline.max_inflight"=>250}
[2016-11-01T10:51:51,184][INFO ][logstash.pipeline        ] Pipeline main started
[2016-11-01T10:51:51,184][INFO ][org.logstash.beats.Server] Starting server on port: 5043
[2016-11-01T10:51:51,240][INFO ][logstash.agent           ] Successfully started Logstash API endpoint {:port=>9600}
[2016-11-01T11:08:14,659][FATAL][logstash.runner          ] An unexpected error occurred! {:error=>#<RuntimeError: No config files found: /etc/logstash/first-pipeline.conf
Can you make sure this path is a logstash config file?>, :backtrace=>["/usr/share/logstash/logstash-core/lib/logstash/config/loader.rb:56:in `local_config'", "/usr/share/logstash/logstash-core/lib/logstash/config/loader.rb:35:in `load_config'", "/usr/share/logstash/logstash-core/lib/logstash/config/loader.rb:15:in `format_config'", "/usr/share/logstash/logstash-core/lib/logstash/runner.rb:244:in `execute'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67:in `run'", "/usr/share/logstash/logstash-core/lib/logstash/runner.rb:174:in `run'", "/usr/share/logstash/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:132:in `run'", "/usr/share/logstash/lib/bootstrap/environment.rb:68:in `(root)'"]}
[mtops@localhost logstash]$