API tools faq
paste
Guest User

start-parser-topologies

a guest
Mar 29th, 2017
42
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Java 12.35 KB | None | 0 0
raw download clone embed print report
  1. [metron@node1 ~]$ for parser in bro snort; do ${METRON_HOME}/bin/start_parser_topology.sh -z node1:2181 -s ${parser} -ksp PLAINTEXTSASL -e /home/metron/storm-config.json; done
  2. Running: /usr/jdk64/jdk1.8.0_77/bin/java -server -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.3.0-37/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.3.0-37/storm/lib/storm-rename-hack-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-core-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/zookeeper.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.3.0-37/storm/lib/disruptor-3.3.2.jar org.apache.storm.daemon.ClientJarTransformerRunner org.apache.storm.hack.StormShadeTransformer /usr/metron/0.3.1/lib/metron-parsers-0.3.1-uber.jar /tmp/366f6d8014bf11e786a90800279b7c65.jar
  3. Running: /usr/jdk64/jdk1.8.0_77/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.3.0-37/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdp/current/storm-client/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.3.0-37/storm/lib/storm-rename-hack-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-core-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/zookeeper.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.3.0-37/storm/lib/disruptor-3.3.2.jar:/tmp/366f6d8014bf11e786a90800279b7c65.jar:/usr/hdp/current/storm-supervisor/conf:/usr/hdp/2.5.3.0-37/storm/bin -Dstorm.jar=/tmp/366f6d8014bf11e786a90800279b7c65.jar org.apache.metron.parsers.topology.ParserTopologyCLI -z node1:2181 -s bro -ksp PLAINTEXTSASL -e /home/metron/storm-config.json
  4. 1679 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
  5. 1766 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
  6. 3618 [main] INFO  o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -5362746479108132740:-4627083287749263868
  7. 3750 [main] INFO  o.a.s.s.a.AuthUtils - Got AutoCreds [org.apache.storm.security.auth.kerberos.AutoTGT@281f23f2]
  8. 3750 [main] INFO  o.a.s.StormSubmitter - Running org.apache.storm.security.auth.kerberos.AutoTGT@281f23f2
  9. 3770 [main] WARN  o.a.s.s.a.k.ClientCallbackHandler - Could not login: the client is being asked for a password, but the  client code does not currently support obtaining a password from the user. Make sure that the client is configured to use a ticket cache (using the JAAS configuration setting 'useTicketCache=true)' and restart the client. If you still get this message after that, the TGT in the ticket cache has expired and must be manually refreshed. To do so, first determine if you are using a password or a keytab. If the former, run kinit in a Unix shell in the environment of the user who is running this client using the command 'kinit <princ>' (where <princ> is the name of the client's Kerberos principal). If the latter, do 'kinit -k -t <keytab> <princ>' (where <princ> is the name of the Kerberos principal, and <keytab> is the location of the keytab file). After manually refreshing your cache, restart this client. If you continue to see this message after manually refreshing your cache, ensure that your KDC host's clock is in sync with this host's clock.
  10. java.lang.RuntimeException: javax.security.auth.login.LoginException: No password provided
  11.     at org.apache.storm.security.auth.kerberos.AutoTGT.populateCredentials(AutoTGT.java:103)
  12.     at org.apache.storm.StormSubmitter.populateCredentials(StormSubmitter.java:94)
  13.     at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:214)
  14.     at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:310)
  15.     at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:157)
  16.     at org.apache.metron.parsers.topology.ParserTopologyCLI.main(ParserTopologyCLI.java:318)
  17. Caused by: javax.security.auth.login.LoginException: No password provided
  18.     at com.sun.security.auth.module.Krb5LoginModule.promptForPass(Krb5LoginModule.java:919)
  19.     at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:760)
  20.     at com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:617)
  21.     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  22.     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  23.     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  24.     at java.lang.reflect.Method.invoke(Method.java:498)
  25.     at javax.security.auth.login.LoginContext.invoke(LoginContext.java:755)
  26.     at javax.security.auth.login.LoginContext.access$000(LoginContext.java:195)
  27.     at javax.security.auth.login.LoginContext$4.run(LoginContext.java:682)
  28.     at javax.security.auth.login.LoginContext$4.run(LoginContext.java:680)
  29.     at java.security.AccessController.doPrivileged(Native Method)
  30.     at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
  31.     at javax.security.auth.login.LoginContext.login(LoginContext.java:587)
  32.     at org.apache.storm.security.auth.kerberos.AutoTGT.populateCredentials(AutoTGT.java:80)
  33.     ... 5 more
  34. Running: /usr/jdk64/jdk1.8.0_77/bin/java -server -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.3.0-37/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.3.0-37/storm/lib/storm-rename-hack-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-core-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/zookeeper.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.3.0-37/storm/lib/disruptor-3.3.2.jar org.apache.storm.daemon.ClientJarTransformerRunner org.apache.storm.hack.StormShadeTransformer /usr/metron/0.3.1/lib/metron-parsers-0.3.1-uber.jar /tmp/5640afca14bf11e7abe10800279b7c65.jar
  35. Running: /usr/jdk64/jdk1.8.0_77/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.3.0-37/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdp/current/storm-client/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.3.0-37/storm/lib/storm-rename-hack-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-core-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/zookeeper.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.3.0-37/storm/lib/disruptor-3.3.2.jar:/tmp/5640afca14bf11e7abe10800279b7c65.jar:/usr/hdp/current/storm-supervisor/conf:/usr/hdp/2.5.3.0-37/storm/bin -Dstorm.jar=/tmp/5640afca14bf11e7abe10800279b7c65.jar org.apache.metron.parsers.topology.ParserTopologyCLI -z node1:2181 -s snort -ksp PLAINTEXTSASL -e /home/metron/storm-config.json
  36. 2267 [main] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
  37. 2352 [main-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
  38. 4298 [main] INFO  o.a.m.p.s.BasicSnortParser - Using default date format 'MM/dd/yy-HH:mm:ss.SSSSSS'
  39. 4354 [main] INFO  o.a.m.p.s.BasicSnortParser - Using default timezone 'UTC'
  40. 4863 [main] INFO  o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -7478785983470675960:-6245510187098762434
  41. 5190 [main] INFO  o.a.s.s.a.AuthUtils - Got AutoCreds [org.apache.storm.security.auth.kerberos.AutoTGT@25a73de1]
  42. 5190 [main] INFO  o.a.s.StormSubmitter - Running org.apache.storm.security.auth.kerberos.AutoTGT@25a73de1
  43. 5228 [main] WARN  o.a.s.s.a.k.ClientCallbackHandler - Could not login: the client is being asked for a password, but the  client code does not currently support obtaining a password from the user. Make sure that the client is configured to use a ticket cache (using the JAAS configuration setting 'useTicketCache=true)' and restart the client. If you still get this message after that, the TGT in the ticket cache has expired and must be manually refreshed. To do so, first determine if you are using a password or a keytab. If the former, run kinit in a Unix shell in the environment of the user who is running this client using the command 'kinit <princ>' (where <princ> is the name of the client's Kerberos principal). If the latter, do 'kinit -k -t <keytab> <princ>' (where <princ> is the name of the Kerberos principal, and <keytab> is the location of the keytab file). After manually refreshing your cache, restart this client. If you continue to see this message after manually refreshing your cache, ensure that your KDC host's clock is in sync with this host's clock.
  44. java.lang.RuntimeException: javax.security.auth.login.LoginException: No password provided
  45.     at org.apache.storm.security.auth.kerberos.AutoTGT.populateCredentials(AutoTGT.java:103)
  46.     at org.apache.storm.StormSubmitter.populateCredentials(StormSubmitter.java:94)
  47.     at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:214)
  48.     at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:310)
  49.     at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:157)
  50.     at org.apache.metron.parsers.topology.ParserTopologyCLI.main(ParserTopologyCLI.java:318)
  51. Caused by: javax.security.auth.login.LoginException: No password provided
  52.     at com.sun.security.auth.module.Krb5LoginModule.promptForPass(Krb5LoginModule.java:919)
  53.     at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:760)
  54.     at com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:617)
  55.     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  56.     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  57.     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  58.     at java.lang.reflect.Method.invoke(Method.java:498)
  59.     at javax.security.auth.login.LoginContext.invoke(LoginContext.java:755)
  60.     at javax.security.auth.login.LoginContext.access$000(LoginContext.java:195)
  61.     at javax.security.auth.login.LoginContext$4.run(LoginContext.java:682)
  62.     at javax.security.auth.login.LoginContext$4.run(LoginContext.java:680)
  63.     at java.security.AccessController.doPrivileged(Native Method)
  64.     at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
  65.     at javax.security.auth.login.LoginContext.login(LoginContext.java:587)
  66.     at org.apache.storm.security.auth.kerberos.AutoTGT.populateCredentials(AutoTGT.java:80)
  67.     ... 5 more
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!