API tools faq
paste
Advertisement
arinto

supervisor.log

arinto
Mar 1st, 2013
184
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 15.90 KB | None | 0 0
raw download clone embed print report
  1. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT
  2. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:host.name=research-hm21
  3. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:java.version=1.7.0_13
  4. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:java.vendor=Oracle Corporation
  5. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:java.home=/home/arinto/local-sw/jdk1.7.0_13/jre
  6. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:java.class.path=/home/arinto/local-sw/storm-0.8.2/storm-0.8.2.jar:/home/arinto/local-sw/storm-0.8.2/lib/curator-framework-1.0.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-fileupload-1.2.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/compojure-1.1.3.jar:/home/arinto/local-sw/storm-0.8.2/lib/snakeyaml-1.9.jar:/home/arinto/local-sw/storm-0.8.2/lib/slf4j-log4j12-1.5.8.jar:/home/arinto/local-sw/storm-0.8.2/lib/clj-time-0.4.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/joda-time-2.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/httpcore-4.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/disruptor-2.10.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/jetty-6.1.26.jar:/home/arinto/local-sw/storm-0.8.2/lib/libthrift7-0.7.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/log4j-1.2.16.jar:/home/arinto/local-sw/storm-0.8.2/lib/servlet-api-2.5.jar:/home/arinto/local-sw/storm-0.8.2/lib/zookeeper-3.3.3.jar:/home/arinto/local-sw/storm-0.8.2/lib/asm-4.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/clout-1.0.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/ring-servlet-0.3.11.jar:/home/arinto/local-sw/storm-0.8.2/lib/objenesis-1.2.jar:/home/arinto/local-sw/storm-0.8.2/lib/kryo-2.17.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-io-1.4.jar:/home/arinto/local-sw/storm-0.8.2/lib/tools.cli-0.2.2.jar:/home/arinto/local-sw/storm-0.8.2/lib/json-simple-1.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/carbonite-1.5.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/minlog-1.2.jar:/home/arinto/local-sw/storm-0.8.2/lib/httpclient-4.1.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/junit-3.8.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/jgrapht-0.8.3.jar:/home/arinto/local-sw/storm-0.8.2/lib/jline-0.9.94.jar:/home/arinto/local-sw/storm-0.8.2/lib/jetty-util-6.1.26.jar:/home/arinto/local-sw/storm-0.8.2/lib/math.numeric-tower-0.0.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/core.incubator-0.1.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/ring-core-1.1.5.jar:/home/arinto/local-sw/storm-0.8.2/lib/ring-jetty-adapter-0.3.11.jar:/home/arinto/local-sw/storm-0.8.2/lib/tools.logging-0.2.3.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-exec-1.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/jzmq-2.1.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/clojure-1.4.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/hiccup-0.3.6.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-codec-1.4.jar:/home/arinto/local-sw/storm-0.8.2/lib/servlet-api-2.5-20081211.jar:/home/arinto/local-sw/storm-0.8.2/lib/reflectasm-1.07-shaded.jar:/home/arinto/local-sw/storm-0.8.2/lib/guava-13.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/curator-client-1.0.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-lang-2.5.jar:/home/arinto/local-sw/storm-0.8.2/lib/slf4j-api-1.5.8.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-logging-1.1.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/tools.macro-0.1.0.jar:/home/arinto/local-sw/storm-0.8.2/log4j:/home/arinto/local-sw/storm-0.8.2/conf
  7. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:java.library.path=/home/arinto/local/lib
  8. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:java.io.tmpdir=/tmp
  9. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:java.compiler=<NA>
  10. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:os.name=Linux
  11. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:os.arch=amd64
  12. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:os.version=2.6.32-131.0.15.el6.20110602.x86_64
  13. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:user.name=arinto
  14. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:user.home=/home/arinto
  15. 2013-03-01 16:10:08 ZooKeeper [INFO] Client environment:user.dir=/home/arinto/storm-scripts
  16. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT
  17. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:host.name=research-hm21
  18. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:java.version=1.7.0_13
  19. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:java.vendor=Oracle Corporation
  20. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:java.home=/home/arinto/local-sw/jdk1.7.0_13/jre
  21. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:java.class.path=/home/arinto/local-sw/storm-0.8.2/storm-0.8.2.jar:/home/arinto/local-sw/storm-0.8.2/lib/curator-framework-1.0.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-fileupload-1.2.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/compojure-1.1.3.jar:/home/arinto/local-sw/storm-0.8.2/lib/snakeyaml-1.9.jar:/home/arinto/local-sw/storm-0.8.2/lib/slf4j-log4j12-1.5.8.jar:/home/arinto/local-sw/storm-0.8.2/lib/clj-time-0.4.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/joda-time-2.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/httpcore-4.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/disruptor-2.10.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/jetty-6.1.26.jar:/home/arinto/local-sw/storm-0.8.2/lib/libthrift7-0.7.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/log4j-1.2.16.jar:/home/arinto/local-sw/storm-0.8.2/lib/servlet-api-2.5.jar:/home/arinto/local-sw/storm-0.8.2/lib/zookeeper-3.3.3.jar:/home/arinto/local-sw/storm-0.8.2/lib/asm-4.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/clout-1.0.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/ring-servlet-0.3.11.jar:/home/arinto/local-sw/storm-0.8.2/lib/objenesis-1.2.jar:/home/arinto/local-sw/storm-0.8.2/lib/kryo-2.17.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-io-1.4.jar:/home/arinto/local-sw/storm-0.8.2/lib/tools.cli-0.2.2.jar:/home/arinto/local-sw/storm-0.8.2/lib/json-simple-1.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/carbonite-1.5.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/minlog-1.2.jar:/home/arinto/local-sw/storm-0.8.2/lib/httpclient-4.1.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/junit-3.8.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/jgrapht-0.8.3.jar:/home/arinto/local-sw/storm-0.8.2/lib/jline-0.9.94.jar:/home/arinto/local-sw/storm-0.8.2/lib/jetty-util-6.1.26.jar:/home/arinto/local-sw/storm-0.8.2/lib/math.numeric-tower-0.0.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/core.incubator-0.1.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/ring-core-1.1.5.jar:/home/arinto/local-sw/storm-0.8.2/lib/ring-jetty-adapter-0.3.11.jar:/home/arinto/local-sw/storm-0.8.2/lib/tools.logging-0.2.3.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-exec-1.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/jzmq-2.1.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/clojure-1.4.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/hiccup-0.3.6.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-codec-1.4.jar:/home/arinto/local-sw/storm-0.8.2/lib/servlet-api-2.5-20081211.jar:/home/arinto/local-sw/storm-0.8.2/lib/reflectasm-1.07-shaded.jar:/home/arinto/local-sw/storm-0.8.2/lib/guava-13.0.jar:/home/arinto/local-sw/storm-0.8.2/lib/curator-client-1.0.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-lang-2.5.jar:/home/arinto/local-sw/storm-0.8.2/lib/slf4j-api-1.5.8.jar:/home/arinto/local-sw/storm-0.8.2/lib/commons-logging-1.1.1.jar:/home/arinto/local-sw/storm-0.8.2/lib/tools.macro-0.1.0.jar:/home/arinto/local-sw/storm-0.8.2/log4j:/home/arinto/local-sw/storm-0.8.2/conf
  22. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:java.library.path=/home/arinto/local/lib
  23. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:java.io.tmpdir=/tmp
  24. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:java.compiler=<NA>
  25. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:os.name=Linux
  26. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:os.arch=amd64
  27. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:os.version=2.6.32-131.0.15.el6.20110602.x86_64
  28. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:user.name=arinto
  29. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:user.home=/home/arinto
  30. 2013-03-01 16:10:08 ZooKeeperServer [INFO] Server environment:user.dir=/home/arinto/storm-scripts
  31. 2013-03-01 16:10:08 supervisor [INFO] Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 5000, "topology.skip.missing.kryo.registrations" false, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 500, "nimbus.monitor.freq.secs" 10, "java.library.path" "/home/arinto/local/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "/home/arinto/local-var/storm", "supervisor.worker.start.timeout.secs" 240, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "research-hm15", "storm.zookeeper.port" 2181, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["research-hm15" "research-hm20" "research-hm21], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs" 240, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "distributed", "topology.optimize" true, "topology.max.task.parallelism" nil}
  32. 2013-03-01 16:10:08 CuratorFrameworkImpl [INFO] Starting
  33. 2013-03-01 16:10:08 ZooKeeper [INFO] Initiating client connection, connectString=research-hm15:2181,research-hm20:2181,research-hm21:2181 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@7608443a
  34. 2013-03-01 16:10:08 ClientCnxn [INFO] Opening socket connection to server research-hm15/xxx.xxx.xxx.xxx:2181
  35. 2013-03-01 16:10:08 ClientCnxn [INFO] Socket connection established to research-hm15/xxx.xxx.xxx.xxx:2181, initiating session
  36. 2013-03-01 16:10:08 ClientCnxn [INFO] Session establishment complete on server research-hm15/xxx.xxx.xxx.xxx:2181, sessionid = 0x13d25cffb50000b, negotiated timeout = 20000
  37. 2013-03-01 16:10:08 zookeeper [INFO] Zookeeper state update: :connected:none
  38. 2013-03-01 16:10:08 ZooKeeper [INFO] Session: 0x13d25cffb50000b closed
  39. 2013-03-01 16:10:08 ClientCnxn [INFO] EventThread shut down
  40. 2013-03-01 16:10:08 CuratorFrameworkImpl [INFO] Starting
  41. 2013-03-01 16:10:08 ZooKeeper [INFO] Initiating client connection, connectString=research-hm15:2181,research-hm20:2181,research-hm21:2181/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@46aea068
  42. 2013-03-01 16:10:08 ClientCnxn [INFO] Opening socket connection to server research-hm20/98.136.4.131:2181
  43. 2013-03-01 16:10:08 ClientCnxn [INFO] Socket connection established to research-hm20/98.136.4.131:2181, initiating session
  44. 2013-03-01 16:10:08 ClientCnxn [INFO] Session establishment complete on server research-hm20/98.136.4.131:2181, sessionid = 0x23d25cffb5c000b, negotiated timeout = 20000
  45. 2013-03-01 16:10:08 supervisor [INFO] Starting supervisor with id 9dd303e2-7599-4c2b-9d83-4d6132912b49 at host research-hm21.
  46. 2013-03-01 16:10:09 supervisor [INFO] Shutting down and clearing state for id 107fe78a-6d45-499d-80ec-3ec99fa3a9b3. Current supervisor time: 1362154209. State: :disallowed, Heartbeat: nil
  47. 2013-03-01 16:10:09 supervisor [INFO] Shutting down 9dd303e2-7599-4c2b-9d83-4d6132912b49:107fe78a-6d45-499d-80ec-3ec99fa3a9b3
  48. 2013-03-01 16:10:09 supervisor [INFO] Shut down 9dd303e2-7599-4c2b-9d83-4d6132912b49:107fe78a-6d45-499d-80ec-3ec99fa3a9b3
  49. 2013-03-01 16:10:09 supervisor [INFO] Shutting down and clearing state for id 6646c3ee-168c-4e96-a50c-8707149fbd1a. Current supervisor time: 1362154209. State: :disallowed, Heartbeat: nil
  50. 2013-03-01 16:10:09 supervisor [INFO] Shutting down 9dd303e2-7599-4c2b-9d83-4d6132912b49:6646c3ee-168c-4e96-a50c-8707149fbd1a
  51. 2013-03-01 16:10:09 supervisor [INFO] Shut down 9dd303e2-7599-4c2b-9d83-4d6132912b49:6646c3ee-168c-4e96-a50c-8707149fbd1a
  52. 2013-03-01 16:10:09 supervisor [INFO] Shutting down and clearing state for id 6d96846d-cf60-4e5c-8d60-294d6ae847c5. Current supervisor time: 1362154209. State: :disallowed, Heartbeat: nil
  53. 2013-03-01 16:10:09 supervisor [INFO] Shutting down 9dd303e2-7599-4c2b-9d83-4d6132912b49:6d96846d-cf60-4e5c-8d60-294d6ae847c5
  54. 2013-03-01 16:10:09 supervisor [INFO] Shut down 9dd303e2-7599-4c2b-9d83-4d6132912b49:6d96846d-cf60-4e5c-8d60-294d6ae847c5
  55. 2013-03-01 16:10:09 supervisor [INFO] Launching worker with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "fed_word_count_two-4-1362153302", :executors ([2 2] [5 5] [8 8] [11 11] [14 14] [17 17] [20 20] [23 23] [26 26] [29 29] [32 32])} for this supervisor 9dd303e2-7599-4c2b-9d83-4d6132912b49 on port 6701 with id 1a2f1028-a222-4c3e-a5fb-18930065b47d
  56. 2013-03-01 16:10:09 event [ERROR] Error when processing event
  57. java.io.FileNotFoundException: File '/home/arinto/local-var/storm/supervisor/stormdist/fed_word_count_two-4-1362153302/stormconf.ser' does not exist
  58. at org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:137)
  59. at org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1135)
  60. at backtype.storm.config$read_supervisor_storm_conf.invoke(config.clj:138)
  61. at backtype.storm.daemon.supervisor$fn__4793.invoke(supervisor.clj:414)
  62. at clojure.lang.MultiFn.invoke(MultiFn.java:177)
  63. at backtype.storm.daemon.supervisor$sync_processes$iter__4684__4688$fn__4689.invoke(supervisor.clj:249)
  64. at clojure.lang.LazySeq.sval(LazySeq.java:42)
  65. at clojure.lang.LazySeq.seq(LazySeq.java:60)
  66. at clojure.lang.RT.seq(RT.java:473)
  67. at clojure.core$seq.invoke(core.clj:133)
  68. at clojure.core$dorun.invoke(core.clj:2725)
  69. at clojure.core$doall.invoke(core.clj:2741)
  70. at backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:237)
  71. at clojure.lang.AFn.applyToHelper(AFn.java:161)
  72. at clojure.lang.AFn.applyTo(AFn.java:151)
  73. at clojure.core$apply.invoke(core.clj:603)
  74. at clojure.core$partial$fn__4070.doInvoke(core.clj:2343)
  75. at clojure.lang.RestFn.invoke(RestFn.java:397)
  76. at backtype.storm.event$event_manager$fn__2507.invoke(event.clj:24)
  77. at clojure.lang.AFn.run(AFn.java:24)
  78. at java.lang.Thread.run(Thread.java:722)
  79. 2013-03-01 16:10:09 util [INFO] Halting process: ("Error when processing an event")
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!