SHARE
TWEET

Storm supervisor EOFException on reboot

a guest Mar 11th, 2014 335 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. 2014-03-11 12:27:19 o.a.z.s.ZooKeeperServer [INFO] Server environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT
  2. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:host.name=localhost
  3. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:java.version=1.6.0_27
  4. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:java.vendor=Sun Microsystems Inc.
  5. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:java.home=/usr/lib/jvm/java-6-openjdk-amd64/jre
  6. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:java.class.path=/path/to/storm/lib/httpclient-4.1.1.jar:/path/to/storm/lib/storm-core-0.9.1-incubating.jar:/path/to/storm/lib/guava-13.0.jar:/path/to/storm/lib/zookeeper-3.3.3.jar:/path/to/storm/lib/compojure-1.1.3.jar:/path/to/storm/lib/json-simple-1.1.jar:/path/to/storm/lib/snakeyaml-1.11.jar:/path/to/storm/lib/clj-time-0.4.1.jar:/path/to/storm/lib/jetty-util-6.1.26.jar:/path/to/storm/lib/commons-io-1.4.jar:/path/to/storm/lib/junit-3.8.1.jar:/path/to/storm/lib/commons-logging-1.1.1.jar:/path/to/storm/lib/netty-3.6.3.Final.jar:/path/to/storm/lib/commons-exec-1.1.jar:/path/to/storm/lib/tools.macro-0.1.0.jar:/path/to/storm/lib/disruptor-2.10.1.jar:/path/to/storm/lib/math.numeric-tower-0.0.1.jar:/path/to/storm/lib/minlog-1.2.jar:/path/to/storm/lib/asm-4.0.jar:/path/to/storm/lib/clj-stacktrace-0.2.4.jar:/path/to/storm/lib/logback-classic-1.0.6.jar:/path/to/storm/lib/slf4j-api-1.6.5.jar:/path/to/storm/lib/commons-codec-1.4.jar:/path/to/storm/lib/ring-servlet-0.3.11.jar:/path/to/storm/lib/ring-devel-0.3.11.jar:/path/to/storm/lib/core.incubator-0.1.0.jar:/path/to/storm/lib/ring-core-1.1.5.jar:/path/to/storm/lib/servlet-api-2.5-20081211.jar:/path/to/storm/lib/clojure-1.4.0.jar:/path/to/storm/lib/carbonite-1.3.2.jar:/path/to/storm/lib/commons-lang-2.5.jar:/path/to/storm/lib/jgrapht-core-0.9.0.jar:/path/to/storm/lib/httpcore-4.1.jar:/path/to/storm/lib/objenesis-1.2.jar:/path/to/storm/lib/clout-1.0.1.jar:/path/to/storm/lib/logback-core-1.0.6.jar:/path/to/storm/lib/reflectasm-1.07-shaded.jar:/path/to/storm/lib/commons-fileupload-1.2.1.jar:/path/to/storm/lib/joda-time-2.0.jar:/path/to/storm/lib/meat-locker-0.3.1.jar:/path/to/storm/lib/jline-2.11.jar:/path/to/storm/lib/hiccup-0.3.6.jar:/path/to/storm/lib/kryo-2.17.jar:/path/to/storm/lib/curator-framework-1.0.1.jar:/path/to/storm/lib/tools.logging-0.2.3.jar:/path/to/storm/lib/ring-jetty-adapter-0.3.11.jar:/path/to/storm/lib/servlet-api-2.5.jar:/path/to/storm/lib/log4j-over-slf4j-1.6.6.jar:/path/to/storm/lib/curator-client-1.0.1.jar:/path/to/storm/lib/tools.cli-0.2.2.jar:/path/to/storm/lib/jetty-6.1.26.jar:/path/to/storm/conf
  7. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
  8. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:java.io.tmpdir=/tmp
  9. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:java.compiler=<NA>
  10. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:os.name=Linux
  11. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:os.arch=amd64
  12. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:os.version=3.2.0-55-generic
  13. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:user.name=root
  14. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:user.home=/root
  15. 2014-03-11 12:27:20 o.a.z.s.ZooKeeperServer [INFO] Server environment:user.dir=/
  16. 2014-03-11 12:27:22 b.s.d.supervisor [INFO] Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 5000, "topology.skip.missing.kryo.registrations" false, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m -Djava.net.preferIPv4Stack=true -Dprocess=storm", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 500, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "/path/to/storm", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "192.168.1.11", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2181, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["192.168.1.11"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m -Djava.net.preferIPv4Stack=true -Dprocess=storm", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 100, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Djava.net.preferIPv4Stack=true -Dprocess=storm", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 9090, "nimbus.childopts" "-Xmx1024m -Djava.net.preferIPv4Stack=true -Dprocess=storm", "storm.cluster.mode" "distributed", "topology.optimize" true, "topology.max.task.parallelism" nil}
  17. 2014-03-11 12:27:22 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting
  18. 2014-03-11 12:27:22 o.a.z.ZooKeeper [INFO] Initiating client connection, connectString=192.168.1.11:2181 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@734f0076
  19. 2014-03-11 12:27:22 o.a.z.ClientCnxn [INFO] Opening socket connection to server /192.168.1.11:2181
  20. 2014-03-11 12:27:22 o.a.z.ClientCnxn [INFO] Socket connection established to dev1/192.168.1.11:2181, initiating session
  21. 2014-03-11 12:27:22 o.a.z.ClientCnxn [INFO] Session establishment complete on server dev1/192.168.1.11:2181, sessionid = 0x144afee32210002, negotiated timeout = 20000
  22. 2014-03-11 12:27:22 b.s.zookeeper [INFO] Zookeeper state update: :connected:none
  23. 2014-03-11 12:27:22 o.a.z.ClientCnxn [INFO] EventThread shut down
  24. 2014-03-11 12:27:22 o.a.z.ZooKeeper [INFO] Session: 0x144afee32210002 closed
  25. 2014-03-11 12:27:22 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting
  26. 2014-03-11 12:27:22 o.a.z.ZooKeeper [INFO] Initiating client connection, connectString=192.168.1.11:2181/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@2a081f8f
  27. 2014-03-11 12:27:22 o.a.z.ClientCnxn [INFO] Opening socket connection to server /192.168.1.11:2181
  28. 2014-03-11 12:27:22 o.a.z.ClientCnxn [INFO] Socket connection established to dev1/192.168.1.11:2181, initiating session
  29. 2014-03-11 12:27:23 o.a.z.ClientCnxn [INFO] Session establishment complete on server dev1/192.168.1.11:2181, sessionid = 0x144afee32210003, negotiated timeout = 20000
  30. 2014-03-11 12:27:24 b.s.d.supervisor [INFO] Starting supervisor with id 7fed4b0c-71cf-41c1-be1d-8c01ea8f991f at host localhost
  31. 2014-03-11 12:27:25 b.s.event [ERROR] Error when processing event
  32. java.lang.RuntimeException: java.io.EOFException
  33.         at backtype.storm.utils.Utils.deserialize(Utils.java:86) ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
  34.         at backtype.storm.utils.LocalState.snapshot(LocalState.java:45) ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
  35.         at backtype.storm.utils.LocalState.get(LocalState.java:56) ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
  36.         at backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:207) ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
  37.         at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.4.0.jar:na]
  38.         at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.4.0.jar:na]
  39.         at clojure.core$apply.invoke(core.clj:603) ~[clojure-1.4.0.jar:na]
  40.         at clojure.core$partial$fn__4070.doInvoke(core.clj:2343) ~[clojure-1.4.0.jar:na]
  41.         at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.4.0.jar:na]
  42.         at backtype.storm.event$event_manager$fn__2593.invoke(event.clj:39) ~[na:na]
  43.         at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
  44.         at java.lang.Thread.run(Thread.java:679) [na:1.6.0_27]
  45. Caused by: java.io.EOFException: null
  46.         at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2322) ~[na:1.6.0_27]
  47.         at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2791) ~[na:1.6.0_27]
  48.         at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:798) ~[na:1.6.0_27]
  49.         at java.io.ObjectInputStream.<init>(ObjectInputStream.java:298) ~[na:1.6.0_27]
  50.         at backtype.storm.utils.Utils.deserialize(Utils.java:81) ~[storm-core-0.9.1-incubating.jar:0.9.1-incubating]
  51.         ... 11 common frames omitted
  52. 2014-03-11 12:27:25 b.s.util [INFO] Halting process: ("Error when processing an event")
RAW Paste Data
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy. OK, I Understand
Top