API tools faq
paste
Guest User

Untitled

a guest
Aug 25th, 2014
484
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.88 KB | None | 0 0
raw download clone embed print report
  1. ~/spark$ JAVA_OPTS="-Xmx10g" ./bin/spark-class org.apache.spark.deploy.worker.Worker spark://10.17.16.43:7077
  2. 14/08/25 09:03:58 INFO slf4j.Slf4jLogger: Slf4jLogger started
  3. 14/08/25 09:03:58 INFO Remoting: Starting remoting
  4. 14/08/25 09:03:58 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkWorker@ubuntu:55553]
  5. 14/08/25 09:03:58 INFO worker.Worker: Starting Spark worker ubuntu:55553 with 8 cores, 30.4 GB RAM
  6. 14/08/25 09:03:58 INFO worker.Worker: Spark home: /home/hduser/spark
  7. 14/08/25 09:03:58 INFO server.Server: jetty-7.x.y-SNAPSHOT
  8. 14/08/25 09:03:58 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/metrics/json,null}
  9. 14/08/25 09:03:58 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/static,null}
  10. 14/08/25 09:03:58 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/log,null}
  11. 14/08/25 09:03:58 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/logPage,null}
  12. 14/08/25 09:03:58 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/json,null}
  13. 14/08/25 09:03:58 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{*,null}
  14. 14/08/25 09:03:58 INFO server.AbstractConnector: Started [email protected]:8081
  15. 14/08/25 09:03:58 INFO ui.WorkerWebUI: Started Worker web UI at http://ubuntu:8081
  16. 14/08/25 09:03:58 INFO worker.Worker: Connecting to master spark://10.17.16.43:7077...
  17. 14/08/25 09:03:59 INFO worker.Worker: Successfully registered with master spark://10.17.16.43:7077
  18. 14/08/25 09:04:15 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/0 for Spark shell
  19. 14/08/25 09:04:16 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "0" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  20. 14/08/25 09:04:16 INFO worker.Worker: Executor app-20140825090434-0003/0 finished with state FAILED message Command exited with code 1 exitStatus 1
  21. 14/08/25 09:04:16 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/1 for Spark shell
  22. 14/08/25 09:04:16 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "1" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  23. 14/08/25 09:04:16 INFO worker.Worker: Executor app-20140825090434-0003/1 finished with state FAILED message Command exited with code 1 exitStatus 1
  24. 14/08/25 09:04:16 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/2 for Spark shell
  25. 14/08/25 09:04:16 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "2" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  26. 14/08/25 09:04:17 INFO worker.Worker: Executor app-20140825090434-0003/2 finished with state FAILED message Command exited with code 1 exitStatus 1
  27. 14/08/25 09:04:17 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/3 for Spark shell
  28. 14/08/25 09:04:17 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "3" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  29. 14/08/25 09:04:17 INFO worker.Worker: Executor app-20140825090434-0003/3 finished with state FAILED message Command exited with code 1 exitStatus 1
  30. 14/08/25 09:04:17 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/4 for Spark shell
  31. 14/08/25 09:04:17 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "4" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  32. 14/08/25 09:04:17 INFO worker.Worker: Executor app-20140825090434-0003/4 finished with state FAILED message Command exited with code 1 exitStatus 1
  33. 14/08/25 09:04:17 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/5 for Spark shell
  34. 14/08/25 09:04:17 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "5" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  35. 14/08/25 09:04:18 INFO worker.Worker: Executor app-20140825090434-0003/5 finished with state FAILED message Command exited with code 1 exitStatus 1
  36. 14/08/25 09:04:18 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/6 for Spark shell
  37. 14/08/25 09:04:18 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "6" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  38. 14/08/25 09:04:18 INFO worker.Worker: Executor app-20140825090434-0003/6 finished with state FAILED message Command exited with code 1 exitStatus 1
  39. 14/08/25 09:04:18 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/7 for Spark shell
  40. 14/08/25 09:04:18 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "7" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  41. 14/08/25 09:04:18 INFO worker.Worker: Executor app-20140825090434-0003/7 finished with state FAILED message Command exited with code 1 exitStatus 1
  42. 14/08/25 09:04:18 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/8 for Spark shell
  43. 14/08/25 09:04:18 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "8" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  44. 14/08/25 09:04:19 INFO worker.Worker: Executor app-20140825090434-0003/8 finished with state FAILED message Command exited with code 1 exitStatus 1
  45. 14/08/25 09:04:19 INFO worker.Worker: Asked to launch executor app-20140825090434-0003/9 for Spark shell
  46. 14/08/25 09:04:19 INFO worker.ExecutorRunner: Launch command: "/usr/lib/jvm/java-8-oracle/bin/java" "-cp" ":/home/hduser/spark/conf:/home/hduser/spark/assembly/target/scala-2.10/spark-assembly_2.10-0.9.2-hadoop2.2.0.jar:/home/hduser/hadoop/etc/hadoop" "-Xms512M" "-Xmx512M" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "akka.tcp://spark@aidan-workstation-webroot:60456/user/CoarseGrainedScheduler" "9" "ubuntu" "8" "akka.tcp://sparkWorker@ubuntu:55553/user/Worker" "app-20140825090434-0003"
  47. 14/08/25 09:04:19 INFO worker.Worker: Executor app-20140825090434-0003/9 finished with state FAILED message Command exited with code 1 exitStatus 1
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!