API tools faq
paste
Advertisement
Guest User

spark-shell output

a guest
Nov 25th, 2014
219
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 5.60 KB | None | 0 0
raw download clone embed print report
  1. [vanz@odin spark-1.1.0-bin-cdh4]$ ./bin/spark-shell --master mesos://zk://192.168.100.66:49181/mesos-master
  2. Spark assembly has been built with Hive, including Datanucleus jars on classpath
  3. Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
  4. 14/11/25 15:04:32 INFO SecurityManager: Changing view acls to: vanz,
  5. 14/11/25 15:04:32 INFO SecurityManager: Changing modify acls to: vanz,
  6. 14/11/25 15:04:32 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(vanz, ); users with modify permissions: Set(vanz, )
  7. 14/11/25 15:04:32 INFO HttpServer: Starting HTTP Server
  8. 14/11/25 15:04:32 INFO Utils: Successfully started service 'HTTP class server' on port 59014.
  9. Welcome to
  10. ____ __
  11. / __/__ ___ _____/ /__
  12. _\ \/ _ \/ _ `/ __/ '_/
  13. /___/ .__/\_,_/_/ /_/\_\ version 1.1.0
  14. /_/
  15.  
  16. Using Scala version 2.10.4 (OpenJDK 64-Bit Server VM, Java 1.7.0_71)
  17. Type in expressions to have them evaluated.
  18. Type :help for more information.
  19. 14/11/25 15:04:35 INFO SecurityManager: Changing view acls to: vanz,
  20. 14/11/25 15:04:35 INFO SecurityManager: Changing modify acls to: vanz,
  21. 14/11/25 15:04:35 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(vanz, ); users with modify permissions: Set(vanz, )
  22. 14/11/25 15:04:36 INFO Slf4jLogger: Slf4jLogger started
  23. 14/11/25 15:04:36 INFO Remoting: Starting remoting
  24. 14/11/25 15:04:36 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://[email protected]:37682]
  25. 14/11/25 15:04:36 INFO Remoting: Remoting now listens on addresses: [akka.tcp://[email protected]:37682]
  26. 14/11/25 15:04:36 INFO Utils: Successfully started service 'sparkDriver' on port 37682.
  27. 14/11/25 15:04:36 INFO SparkEnv: Registering MapOutputTracker
  28. 14/11/25 15:04:36 INFO SparkEnv: Registering BlockManagerMaster
  29. 14/11/25 15:04:36 INFO DiskBlockManager: Created local directory at /home/vanz/spark-1.1.0-bin-cdh4/var/lib/spark/tmp/spark-local-20141125150436-6fe3
  30. 14/11/25 15:04:36 INFO Utils: Successfully started service 'Connection manager for block manager' on port 46812.
  31. 14/11/25 15:04:36 INFO ConnectionManager: Bound socket to port 46812 with id = ConnectionManagerId(192.168.100.6,46812)
  32. 14/11/25 15:04:36 INFO MemoryStore: MemoryStore started with capacity 530.3 MB
  33. 14/11/25 15:04:36 INFO BlockManagerMaster: Trying to register BlockManager
  34. 14/11/25 15:04:36 INFO BlockManagerMasterActor: Registering block manager 192.168.100.6:46812 with 530.3 MB RAM
  35. 14/11/25 15:04:36 INFO BlockManagerMaster: Registered BlockManager
  36. 14/11/25 15:04:36 INFO HttpFileServer: HTTP File server directory is /tmp/spark-267d228b-961b-4a42-a364-1f841d9e274a
  37. 14/11/25 15:04:36 INFO HttpServer: Starting HTTP Server
  38. 14/11/25 15:04:36 INFO Utils: Successfully started service 'HTTP file server' on port 34586.
  39. 14/11/25 15:04:36 INFO Utils: Successfully started service 'SparkUI' on port 4040.
  40. 14/11/25 15:04:36 INFO SparkUI: Started SparkUI at http://192.168.100.6:4040
  41. 14/11/25 15:04:36 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  42. 14/11/25 15:04:36 INFO EventLoggingListener: Logging events to file:/tmp/spark-events//spark-shell-1416935076815
  43. I1125 15:04:37.042549 28520 sched.cpp:139] Version: 0.20.1
  44. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
  45. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@log_env@716: Client environment:host.name=odin
  46. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
  47. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@log_env@724: Client environment:os.arch=3.17.2-200.fc20.x86_64
  48. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@log_env@725: Client environment:os.version=#1 SMP Tue Nov 4 18:04:56 UTC 2014
  49. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@log_env@733: Client environment:user.name=vanz
  50. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@log_env@741: Client environment:user.home=/home/vanz
  51. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@log_env@753: Client environment:user.dir=/home/vanz/spark-1.1.0-bin-cdh4
  52. 2014-11-25 15:04:37,042:28386(0x7f28294eb700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=192.168.100.66:49181 sessionTimeout=10000 watcher=0x7f2846ed4050 sessionId=0 sessionPasswd=<null> context=0x7f2848007650 flags=0
  53. 2014-11-25 15:04:37,055:28386(0x7f27c87f8700):ZOO_INFO@check_events@1703: initiated connection to server [192.168.100.66:49181]
  54. 2014-11-25 15:04:37,154:28386(0x7f27c87f8700):ZOO_INFO@check_events@1750: session establishment complete on server [192.168.100.66:49181], sessionId=0x149e200db7e0042, negotiated timeout=10000
  55. I1125 15:04:37.154762 28525 group.cpp:313] Group process (group(1)@127.0.0.1:58229) connected to ZooKeeper
  56. I1125 15:04:37.154805 28525 group.cpp:787] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0)
  57. I1125 15:04:37.154830 28525 group.cpp:385] Trying to create path '/mesos-master' in ZooKeeper
  58. I1125 15:04:37.157518 28525 detector.cpp:138] Detected a new leader: (id='10')
  59. I1125 15:04:37.157616 28527 group.cpp:658] Trying to get '/mesos-master/info_0000000010' in ZooKeeper
  60. I1125 15:04:37.158694 28521 detector.cpp:426] A new leading master ([email protected]:5050) is detected
  61. I1125 15:04:37.158764 28521 sched.cpp:235] New master detected at [email protected]:5050
  62. I1125 15:04:37.159047 28521 sched.cpp:243] No credentials provided. Attempting to register without authentication
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!