API tools faq
paste
Advertisement
aironman

docker-compose up output

aironman
Mar 13th, 2019
160
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 15.30 KB | None | 0 0
raw download clone embed print report
  1. aironman@MacBook-Pro-Retina-de-Alonso ~/s/docker-spark-cluster> docker-compose up
  2. spark-master is up-to-date
  3. spark-worker-1 is up-to-date
  4. spark-worker-2 is up-to-date
  5. spark-worker-3 is up-to-date
  6. Attaching to spark-master, spark-worker-1, spark-worker-2, spark-worker-3
  7. spark-worker-2 | 2019-03-13 11:05:02 INFO Worker:2566 - Started daemon with process name: 11@spark-worker-2
  8. spark-worker-2 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for TERM
  9. spark-worker-2 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for HUP
  10. spark-worker-2 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for INT
  11. spark-worker-2 | 2019-03-13 11:05:03 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  12. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls to: root
  13. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls to: root
  14. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls groups to:
  15. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls groups to:
  16. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
  17. spark-worker-2 | 2019-03-13 11:05:05 INFO Utils:54 - Successfully started service 'sparkWorker' on port 41603.
  18. spark-worker-2 | 2019-03-13 11:05:05 INFO Worker:54 - Starting Spark worker 10.5.0.4:41603 with 1 cores, 1024.0 MB RAM
  19. spark-worker-2 | 2019-03-13 11:05:05 INFO Worker:54 - Running Spark version 2.4.0
  20. spark-worker-2 | 2019-03-13 11:05:05 INFO Worker:54 - Spark home: /spark
  21. spark-worker-2 | 2019-03-13 11:05:05 INFO log:192 - Logging initialized @4820ms
  22. spark-worker-2 | 2019-03-13 11:05:06 INFO Server:351 - jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
  23. spark-worker-2 | 2019-03-13 11:05:06 INFO Server:419 - Started @4975ms
  24. spark-worker-2 | 2019-03-13 11:05:06 INFO AbstractConnector:278 - Started ServerConnector@2e2456df{HTTP/1.1,[http/1.1]}{spark-worker-2:8081}
  25. spark-worker-2 | 2019-03-13 11:05:06 INFO Utils:54 - Successfully started service 'WorkerUI' on port 8081.
  26. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5a1d7ffb{/logPage,null,AVAILABLE,@Spark}
  27. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@3bf47f32{/logPage/json,null,AVAILABLE,@Spark}
  28. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4a01f715{/,null,AVAILABLE,@Spark}
  29. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5307309c{/json,null,AVAILABLE,@Spark}
  30. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4b92d821{/static,null,AVAILABLE,@Spark}
  31. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@23e2a578{/log,null,AVAILABLE,@Spark}
  32. spark-worker-2 | 2019-03-13 11:05:06 INFO WorkerWebUI:54 - Bound WorkerWebUI to spark-worker-2, and started at http://spark-worker-2:8081
  33. spark-worker-2 | 2019-03-13 11:05:06 INFO Worker:54 - Connecting to master spark-master:7077...
  34. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@7a3d3f26{/metrics/json,null,AVAILABLE,@Spark}
  35. spark-worker-2 | 2019-03-13 11:05:06 INFO TransportClientFactory:267 - Successfully created connection to spark-master/10.5.0.2:7077 after 207 ms (0 ms spent in bootstraps)
  36. spark-worker-2 | 2019-03-13 11:05:07 INFO Worker:54 - Successfully registered with master spark://spark-master:7077
  37. spark-master | 2019-03-13 11:05:01 INFO Master:2566 - Started daemon with process name: 12@spark-master
  38. spark-master | 2019-03-13 11:05:01 INFO SignalUtils:54 - Registered signal handler for TERM
  39. spark-master | 2019-03-13 11:05:01 INFO SignalUtils:54 - Registered signal handler for HUP
  40. spark-master | 2019-03-13 11:05:01 INFO SignalUtils:54 - Registered signal handler for INT
  41. spark-master | 2019-03-13 11:05:02 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  42. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - Changing view acls to: root
  43. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - Changing modify acls to: root
  44. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - Changing view acls groups to:
  45. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - Changing modify acls groups to:
  46. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
  47. spark-master | 2019-03-13 11:05:04 INFO Utils:54 - Successfully started service 'sparkMaster' on port 7077.
  48. spark-master | 2019-03-13 11:05:04 INFO Master:54 - Starting Spark master at spark://spark-master:7077
  49. spark-master | 2019-03-13 11:05:04 INFO Master:54 - Running Spark version 2.4.0
  50. spark-master | 2019-03-13 11:05:04 INFO log:192 - Logging initialized @4559ms
  51. spark-master | 2019-03-13 11:05:04 INFO Server:351 - jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
  52. spark-master | 2019-03-13 11:05:04 INFO Server:419 - Started @4753ms
  53. spark-master | 2019-03-13 11:05:05 INFO AbstractConnector:278 - Started ServerConnector@16ab0a4f{HTTP/1.1,[http/1.1]}{spark-master:8080}
  54. spark-master | 2019-03-13 11:05:05 INFO Utils:54 - Successfully started service 'MasterUI' on port 8080.
  55. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@3651d7f1{/app,null,AVAILABLE,@Spark}
  56. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4c8f3529{/app/json,null,AVAILABLE,@Spark}
  57. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@675c9d6e{/,null,AVAILABLE,@Spark}
  58. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@8d0c308{/json,null,AVAILABLE,@Spark}
  59. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@3dc39946{/static,null,AVAILABLE,@Spark}
  60. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5e884957{/app/kill,null,AVAILABLE,@Spark}
  61. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@19202a47{/driver/kill,null,AVAILABLE,@Spark}
  62. spark-master | 2019-03-13 11:05:05 INFO MasterWebUI:54 - Bound MasterWebUI to spark-master, and started at http://spark-master:8080
  63. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@175cd8c3{/metrics/master/json,null,AVAILABLE,@Spark}
  64. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@1080472b{/metrics/applications/json,null,AVAILABLE,@Spark}
  65. spark-master | 2019-03-13 11:05:05 INFO Master:54 - I have been elected leader! New state: ALIVE
  66. spark-master | 2019-03-13 11:05:07 INFO Master:54 - Registering worker 10.5.0.5:45435 with 1 cores, 1024.0 MB RAM
  67. spark-master | 2019-03-13 11:05:07 INFO Master:54 - Registering worker 10.5.0.4:41603 with 1 cores, 1024.0 MB RAM
  68. spark-master | 2019-03-13 11:05:07 INFO Master:54 - Registering worker 10.5.0.3:42207 with 1 cores, 1024.0 MB RAM
  69. spark-worker-1 | 2019-03-13 11:05:02 INFO Worker:2566 - Started daemon with process name: 13@spark-worker-1
  70. spark-worker-1 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for TERM
  71. spark-worker-1 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for HUP
  72. spark-worker-1 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for INT
  73. spark-worker-1 | 2019-03-13 11:05:03 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  74. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls to: root
  75. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls to: root
  76. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls groups to:
  77. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls groups to:
  78. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
  79. spark-worker-1 | 2019-03-13 11:05:05 INFO Utils:54 - Successfully started service 'sparkWorker' on port 42207.
  80. spark-worker-1 | 2019-03-13 11:05:05 INFO Worker:54 - Starting Spark worker 10.5.0.3:42207 with 1 cores, 1024.0 MB RAM
  81. spark-worker-1 | 2019-03-13 11:05:05 INFO Worker:54 - Running Spark version 2.4.0
  82. spark-worker-1 | 2019-03-13 11:05:05 INFO Worker:54 - Spark home: /spark
  83. spark-worker-1 | 2019-03-13 11:05:05 INFO log:192 - Logging initialized @4613ms
  84. spark-worker-1 | 2019-03-13 11:05:05 INFO Server:351 - jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
  85. spark-worker-1 | 2019-03-13 11:05:06 INFO Server:419 - Started @4751ms
  86. spark-worker-1 | 2019-03-13 11:05:06 INFO AbstractConnector:278 - Started ServerConnector@29901207{HTTP/1.1,[http/1.1]}{spark-worker-1:8081}
  87. spark-worker-1 | 2019-03-13 11:05:06 INFO Utils:54 - Successfully started service 'WorkerUI' on port 8081.
  88. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@3d31f7cf{/logPage,null,AVAILABLE,@Spark}
  89. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5b8516d3{/logPage/json,null,AVAILABLE,@Spark}
  90. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@635c4df7{/,null,AVAILABLE,@Spark}
  91. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@6e3abebc{/json,null,AVAILABLE,@Spark}
  92. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@1d7a0e26{/static,null,AVAILABLE,@Spark}
  93. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@7b51fce2{/log,null,AVAILABLE,@Spark}
  94. spark-worker-1 | 2019-03-13 11:05:06 INFO WorkerWebUI:54 - Bound WorkerWebUI to spark-worker-1, and started at http://spark-worker-1:8081
  95. spark-worker-1 | 2019-03-13 11:05:06 INFO Worker:54 - Connecting to master spark-master:7077...
  96. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4a2e1dd4{/metrics/json,null,AVAILABLE,@Spark}
  97. spark-worker-1 | 2019-03-13 11:05:06 INFO TransportClientFactory:267 - Successfully created connection to spark-master/10.5.0.2:7077 after 179 ms (0 ms spent in bootstraps)
  98. spark-worker-1 | 2019-03-13 11:05:07 INFO Worker:54 - Successfully registered with master spark://spark-master:7077
  99. spark-worker-3 | 2019-03-13 11:05:02 INFO Worker:2566 - Started daemon with process name: 11@spark-worker-3
  100. spark-worker-3 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for TERM
  101. spark-worker-3 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for HUP
  102. spark-worker-3 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for INT
  103. spark-worker-3 | 2019-03-13 11:05:03 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  104. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls to: root
  105. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls to: root
  106. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls groups to:
  107. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls groups to:
  108. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
  109. spark-worker-3 | 2019-03-13 11:05:05 INFO Utils:54 - Successfully started service 'sparkWorker' on port 45435.
  110. spark-worker-3 | 2019-03-13 11:05:05 INFO Worker:54 - Starting Spark worker 10.5.0.5:45435 with 1 cores, 1024.0 MB RAM
  111. spark-worker-3 | 2019-03-13 11:05:05 INFO Worker:54 - Running Spark version 2.4.0
  112. spark-worker-3 | 2019-03-13 11:05:05 INFO Worker:54 - Spark home: /spark
  113. spark-worker-3 | 2019-03-13 11:05:05 INFO log:192 - Logging initialized @4789ms
  114. spark-worker-3 | 2019-03-13 11:05:06 INFO Server:351 - jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
  115. spark-worker-3 | 2019-03-13 11:05:06 INFO Server:419 - Started @4947ms
  116. spark-worker-3 | 2019-03-13 11:05:06 INFO AbstractConnector:278 - Started ServerConnector@cf012af{HTTP/1.1,[http/1.1]}{spark-worker-3:8081}
  117. spark-worker-3 | 2019-03-13 11:05:06 INFO Utils:54 - Successfully started service 'WorkerUI' on port 8081.
  118. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@42e9590f{/logPage,null,AVAILABLE,@Spark}
  119. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4a5bb0b5{/logPage/json,null,AVAILABLE,@Spark}
  120. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5b8516d3{/,null,AVAILABLE,@Spark}
  121. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@7973673f{/json,null,AVAILABLE,@Spark}
  122. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@6e3abebc{/static,null,AVAILABLE,@Spark}
  123. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@366d6a04{/log,null,AVAILABLE,@Spark}
  124. spark-worker-3 | 2019-03-13 11:05:06 INFO WorkerWebUI:54 - Bound WorkerWebUI to spark-worker-3, and started at http://spark-worker-3:8081
  125. spark-worker-3 | 2019-03-13 11:05:06 INFO Worker:54 - Connecting to master spark-master:7077...
  126. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@658db874{/metrics/json,null,AVAILABLE,@Spark}
  127. spark-worker-3 | 2019-03-13 11:05:06 INFO TransportClientFactory:267 - Successfully created connection to spark-master/10.5.0.2:7077 after 113 ms (0 ms spent in bootstraps)
  128. spark-worker-3 | 2019-03-13 11:05:07 INFO Worker:54 - Successfully registered with master spark://spark-master:7077
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!