Advertisement
aironman

docker-compose up output

Mar 13th, 2019
98
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. aironman@MacBook-Pro-Retina-de-Alonso ~/s/docker-spark-cluster> docker-compose up
  2. spark-master is up-to-date
  3. spark-worker-1 is up-to-date
  4. spark-worker-2 is up-to-date
  5. spark-worker-3 is up-to-date
  6. Attaching to spark-master, spark-worker-1, spark-worker-2, spark-worker-3
  7. spark-worker-2 | 2019-03-13 11:05:02 INFO Worker:2566 - Started daemon with process name: 11@spark-worker-2
  8. spark-worker-2 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for TERM
  9. spark-worker-2 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for HUP
  10. spark-worker-2 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for INT
  11. spark-worker-2 | 2019-03-13 11:05:03 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  12. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls to: root
  13. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls to: root
  14. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls groups to:
  15. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls groups to:
  16. spark-worker-2 | 2019-03-13 11:05:04 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
  17. spark-worker-2 | 2019-03-13 11:05:05 INFO Utils:54 - Successfully started service 'sparkWorker' on port 41603.
  18. spark-worker-2 | 2019-03-13 11:05:05 INFO Worker:54 - Starting Spark worker 10.5.0.4:41603 with 1 cores, 1024.0 MB RAM
  19. spark-worker-2 | 2019-03-13 11:05:05 INFO Worker:54 - Running Spark version 2.4.0
  20. spark-worker-2 | 2019-03-13 11:05:05 INFO Worker:54 - Spark home: /spark
  21. spark-worker-2 | 2019-03-13 11:05:05 INFO log:192 - Logging initialized @4820ms
  22. spark-worker-2 | 2019-03-13 11:05:06 INFO Server:351 - jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
  23. spark-worker-2 | 2019-03-13 11:05:06 INFO Server:419 - Started @4975ms
  24. spark-worker-2 | 2019-03-13 11:05:06 INFO AbstractConnector:278 - Started ServerConnector@2e2456df{HTTP/1.1,[http/1.1]}{spark-worker-2:8081}
  25. spark-worker-2 | 2019-03-13 11:05:06 INFO Utils:54 - Successfully started service 'WorkerUI' on port 8081.
  26. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5a1d7ffb{/logPage,null,AVAILABLE,@Spark}
  27. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@3bf47f32{/logPage/json,null,AVAILABLE,@Spark}
  28. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4a01f715{/,null,AVAILABLE,@Spark}
  29. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5307309c{/json,null,AVAILABLE,@Spark}
  30. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4b92d821{/static,null,AVAILABLE,@Spark}
  31. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@23e2a578{/log,null,AVAILABLE,@Spark}
  32. spark-worker-2 | 2019-03-13 11:05:06 INFO WorkerWebUI:54 - Bound WorkerWebUI to spark-worker-2, and started at http://spark-worker-2:8081
  33. spark-worker-2 | 2019-03-13 11:05:06 INFO Worker:54 - Connecting to master spark-master:7077...
  34. spark-worker-2 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@7a3d3f26{/metrics/json,null,AVAILABLE,@Spark}
  35. spark-worker-2 | 2019-03-13 11:05:06 INFO TransportClientFactory:267 - Successfully created connection to spark-master/10.5.0.2:7077 after 207 ms (0 ms spent in bootstraps)
  36. spark-worker-2 | 2019-03-13 11:05:07 INFO Worker:54 - Successfully registered with master spark://spark-master:7077
  37. spark-master | 2019-03-13 11:05:01 INFO Master:2566 - Started daemon with process name: 12@spark-master
  38. spark-master | 2019-03-13 11:05:01 INFO SignalUtils:54 - Registered signal handler for TERM
  39. spark-master | 2019-03-13 11:05:01 INFO SignalUtils:54 - Registered signal handler for HUP
  40. spark-master | 2019-03-13 11:05:01 INFO SignalUtils:54 - Registered signal handler for INT
  41. spark-master | 2019-03-13 11:05:02 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  42. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - Changing view acls to: root
  43. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - Changing modify acls to: root
  44. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - Changing view acls groups to:
  45. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - Changing modify acls groups to:
  46. spark-master | 2019-03-13 11:05:03 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
  47. spark-master | 2019-03-13 11:05:04 INFO Utils:54 - Successfully started service 'sparkMaster' on port 7077.
  48. spark-master | 2019-03-13 11:05:04 INFO Master:54 - Starting Spark master at spark://spark-master:7077
  49. spark-master | 2019-03-13 11:05:04 INFO Master:54 - Running Spark version 2.4.0
  50. spark-master | 2019-03-13 11:05:04 INFO log:192 - Logging initialized @4559ms
  51. spark-master | 2019-03-13 11:05:04 INFO Server:351 - jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
  52. spark-master | 2019-03-13 11:05:04 INFO Server:419 - Started @4753ms
  53. spark-master | 2019-03-13 11:05:05 INFO AbstractConnector:278 - Started ServerConnector@16ab0a4f{HTTP/1.1,[http/1.1]}{spark-master:8080}
  54. spark-master | 2019-03-13 11:05:05 INFO Utils:54 - Successfully started service 'MasterUI' on port 8080.
  55. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@3651d7f1{/app,null,AVAILABLE,@Spark}
  56. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4c8f3529{/app/json,null,AVAILABLE,@Spark}
  57. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@675c9d6e{/,null,AVAILABLE,@Spark}
  58. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@8d0c308{/json,null,AVAILABLE,@Spark}
  59. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@3dc39946{/static,null,AVAILABLE,@Spark}
  60. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5e884957{/app/kill,null,AVAILABLE,@Spark}
  61. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@19202a47{/driver/kill,null,AVAILABLE,@Spark}
  62. spark-master | 2019-03-13 11:05:05 INFO MasterWebUI:54 - Bound MasterWebUI to spark-master, and started at http://spark-master:8080
  63. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@175cd8c3{/metrics/master/json,null,AVAILABLE,@Spark}
  64. spark-master | 2019-03-13 11:05:05 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@1080472b{/metrics/applications/json,null,AVAILABLE,@Spark}
  65. spark-master | 2019-03-13 11:05:05 INFO Master:54 - I have been elected leader! New state: ALIVE
  66. spark-master | 2019-03-13 11:05:07 INFO Master:54 - Registering worker 10.5.0.5:45435 with 1 cores, 1024.0 MB RAM
  67. spark-master | 2019-03-13 11:05:07 INFO Master:54 - Registering worker 10.5.0.4:41603 with 1 cores, 1024.0 MB RAM
  68. spark-master | 2019-03-13 11:05:07 INFO Master:54 - Registering worker 10.5.0.3:42207 with 1 cores, 1024.0 MB RAM
  69. spark-worker-1 | 2019-03-13 11:05:02 INFO Worker:2566 - Started daemon with process name: 13@spark-worker-1
  70. spark-worker-1 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for TERM
  71. spark-worker-1 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for HUP
  72. spark-worker-1 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for INT
  73. spark-worker-1 | 2019-03-13 11:05:03 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  74. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls to: root
  75. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls to: root
  76. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls groups to:
  77. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls groups to:
  78. spark-worker-1 | 2019-03-13 11:05:04 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
  79. spark-worker-1 | 2019-03-13 11:05:05 INFO Utils:54 - Successfully started service 'sparkWorker' on port 42207.
  80. spark-worker-1 | 2019-03-13 11:05:05 INFO Worker:54 - Starting Spark worker 10.5.0.3:42207 with 1 cores, 1024.0 MB RAM
  81. spark-worker-1 | 2019-03-13 11:05:05 INFO Worker:54 - Running Spark version 2.4.0
  82. spark-worker-1 | 2019-03-13 11:05:05 INFO Worker:54 - Spark home: /spark
  83. spark-worker-1 | 2019-03-13 11:05:05 INFO log:192 - Logging initialized @4613ms
  84. spark-worker-1 | 2019-03-13 11:05:05 INFO Server:351 - jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
  85. spark-worker-1 | 2019-03-13 11:05:06 INFO Server:419 - Started @4751ms
  86. spark-worker-1 | 2019-03-13 11:05:06 INFO AbstractConnector:278 - Started ServerConnector@29901207{HTTP/1.1,[http/1.1]}{spark-worker-1:8081}
  87. spark-worker-1 | 2019-03-13 11:05:06 INFO Utils:54 - Successfully started service 'WorkerUI' on port 8081.
  88. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@3d31f7cf{/logPage,null,AVAILABLE,@Spark}
  89. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5b8516d3{/logPage/json,null,AVAILABLE,@Spark}
  90. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@635c4df7{/,null,AVAILABLE,@Spark}
  91. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@6e3abebc{/json,null,AVAILABLE,@Spark}
  92. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@1d7a0e26{/static,null,AVAILABLE,@Spark}
  93. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@7b51fce2{/log,null,AVAILABLE,@Spark}
  94. spark-worker-1 | 2019-03-13 11:05:06 INFO WorkerWebUI:54 - Bound WorkerWebUI to spark-worker-1, and started at http://spark-worker-1:8081
  95. spark-worker-1 | 2019-03-13 11:05:06 INFO Worker:54 - Connecting to master spark-master:7077...
  96. spark-worker-1 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4a2e1dd4{/metrics/json,null,AVAILABLE,@Spark}
  97. spark-worker-1 | 2019-03-13 11:05:06 INFO TransportClientFactory:267 - Successfully created connection to spark-master/10.5.0.2:7077 after 179 ms (0 ms spent in bootstraps)
  98. spark-worker-1 | 2019-03-13 11:05:07 INFO Worker:54 - Successfully registered with master spark://spark-master:7077
  99. spark-worker-3 | 2019-03-13 11:05:02 INFO Worker:2566 - Started daemon with process name: 11@spark-worker-3
  100. spark-worker-3 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for TERM
  101. spark-worker-3 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for HUP
  102. spark-worker-3 | 2019-03-13 11:05:02 INFO SignalUtils:54 - Registered signal handler for INT
  103. spark-worker-3 | 2019-03-13 11:05:03 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  104. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls to: root
  105. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls to: root
  106. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing view acls groups to:
  107. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - Changing modify acls groups to:
  108. spark-worker-3 | 2019-03-13 11:05:04 INFO SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
  109. spark-worker-3 | 2019-03-13 11:05:05 INFO Utils:54 - Successfully started service 'sparkWorker' on port 45435.
  110. spark-worker-3 | 2019-03-13 11:05:05 INFO Worker:54 - Starting Spark worker 10.5.0.5:45435 with 1 cores, 1024.0 MB RAM
  111. spark-worker-3 | 2019-03-13 11:05:05 INFO Worker:54 - Running Spark version 2.4.0
  112. spark-worker-3 | 2019-03-13 11:05:05 INFO Worker:54 - Spark home: /spark
  113. spark-worker-3 | 2019-03-13 11:05:05 INFO log:192 - Logging initialized @4789ms
  114. spark-worker-3 | 2019-03-13 11:05:06 INFO Server:351 - jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown
  115. spark-worker-3 | 2019-03-13 11:05:06 INFO Server:419 - Started @4947ms
  116. spark-worker-3 | 2019-03-13 11:05:06 INFO AbstractConnector:278 - Started ServerConnector@cf012af{HTTP/1.1,[http/1.1]}{spark-worker-3:8081}
  117. spark-worker-3 | 2019-03-13 11:05:06 INFO Utils:54 - Successfully started service 'WorkerUI' on port 8081.
  118. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@42e9590f{/logPage,null,AVAILABLE,@Spark}
  119. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@4a5bb0b5{/logPage/json,null,AVAILABLE,@Spark}
  120. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@5b8516d3{/,null,AVAILABLE,@Spark}
  121. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@7973673f{/json,null,AVAILABLE,@Spark}
  122. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@6e3abebc{/static,null,AVAILABLE,@Spark}
  123. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@366d6a04{/log,null,AVAILABLE,@Spark}
  124. spark-worker-3 | 2019-03-13 11:05:06 INFO WorkerWebUI:54 - Bound WorkerWebUI to spark-worker-3, and started at http://spark-worker-3:8081
  125. spark-worker-3 | 2019-03-13 11:05:06 INFO Worker:54 - Connecting to master spark-master:7077...
  126. spark-worker-3 | 2019-03-13 11:05:06 INFO ContextHandler:781 - Started o.s.j.s.ServletContextHandler@658db874{/metrics/json,null,AVAILABLE,@Spark}
  127. spark-worker-3 | 2019-03-13 11:05:06 INFO TransportClientFactory:267 - Successfully created connection to spark-master/10.5.0.2:7077 after 113 ms (0 ms spent in bootstraps)
  128. spark-worker-3 | 2019-03-13 11:05:07 INFO Worker:54 - Successfully registered with master spark://spark-master:7077
Advertisement
Advertisement
Advertisement
RAW Paste Data Copied
Advertisement