API tools faq
paste
Advertisement
Guest User

SparkPi Driver Pod ClientMode Log

a guest
May 2nd, 2020
229
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 16.97 KB | None | 0 0
raw download clone embed print report
  1. vagrant@kmaster:~/spark-2.4.5-bin-hadoop2.7$ bin/spark-submit \
  2. > --master k8s://https://<ip>:<port> \
  3. > --deploy-mode client \
  4. > --name spark-pi \
  5. > --class org.apache.spark.examples.SparkPi \
  6. > --conf spark.executor.instances=1 \
  7. > --conf spark.kubernetes.namespace=spark-native \
  8. > --conf spark.kubernetes.container.image=kmaster:5000/spark:latest \
  9. > --conf spark.kubernetes.container.image.pullPolicy=IfNotPresent \
  10. > --conf spark.kubernetes.authenticate.driver.serviceAccountName=spark \
  11. > local:///home/vagrant/spark-2.4.5-bin-hadoop2.7/examples/jars/spark-examples_2.11-2.4.5.jar 100
  12. 20/04/27 15:41:30 WARN Utils: Your hostname, kmaster resolves to a loopback address: 127.0.0.1; using 10.0.2.15 instead (on interface eth0)
  13. 20/04/27 15:41:30 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
  14. 20/04/27 15:41:30 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  15. Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
  16. 20/04/27 15:41:31 INFO SparkContext: Running Spark version 2.4.5
  17. 20/04/27 15:41:31 INFO SparkContext: Submitted application: Spark Pi
  18. 20/04/27 15:41:31 INFO SecurityManager: Changing view acls to: vagrant
  19. 20/04/27 15:41:31 INFO SecurityManager: Changing modify acls to: vagrant
  20. 20/04/27 15:41:31 INFO SecurityManager: Changing view acls groups to:
  21. 20/04/27 15:41:31 INFO SecurityManager: Changing modify acls groups to:
  22. 20/04/27 15:41:31 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(vagrant); groups with view permissions: Set(); users  with modify permissions: Set(vagrant); groups with modify permissions: Set()
  23. 20/04/27 15:41:32 INFO Utils: Successfully started service 'sparkDriver' on port 37837.
  24. 20/04/27 15:41:32 INFO SparkEnv: Registering MapOutputTracker
  25. 20/04/27 15:41:32 INFO SparkEnv: Registering BlockManagerMaster
  26. 20/04/27 15:41:32 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
  27. 20/04/27 15:41:32 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
  28. 20/04/27 15:41:32 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-f11ebf68-8ac9-4423-a559-47bc5412fea4
  29. 20/04/27 15:41:32 INFO MemoryStore: MemoryStore started with capacity 366.3 MB
  30. 20/04/27 15:41:32 INFO SparkEnv: Registering OutputCommitCoordinator
  31. 20/04/27 15:41:32 INFO Utils: Successfully started service 'SparkUI' on port 4040.
  32. 20/04/27 15:41:32 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://10.0.2.15:4040
  33. 20/04/27 15:41:32 INFO SparkContext: Added JAR local:///home/vagrant/spark-2.4.5-bin-hadoop2.7/examples/jars/spark-examples_2.11-2.4.5.jar at file:/home/vagrant/spark-2.4.5-bin-hadoop2.7/examples/jars/spark-examples_2.11-2.4.5.jar with timestamp 1588027292920
  34. 20/04/27 15:41:34 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  35. 20/04/27 15:41:35 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 38133.
  36. 20/04/27 15:41:35 INFO NettyBlockTransferService: Server created on 10.0.2.15:38133
  37. 20/04/27 15:41:35 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
  38. 20/04/27 15:41:35 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 10.0.2.15, 38133, None)
  39. 20/04/27 15:41:35 INFO BlockManagerMasterEndpoint: Registering block manager 10.0.2.15:38133 with 366.3 MB RAM, BlockManagerId(driver, 10.0.2.15, 38133, None)
  40. 20/04/27 15:41:35 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 10.0.2.15, 38133, None)
  41. 20/04/27 15:41:35 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 10.0.2.15, 38133, None)
  42. 20/04/27 15:41:40 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  43. 20/04/27 15:41:41 INFO BlockManagerMasterEndpoint: Trying to remove executor 1 from BlockManagerMaster.
  44. 20/04/27 15:41:41 INFO BlockManagerMaster: Removal of executor 1 requested
  45. 20/04/27 15:41:41 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 1
  46. 20/04/27 15:41:46 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  47. 20/04/27 15:41:46 INFO BlockManagerMaster: Removal of executor 2 requested
  48. 20/04/27 15:41:46 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 2
  49. 20/04/27 15:41:46 INFO BlockManagerMasterEndpoint: Trying to remove executor 2 from BlockManagerMaster.
  50. 20/04/27 15:41:53 INFO BlockManagerMaster: Removal of executor 3 requested
  51. 20/04/27 15:41:53 INFO BlockManagerMasterEndpoint: Trying to remove executor 3 from BlockManagerMaster.
  52. 20/04/27 15:41:53 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 3
  53. 20/04/27 15:41:53 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  54. 20/04/27 15:41:59 INFO BlockManagerMaster: Removal of executor 4 requested
  55. 20/04/27 15:41:59 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 4
  56. 20/04/27 15:41:59 INFO BlockManagerMasterEndpoint: Trying to remove executor 4 from BlockManagerMaster.
  57. 20/04/27 15:41:59 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  58. 20/04/27 15:42:04 INFO KubernetesClusterSchedulerBackend: SchedulerBackend is ready for scheduling beginning after waiting maxRegisteredResourcesWaitingTime: 30000(ms)
  59. 20/04/27 15:42:04 INFO SparkContext: Starting job: reduce at SparkPi.scala:38
  60. 20/04/27 15:42:04 INFO DAGScheduler: Got job 0 (reduce at SparkPi.scala:38) with 100 output partitions
  61. 20/04/27 15:42:04 INFO DAGScheduler: Final stage: ResultStage 0 (reduce at SparkPi.scala:38)
  62. 20/04/27 15:42:04 INFO DAGScheduler: Parents of final stage: List()
  63. 20/04/27 15:42:04 INFO DAGScheduler: Missing parents: List()
  64. 20/04/27 15:42:04 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[1] at map at SparkPi.scala:34), which has no missing parents
  65. 20/04/27 15:42:04 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KB, free 366.3 MB)
  66. 20/04/27 15:42:04 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1381.0 B, free 366.3 MB)
  67. 20/04/27 15:42:04 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on 10.0.2.15:38133 (size: 1381.0 B, free: 366.3 MB)
  68. 20/04/27 15:42:04 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1163
  69. 20/04/27 15:42:04 INFO DAGScheduler: Submitting 100 missing tasks from ResultStage 0 (MapPartitionsRDD[1] at map at SparkPi.scala:34) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
  70. 20/04/27 15:42:04 INFO TaskSchedulerImpl: Adding task set 0.0 with 100 tasks
  71. 20/04/27 15:42:05 INFO BlockManagerMaster: Removal of executor 5 requested
  72. 20/04/27 15:42:05 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 5
  73. 20/04/27 15:42:05 INFO BlockManagerMasterEndpoint: Trying to remove executor 5 from BlockManagerMaster.
  74. 20/04/27 15:42:05 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  75. 20/04/27 15:42:13 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  76. 20/04/27 15:42:13 INFO BlockManagerMaster: Removal of executor 6 requested
  77. 20/04/27 15:42:13 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 6
  78. 20/04/27 15:42:13 INFO BlockManagerMasterEndpoint: Trying to remove executor 6 from BlockManagerMaster.
  79. 20/04/27 15:42:19 INFO BlockManagerMaster: Removal of executor 7 requested
  80. 20/04/27 15:42:19 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 7
  81. 20/04/27 15:42:19 INFO BlockManagerMasterEndpoint: Trying to remove executor 7 from BlockManagerMaster.
  82. 20/04/27 15:42:19 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  83. 20/04/27 15:42:20 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
  84. 20/04/27 15:42:26 INFO BlockManagerMaster: Removal of executor 8 requested
  85. 20/04/27 15:42:26 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 8
  86. 20/04/27 15:42:26 INFO BlockManagerMasterEndpoint: Trying to remove executor 8 from BlockManagerMaster.
  87. 20/04/27 15:42:27 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  88. 20/04/27 15:42:33 INFO BlockManagerMaster: Removal of executor 9 requested
  89. 20/04/27 15:42:33 INFO BlockManagerMasterEndpoint: Trying to remove executor 9 from BlockManagerMaster.
  90. 20/04/27 15:42:33 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 9
  91. 20/04/27 15:42:33 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  92. 20/04/27 15:42:35 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
  93. 20/04/27 15:42:39 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  94. 20/04/27 15:42:39 INFO BlockManagerMasterEndpoint: Trying to remove executor 10 from BlockManagerMaster.
  95. 20/04/27 15:42:39 INFO BlockManagerMaster: Removal of executor 10 requested
  96. 20/04/27 15:42:39 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 10
  97. 20/04/27 15:42:45 INFO BlockManagerMaster: Removal of executor 11 requested
  98. 20/04/27 15:42:45 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 11
  99. 20/04/27 15:42:45 INFO BlockManagerMasterEndpoint: Trying to remove executor 11 from BlockManagerMaster.
  100. 20/04/27 15:42:45 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  101. 20/04/27 15:42:50 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
  102. 20/04/27 15:42:52 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  103. 20/04/27 15:42:52 INFO BlockManagerMaster: Removal of executor 12 requested
  104. 20/04/27 15:42:52 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 12
  105. 20/04/27 15:42:52 INFO BlockManagerMasterEndpoint: Trying to remove executor 12 from BlockManagerMaster.
  106. 20/04/27 15:42:58 INFO BlockManagerMaster: Removal of executor 13 requested
  107. 20/04/27 15:42:58 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 13
  108. 20/04/27 15:42:58 INFO BlockManagerMasterEndpoint: Trying to remove executor 13 from BlockManagerMaster.
  109. 20/04/27 15:42:58 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  110. 20/04/27 15:43:05 WARN TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
  111. 20/04/27 15:43:05 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  112. 20/04/27 15:43:05 INFO BlockManagerMaster: Removal of executor 14 requested
  113. 20/04/27 15:43:05 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 14
  114. 20/04/27 15:43:05 INFO BlockManagerMasterEndpoint: Trying to remove executor 14 from BlockManagerMaster.
  115. 20/04/27 15:43:11 INFO ExecutorPodsAllocator: Going to request 1 executors from Kubernetes.
  116. 20/04/27 15:43:11 INFO BlockManagerMaster: Removal of executor 15 requested
  117. 20/04/27 15:43:11 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asked to remove non-existent executor 15
  118. 20/04/27 15:43:11 INFO BlockManagerMasterEndpoint: Trying to remove executor 15 from BlockManagerMaster.
  119. ^C20/04/27 15:43:14 INFO SparkContext: Invoking stop() from shutdown hook
  120. 20/04/27 15:43:14 INFO SparkUI: Stopped Spark web UI at http://10.0.2.15:4040
  121. 20/04/27 15:43:14 INFO DAGScheduler: Job 0 failed: reduce at SparkPi.scala:38, took 70.120058 s
  122. Exception in thread "main" org.apache.spark.SparkException: Job 0 cancelled because SparkContext was shut down
  123.     at org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:933)
  124.     at org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:931)
  125.     at scala.collection.mutable.HashSet.foreach(HashSet.scala:78)
  126.     at org.apache.spark.scheduler.DAGScheduler.cleanUpAfterSchedulerStop(DAGScheduler.scala:931)
  127.     at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onStop(DAGScheduler.scala:2130)
  128.     at org.apache.spark.util.EventLoop.stop(EventLoop.scala:84)
  129.     at org.apache.spark.scheduler.DAGScheduler.stop(DAGScheduler.scala:2043)
  130.     at org.apache.spark.SparkContext$$anonfun$stop$6.apply$mcV$sp(SparkContext.scala:1949)
  131.     at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1340)
  132.     at org.apache.spark.SparkContext.stop(SparkContext.scala:1948)
  133.     at org.apache.spark.SparkContext$$anonfun$2.apply$mcV$sp(SparkContext.scala:575)
  134.     at org.apache.spark.util.SparkShutdownHook.run(ShutdownHookManager.scala:216)
  135.     at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(ShutdownHookManager.scala:188)
  136.     at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply(ShutdownHookManager.scala:188)
  137.     at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply(ShutdownHookManager.scala:188)
  138.     at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1945)
  139.     at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply$mcV$sp(ShutdownHookManager.scala:188)
  140.     at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(ShutdownHookManager.scala:188)
  141.     at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(ShutdownHookManager.scala:188)
  142.     at scala.util.Try$.apply(Try.scala:192)
  143.     at org.apache.spark.util.SparkShutdownHookManager.runAll(ShutdownHookManager.scala:188)
  144.     at org.apache.spark.util.SparkShutdownHookManager$$anon$2.run(ShutdownHookManager.scala:178)
  145.     at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
  146.     at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:738)
  147.     at org.apache.spark.SparkContext.runJob(SparkContext.scala:2061)
  148.     at org.apache.spark.SparkContext.runJob(SparkContext.scala:2158)
  149.     at org.apache.spark.rdd.RDD$$anonfun$reduce$1.apply(RDD.scala:1080)
  150.     at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
  151.     at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
  152.     at org.apache.spark.rdd.RDD.withScope(RDD.scala:385)
  153.     at org.apache.spark.rdd.RDD.reduce(RDD.scala:1062)
  154.     at org.apache.spark.examples.SparkPi$.main(SparkPi.scala:38)
  155.     at org.apache.spark.examples.SparkPi.main(SparkPi.scala)
  156.     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  157.     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  158.     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  159.     at java.lang.reflect.Method.invoke(Method.java:498)
  160.     at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
  161.     at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
  162.     at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
  163.     at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
  164.     at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
  165.     at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
  166.     at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
  167.     at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
  168. 20/04/27 15:43:14 INFO DAGScheduler: ResultStage 0 (reduce at SparkPi.scala:38) failed in 70.002 s due to Stage cancelled because SparkContext was shut down
  169. 20/04/27 15:43:14 INFO KubernetesClusterSchedulerBackend: Shutting down all executors
  170. 20/04/27 15:43:14 INFO KubernetesClusterSchedulerBackend$KubernetesDriverEndpoint: Asking each executor to shut down
  171. 20/04/27 15:43:14 WARN ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed (this is expected if the application is shutting down.)
  172. 20/04/27 15:43:14 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
  173. 20/04/27 15:43:14 INFO MemoryStore: MemoryStore cleared
  174. 20/04/27 15:43:14 INFO BlockManager: BlockManager stopped
  175. 20/04/27 15:43:14 INFO BlockManagerMaster: BlockManagerMaster stopped
  176. 20/04/27 15:43:14 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
  177. 20/04/27 15:43:14 INFO SparkContext: Successfully stopped SparkContext
  178. 20/04/27 15:43:14 INFO ShutdownHookManager: Shutdown hook called
  179. 20/04/27 15:43:14 INFO ShutdownHookManager: Deleting directory /tmp/spark-acbb97fe-bbf5-4b65-98d0-a66de228676b
  180. 20/04/27 15:43:14 INFO ShutdownHookManager: Deleting directory /tmp/spark-8a83c8a6-1162-4c31-a2f6-178b5835a476
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!