API tools faq
paste
Advertisement
Guest User

SparkPi Driver Pod Log2

a guest
May 2nd, 2020
290
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 16.41 KB | None | 0 0
raw download clone embed print report
  1. vagrant@kmaster:~/spark$ kubectl logs spark-pi-75235d719d31da3f-driver
  2. ++ id -u
  3. + myuid=185
  4. ++ id -g
  5. + mygid=0
  6. + set +e
  7. ++ getent passwd 185
  8. + uidentry=
  9. + set -e
  10. + '[' -z '' ']'
  11. + '[' -w /etc/passwd ']'
  12. + echo '185:x:185:0:anonymous uid:/opt/spark:/bin/false'
  13. + SPARK_CLASSPATH=':/opt/spark/jars/*'
  14. + env
  15. + grep SPARK_JAVA_OPT_
  16. + sort -t_ -k4 -n
  17. + sed 's/[^=]*=\(.*\)/\1/g'
  18. + readarray -t SPARK_EXECUTOR_JAVA_OPTS
  19. + '[' -n '' ']'
  20. + '[' '' == 2 ']'
  21. + '[' '' == 3 ']'
  22. + '[' -n '' ']'
  23. + '[' -z ']'
  24. + case "$1" in
  25. + shift 1
  26. + CMD=("$SPARK_HOME/bin/spark-submit" --conf "spark.driver.bindAddress=$SPARK_DRIVER_BIND_ADDRESS" --deploy-mode client "$@")
  27. + exec /usr/bin/tini -s -- /opt/spark/bin/spark-submit --conf spark.driver.bindAddress=192.168.41.181 --deploy-mode client --properties-file /opt/spark/conf/spark.properties --class org.apache.spark.examples.SparkPi local:///opt/spark/examples/jars/spark-examples_2.12-3.1.0-SNAPSHOT.jar 10000000
  28. 20/04/21 14:43:50 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  29. Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
  30. 20/04/21 14:43:50 INFO SparkContext: Running Spark version 3.1.0-SNAPSHOT
  31. 20/04/21 14:43:50 INFO ResourceUtils: ==============================================================
  32. 20/04/21 14:43:50 INFO ResourceUtils: No custom resources configured for spark.driver.
  33. 20/04/21 14:43:50 INFO ResourceUtils: ==============================================================
  34. 20/04/21 14:43:50 INFO SparkContext: Submitted application: Spark Pi
  35. 20/04/21 14:43:50 INFO ResourceProfile: Default ResourceProfile created, executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: , memory -> name: memory, amount: 1024, script: , vendor: ), task resources: Map(cpus -> name: cpus, amount: 1.0)
  36. 20/04/21 14:43:50 INFO ResourceProfile: Limiting resource is cpus at 1 tasks per executor
  37. 20/04/21 14:43:50 INFO ResourceProfileManager: Added ResourceProfile id: 0
  38. 20/04/21 14:43:50 INFO SecurityManager: Changing view acls to: 185,vagrant
  39. 20/04/21 14:43:50 INFO SecurityManager: Changing modify acls to: 185,vagrant
  40. 20/04/21 14:43:50 INFO SecurityManager: Changing view acls groups to:
  41. 20/04/21 14:43:50 INFO SecurityManager: Changing modify acls groups to:
  42. 20/04/21 14:43:50 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(185, vagrant); groups with view permissions: Set(); users  with modify permissions: Set(185, vagrant); groups with modify permissions: Set()
  43. 20/04/21 14:43:50 INFO Utils: Successfully started service 'sparkDriver' on port 7078.
  44. 20/04/21 14:43:50 INFO SparkEnv: Registering MapOutputTracker
  45. 20/04/21 14:43:51 INFO SparkEnv: Registering BlockManagerMaster
  46. 20/04/21 14:43:51 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
  47. 20/04/21 14:43:51 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
  48. 20/04/21 14:43:51 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
  49. 20/04/21 14:43:51 INFO DiskBlockManager: Created local directory at /var/data/spark-4fdc6242-3ab9-4ea4-864b-3b0ffb981e91/blockmgr-d8363b86-9490-4c0c-b4b5-93a59535bbb0
  50. 20/04/21 14:43:51 INFO MemoryStore: MemoryStore started with capacity 413.9 MiB
  51. 20/04/21 14:43:51 INFO SparkEnv: Registering OutputCommitCoordinator
  52. 20/04/21 14:43:51 INFO Utils: Successfully started service 'SparkUI' on port 4040.
  53. 20/04/21 14:43:51 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://spark-pi-75235d719d31da3f-driver-svc.default.svc:4040
  54. 20/04/21 14:43:51 INFO SparkContext: Added JAR local:///opt/spark/examples/jars/spark-examples_2.12-3.1.0-SNAPSHOT.jar at file:/opt/spark/examples/jars/spark-examples_2.12-3.1.0-SNAPSHOT.jar with timestamp 1587480231678
  55. 20/04/21 14:43:51 WARN SparkContext: The jar local:///opt/spark/examples/jars/spark-examples_2.12-3.1.0-SNAPSHOT.jar has been added already. Overwriting of added jars is not supported in the current version.
  56. 20/04/21 14:43:51 INFO SparkKubernetesClientFactory: Auto-configuring K8S client using current context from users K8S config file
  57. 20/04/21 14:43:52 ERROR SparkContext: Error initializing SparkContext.
  58. org.apache.spark.SparkException: External scheduler cannot be instantiated
  59.     at org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:2859)
  60.     at org.apache.spark.SparkContext.<init>(SparkContext.scala:533)
  61.     at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2570)
  62.     at org.apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$5(SparkSession.scala:937)
  63.     at scala.Option.getOrElse(Option.scala:189)
  64.     at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:928)
  65.     at org.apache.spark.examples.SparkPi$.main(SparkPi.scala:30)
  66.     at org.apache.spark.examples.SparkPi.main(SparkPi.scala)
  67.     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  68.     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  69.     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  70.     at java.lang.reflect.Method.invoke(Method.java:498)
  71.     at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
  72.     at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:934)
  73.     at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
  74.     at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
  75.     at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
  76.     at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1013)
  77.     at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1022)
  78.     at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
  79. Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Operation: [get]  for kind: [Pod]  with name: [spark-pi-75235d719d31da3f-driver]  in namespace: [default]  failed.
  80.     at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:64)
  81.     at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:72)
  82.     at io.fabric8.kubernetes.client.dsl.base.BaseOperation.getMandatory(BaseOperation.java:225)
  83.     at io.fabric8.kubernetes.client.dsl.base.BaseOperation.get(BaseOperation.java:168)
  84.     at org.apache.spark.scheduler.cluster.k8s.ExecutorPodsAllocator.$anonfun$driverPod$1(ExecutorPodsAllocator.scala:59)
  85.     at scala.Option.map(Option.scala:230)
  86.     at org.apache.spark.scheduler.cluster.k8s.ExecutorPodsAllocator.<init>(ExecutorPodsAllocator.scala:58)
  87.     at org.apache.spark.scheduler.cluster.k8s.KubernetesClusterManager.createSchedulerBackend(KubernetesClusterManager.scala:113)
  88.     at org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:2853)
  89.     ... 19 more
  90. Caused by: okhttp3.internal.http2.ConnectionShutdownException
  91.     at okhttp3.internal.http2.Http2Connection.newStream(Http2Connection.java:247)
  92.     at okhttp3.internal.http2.Http2Connection.newStream(Http2Connection.java:230)
  93.     at okhttp3.internal.http2.Http2Codec.writeRequestHeaders(Http2Codec.java:117)
  94.     at okhttp3.internal.http.CallServerInterceptor.intercept(CallServerInterceptor.java:50)
  95.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  96.     at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:45)
  97.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  98.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  99.     at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:93)
  100.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  101.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  102.     at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93)
  103.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  104.     at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:127)
  105.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  106.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  107.     at io.fabric8.kubernetes.client.utils.BackwardsCompatibilityInterceptor.intercept(BackwardsCompatibilityInterceptor.java:134)
  108.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  109.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  110.     at io.fabric8.kubernetes.client.utils.ImpersonatorInterceptor.intercept(ImpersonatorInterceptor.java:68)
  111.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  112.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  113.     at io.fabric8.kubernetes.client.utils.HttpClientUtils.lambda$createHttpClient$3(HttpClientUtils.java:112)
  114.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  115.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  116.     at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:257)
  117.     at okhttp3.RealCall.execute(RealCall.java:93)
  118.     at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:469)
  119.     at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:430)
  120.     at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleGet(OperationSupport.java:395)
  121.     at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleGet(OperationSupport.java:376)
  122.     at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleGet(BaseOperation.java:832)
  123.     at io.fabric8.kubernetes.client.dsl.base.BaseOperation.getMandatory(BaseOperation.java:214)
  124.     ... 25 more
  125. 20/04/21 14:43:52 INFO SparkUI: Stopped Spark web UI at http://spark-pi-75235d719d31da3f-driver-svc.default.svc:4040
  126. 20/04/21 14:43:52 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
  127. 20/04/21 14:43:52 INFO MemoryStore: MemoryStore cleared
  128. 20/04/21 14:43:52 INFO BlockManager: BlockManager stopped
  129. 20/04/21 14:43:52 INFO BlockManagerMaster: BlockManagerMaster stopped
  130. 20/04/21 14:43:52 WARN MetricsSystem: Stopping a MetricsSystem that is not running
  131. 20/04/21 14:43:52 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
  132. 20/04/21 14:43:52 INFO SparkContext: Successfully stopped SparkContext
  133. Exception in thread "main" org.apache.spark.SparkException: External scheduler cannot be instantiated
  134.     at org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:2859)
  135.     at org.apache.spark.SparkContext.<init>(SparkContext.scala:533)
  136.     at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2570)
  137.     at org.apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$5(SparkSession.scala:937)
  138.     at scala.Option.getOrElse(Option.scala:189)
  139.     at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:928)
  140.     at org.apache.spark.examples.SparkPi$.main(SparkPi.scala:30)
  141.     at org.apache.spark.examples.SparkPi.main(SparkPi.scala)
  142.     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  143.     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  144.     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  145.     at java.lang.reflect.Method.invoke(Method.java:498)
  146.     at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
  147.     at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:934)
  148.     at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
  149.     at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
  150.     at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
  151.     at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1013)
  152.     at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1022)
  153.     at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
  154. Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Operation: [get]  for kind: [Pod]  with name: [spark-pi-75235d719d31da3f-driver]  in namespace: [default]  failed.
  155.     at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:64)
  156.     at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:72)
  157.     at io.fabric8.kubernetes.client.dsl.base.BaseOperation.getMandatory(BaseOperation.java:225)
  158.     at io.fabric8.kubernetes.client.dsl.base.BaseOperation.get(BaseOperation.java:168)
  159.     at org.apache.spark.scheduler.cluster.k8s.ExecutorPodsAllocator.$anonfun$driverPod$1(ExecutorPodsAllocator.scala:59)
  160.     at scala.Option.map(Option.scala:230)
  161.     at org.apache.spark.scheduler.cluster.k8s.ExecutorPodsAllocator.<init>(ExecutorPodsAllocator.scala:58)
  162.     at org.apache.spark.scheduler.cluster.k8s.KubernetesClusterManager.createSchedulerBackend(KubernetesClusterManager.scala:113)
  163.     at org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:2853)
  164.     ... 19 more
  165. Caused by: okhttp3.internal.http2.ConnectionShutdownException
  166.     at okhttp3.internal.http2.Http2Connection.newStream(Http2Connection.java:247)
  167.     at okhttp3.internal.http2.Http2Connection.newStream(Http2Connection.java:230)
  168.     at okhttp3.internal.http2.Http2Codec.writeRequestHeaders(Http2Codec.java:117)
  169.     at okhttp3.internal.http.CallServerInterceptor.intercept(CallServerInterceptor.java:50)
  170.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  171.     at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:45)
  172.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  173.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  174.     at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:93)
  175.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  176.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  177.     at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93)
  178.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  179.     at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:127)
  180.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  181.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  182.     at io.fabric8.kubernetes.client.utils.BackwardsCompatibilityInterceptor.intercept(BackwardsCompatibilityInterceptor.java:134)
  183.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  184.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  185.     at io.fabric8.kubernetes.client.utils.ImpersonatorInterceptor.intercept(ImpersonatorInterceptor.java:68)
  186.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  187.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  188.     at io.fabric8.kubernetes.client.utils.HttpClientUtils.lambda$createHttpClient$3(HttpClientUtils.java:112)
  189.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147)
  190.     at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121)
  191.     at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:257)
  192.     at okhttp3.RealCall.execute(RealCall.java:93)
  193.     at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:469)
  194.     at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:430)
  195.     at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleGet(OperationSupport.java:395)
  196.     at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleGet(OperationSupport.java:376)
  197.     at io.fabric8.kubernetes.client.dsl.base.BaseOperation.handleGet(BaseOperation.java:832)
  198.     at io.fabric8.kubernetes.client.dsl.base.BaseOperation.getMandatory(BaseOperation.java:214)
  199.     ... 25 more
  200. 20/04/21 14:43:52 INFO ShutdownHookManager: Shutdown hook called
  201. 20/04/21 14:43:52 INFO ShutdownHookManager: Deleting directory /tmp/spark-8d462ebb-91cc-4089-b61c-a274781c369a
  202. 20/04/21 14:43:52 INFO ShutdownHookManager: Deleting directory /var/data/spark-4fdc6242-3ab9-4ea4-864b-3b0ffb981e91/spark-373cdf3b-231a-4216-aae0-47bd3ca65874
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!