Guest User

Untitled

a guest
Oct 22nd, 2018
92
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.48 KB | None | 0 0
  1. ${SPARK_PATH}/bin/spark-submit
  2. --master <K8S_MASTER>
  3. --deploy-mode cluster
  4. --name spark-py-driver
  5. --conf spark.executor.instances=5
  6. --conf spark.kubernetes.container.image=spark-py:2.4.0-rc3
  7. --conf spark.kubernetes.driver.pod.name=spark-py-driver
  8. --conf spark.executor.memory=2g
  9. --conf spark.driver.memory=2g
  10. local:///opt/spark/applications/spark_submit_test_job.py
  11.  
  12. python: can't open file '/opt/spark/applications/spark_submit_test_job.py': [Errno 2] No such file or directory
Add Comment
Please, Sign In to add comment