Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- ${SPARK_HOME}/bin/spark-submit --queue default --verbose --master yarn --deploy-mode client --num-executors 5 --executor-memory 2G --py-files TensorFlowOnSpark/tfspark.zip,TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.driver.extraJavaOptions="-XX:PermSize=128m -XX:MaxPermSize=128m" --conf spark.dynamicAllocation.enabled=false --conf spark.executor.extraJavaOptions="-XX:PermSize=128m -XX:MaxPermSize=128m" --conf spark.yarn.maxAppAttempts=2 TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images mnist/csv/train/images --labels mnist/csv/train/labels --mode train --model mnist_model --cluster_size 5
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement