Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- val numPartitions = numSlaveNodes * numExecutorsPerNode * numCoresPerExecutor
- val myRDD = sparkContext.parallelize(myCollection, numPartitions)
- sparkSession.conf.get("spark.executor.cores").toInt
Add Comment
Please, Sign In to add comment
