Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Python Notebooks
- import subprocess
- print("Spark Context Version: " + sc.version);
- print ("Spark Scala Version: " + os.environ['SPARK_SCALA_VERSION'])
- print("Python Release version: " + sys.version)
- print(subprocess.check_output(["java", "-version"], stderr=subprocess.STDOUT))
- print("Spark Context Config:")
- print("_____________________")
- print sc._conf.toDebugString()
- =========================================================================================
- Scala Notebooks
- println("Spark Context Version: " + sc.version);
- println("Java version: " + scala.util.Properties.javaVersion);
- println("Scala Release version: " + scala.util.Properties.releaseVersion);
- println("_____________________");
- println("Spark Context Config:");
- sc.getConf.getAll.foreach(println);
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement