daily pastebin goal
29%
SHARE
TWEET

Untitled

a guest Sep 24th, 2018 56 Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. conf = pyspark.SparkConf()
  2.  
  3. # Set number of workers and number of cores
  4. conf.set('spark.num.executors', 3)
  5. conf.set('spark.executor.memory', '12g')
  6. conf.set('spark.executor.cores', 3)
  7.  
  8. # Create a spark context
  9. sc = pyspark.SparkContext(master = 'spark://ip-172-31-8-174.ec2.internal:7077'
  10.                           appName = 'featuretools', conf = conf)
RAW Paste Data
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy. OK, I Understand
 
Top