Advertisement
Guest User

Untitled

a guest
Mar 28th, 2019
130
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.54 KB | None | 0 0
  1. $ pyspark --driver-class-path E:/Spark1_6/Spark_1_6/lib/mysql-connector-java-5.1.37.jar
  2. ## Import Pyspark Lib
  3. from pyspark.sql import SparkSession
  4.  
  5. ## Spark Session Creating
  6. spark = SparkSession.builder.appName("Python Spark SQL basic example").getOrCreate()
  7.  
  8. ## Creating Data Frarme
  9. jdbcDF = spark.read \
  10. .format("jdbc") \
  11. .option("url", "jdbc:mysql://localhost:3306/webdb") \
  12. .option("dbtable", "myjob") \
  13. .option("user", "root") \
  14. .option("password", "root") \
  15. .load()
  16. ## Display Results
  17.  
  18. jdbcDF.printSchema()
  19. jdbcDF.show(10)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement