Advertisement
Guest User

Untitled

a guest
Jul 22nd, 2016
80
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.42 KB | None | 0 0
  1. val sqlContext = new org.apache.spark.sql.SQLContext(sc) // optional
  2.  
  3. val df = sqlContext.load("jdbc", Map(
  4. "url" -> "jdbc:mysql://<ip.address.your.db>/<table>?user=<username>&password=<pwd>",
  5. "dbtable" -> "<tablename>"))
  6.  
  7. df.select("<col1>","<col2>","<col3>").save("</path/to/parquet/file.parquet>","parquet")
  8.  
  9. //Alternatively, to save all the columns:
  10.  
  11. df.write.parquet("</path/to/parquet/file.parquet>")
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement