Advertisement
Guest User

Untitled

a guest
May 10th, 2019
296
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Scala 0.52 KB | None | 0 0
  1. // Databricks notebook source
  2. val df = spark.read.json("/mnt/demo/small_radio_json.json")
  3.  
  4. // COMMAND ----------
  5.  
  6. df.show()
  7.  
  8. // COMMAND ----------
  9.  
  10. val specificColumnsDf = df.select("firstname", "lastname", "gender", "location", "level")
  11. specificColumnsDf.show()
  12.  
  13. // COMMAND ----------
  14.  
  15. val renamedColumnsDF = specificColumnsDf.withColumnRenamed("level", "subscription_type")
  16. renamedColumnsDF.show()
  17.  
  18.  
  19. // COMMAND ----------
  20.  
  21. renamedColumnsDF.write.mode("overwrite").json("/mnt/demo/output/renamedColumnsDF.json")
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement