API tools faq
paste
Guest User

Untitled

a guest
Jan 23rd, 2019
83
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.48 KB | None | 0 0
raw download clone embed print report
  1. Year Account
  2. 2009 Acct1
  3. 2009 Acct2
  4. 2009 Acct3
  5. 2009 Acct4
  6. 2009 Acct5
  7. 2009 Acct1
  8. 2009 Acct2
  9. 2009 Acct3
  10.  
  11. Year Account
  12. 2009 Acct1
  13. 2009 Acct2
  14. 2009 Acct1
  15. 2009 Acct2
  16.  
  17. Year Account
  18. 2009 Acct3
  19. 2009 Acct4
  20. 2009 Acct5
  21. 2009 Acct3
  22.  
  23. sparkSession.read()
  24. .json("jsonFile.json")
  25. .toDF()
  26. .repartition(1)
  27. .write()
  28. .options(sparkOptions)
  29. .partitionBy("year","month","day")
  30. .mode(SaveMode.Overwrite)
  31. .orc("orcDir");
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!