Advertisement
Guest User

Untitled

a guest
Jun 27th, 2019
98
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.06 KB | None | 0 0
  1. val jsondftemp = spark.read.json('path') to read the json file
  2.  
  3. {"srchTrnsPhrs":"Psychiatric Care","Nm":"bh","Num":"746","reqPlsize":"11707","reqID":"a520a039-310b-485e-9be2-3bfe51d376a2"}
  4. {"CoreFuncStrtTm":"2019-04-16 00:00:16.356614","reqID":"a520a039-310b-485e-9be2-3bfe51d376a2"}
  5. {"CoreFuncEndTm":"2019-04-16 00:00:16.536903","execTm":"180","reqID":"a520a039-310b-485e-9be2-3bfe51d376a2"}
  6.  
  7. |-- CoreFuncEndTm: string (nullable = true)
  8. |-- CoreFuncStrtTm: string (nullable = true)
  9. |-- Nm: string (nullable = true)
  10. |-- Num : string (nullable = true)
  11. |-- execTm: string (nullable = true)
  12. |-- reqID: string (nullable = true)
  13. |-- srchTrnsPhrs: string (nullable = true)
  14. |-- reqPlsize: string (nullable = true)
  15.  
  16. +--------------------+--------------------+-------+-----------+--------------------+--------------------+-------+---------+
  17. | CoreFuncEndTm| CoreFuncStrtTm|Nm |execTm | reqID| srchEntrdPhrs|Num |reqPlsize|
  18. +--------------------+--------------------+-------+-----------+--------------------+--------------------+-------+---------+
  19. | null| null| bh| null|a520a039-310b-485...| Psychiatric Care| 746 | 11707|
  20. | null|2019-04-16 00:00:...| null| null|a520a039-310b-485...| null| null| null|
  21. |2019-04-16 00:00:...| null| null| 180|a520a039-310b-485...| null| null| null|
  22. +--------------------+--------------------+-------+-----------+--------------------+--------------------+-------+-------+
  23.  
  24. +--------------------+--------------------+-------+-----------+--------------------+--------------------+-------+---------+
  25. | CoreFuncEndTm| CoreFuncStrtTm|Nm |execTm | reqID| srchEntrdPhrs|Num |reqPlsize|
  26. +--------------------+--------------------+-------+-----------+--------------------+--------------------+-------+---------+
  27. |2019-04-16 00:00:...|2019-04-16 00:00:...| bh| 180|a520a039-310b-485...| Psychiatric Care| 746 | 11707|
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement