Guest User

Untitled

a guest
May 21st, 2018
238
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.76 KB | None | 0 0
  1. Col_A | Col_B
  2. --------------
  3. A | 1,6,5,3,7
  4. B | 17,18,78
  5. C | 90
  6. D | 56,57
  7.  
  8. Col_A | Col_B
  9. ----------------
  10. A | 1
  11. A | 6
  12. A | 5
  13. B | 17
  14. B | 18
  15. B | 78
  16. C | 90
  17. D | 56
  18. D | 57
  19.  
  20. val origDF = Seq(
  21. ("A", "1,6,5,3,7"),
  22. ("B", "17,18,78"),
  23. ("C", "90"),
  24. ("D", "56,57")
  25. ).toDF("Col_A", "Col_B")
  26.  
  27. val valueAsArray = udf((value: String) => {
  28. value.split(",").map(_.trim).take(3)
  29. })
  30.  
  31. origDF.withColumn("Col_B", explode(valueAsArray($"Col_B"))).show(false)
  32.  
  33. +-----+-----+
  34. |Col_A|Col_B|
  35. +-----+-----+
  36. |A |1 |
  37. |A |6 |
  38. |A |5 |
  39. |B |17 |
  40. |B |18 |
  41. |B |78 |
  42. |C |90 |
  43. |D |56 |
  44. |D |57 |
  45. +-----+-----+
Add Comment
Please, Sign In to add comment