Advertisement
Guest User

Untitled

a guest
Oct 21st, 2014
185
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Scala 0.79 KB | None | 0 0
  1. val csvFiles = sc.textFile(path)
  2.  
  3. val selectedRows = csvFiles.map(_.split(","))
  4.     .filter(row => (row.length > fieldNumber) && (row(fieldNumber).equals(value)))
  5.  
  6. selectedRows.saveAsTextFile(output)
  7.  
  8. OUTPUT:
  9. [Ljava.lang.String;@77f4ff45
  10. [Ljava.lang.String;@2d066f5c
  11. [Ljava.lang.String;@179181c
  12. [Ljava.lang.String;@351dd705
  13. [Ljava.lang.String;@3a0fa481
  14. [Ljava.lang.String;@58f92eee
  15. [Ljava.lang.String;@4f7838e4
  16. [Ljava.lang.String;@5ddf297e
  17. [Ljava.lang.String;@661d3f57
  18. [Ljava.lang.String;@a299d21
  19. [Ljava.lang.String;@320ae6bd
  20. [Ljava.lang.String;@4d1d2809
  21. [Ljava.lang.String;@352f8e6c
  22. [Ljava.lang.String;@452f6fbb
  23. [Ljava.lang.String;@2d508179
  24. [Ljava.lang.String;@373b348e
  25. [Ljava.lang.String;@ff772f6
  26. [Ljava.lang.String;@3e9c7caa
  27. [Ljava.lang.String;@13bc9d03
  28. [Ljava.lang.String;@433d19e0
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement