API tools faq
paste
Advertisement
Guest User

Untitled

a guest
May 30th, 2015
252
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 6.75 KB | None | 0 0
raw download clone embed print report
  1. dataIn.collect.map(println(_))
  2. gives: note 8 hello worlds 9 this is a test
  3. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  4. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  5. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  6. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  7. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  8. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  9. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  10. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  11. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"}
  12. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"}
  13. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"}
  14. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"}
  15. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"}
  16. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"}
  17. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"}
  18. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"}
  19. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"}
  20.  
  21. dataIn.map(x => (vectorAggregators.key(x), x)).collect.map(println(_)) gives: (checkout line 31)
  22. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  23. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  24. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  25. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  26. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  27. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  28. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  29. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  30. (hello world,{"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  31. (this is a test,{"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  32. (hello world,{"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  33. (hello world,{"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  34. (hello world,{"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  35. (hello world,{"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  36. (hello world,{"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  37. (hello world,{"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  38. (this is a test,{"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
  39.  
  40. dataIn.groupBy(vectorAggregators.key).map(x => x._2).collect.map(println(_))
  41. gives this: note 7 hello worlds 10 this is a test
  42. CompactBuffer(
  43. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"},
  44. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"},
  45. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"},
  46. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"},
  47. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"},
  48. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"},
  49. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "hello world"})
  50. CompactBuffer(
  51. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"},
  52. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"},
  53. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"},
  54. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"},
  55. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"},
  56. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"},
  57. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"},
  58. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"},
  59. {"memberId": 12345, "transactionTime": 1424852578493, "isActive": true, "insertedPeriod": 123, "message": "this is a test"},
  60. {"memberId": 12345, "transactionTime": 1424420578493, "isActive": false, "insertedPeriod": 123, "message": "this is a test"})
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!