Advertisement
Guest User

Untitled

a guest
Dec 16th, 2017
85
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Scala 0.43 KB | None | 0 0
  1. val ssc = new StreamingContext(sc)
  2.    
  3. val stream = ssc.receiverStream(new MyReceiver)
  4.    
  5. stream.filter(line => line.contains("Accepted"))
  6. .map(line => (line.split.(0)+" "+line.split.(1), (1, 0))
  7. .reduceByKey((a, b) => a + b)
  8. ..........
  9. stream.filter(line => line.contains("Failed"))
  10. .map(line => (line.split.(0)+" "+line.split.(1), (0, 1))
  11. .reduceByKey((a, b) => a + b)
  12. ..........
  13. .print()
  14. ssc.start()
  15. ssc.awaitTermination()
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement