Advertisement
Guest User

Untitled

a guest
Feb 14th, 2016
54
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.34 KB | None | 0 0
  1. def createStreamingContext(): StreamingContext = {
  2. val ssc = new StreamingContext(sparkConf, Duration(1000))
  3. ssc.checkpoint(checkpointDir)
  4. ssc
  5. }
  6. val ssc = StreamingContext.getOrCreate(checkpointDir), createStreamingContext)
  7.  
  8. val socketStream = ssc.socketTextStream(...)
  9. socketStream.checkpoint(Seconds(1))
  10. socketStream.foreachRDD(...)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement