Advertisement
Guest User

Untitled

a guest
Jun 20th, 2019
64
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.29 KB | None | 0 0
  1. from pyspark import SparkContext
  2. from pyspark.streaming import StreamingContext
  3.  
  4. sc = SparkContext.getOrCreate()
  5. ssc = StreamingContext(sc, 1)
  6.  
  7. stream_data = ssc.textFileStream("file:///tmp/stream") \
  8. .map( lambda x: x.split(","))
  9.  
  10. stream_data.pprint()
  11.  
  12. ssc.start()
  13.  
  14. ssc.awaitTermination()
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement