Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- from pyspark import SparkContext
- from pyspark.streaming import StreamingContext
- sc = SparkContext.getOrCreate()
- ssc = StreamingContext(sc, 1)
- stream_data = ssc.textFileStream("file:///tmp/stream") \
- .map( lambda x: x.split(","))
- stream_data.pprint()
- ssc.start()
- ssc.awaitTermination()
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement