Guest User

Untitled

a guest
Dec 7th, 2017
83
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.27 KB | None | 0 0
  1. rddQueue = ssc.queueStream([rdd1, rdd2])
  2. def func(new_values, old_value):
  3. return sum(new_values) + (old_value or 0)
  4.  
  5. rddQueue = rddQueue.updateStateByKey(func).transform(lambda x: x.sortBy(lambda y: y[1], ascending=False))
  6.  
  7. .updateStateByKey(func).transform(...
Add Comment
Please, Sign In to add comment