Guest User

Untitled

a guest
Jan 6th, 2018
63
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.34 KB | None | 0 0
  1. val longList = 1 to 1000000 toList
  2. val numsToAdd = sc.parallelize(longList,30)
  3. val st = System.nanoTime()
  4. println(numsToAdd.reduce((x,y) => x+y))
  5. val et = System.nanoTime()
  6. println("Time spend:"+(et-st))
  7.  
  8. Partitions Time spend
  9.  
  10. default 97916961
  11.  
  12. 10 111907094
  13.  
  14. 20 141691820
  15.  
  16. 30 158264230
Add Comment
Please, Sign In to add comment