Guest User

Untitled

a guest
Jan 24th, 2018
74
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.40 KB | None | 0 0
  1. val rddWithOutNull2 = rddSlices.filter(x => x(0) != null)
  2.  
  3. val df = spark.createDataFrame(rddRow,schema)
  4. df.printSchema()
  5.  
  6. root
  7. |-- name: string (nullable = false)
  8.  
  9.  
  10. println(df.count())
  11.  
  12. Error :
  13. count : :
  14. [Stage 11:==================================> (3 + 2) / 5][error] o.a.s.e.Executor - Exception in task 4.0 in stage 11.0 (TID 16)
  15. java.lang.IndexOutOfBoundsException: 0
Add Comment
Please, Sign In to add comment