Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- val rddWithOutNull2 = rddSlices.filter(x => x(0) != null)
- val df = spark.createDataFrame(rddRow,schema)
- df.printSchema()
- root
- |-- name: string (nullable = false)
- println(df.count())
- Error :
- count : :
- [Stage 11:==================================> (3 + 2) / 5][error] o.a.s.e.Executor - Exception in task 4.0 in stage 11.0 (TID 16)
- java.lang.IndexOutOfBoundsException: 0
Add Comment
Please, Sign In to add comment