Guest User

Untitled

a guest
Jun 19th, 2018
82
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.41 KB | None | 0 0
  1. case class A(s:String, i:Int)
  2.  
  3. spark.read.parquet(file).as[A]
  4.  
  5. sealed trait E
  6. case object A extends E
  7. case object B extends E
  8.  
  9. spark.read.parquet(file).as[E]
  10. // java.lang.UnsupportedOperationException: No Encoder found for E
  11.  
  12. implicit val eEncoder = new org.apache.spark.sql.Encoder[E] {
  13. def clsTag = ClassTag(classOf[E])
  14. def schema = StructType(StructField("e", IntegerType, nullable = false)::Nil)
  15. }
Add Comment
Please, Sign In to add comment