Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- WARN NettyRpcEndpointRef: Error sending message [message = Heartbeat(driver,[Lscala.Tuple2;@dac44da,BlockManagerId(driver, localhost, 46158))] in 1 attempts
- ERROR ActorSystemImpl: Uncaught fatal error from thread [sparkDriverActorSystem-scheduler-1] shutting down ActorSystem [sparkDriverActorSystem]
- java.lang.OutOfMemoryError: GC overhead limit exceeded
- spark-shell --packages mysql:mysql-connector-java:5.1.26 org.slf4j:slf4j-simple:1.7.21 --driver-memory 12G
- val dataframe_mysql = sqlContext.read.format("jdbc").option("url", "jdbc:mysql://.../folletto").option("driver", "com.mysql.jdbc.Driver").option("dbtable", "...").option("user", "...").option("password", "...").load()
- dataframe_mysql.saveAsParquetFile("name.parquet")
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement