Advertisement
Guest User

Untitled

a guest
Oct 27th, 2016
77
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.73 KB | None | 0 0
  1. WARN NettyRpcEndpointRef: Error sending message [message = Heartbeat(driver,[Lscala.Tuple2;@dac44da,BlockManagerId(driver, localhost, 46158))] in 1 attempts
  2.  
  3. ERROR ActorSystemImpl: Uncaught fatal error from thread [sparkDriverActorSystem-scheduler-1] shutting down ActorSystem [sparkDriverActorSystem]
  4. java.lang.OutOfMemoryError: GC overhead limit exceeded
  5.  
  6. spark-shell --packages mysql:mysql-connector-java:5.1.26 org.slf4j:slf4j-simple:1.7.21 --driver-memory 12G
  7.  
  8. val dataframe_mysql = sqlContext.read.format("jdbc").option("url", "jdbc:mysql://.../folletto").option("driver", "com.mysql.jdbc.Driver").option("dbtable", "...").option("user", "...").option("password", "...").load()
  9.  
  10. dataframe_mysql.saveAsParquetFile("name.parquet")
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement