Advertisement
Guest User

Untitled

a guest
Jun 18th, 2019
102
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.57 KB | None | 0 0
  1. org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /test/metadata could only be replicated to 0 nodes instead of minReplication (=1). There are 3 datanode(s) running and 3 node(s) are excluded in this operation.
  2.  
  3. val query = lbcAutomationCastDf
  4. .writeStream
  5. .outputMode("append")
  6. .format("parquet")
  7. .queryName("lbcautomation")
  8. .partitionBy("date_year", "date_month", "date_day")
  9. .option("checkpointLocation", "hdfs://NAMENODE_IP:8020/test/")
  10. .option("path", "hdfs://NAMENODE_I:8020/test/")
  11. .start()
  12. .awaitTermination()
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement