Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /test/metadata could only be replicated to 0 nodes instead of minReplication (=1). There are 3 datanode(s) running and 3 node(s) are excluded in this operation.
- val query = lbcAutomationCastDf
- .writeStream
- .outputMode("append")
- .format("parquet")
- .queryName("lbcautomation")
- .partitionBy("date_year", "date_month", "date_day")
- .option("checkpointLocation", "hdfs://NAMENODE_IP:8020/test/")
- .option("path", "hdfs://NAMENODE_I:8020/test/")
- .start()
- .awaitTermination()
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement