Guest User

Untitled

a guest
Jun 20th, 2018
78
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.79 KB | None | 0 0
  1. df.write()
  2. .format("com.databricks.spark.csv")
  3. .option("header", "true")
  4. .save("/user/cloudera/csv");
  5.  
  6. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/csv/CSVFormat
  7. ...
  8. Caused by: java.lang.ClassNotFoundException: org.apache.commons.csv.CSVFormat
  9. ... 21 more
  10.  
  11. <dependency>
  12. <groupId>com.databricks</groupId>
  13. <artifactId>spark-csv_2.10</artifactId>
  14. <version>1.5.0</version>
  15. </dependency>
  16.  
  17. <dependency>
  18. <groupId>org.apache.commons</groupId>
  19. <artifactId>commons-csv</artifactId>
  20. <version>1.5</version>
  21. </dependency>
  22.  
  23. <dependency>
  24. <groupId>org.apache.spark</groupId>
  25. <artifactId>spark-sql_2.10</artifactId>
  26. <version>1.6.0</version>
  27. </dependency>
  28.  
  29. spark-submit --jars /path/spark-csv_2.10-1.5.0.jar --class com.iris.Begin /path/CsvSolver.jar
Add Comment
Please, Sign In to add comment