Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- $ cd /usr/local/spark/sbin
- $ sh start-history-server.sh
- Exception in thread "main" java.lang.ClassNotFoundException: org.apache.hadoop.fs.s3a.S3AFileSystem
- at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
- at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
- at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
- at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
- at java.lang.Class.forName0(Native Method)
- at java.lang.Class.forName(Class.java:348)
- at org.apache.spark.util.Utils$.classForName(Utils.scala:230)
- ....
- spark.hadoop.fs.s3a.impl org.apache.hadoop.fs.s3a.S3AFileSystem
- spark.history.provider org.apache.hadoop.fs.s3a.S3AFileSystem
- spark.history.fs.logDirectory s3a://xxxxxxxxxxxxx
- spark.eventLog.enabled true
- spark.eventLog.dir s3a://xxxxxxxxxxxxxxx
- aws-java-sdk-1.7.4.jar
- hadoop-aws-2.7.3.jar
Add Comment
Please, Sign In to add comment