Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- > Sys.setenv(JAVA_HOME = '/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.121-0.b13.el7_3.x86_64')
- > Sys.setenv(SPARK_HOME = '/usr/share/dse/spark/')
- spark.cassandra.connection.host: <IP of one node>
- spark.cassandra.auth.username: cassandra
- spark.cassandra.auth.password: <PW>
- sparklyr.defaultPackages:
- - com.databricks:spark-csv_2.11:1.3.0
- - com.datastax.spark:spark-cassandra-connector_2.11:2.0.0-M1
- - com.datastax.cassandra:cassandra-driver-core:3.0.2
- > sc <- spark_connect(master = "spark://<IP of one node>", config = spark_config(file = "config.yml"), version = "1.6.2")
- Error in force(code) :
- Failed while connecting to sparklyr to port (8880) for sessionid (646): Gateway in port (8880) did not respond.
- Path: /usr/share/dse/spark/bin/spark-submit
- Parameters: --class, sparklyr.Backend, --jars, '/home/emiliano/rprojects/sparklyr_test/packrat/lib/x86_64-redhat-linux-gnu/3.3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar','/home/emiliano/rprojects/sparklyr_test/packrat/lib/x86_64-redhat-linux-gnu/3.3.2/sparklyr/java/commons-csv-1.1.jar','/home/emiliano/rprojects/sparklyr_test/packrat/lib/x86_64-redhat-linux-gnu/3.3.2/sparklyr/java/univocity-parsers-1.5.1.jar', '/home/emiliano/rprojects/sparklyr_test/packrat/lib/x86_64-redhat-linux-gnu/3.3.2/sparklyr/java/sparklyr-1.6-2.10.jar', 8880, 646
- ---- Output Log ----
- Failed to find Spark assembly in /usr/share/dse/spark/lib.
- You need to build Spark before running this program.
- ---- Error Log ----
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement