Advertisement
Guest User

Untitled

a guest
Feb 2nd, 2017
110
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 1.44 KB | None | 0 0
  1. > Sys.setenv(JAVA_HOME = '/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.121-0.b13.el7_3.x86_64')
  2. > Sys.setenv(SPARK_HOME = '/usr/share/dse/spark/')
  3.  
  4. spark.cassandra.connection.host: <IP of one node>
  5. spark.cassandra.auth.username: cassandra
  6. spark.cassandra.auth.password: <PW>
  7.  
  8. sparklyr.defaultPackages:
  9. - com.databricks:spark-csv_2.11:1.3.0
  10. - com.datastax.spark:spark-cassandra-connector_2.11:2.0.0-M1
  11. - com.datastax.cassandra:cassandra-driver-core:3.0.2
  12.  
  13. > sc <- spark_connect(master = "spark://<IP of one node>", config = spark_config(file = "config.yml"), version = "1.6.2")
  14. Error in force(code) :
  15. Failed while connecting to sparklyr to port (8880) for sessionid (646): Gateway in port (8880) did not respond.
  16. Path: /usr/share/dse/spark/bin/spark-submit
  17. Parameters: --class, sparklyr.Backend, --jars, '/home/emiliano/rprojects/sparklyr_test/packrat/lib/x86_64-redhat-linux-gnu/3.3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar','/home/emiliano/rprojects/sparklyr_test/packrat/lib/x86_64-redhat-linux-gnu/3.3.2/sparklyr/java/commons-csv-1.1.jar','/home/emiliano/rprojects/sparklyr_test/packrat/lib/x86_64-redhat-linux-gnu/3.3.2/sparklyr/java/univocity-parsers-1.5.1.jar', '/home/emiliano/rprojects/sparklyr_test/packrat/lib/x86_64-redhat-linux-gnu/3.3.2/sparklyr/java/sparklyr-1.6-2.10.jar', 8880, 646
  18.  
  19.  
  20. ---- Output Log ----
  21. Failed to find Spark assembly in /usr/share/dse/spark/lib.
  22. You need to build Spark before running this program.
  23.  
  24. ---- Error Log ----
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement