Guest User

Untitled

a guest
Apr 5th, 2018
104
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 3.74 KB | None | 0 0
  1. spark = SparkSession
  2. .builder
  3. .appName("Cloudant Spark SQL Example in Python using temp tables")
  4. .config("cloudant.host","ACCOUNT.cloudant.com")
  5. .config("cloudant.username", "USERNAME")
  6. .config("cloudant.password","PASSWORD")
  7. .getOrCreate()
  8.  
  9. # Loading temp table from Cloudant db
  10. df = spark.sql(" CREATE TEMPORARY TABLE test USING
  11. org.apache.bahir.cloudant OPTIONS ( database 'test')")
  12. df.printSchema()
  13.  
  14. spark-submit --packages org.apache.bahir:spark-sql-cloudant_2.11:2.1.1 --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=rizwan --conf spark.cloudant.password=mypassword ./couch-spark.py
  15.  
  16. :: problems summary ::
  17. :::: WARNINGS
  18. module not found: org.apache.bahir#spark-sql-cloudant_2.11;2.1.1
  19.  
  20.  
  21. ==== local-m2-cache: tried
  22.  
  23. file:/C:/Users/rrahman006/.m2/repository/org/apache/bahir/spark-sql-cl
  24. oudant_2.11/2.1.1/spark-sql-cloudant_2.11-2.1.1.pom
  25.  
  26. -- artifact org.apache.bahir#spark-sql-cloudant_2.11;2.1.1!spark-sql-c
  27. loudant_2.11.jar:
  28.  
  29. file:/C:/Users/rrahman006/.m2/repository/org/apache/bahir/spark-sql-cl
  30. oudant_2.11/2.1.1/spark-sql-cloudant_2.11-2.1.1.jar
  31.  
  32. ==== local-ivy-cache: tried
  33.  
  34. C:Usersrrahman006.ivy2localorg.apache.bahirspark-sql-cloudant_2.
  35. 112.1.1ivysivy.xml
  36.  
  37. ==== central: tried
  38.  
  39. https://repo1.maven.org/maven2/org/apache/bahir/spark-sql-cloudant_2.1
  40. 1/2.1.1/spark-sql-cloudant_2.11-2.1.1.pom
  41.  
  42. -- artifact org.apache.bahir#spark-sql-cloudant_2.11;2.1.1!spark-sql-c
  43. loudant_2.11.jar:
  44.  
  45. https://repo1.maven.org/maven2/org/apache/bahir/spark-sql-cloudant_2.1
  46. 1/2.1.1/spark-sql-cloudant_2.11-2.1.1.jar
  47.  
  48. ==== spark-packages: tried
  49.  
  50. http://dl.bintray.com/spark-packages/maven/org/apache/bahir/spark-sql-
  51. cloudant_2.11/2.1.1/spark-sql-cloudant_2.11-2.1.1.pom
  52.  
  53. -- artifact org.apache.bahir#spark-sql-cloudant_2.11;2.1.1!spark-sql-c
  54. loudant_2.11.jar:
  55.  
  56. http://dl.bintray.com/spark-packages/maven/org/apache/bahir/spark-sql-
  57. cloudant_2.11/2.1.1/spark-sql-cloudant_2.11-2.1.1.jar
  58.  
  59. ::::::::::::::::::::::::::::::::::::::::::::::
  60.  
  61. :: UNRESOLVED DEPENDENCIES ::
  62.  
  63. ::::::::::::::::::::::::::::::::::::::::::::::
  64.  
  65. :: org.apache.bahir#spark-sql-cloudant_2.11;2.1.1: not found
  66.  
  67. ::::::::::::::::::::::::::::::::::::::::::::::
  68.  
  69.  
  70. :::: ERRORS
  71. Server access error at url https://repo1.maven.org/maven2/org/apache/bah
  72. ir/spark-sql-cloudant_2.11/2.1.1/spark-sql-cloudant_2.11-2.1.1.pom (javax.net.ss
  73. l.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path bu
  74. ilding failed: sun.security.provider.certpath.SunCertPathBuilderException: unabl
  75. e to find valid certification path to requested target)
  76.  
  77. Server access error at url https://repo1.maven.org/maven2/org/apache/bah
  78. ir/spark-sql-cloudant_2.11/2.1.1/spark-sql-cloudant_2.11-2.1.1.jar (javax.net.ss
  79. l.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path bu
  80. ilding failed: sun.security.provider.certpath.SunCertPathBuilderException: unabl
  81. e to find valid certification path to requested target)
  82.  
  83.  
  84. :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
  85. Exception in thread "main" java.lang.RuntimeException: [unresolved dependency: o
  86. rg.apache.bahir#spark-sql-cloudant_2.11;2.1.1: not found]
  87. at org.apache.spark.deploy.SparkSubmitUtils$.resolveMavenCoordinates(Spa
  88. rkSubmit.scala:1068)
  89. at org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSu
  90. bmit.scala:287)
  91. at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:154)
  92. at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
  93. at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Add Comment
Please, Sign In to add comment