Guest User

Untitled

a guest
Apr 23rd, 2018
88
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 1.78 KB | None | 0 0
  1. #.option("driver", "com.dbschema.CassandraJdbcDriver")
  2. df = spark_sql_context.read.format('jdbc')
  3. .option("driver", "com.dbschema.CassandraJdbcDriver")
  4. .option("url",url)
  5. .option("dbtable", query)
  6. .option("numPartitions", 2)
  7. .load()
  8. `
  9. `java.sql.SQLException: com.datastax.driver.core.exceptions.SyntaxError: line 1:14 no viable alternative at input 'select' (SELECT * FROM [select]...)
  10. at com.dbschema.CassandraPreparedStatement.executeQuery(CassandraPreparedStatement.java:113)
  11. at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.resolveTable(JDBCRDD.scala:62)
  12. at org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation.<init>(JDBCRelation.scala:113)
  13. at org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider.createRelation(JdbcRelationProvider.scala:45)
  14. at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:330)
  15. at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:152)
  16. at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:125)
  17. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  18. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  19. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  20. at java.lang.reflect.Method.invoke(Method.java:498)
  21. at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
  22. at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
  23. at py4j.Gateway.invoke(Gateway.java:282)
  24. at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)`
  25.  
  26. spark_sql_context.read.format("org.apache.spark.sql.cassandra").options(table="tablename", keyspace="keyspace name").load()
Add Comment
Please, Sign In to add comment