Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- val rdd = new JdbcRDD[Email](sc,
- () => {DriverManager.getConnection(
- "jdbc:sqlserver://omnimirror;databaseName=moneycorp;integratedSecurity=true;")},
- "SELECT * FROM TABLE_NAME Where ? < X and X < ?",
- 1, 100000, 1000,
- (r:ResultSet) => { SomeClass(r.getString("Col1"),
- r.getString("Col2"), r.getString("Col3")) } )
- c:Appsdistsqoopbin>sqoop.cmd import –connect “jdbc:sqlserver://alexeik0N:1433;database=RelationalDB;user=sa;password=Password" –table SOURCE –target-dir /hive/warehouse/SQLDATA/ –as-textfile –split-by clientid –fields-terminated -by t -m 1
- loading a hdfs file into spark context
- sc.textFile("hdfs://nn1home:8020/input/as.txt")
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement