Advertisement
Guest User

Untitled

a guest
May 24th, 2019
85
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.29 KB | None | 0 0
  1. import org.apache.spark.SparkFiles
  2. import org.apache.spark.SparkContext
  3.  
  4. val context = spark.sparkContext
  5. val fileName = "file.csv"
  6. val fetchedFile = context.addFile(s"ftp://my-ftp-server.net/$fileName")
  7.  
  8. val readFile = context.textFile(SparkFiles.get(fileName)).collect()
  9.  
  10. readFile.foreach(println)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement