Advertisement
Guest User

Naj artysta

a guest
May 11th, 2019
89
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Scala 0.66 KB | None | 0 0
  1.  val spark = org.apache.spark.sql.SparkSession.builder
  2.       .master("local")
  3.       .appName("Spark CSV Reader")
  4.       .getOrCreate;
  5.  
  6.     val samples = spark.read.format("com.databricks.spark.csv").
  7.       option("sep",",").
  8.       csv("samples.txt").
  9.       toDF("user_id", "song_id", "date_id")
  10.     val songs = spark.read.format("com.databricks.spark.csv").
  11.       option("sep",",").
  12.       csv("tracks1.txt").
  13.       toDF("track_id","song_id","artist","title","nowe_id")
  14.  
  15.     samples.select("song_id").
  16.       join(songs, "song_id").
  17.       groupBy("artist").
  18.       count().
  19.       orderBy(desc("count")).
  20.       select("artist", "count").
  21.       show(1, false)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement