Advertisement
Guest User

Untitled

a guest
Jan 24th, 2017
82
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.22 KB | None | 0 0
  1. def getTokens(data:RDD[(String,String)]):RDD[(String,List[String])]={
  2. data.map(x => (Utils.parseLine(x._2)._1.toString(),
  3. EntityResolution.tokenize(Utils.parseLine(x._2)._1.toString(), stopWords)))
  4. }
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement