Don't like ads? PRO users don't see any ads ;-)
Public Pastes
Guest

Untitled

By: a guest on Aug 12th, 2012  |  syntax: None  |  size: 0.30 KB  |  hits: 12  |  expires: Never
download  |  raw  |  embed  |  report abuse  |  print
Text below is selected. Please press Ctrl+C to copy to your clipboard. (⌘+C on Mac)
  1. How to use Parts-of-Speech to evaluate semantic text similarity?
  2. postags = nltk.pos_tag(tokens)
  3. self.pos_freq_dist = Counter(tag for word,tag in postags)
  4. for pos, freq in self.pos_freq_dist.iteritems():
  5.     self.pos_freq_dist_relative[pos] = freq/self.token_count    #normalise pos freq by token counts
create a new version of this paste RAW Paste Data