Advertisement
jessking1019

Untitled

Feb 17th, 2020
108
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.29 KB | None | 0 0
  1. import nltk
  2. lemma = nltk.stem.WordNetLemmatizer()
  3. w_tokenize = nltk.tokenize.WhitespaceTokenizer()
  4.  
  5. def converted_text(text):
  6. return[nltk.stem.WordNetLemmatizer().lemmatize(w, pos = 'n') for w in w_tokenize.tokenize(text)]
  7.  
  8. data['purpose_lemmatized'] = data['purpose'].apply(converted_text)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement