Advertisement
Guest User

Untitled

a guest
Apr 16th, 2020
564
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Python 0.45 KB | None | 0 0
  1. import nltk
  2. from nltk.util import ngrams
  3.  
  4. # Function to generate n-grams from sentences.
  5. def extract_ngrams(data, num):
  6.     n_grams = ngrams(nltk.word_tokenize(data), num)
  7.     return [ ' '.join(grams) for grams in n_grams]
  8.  
  9. data = 'A class is a blueprint for the object.'
  10.  
  11. print("1-gram: ", extract_ngrams(data, 1))
  12. print("2-gram: ", extract_ngrams(data, 2))
  13. print("3-gram: ", extract_ngrams(data, 3))
  14. print("4-gram: ", extract_ngrams(data, 4))
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement