Advertisement
Guest User

Untitled

a guest
Jun 25th, 2019
62
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.43 KB | None | 0 0
  1. import keras.preprocessing.text.Tokenizer as Tokenizer
  2.  
  3. data = ["Two little dicky birds",
  4. "Sat on a wall,",
  5. "One called Peter,",
  6. "One called Paul.",
  7. "Fly away, Peter,",
  8. "Fly away, Paul!",
  9. "Come back, Peter,",
  10. "Come back, Paul."]
  11.  
  12. # Preprocess data
  13. tokenizer = Tokenizer()
  14. tokenizer.fit_on_texts(data)
  15. vocab = tokenizer.word_index
  16. seqs = tokenizer.texts_to_sequences(data)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement