Guest User

Untitled

a guest
Jun 22nd, 2018
80
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.16 KB | None | 0 0
  1. from lexer import Lexer
  2.  
  3. text_input = """
  4. print(4 + 4 - 2);
  5. """
  6.  
  7. lexer = Lexer().get_lexer()
  8. tokens = lexer.lex(text_input)
  9.  
  10. for token in tokens:
  11. print(token)
Add Comment
Please, Sign In to add comment