Guest User

Untitled

a guest
Jul 19th, 2018
74
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.30 KB | None | 0 0
  1. from pygments.lexers import PythonLexer
  2. from pygments import lex
  3. import json
  4. code = open(__file__).read()
  5. tokens = lex(code, PythonLexer())
  6. def filter_token(token, text):
  7. return {"token": str(token)[6:], "text": text}
  8. print json.dumps({"tokens": [filter_token(*token) for token in tokens]}, indent=2)
Add Comment
Please, Sign In to add comment