Pastebin launched a little side project called VERYVIRAL.com, check it out ;-) Want more features on Pastebin? Sign Up, it's FREE!
Guest

Untitled

By: a guest on Jul 31st, 2013  |  syntax: None  |  size: 0.21 KB  |  views: 24  |  expires: Never
download  |  raw  |  embed  |  report abuse  |  print
Text below is selected. Please press Ctrl+C to copy to your clipboard. (⌘+C on Mac)
  1. let lexeme lexbuf = LexBuffer<char>.LexemeString lexbuf
  2. ...
  3. rule tokenize = parse  
  4.  
  5. | ['a'-'z' 'A'-'Z'] { TOKEN1 }  
  6. | [u0100u0101]    { TOKEN2 }
  7. | [u0102-u01FF]   { TOKEN3 }  
  8. ...
  9. | [eof]             { EOF }