Tuesday, July 5, 2011

Lexer

A lexer takes as input a character or binary stream, and converts it into tokens using lexer rules.

Questions:
  1. Can lexer rules contain non terminals on the LHS (I do not think so ... )?
  2. Specific to ANTLR, are tokens considered part of Lexer rules?

No comments:

Post a Comment