2 Commits

Author	SHA1	Message	Date
Adam Sampson	223a14d767	Add a preprocessor that works with the new lexer. ... The parser now gets a stream of tokens, rather than needing to worry about loading files itself. This also reworks the lexer's idea of what constitutes a Token -- it's now a pair (Meta, TokenType), so it's always easy to pull out/rewrite the metadata -- and adds proper support for lexing preprocessor directives, rather than just treating them as reserved words.	2007-08-20 23:46:57 +00:00
Adam Sampson	a9f1e52103	Structure analyser for the new lexer.	2007-08-20 00:48:55 +00:00