Commit Graph

15 Commits

Author SHA1 Message Date
Robby Findler
5e2cc344c8 change the option setup: everyone has an option contract now and
the module lexer either exercises or not, depending on its level of trust
2013-02-23 16:26:46 -06:00
Robby Findler
b0343aa9f0 add a contract on the interaction between the module-lexer and the
lexers it defers to

also, remove the checks in color.rkt in the framework (they are not
all covered by the added contract, but they mostly are and when they
aren't, most of those times are using the heavily tested racket-lexer)
2013-02-23 14:35:25 -06:00
Eli Barzilay
f7c67b49a4 Big newline at EOF scan. 2012-02-29 00:28:11 -05:00
Robby Findler
11994bd4f8 fix a bug in the module lexer; it was returning the wrong length for the tokens
it creates when the #lang line isn't well-formed (eg "#lang racke").

closes PR 12399
2011-11-28 21:16:31 -06:00
Robby Findler
65fd0234ad add a unicode test to scheme-lexer.rkt
and change the tests so they all run with port line
counting enabled (or else the unicode test fails)

adjust module-lexer.rkt tests so they can run in either
port-counting mode or not (but currently run them all in
port-counting mode because scheme-lexer doesn't work without it)

also make a first stab at what needs to change in the module
lexer to make it work in non port line-counting mode
2011-11-03 22:41:27 -05:00
Robby Findler
d00aed6f1b fix the module reader for the case when there are non-ASCII unicode characters
in comments before the #lang line

also add an #:init-position argument to peeking-input-port
2011-11-03 17:13:17 -05:00
Robby Findler
1eaf53d4cb adjust the module lexer so that it treats the entire range that
'read-language' uses as a single token in the case that read-language
fails. This helps it to deal with things like s-exp and at-exp
properly

closes PR 12260
2011-10-08 08:08:36 -05:00
Robby Findler
68b5d2abf8 adjust module lexer to handle the case of specials in the editor properly 2011-03-01 15:20:55 -06:00
Robby Findler
83b00c0cf1 adjust the module-lexer so it explicitly notes malformed #lang lines before going into "no-lang-line" mode
closes PR 11766
2011-02-22 20:42:19 -06:00
Robby Findler
50e9aec0ab catch more exceptions in the module lexer when it calls read-language 2011-02-10 09:56:43 -06:00
Robby Findler
d659d2f0af changed the module lexer's strategy to be able to handle
the part of the buffer before the #lang line properly
  closes PR 11381
2011-02-09 15:27:05 -06:00
Robby Findler
dce1d0ad47 revert the module-lexer.rkt changes that I accidentally pushed 2011-02-08 10:55:35 -06:00
Robby Findler
49c3011f49 started to fix the colorer problems (now that I undestand how!)
plus some extra checking in the colorer
2011-02-08 10:02:42 -06:00
Eli Barzilay
939af28a4c Some random ".ss" -> ".rkt"s 2010-05-17 05:58:19 -04:00
Matthew Flatt
28b4043077 rename all files .ss -> .rkt 2010-04-27 16:50:15 -06:00