Robby Findler
551150e805
tweaks to option contract usage
2013-03-15 15:38:13 -05:00
Robby Findler
761054890d
extend the lexer <-> framework's color:text api
...
to let lexers say "call me again before you change the buffer"
also, use this in the 2d lexer
2013-03-10 20:17:20 -05:00
Robby Findler
5e2cc344c8
change the option setup: everyone has an option contract now and
...
the module lexer either exercises or not, depending on its level of trust
2013-02-23 16:26:46 -06:00
Robby Findler
b0343aa9f0
add a contract on the interaction between the module-lexer and the
...
lexers it defers to
also, remove the checks in color.rkt in the framework (they are not
all covered by the added contract, but they mostly are and when they
aren't, most of those times are using the heavily tested racket-lexer)
2013-02-23 14:35:25 -06:00
Eli Barzilay
f7c67b49a4
Big newline at EOF scan.
2012-02-29 00:28:11 -05:00
Robby Findler
11994bd4f8
fix a bug in the module lexer; it was returning the wrong length for the tokens
...
it creates when the #lang line isn't well-formed (eg "#lang racke").
closes PR 12399
2011-11-28 21:16:31 -06:00
Robby Findler
65fd0234ad
add a unicode test to scheme-lexer.rkt
...
and change the tests so they all run with port line
counting enabled (or else the unicode test fails)
adjust module-lexer.rkt tests so they can run in either
port-counting mode or not (but currently run them all in
port-counting mode because scheme-lexer doesn't work without it)
also make a first stab at what needs to change in the module
lexer to make it work in non port line-counting mode
2011-11-03 22:41:27 -05:00
Robby Findler
d00aed6f1b
fix the module reader for the case when there are non-ASCII unicode characters
...
in comments before the #lang line
also add an #:init-position argument to peeking-input-port
2011-11-03 17:13:17 -05:00
Robby Findler
1eaf53d4cb
adjust the module lexer so that it treats the entire range that
...
'read-language' uses as a single token in the case that read-language
fails. This helps it to deal with things like s-exp and at-exp
properly
closes PR 12260
2011-10-08 08:08:36 -05:00
Robby Findler
68b5d2abf8
adjust module lexer to handle the case of specials in the editor properly
2011-03-01 15:20:55 -06:00
Robby Findler
83b00c0cf1
adjust the module-lexer so it explicitly notes malformed #lang lines before going into "no-lang-line" mode
...
closes PR 11766
2011-02-22 20:42:19 -06:00
Robby Findler
50e9aec0ab
catch more exceptions in the module lexer when it calls read-language
2011-02-10 09:56:43 -06:00
Robby Findler
d659d2f0af
changed the module lexer's strategy to be able to handle
...
the part of the buffer before the #lang line properly
closes PR 11381
2011-02-09 15:27:05 -06:00
Robby Findler
dce1d0ad47
revert the module-lexer.rkt changes that I accidentally pushed
2011-02-08 10:55:35 -06:00
Robby Findler
49c3011f49
started to fix the colorer problems (now that I undestand how!)
...
plus some extra checking in the colorer
2011-02-08 10:02:42 -06:00
Eli Barzilay
939af28a4c
Some random ".ss" -> ".rkt"s
2010-05-17 05:58:19 -04:00
Matthew Flatt
28b4043077
rename all files .ss -> .rkt
2010-04-27 16:50:15 -06:00
