Eli Barzilay
f7c67b49a4
Big newline at EOF scan.
2012-02-29 00:28:11 -05:00
Robby Findler
11994bd4f8
fix a bug in the module lexer; it was returning the wrong length for the tokens
...
it creates when the #lang line isn't well-formed (eg "#lang racke").
closes PR 12399
2011-11-28 21:16:31 -06:00
Robby Findler
65fd0234ad
add a unicode test to scheme-lexer.rkt
...
and change the tests so they all run with port line
counting enabled (or else the unicode test fails)
adjust module-lexer.rkt tests so they can run in either
port-counting mode or not (but currently run them all in
port-counting mode because scheme-lexer doesn't work without it)
also make a first stab at what needs to change in the module
lexer to make it work in non port line-counting mode
2011-11-03 22:41:27 -05:00
Robby Findler
d00aed6f1b
fix the module reader for the case when there are non-ASCII unicode characters
...
in comments before the #lang line
also add an #:init-position argument to peeking-input-port
2011-11-03 17:13:17 -05:00
Robby Findler
1eaf53d4cb
adjust the module lexer so that it treats the entire range that
...
'read-language' uses as a single token in the case that read-language
fails. This helps it to deal with things like s-exp and at-exp
properly
closes PR 12260
2011-10-08 08:08:36 -05:00
Robby Findler
68b5d2abf8
adjust module lexer to handle the case of specials in the editor properly
2011-03-01 15:20:55 -06:00
Robby Findler
83b00c0cf1
adjust the module-lexer so it explicitly notes malformed #lang lines before going into "no-lang-line" mode
...
closes PR 11766
2011-02-22 20:42:19 -06:00
Robby Findler
50e9aec0ab
catch more exceptions in the module lexer when it calls read-language
2011-02-10 09:56:43 -06:00
Robby Findler
d659d2f0af
changed the module lexer's strategy to be able to handle
...
the part of the buffer before the #lang line properly
closes PR 11381
2011-02-09 15:27:05 -06:00
Robby Findler
dce1d0ad47
revert the module-lexer.rkt changes that I accidentally pushed
2011-02-08 10:55:35 -06:00
Robby Findler
49c3011f49
started to fix the colorer problems (now that I undestand how!)
...
plus some extra checking in the colorer
2011-02-08 10:02:42 -06:00
Eli Barzilay
939af28a4c
Some random ".ss" -> ".rkt"s
2010-05-17 05:58:19 -04:00
Matthew Flatt
28b4043077
rename all files .ss -> .rkt
2010-04-27 16:50:15 -06:00
