Commit Graph

5813 Commits

Author SHA1 Message Date
Bogdan Popa
bdef494c8c match: preserve source location in constant-pat predicate applications 2020-11-24 10:00:43 -05:00
Bogdan Popa
0f5ba032bf match: ensure entire `body' is traversed when eliminating unused temps 2020-11-24 10:00:43 -05:00
Bogdan Popa
21cd97f2b2 match: stop searching for unused tmps when all have been found 2020-11-24 10:00:43 -05:00
Bogdan Popa
684a1f1039 match: eliminate field refs due to _ in constructor patterns
Related to #3487.
2020-11-24 10:00:43 -05:00
Matthew Flatt
403ef87ec2 bc: upgrade to libffi 3.3 2020-11-24 07:19:41 -07:00
Matthew Flatt
31d0c07d37 rktboot: fix confusion between compile-time and run-time fixnums 2020-11-23 09:55:39 -07:00
Matthew Flatt
318d3e0a9f Chez Scheme: implementation notes on adding functions
Also, explain primitives and entries, which helps make sense of
definitions like

 (define set-car!
   (lambda (p v)
     (#2%set-car! p v)))
2020-11-23 08:32:22 -07:00
Matthew Flatt
71d86bd3a3 cs: unbreak MSVC build 2020-11-23 06:54:01 -07:00
Matthew Flatt
c52113397c Chez Scheme: add weak generic hash tables
Implement weak and ephemeron generic hashtables, and repair weak and
ephemeron `eqv?` hashtables to be weak on numbers.

Racket's implementation of weak `equal?`-based tables now uses weak
generic tables. Datum interning, which needs a weak `equal?`-based
table and was the bottleneck for unfasling literal data, is much
faster. DrRacket's footprint is 1% smaller.
2020-11-23 06:43:49 -07:00
Matthew Flatt
60e9245390 cs: tweak implementation of keyword intern table 2020-11-22 16:12:17 -07:00
Matthew Flatt
3b1f457375 tweak case fixnum-only dispatch
Use `fixnum?` instead of `fixnum-for-any-platform?` when
only fixnums-on-any-platform are relevant.
2020-11-22 15:53:44 -07:00
Matthew Flatt
8751e5b75f Chez Scheme: fix $describe-fasl-from-port with cycles 2020-11-22 15:21:44 -07:00
Matthew Flatt
3ccb523f1a Chez Scheme: unbreak eq? hash on 32-bit platforms 2020-11-22 13:06:08 -07:00
Matthew Flatt
4b39dc73be cs: restore -natipkg in system-library-subpath result 2020-11-22 11:37:00 -07:00
Matthew Flatt
5ca183a710 cs: improve eq? hashing
Use the fixnum-mixing idea of dc82685ce0 on pointers, too.

This change provides a significant improvement on the "hash-mem.rkt"
benchmark, for example, because the allocated objects have a size that
triggers a repeating pattern in the low bits of the allocated address.
2020-11-22 09:46:30 -07:00
Matthew Flatt
f07c2fea71 cs: simplify and improve handling of literals
Use data instead of code to shrink ".zo" sizes by 10-30%.

When Racket code contains a literal that cannot be serialized directly
by Chez Scheme (such as a keyword or an immutable string that should
be datum-interned), the old approach was to generate Scheme code to
construct the literal through a lifted `let` binding. To handle paths
associated with procedures, however, Chez Scheme's `fasl-write` had
been extended to allow arbitrary values to be intercepted during fasl
and passed back in to `fasl-read`. Using that strategy for all Racket
literals simplifies the implementation and reduces compiled code. It
also makes closures smaller, while increases the number of
relocations. DrRacket's foorprint shrinks by about 1%, but the main
affect is on disk space for a Racket installation.
2020-11-22 06:02:40 -07:00
Matthew Flatt
b2a27ef05c cs & raco decompile: expose more fasl content
Show the machine code that constructs lifted constants for a linket.

Also, add a `--partial-fasl` option that shows fasl content in a rawer
form, which is useful for checking how content is presented and that
nothing is getting lost in other reconstructed views.
2020-11-21 07:26:08 -07:00
Matthew Flatt
a6e683cc71 bc: fix incomplete update for 'os* and 'arch reporting 2020-11-20 15:35:58 -07:00
Matthew Flatt
39d5adc745 system-type: add 'os* and 'arch modes
The 'os* mode is like 'os, but it provides a more specific result for
Unix variants, such as 'linux on Linux.

The 'os* and 'arch modes together are the information that we've
previously accessed indirectly via `(system-library-subpath #f)`.

Closes #3510
2020-11-20 15:11:52 -07:00
xxyzz
153e417862 generate GitHub Action file for raco pkg new 2020-11-20 10:15:26 -05:00
Matthew Flatt
d88ae7911d Chez Scheme: update expected-error test for cp0 repair
Commit 3b7378f071 turns out to have fixed the error message for an
existing tests (that I didn't notice was wrong before).
2020-11-20 07:41:35 -07:00
Gustavo Massaccesi
b9e1294b19 cptypes: add special case for zero? 2020-11-20 00:25:25 -03:00
Gustavo Massaccesi
cdfa80bde9 cptypes: add suport for bignum? 2020-11-20 00:23:29 -03:00
Matthew Flatt
3b7378f071 Chez Scheme: cp0 repair for fx{+,*}/overflow with identity
Using folding approach for `fx+` caused cp0 to convert `(fx+/overflow
x 0)` to `(fx+/overflow x)`, but two arguments are required.
2020-11-19 19:59:03 -07:00
Matthew Flatt
f34ff31aef cs: improve equal-hash-code
Mixing for sequences did not produce enough variety related to the
length of the sequence. For example, '(0 0) and '(0 0 0) and '(0 0 0
0) had the same hash code.
2020-11-19 19:21:34 -07:00
Matthew Flatt
d1a61e5ab5 Chez Scheme: mark fx{+,-,*}/wraparound as safe on good args
Allow cptypes to convert a `fx{+,-,*}/wraparound` call to unsafe if it
proves that the arguments are fixnums (unlike, say, `fx+`, where the
possibility of overflow remains).
2020-11-19 16:56:28 -07:00
yjqww6
6075923a45 add fast path for rename-in 2020-11-19 15:08:54 -07:00
Matthew Flatt
b5a9fbb03d cs: use wraparound functions for hashing
Change hash-code calculations to use `fx+/wraparound` and
`fxsll/wraparound` instead of `#3%fx+` and `#3%fxsll`. The resulting
code should be the same in the default unsafe compilation mode for the
Racket core, but the `wraparound` versions can be checked in safe
mode.

Also, fill in missing tests in Chez Scheme, which exposed cp0 problems
with `fx-/wraparound`.
2020-11-19 12:38:16 -07:00
Matthew Flatt
53c14c78d6 bc: fix C compiler warnings 2020-11-18 18:15:42 -07:00
Matthew Flatt
77ee4bb877 fix read-line-evt on a port that delivers bytes one at a time
Thanks to Javier Vivanco for the report.
2020-11-18 17:39:18 -07:00
Matthew Flatt
128892c996 add fx{+,-,*,lshift}/wraparound
Expose machine-level operations that stay within the fixnum range,
which can be useful for things like hash-code computations where it's
ok to just lose bits. Operations like `unsafe-fx+` turn out to do that
already in the current implementation, but with no guarantee (and with
no checking of arguments).

For Racket BC, before this commit, JIT-inlined `fxlshift` incorrectly
handled a negative second argument like `arithmetic-shift` instead of
erroring.
2020-11-18 17:39:18 -07:00
Matthew Flatt
9a3eb15d8b cs & thread: fix scheduler timer event in atomic mode
When the thread-scheduler timer fires while a thread is in atomic
mode, the thread could check for breaks even when it shouldn't. Worse,
if the atomic region was to implement terminating a thread, the path
to check for a break could end up ressurecting the thread from the
persspective of `thread-dead?`.
2020-11-18 04:10:06 -07:00
kurinoku
3f9f01e520 Fix mutator listing in struct-auto-info. 2020-11-16 12:42:07 -05:00
Matthew Flatt
5656073637 repair mismatch in fixnum mixing
Scheme code and C code did not compute the same result for negative
fixnums for 64-bit machines.
2020-11-14 12:42:34 -07:00
Matthew Flatt
dc82685ce0 fix mutable hash tables for certain likely fixnum distibutions
A mutable hash table only uses the lower few bits of a hash code,
because it masks the hash code by [one less than] the power-of-two
size of the bucket array. That truncation interacts badly with the
hashing function for fixnums, which is the identity function; if the
the lower several bits of the fixnum stay the same for many keys and
the upper bits change, then there are many hash collisions --- and
that's a relatively likely distribution.

Fix the mutable hash-table implementations by mixing the hash code to
let higher bits influence the lower bits: xor the high half of the
bits with the lower half (which doesn't lose information, because
xoring again would recover the original number), then do the same for
the high one-fourth of bits in the low half, and then (on a 64-bit
platform) the high one-eighth of the low one-fourth of the bits.

Instead if blaming the way the mutable hash-table implementations only
use the lower bits of a hash code, we could blame the hash function on
fixnums for not performing this kind of mixing. In this patch, though,
we take the view that the hash function's job is to map variation in
its domain to variation in the fixnum hash code, and then the hash
table's job is to use that fixnum effectively. That separation of
responsibilities is now documented with `gen:equal+hash`.

There are also improvements here to the hashing function for bignums
in CS and to the secondary hashung function for fixnums and bignums in
BC.

Thanks to Alex Harsanyi for reporting the problem.
2020-11-14 10:45:15 -07:00
Matthew Flatt
b37cc53b70 cs: fix {{,fx,fl}vector,string,bytes}-ref error-message rewrite
Fix the ending index, since it's inclusive.

Thanks to Matthias for the report.
2020-11-13 17:37:38 -07:00
Matthew Flatt
78b09313a0 fix Racket bootstrap for Chez Scheme for 32-bit platforms 2020-11-13 11:34:51 -07:00
Matthew Flatt
fcd9e9448c Chez Scheme: improve guidance from configure 2020-11-13 11:34:51 -07:00
Paulo Matos
355d384e3c
Changes required to compile Racket with C99+exts (#3497)
With these changes RacketCS and RacketBC can be compiled with:
     `-std=c99 -D_DEFAULT_SOURCE`

Also added some documentation on contribution guidelines.
2020-11-13 19:34:12 +01:00
Paulo Matos
83e256cce6
Ensure DEST exists before calling find (#3496)
On raw racket clones when compiling with `--enable-racket` (i.e. no
pb), there are `find` warnings that DEST does not exist and
compilation still succeeds.

This change however, ensures that we do not have build warnings and
that the symlinks are properly created.
2020-11-13 14:43:22 +01:00
Matthew Flatt
b33f26415b Chez Scheme: fix double counting of some adminstrative GC overhead 2020-11-12 18:57:09 -07:00
Matthew Flatt
5f4480e39e generics: adjust generated error messages 2020-11-11 12:54:28 -07:00
Matthew Flatt
7975bdf25d traditional Windows directory paths are limited to 247 characters
... not 259 characters, which is the limit on file paths.
2020-11-10 14:53:07 -07:00
Matthew Flatt
23710d5862 cs & io: avoid overlong Windows paths
Convert paths to "\\?\" as needed to avoid the 259-character limit on
a path length.
2020-11-10 14:53:07 -07:00
Matthew Flatt
0342804b18 rktio on windows: fix buffer size for getting OS current directory
Relevant to #3493
2020-11-10 14:00:43 -07:00
Matthew Flatt
aea024736a unbreak cify 2020-11-10 11:31:41 -07:00
Matthew Flatt
1ac6c15207 add #:unsafe option for #%declare
Finally give in and add an option to compile a module as unsafe. This
was going to be easy, since the option already exists at the linklet
level, but it turns out that a lot of plumbing was needed to propagate
the argument, and even more to preserve unsafety with cross-module
inlining.

Macros can effectively conditoinalize their expansion in unsafe mode
by generating the pattern

 (if (variable-reference-from-unsafe? (#%variable-reference))
     <unsafe variant>
     <safe variant>)

The compiler will only keep one of the two variants, because it
promises to optimize `(variable-reference-from-unsafe?
(#%variable-reference))` to a literal boolean. The expander will still
expand both variants, however, so avoid putting code in both variants
that itself can have safety variants.
2020-11-10 10:36:03 -07:00
Matthew Flatt
c85659b905 Chez Scheme: fix compiler bug introduced with unboxing
When simplifying certain expressions, a non-pointer variable was
created to hold a pointer value.
2020-11-09 13:23:39 -07:00
Matthew Flatt
c017ecbafe cs: avoid inlining error path internally 2020-11-09 11:44:12 -07:00
Matthew Flatt
91e3065991 Chez Scheme: fix typo for flvector operation 2020-11-09 11:43:36 -07:00
Matthew Flatt
a17516f5b6 rktio: repair for subprocesses on Unix witthout threads
A list of pending process records was not managed correctly when
interest in a subprocess is abandoned before the subprocess completes.
2020-11-09 09:24:05 -07:00
Matthew Flatt
a0375111a3 Chez Scheme: fix flvector-copy for 32-bit platforms
Closes #3490
2020-11-09 05:55:47 -07:00
Matthew Flatt
fe54cbc63f Chez Scheme: avoid copying huge objects during GC 2020-11-08 19:22:09 -07:00
Matthew Flatt
e40e86ae5a Chez Scheme: unbreak 32-bit build 2020-11-08 05:56:56 -07:00
Matthew Flatt
7a12b4ac93 cs & thread: repair suspending a thread that is currently in sleep
Thanks to Greg Rosenblatt for the report.
2020-11-07 17:35:30 -07:00
Matthew Flatt
7c8d9c6523 bc: avoid bad floating-point roundoff in seconds->date
Thanks, Xsmith!

Closes #3489
2020-11-07 12:52:38 -07:00
Matthew Flatt
09c9901f6b bc: don't drop operations when impersonators can interpose
For example, if the result of `(when (box? x) (unbox x))` is not used,
then the `(unbox x)` still must be done, because the box might be an
impersonator. In contrast, `(when (box*? x) (unbox* x))` can be
dropped, since `unbox*` is an authentic unbox.

This change applies to unsafe operations like `unsafe-struct-ref`,
too, and applies to struct accessors for non-authentic structure
types.

Racket CS already preserves operations appropriately.

Relevant to #3487
2020-11-07 10:53:44 -07:00
Matthew Flatt
1149bb8b2c reader: extend error message for disabled #lang
Try to give more hints to help somone who writes `#lang` twice.
2020-11-07 07:55:20 -07:00
Matthew Flatt
2b7e36b5f4 Chez Scheme: fix version mismatch for install 2020-11-07 07:54:46 -07:00
Matthew Flatt
2b945d12fb Chez Scheme: add flvectors
To make room in the type encoding, remove immutable fxvectors from
Chez Scheme --- which had been added just to go along with immutable
strings, vectors, and bytevectors, but immutable fxvectors do not seem
useful, and they have no counterpart in Racket.
2020-11-07 07:34:33 -07:00
Matthew Flatt
128174594e fix symbol prining with #\uFEFF characters
Since the reader now treats #\uFEFF as whitespace, adjust the printer to
escape \uFEFFa.

Thanks, Xsmith!

Writing an actual #\uFEFF character seems bad, even escaped, but
Racket's symbol syntax doesn't have a kind of escaping that uses
different characters than the one to be represented.

Closes #3486
2020-11-06 12:20:47 -07:00
Matthew Flatt
6b7a184297 bc: fix gcd on most negative fixnum
Xsmith found this fixnum-boundary bug.

Closes #3484
2020-11-05 17:25:30 -07:00
Matthew Flatt
add9ed72c6 bc: sync expander expansion 2020-11-05 17:24:39 -07:00
Matthew Flatt
3db7e471eb cs: faster path for a foreign call with a lock
The call is only slightly faster, but since it affects text drawing
with `racket/draw`, a slight improvement can be worthwhile for
DrRacket.
2020-11-04 16:33:18 -07:00
Matthew Flatt
1aab61340e cs: fix printed name of some fx and fl functions 2020-11-04 15:33:42 -07:00
Matthew Flatt
e50f53e990 cs: reduce allocation on foreign calls with 5-8 arguments
Extend a fast path for up to 4 arguments to work on up to 8 arguments.
2020-11-04 15:22:41 -07:00
Matthew Flatt
18ff816358 cs: performance improvements related to string encoding
Streamline rktio byte-result copying (main improvement), use fixnum
arithmetic more consistently (minor improvement), and change
`in-bytes`, etc., to avoid some checks in unsafe mode (intermediate
improvement).
2020-11-04 11:57:52 -07:00
Matthew Flatt
fc53f2998c normal-case-path: leave bad encoding bytes alone
When bytes within a Windows path cannot be converted using
`bytes->string/locale` (i.e., when the bytes do not fit a UTF-8
encoding), then leave the bytes alone, instead of triggering a failure
from `bytes->string/locale`.

Fixing this bug uncovered others: `string-locale-downcase` did not
work on an empty byte string on a little-endian machine, and
`in-bytes` and similar reported range errors in terms of "vectors".
2020-11-04 10:27:07 -07:00
Matthew Flatt
66ed5369ef Chez Scheme: accomodate new MinGW for 32-bit Windows 2020-11-03 18:09:56 -07:00
Matthew Flatt
5d53bdac0c Chez Scheme: unbreak 32-bit Windows cross-build 2020-11-03 17:32:08 -07:00
Matthew Flatt
06021193ee cs: fix (system-type 'link) 2020-11-03 15:00:55 -07:00
Matthew Flatt
689fa6e2b2 cs: adjust how boot images get to Chez Scheme
Change the way boot images are sent to Chez Scheme by the Racket CS
wrapper, especially in the case where boot images are embedded in an
executable (which is always true for a distriution build). The revised
approach avoids a little filesystem work, and it may help Chez Scheme
pull bytes in faster.
2020-11-03 13:21:24 -07:00
Robby Findler
daf142c1c0 improve the error messages for flat hash/dc contracts 2020-11-03 09:47:43 -06:00
Matthew Flatt
6e917a610e cs configure: add --disable-wpo
Builing Racket CS on a 64-bit platform requires a little more than 1.5
GB of memory due to whole-program optimization of the Racket core
immplementation. Add a `--disable-wpo` configure option, which keeps
memory use below 0.5 MB to provide the option of building Racket in a
more constrained environment.
2020-11-03 08:11:44 -07:00
Matthew Flatt
7ef4ac10d2 Chez Scheme: move C compiler default flags to configure
Instead of selecting flags through a mixture of `configure` and
"c/Mf-*", determine defaults in `configure`. If `CFLAGS` is provided,
then the defaults are not used. Flags needed for threaded mode are an
exception, and `LDFLAGS` and `LIBS` are expanded even if supplied ---
unless `--disable-auto-flags` is specified.

Closes #3467
2020-11-02 21:03:14 -07:00
Matthew Flatt
3553df0246 avoid C compiler warning 2020-11-02 08:33:49 -07:00
Matthew Flatt
0a7c4e2613 bc: fix printing of #:|.| and #:|#|.
Closes #3477

Thanks, Xsmith!
2020-11-01 06:12:31 -07:00
Matthew Flatt
f6a598a116 raco setup: add --sync-docs-only flag
The `--sync-docs-only` flag is intended for contexts like pkg-build as
a backstop against unintended and time-consuming activity when the
intent is to assemble documentation.
2020-11-01 06:12:31 -07:00
Matthew Flatt
741048eebb remove accidentally comitted debugging output 2020-10-30 17:01:43 -06:00
bdeket
8137798937
Improve (sinh x) : x around 0 (#3473)
* sinh - Taylor expansion near 0
* fast path for |z| < 1e-8 in this case the second term is already to small to matter
2020-10-30 12:36:13 -04:00
Matthew Flatt
24bd6abecb cs: _path should not force an absolute path
While sending an absolute path to a foreign library is usually the
right idea to ensure that it's relative to `(current-directory)`, the
`_path` FFI type should not do that automatically --- because
sometimes it's useful to send a relative path to a foreign library,
but most because it hasn't been defined that way in BC.
2020-10-30 08:25:43 -06:00
Matthew Flatt
507454a6d8 rktio: use tm_gmtoff instead of timezone on Linux
Closes #3474

Xsmith discovered that Chez Scheme's use of `tm_gmtoff` is better
thank rktio's use of `timezone`.
2020-10-30 07:10:32 -06:00
Matthew Flatt
de3e22f7a4 bc: fix string downcasing of U+1E9E
In building up conversion tables, information from "SpecialCasing.txt"
data was incorrectly merged with data from "UnicodeData.txt" so that
not-quite-so-special casings were fumbled. For Unicode 7.0, the bug
turned out to affect only string downcasing of U+1E9E.

Closes #3475

Thanks to Xsmith!
2020-10-29 17:32:39 -06:00
Matthew Flatt
dcaa20b411 initialize default locale
Changes to use xlocale fixed problems with places and locale settings,
but it caused the initial process-wide locale to stay with the C
locale, which is bad for things like libedit. To get the good part of
the old behavior bback, set the process-wide locale to "" on startup.
2020-10-29 15:51:08 -06:00
Matthew Flatt
d70a11236f Chez Scheme: fix flonum modulo and remainder
Use fmod() instead of trying to work around imprecision in the naive
algorithm.

Closes #3469

Great catch, Xsmith!
2020-10-27 16:58:55 -06:00
Matthew Flatt
fd2ffe3170 reference: cite Concurrent ML 2020-10-27 16:50:26 -06:00
Paulo Matos
11be8813a2
Fix CFLAGS ordering to ensure users CFLAGS take precedence (#3466) 2020-10-27 13:34:10 +01:00
Matthew Flatt
0b42a143af cs: fix shell-execute error reporting
Closes #3465
2020-10-25 20:06:03 -06:00
Matthew Flatt
c2797c0e9d bc: fix rationals as place messages
When an exact (non-integer) rational is reconstructed from a place
message, normalization could involve bignum operations --- and those
operations might use a cache, but the cache should not refer to the
pages that are specific to a place message being constructed.
Normalization isn't necessary, since the parts were already in a
rational, so the repair is just it skip it.

Relevant to #3456
2020-10-23 15:42:26 -06:00
Paulo Matos
3dc37ee035
Use locale.h if not xlocale.h header (#3461)
Otherwise we have a missing definition for locale_t when
RKTIO_USE_XLOCALE but !RKTIO_USE_XLOCALE_HEADER.
2020-10-23 23:41:41 +02:00
Matthew Flatt
5f8ad6039d cs & io: fix subprocess handling with places
A table of subprocess handles to finalize was not place-local as it
should have been. The same was true of a table of resolved IP
addresses to finalize.

Related to  #3456
2020-10-23 11:22:46 -06:00
Matthew Flatt
fb87a5032c cs: fix exit on catastrophic failure
Actuall exit, instead of calling `exit` with the wrong number of
arguments and generating an endless stream of errors.
2020-10-23 09:10:05 -06:00
Matthew Flatt
9caa0554bc Chez Scheme: fix race in a test 2020-10-23 08:28:55 -06:00
Matthew Flatt
614992a65c Chez Scheme: more repairs to avoid xlocale and an old-compiler warning 2020-10-22 16:57:47 -06:00
Matthew Flatt
0a6b8356c1 Chez Scheme: unbreak parallel GC on Arm
Thanks to @Bogdanp for the report and correct repair idea.

Closes #3455
2020-10-22 22:56:05 +00:00
Matthew Flatt
8734215827 racket/HISTORY.txt for v7.9 2020-10-22 08:38:28 -06:00
Matthew Flatt
d3ef0a0a35 cs & io: fix ~s formatting of keywords 2020-10-21 17:24:03 -06:00
Matthew Flatt
3ce134866b Chez Scheme: repair fasl of deeply nested values
The Racket variant of Chez Scheme includes special treatment of deeply
nested structures to avoid a C-stack overflow on unfasl, but the
relevant callbacks had gotten mangled.

Closes #3454
2020-10-21 13:14:54 -06:00
Matthew Flatt
c3dbc3dd2a Chez Scheme: avoid uselocale on more Solaris
A refinment to a86cf525ef, which moves the no-`uselocale`
declaration to a more reliable place.
2020-10-21 12:11:17 -06:00
Matthew Flatt
279412d316 cs & schemify: fix [non-]loop detection in lifting pass
When a would-be loop is called in a would-be loop that turns out not
to be a loop due to an intervening non-loop layer, the outer would-be
loop was not detected as a non-loop.
2020-10-21 11:42:56 -06:00
Matthew Flatt
5304ff5327 expander: fix malformed linklet
A linklet generated for deserializing syntax objects shadowed a local
variable, which is not allowed.
2020-10-21 11:02:03 -06:00
Matthew Flatt
efbb431a69 cs & schemify: another set! repair
When the mutability decision on a variable is delayed, but then the
variable is discovered to be mutable before the delay is triggered,
then mutability information could get lost.
2020-10-21 09:37:40 -06:00
Matthew Flatt
42a9e26ee9 schemify: fix handling of set! in dead code
Mutability analysis may determine that a `set!` is dead code, and then
the mutated variable might be optimized away, so don't leave the dead
`set!` behind.
2020-10-21 08:45:00 -06:00
Matthew Flatt
1dcabfada7 cs: fix handling of cross-module inline with strange srcloc
When the srcloc-enriched S-expression representation a function that
is available for cross-module inlining has a source that is not a
path, string, or symbol, then the source has to be dropped in the
module's serialized form.
2020-10-21 07:29:40 -06:00
Matthew Flatt
0ed1fc3850 cs & thread: fix atomic mode in callbacks within replace-evt
A nested evt poll did not move back to non-atomic mode when calling
event generators in the first argument of `replace-evt`.
2020-10-21 05:49:53 -06:00
Matthew Flatt
3b34b0ce02 cs: fix printer for symbols containing ; or `
Closes #3448

Thanks again, Xsmith!
2020-10-19 15:26:31 -06:00
Matthew Flatt
6c6cfd39b2 rktio: avoid nl_langinfo_l
Using `nl_langinfo_l` crashes the "unicode.rktl" test on Linux. I
don't know how `nl_langinfo_l` was being misused, but it's easy to
just avoid it.
2020-10-19 09:50:16 -06:00
Matthew Flatt
a86cf525ef Chez Scheme: avoid uselocale on Solaris
Although Solaris 11 and up probably have `uselocale`, just disable its
use in the expeditor on Solaris for simplicity.
2020-10-19 07:43:14 -06:00
Matthew Flatt
7411b7ffa7 rktio: detect and use xlocale 2020-10-19 07:26:40 -06:00
Matthew Flatt
1091536361 remove unneeded mutex acquire 2020-10-19 06:38:35 -06:00
Matthew Flatt
8baf16c093 cs: fix random on 4294967087
On a 64-bit machine, the problem was a `<` versus `<=`.
On a 32-bit machine where 4294967087 is not a fixnum, the
problem was in how bignums are handled.
2020-10-17 17:38:03 -06:00
Matthew Flatt
9f5c0cbb07 cs: fix names of some byte-string primitives
Closes #3441
2020-10-15 18:19:45 -06:00
Robby Findler
1aac750373 add missing paren 2020-10-15 17:12:02 -05:00
Philip McGrath
79fceea024 flat-contract-with-explanation: fix internal error
Previously, `error` would raise an `exn:fail` with the following message,
because it treated the first of the three strings as a format string
and the other two as its arguments:

> error: format string requires 0 arguments, given 2;
> arguments were:
> " is a procedure, to always escape when called"
> " (by calling raise-blame-error with the arguments it was given"`
2020-10-15 17:10:24 -05:00
Matthew Flatt
a471692ce8 raco setup: remove forced GCs and add output timestamps
The main change is to disable forced GCs during the documentation
phase in a parallel `raco setup`. Since each GC is global (instead of
place local) in Racket CS, these forced GCs created a scaling problem.
Furthermore, they're not really necessary; peak memory use tends to
remain the same without them in a parallel build, since the
".zo"-building phase doens't have extra collections and tends to
establish peak memory use.

A non-parallel build still includes explicitly forced GCs. In that
mode, the cost is modest while reducing peak use by 30%.

A new environment variable appends timestamps (in process time since
startup) for each status line, which is useful for generating more
detailed build plots.
2020-10-14 19:25:13 -06:00
Matthew Flatt
927ab67f27 Chez Scheme GC: potentially keep allocation ownership in accounting mode
Since a GC with accounting doesn't run in parallel, it discards
owner-thread information (ironically) that is used for parallel
collection. Losing ownership information could reduce parallelism in
later collections --- but only if they run without accounting.

This commit does not turn on ownership tracking, however, because
experiments suggest that it isn't worthwhile for Racket:

 * Preserving ownership information slows down a major collection in
   accounting mode by 5-10%.

 * Racket uses accounting mode only for full collections, and the loss
   of ownership information would mostly affect only later full
   collections. Since accounting momde tends to stick around, very
   little parallelism is actually lost.

 * Without further work, accounting mode cannot benefit from
   parallelization, because it works by stepping sequentially through
   accounting domains, and that aligns with thread ownership. A
   possible improvement is to look ahead in the accounting-domain
   object sequence to find one that starts in another ownership
   domain, and then constrain concurrent tracing from that object to
   keep the count private and not leave the ownership domain until the
   accounting sequence has caught up.

Besides making it easier to turn on "parallel" collection for
accounting mode, the small refactorings here make it easier to bring
more things, like guardian and weak-pair handling, into the parallel
part of a collection. So, the changes are probably worth keeping for
that purpose.
2020-10-14 11:24:52 -06:00
Matthew Flatt
331a710e22 pretty-print: fix spacing when a symbol includes a newline
Closes #3439
2020-10-13 16:04:18 -06:00
Matthew Flatt
366bdcb9e7 avoid compiler warning 2020-10-12 19:39:32 -06:00
Matthew Flatt
5c45588573 cs: provide hint to GC about places
The collector tries to use roughly the same amount of parallelism as
the number of active threads, but make sure that it doesn't fall back
to an ownership-mangling non-parallel collection if all but one place
happens to be stalled.
2020-10-12 19:24:24 -06:00
Matthew Flatt
449f01b55d Chez Scheme GC: simplify make parallel sweeper object exchange
Make the exchange of objects by parallel sweepers --- which is needed
when an object being swept by one thread refers to an object owner by
another thread --- much simpler and slightly faster.

The original design of exchanging memory regions didn't really work
out, and it had degrenerated to essentially exchanging objects.
Explicitly exchanging objects instead of regions makes the GC simpler,
because received objects can be just added to the regular sweep stack,
and less additional space<->type correspondence is needed.
2020-10-12 18:00:27 -06:00
Matthew Flatt
1a1bad4e90 expander: repair literal syntax in test position of if
Fix mishandling of an expanded `if` where the test position is a
syntax object. The expander's compiler pass from expanded objects to
linkets knows that the syntax object isn't useful, but it tried to be
helpful by preserving the syntax object's content as quoted --- and
that content turns out not to be available, so the syntax object was
replaced by #f, instead.

Closes #3436
2020-10-12 17:58:37 -06:00
Matthew Flatt
82744013d5 cs: unbreak build 2020-10-12 09:35:20 -06:00
Matthew Flatt
3566536cfe cs: more OpenIndiana repairs 2020-10-12 09:17:47 -06:00
Sergiu Ivanov
5cbff3403a
hash.rkt: Add hash-intersect 2020-10-11 13:37:02 -06:00
Matthew Flatt
9905c1c89a cs: fix srcloc->string as relative to current-directory-for-user 2020-10-11 11:40:25 -06:00
Matthew Flatt
59e31e700d more normalization of checked-in schemified code
Rename definitions that are not exported and that are not used as
inferred function names. The rename is based on a hash of the
right-hand side, instead of being just the position of the definition
in the module, and that should help further reduce diffs in schemified
output after small changes to the source.
2020-10-11 10:57:31 -06:00
Matthew Flatt
5691ade54d cs: repairs for building on Solairs / OpenIndiana 2020-10-11 09:04:21 -06:00
Matthew Flatt
77ece3feb0 cs & io: fix 'any line reading mode and buffer boundary
Closes #3434
2020-10-10 20:31:11 -06:00
Matthew Flatt
f1f4959b66 Chez Scheme: separate allocation and thread mutexes
Instead of one big lock, have one big lock and one small lock for just
manipulating allocation state. This separation better reflects the
locking needs of parallel collection, where the main collecting thread
holds the one big lock, and helper threads need to take a different
lock while changing allocation state.

This commit also includes changes to cooperate better with LLVM's
thread sanitizer. It doesn't work for parallel collection, but it
seems to work otherwise and helped expose a missing lock and a
questionable use of a global variable.
2020-10-09 17:45:48 -06:00
Matthew Flatt
274bce975a remove unintended copy of include files 2020-10-09 17:45:48 -06:00
Paulo Matos
67c00aaa7d
Fix ARMv7 build using Thumb-2 (#3431)
This ensures that the moveq instruction is inside an IT block.
Backward compatible change - still builds on ARMv6 with Thumb.

This breakage is generally not noticeable on a RPi3 because, although the
CPU is ARMv7, it is generally running an ARMv6 OS.
2020-10-09 18:10:57 +02:00
John Clements
965fa1a541 Post-release version for the v7.9 release 2020-10-08 11:58:50 -07:00
Matthew Flatt
68bb2a6973 cs: fix cpointer offset handling for C API racket_cpointer_address 2020-10-08 06:48:51 -06:00
Matthew Flatt
20f087af92 Chez Scheme: add C API functions for records and record types 2020-10-07 18:41:20 -06:00
Paulo Matos
c5e3de2a7b
Add option to enable asan compilation in CS: --enable-asan (#3428)
Add workflow `ci-asan.yml` to test CS with ASAN as well.
2020-10-07 17:18:56 +02:00
Paulo Matos
0834d28d75
Remove assignment typo (#3429) 2020-10-07 14:38:45 +02:00
Alex Knauth
003ac9b338
add keyword-apply/dict to racket/dict (#2592)
* add keyword-apply/dict to racket/dict
* add history note
2020-10-07 01:11:02 -04:00
Matthew Flatt
c471e3192b cs: fix typo in dump-memory-stats error message 2020-10-06 19:23:17 -06:00
Matthew Flatt
716e6d9435 Chez Scheme GC: fix interaction of backtrace and incremental promotion
Disable incremental promotion when backreferences are enabled,
otherwise the backreference list for a generation can have
references to younger-generation objects.
2020-10-06 15:10:29 -06:00
Paulo Matos
8a14d31f06
Fix compiler warning in 32bits due to size mismatch in ptr cast (#3427)
Casting a ptr to an integer of a different size causes a warning - this is only noticeable on 32bits. Fix this by using `TO_VOIDP` and `TO_PTR` helper macros.
2020-10-06 14:36:53 +02:00
Matthew Flatt
da6fd94fe1 expander: fix module cache when current-load-relative-directory is #f
Corrects a problem with 4525c231a7.
2020-10-05 14:15:52 -06:00
Sam Tobin-Hochstadt
73053d7a60 Disable implicit for-clause optimization with syntax property.
Related to #3396.
2020-10-05 13:29:52 -04:00
sorawee
812339a04b
reqprov: fix disappeared-use
This PR fixes two issues regarding disappeared-use in reqprov.rkt

1. Copy/preserve disappeared-use for all provide subforms instead
of only the first one. The following program doesn't have an arrow from
`struct-out` to `#lang racket` prior this PR, but it does after this PR.

    #lang racket
    (provide a? (struct-out a))
    (struct a ())

2. Fix incorrect `disappeared-use` for `struct-out`: it is inappropriate
to check if an identifier is bound to a struct info in provide
pre-transformer because it would not be able to handle backlinks.
This PR moves the attachment from provide pre-transformer to provide
transformer, allowing Check Syntax to draw an arrow for the identifier
`abc` in:

   #lang racket
   (provide (struct-out abc))
   (struct abc ())
2020-10-05 10:13:43 -06:00
Matthew Flatt
2a66eddcc9 schemify: fix undefined checking when constants no enforced
Related to #3325
2020-10-05 08:33:10 -06:00
Matthew Flatt
4d8851d1be rktio: add support for xlocale
Add support for using xlocale's thread-friendly API instead of
setlocale --- but it's not turned on, yet, for any platform.
2020-10-04 06:32:15 -06:00
Matthew Flatt
4525c231a7 expander: make cache accomodate optional directory path terminator
The cache is sensitive to `current-load-relative-directory`, but
normalize with `path->directory-path`.
2020-10-03 16:29:53 -06:00
Matthew Flatt
629153c4e0 Chez Scheme GC: repair for locked object in space_new 2020-10-02 17:22:27 -06:00
Matthew Flatt
cb50bab726 unbreak Windows CS build 2020-10-02 12:21:34 -06:00
Matthew Flatt
19fc04ae0e makefiles: clean out unused Git submodule targets and hooks 2020-10-02 11:17:34 -06:00
Matthew Flatt
6b4f9d6885 Chez Scheme GC: improve heap checking
Handle marked segments and check dirty bytes (for generational GC)
for typed ojbects.
2020-10-02 11:17:34 -06:00
Matthew Flatt
53ef242889 fix arity exception for a keyword procedure
Closes #3416
2020-09-30 08:05:19 -06:00
Paulo Matos
5db75a92ae
Small fixes to enable LTO compilation (#3418)
Small fixes to enable LTO compilation

To do this in racket/src:
  ./configure CFLAGS="-O3 -march=native -flto"
              LDFLAGS="-O3 -march=native -flto"
              --prefix=...

One fix deals with variable `errnum` that might be used uninitialized.
The other is to ensure that `boot_file_data` is marked as used
otherwise, it is removed by LTO and ends up crashing build
in `embed-boot.rkt`.
2020-09-30 15:44:13 +02:00
Matthew Flatt
838b4e7896 rackt/unit: add some missing syntax-track-origins 2020-09-29 20:17:36 -06:00
Matthew Flatt
46a191df03 expander: fix srcloc tracking for set! on rename transformer 2020-09-29 14:08:17 -06:00
Matthew Flatt
c7e6cbc001 cs: more repairs for old vector-based HAMT
Fix `hash-map` and `hash-for-each` for applicable structs.
2020-09-29 09:50:29 -06:00
Matthew Flatt
58deff8b6f cs: repairs for old vector-based HAMT
Sync the old implementation with some repairs for `equal?/recur` and
key replacement.
2020-09-29 08:38:35 -06:00
Matthew Flatt
c4df79b38d cs windows: add dependencies on petite.so and scheme.so
Originally, the dependency was expressed via "compile-file.ss", but
now the dependency can be more direct.
2020-09-28 19:15:33 -06:00
Matthew Flatt
075048409b bump version 2020-09-27 15:36:40 -06:00
Matthew Flatt
b203c52193 Chez Scheme GC: keep per-thread allocation more separate
Instead of having leftover Scheme threads swept by the main thread,
distribute Scheme threads among sweeper threads, and swap into each
thread's content to preserve its allocation ownership. This change
makes parallelism more consistent for different timings that end up
assigning sweepers differently.
2020-09-27 15:36:40 -06:00
Matthew Flatt
16d71ac249 Chez Scheme GC: refactor thread and allocation organization
Move per-thread allocation information to a separate object, so the
needs of the collector are better separated from the thread
representation. This refactoring sets up a change in the collector to
detangle sweeper threads from Scheme threads.
2020-09-27 15:36:40 -06:00
Matthew Flatt
c46e4f91c1 Chez Scheme GC: internal parallelism by messages instead of locks
Change the internal parallelism strategy for the GC to record an owner
for each allocated segment of memory, and have the owner be solely
responsible for copying or marking objects of the segment. When
sweeping, a collecting thread handles references to objects that it
owns or that have been copied or marked already, and it asks another
collecting thread to resweep an object that refers to objects owned by
that that thread. At worst, an object ends up being swept by all
collecting threads, one at a time, but that's unlikely for a given
object.

The approach seems likely to scale better than a lock-based approach,
even the one that used a lightweight, CAS-based lock and retries on
lock failure.
2020-09-27 15:36:40 -06:00
Gustavo Massaccesi
4fdc896412 fix typos in linklet.sls 2020-09-26 10:49:09 -04:00
Robby Findler
515012525c improve value-contract handling a little bit
That is, use pairs on the property in more places, as the pair
already was computed and the value-blame function already does
the needful when it sees a pair on the property.
2020-09-24 17:18:27 -05:00
Robby Findler
816e20b803 fix bug in ->i (neg party was getting dropped) 2020-09-24 17:18:27 -05:00
xxyzz
659741bb58
bc: declare interntional unsafe fixnum arithmetic
Eliminate overflow errors from fixnum test when racket bc compiled with
--enable-ubsan (issue #2314)
2020-09-22 07:57:32 -06:00
Matthew Flatt
d24cbd4344 Chez Scheme GC: faster record type handling
When the GC needs to copy/mark a record, it previously forced a
copy/mark on the record's type descriptor, since the copy/mark needs
information from the descriptor. But the needed information is not in
danger of being overwritten for forwading (since it's after the first
two words of the type descriptor), so it's ok to use the old reference
as-is --- at least in non-counting mode. Simplifying record-type
handling and deferring the record-type update to the sweep phase, the
same as for other components of the record type, makes the GC slightly
faster.
2020-09-22 07:52:13 -06:00
Matthew Flatt
54367de430 Chez Scheme GC: fix overhead tracking 2020-09-20 07:25:51 -06:00
Matthew Flatt
024cc90813 Chez Scheme: avoid MinGW warnings 2020-09-19 11:36:56 -06:00
Matthew Flatt
fa3b0699d3 Chez Scheme: sync pb
Also, improve internal timing instrumentation for parallel GC.
2020-09-19 11:36:56 -06:00
Matthew Flatt
4ee149d226 Chez Scheme GC: add ephemeron checking to parallel phase 2020-09-19 11:36:46 -06:00
Matthew Flatt
7738499c70 Chez Scheme GC: move dirty-sweep phase to parallel
The dirty-sweep phase handles old objects that have references to
objects that are in generations about to be collected.
2020-09-19 07:10:02 -06:00
Matthew Flatt
8f08a9ee5c cs: fix srcloc path conversion on load with no current-load-relative-directory
Fall back to `current-directory` when `current-load-relative-directory`
is #f.

This change also affects `deserialize` --- not because byte code
loading uses it directly in this case, but because they share a helper
function, which exposes the issue. This implementation change is
worrying (even though it makes the implementation match the
documentation), but unless we discover that some use of serialization
needs absolute paths deseialized as relative, is seems better to be
consistent everywhere about falling back to `currenrt-directory`. This
aspect of the change can be reverted separately (by adding more code)
if needed.

Closes racket/drracket#421
2020-09-18 14:36:48 -06:00
Matthew Flatt
1766cba6c6 cs: repair sync on empty byte-string port 2020-09-16 20:03:28 -06:00
Matthew Flatt
60b2f8e0c2 CS: fix continuation-mark-set->context results
Return function names as symbols instead of strings.

Closes #3398
2020-09-15 15:43:34 -06:00
Matthew Flatt
a74a30ee8d cs: fix supression of built-in functions in traces
Repairs 0ae3ef7b42 after the number representing the static
generation changed.
2020-09-15 15:33:49 -06:00
Matthew Flatt
c1f62ae959 Chez Scheme: fix intern of some symbols on startup
Closes #3399
2020-09-15 15:19:12 -06:00
Sorawee Porncharoenwase
cb723ad4c8 info: recognize by binding
Prior this PR:

    #lang info
    (list 1)

is accidentally considered well-formed.
This PR fixes the problem.
2020-09-15 10:45:50 -06:00
sorawee
6366874ecd
for: optimize literals
Closes #883
2020-09-15 10:43:57 -06:00
Matthew Flatt
8305e5eaef Chez Scheme: parallel garbage collection
All allocation is now thread-local, which recovers a small bit of
performance that was lost when adding thread-local allocation
alongside global allocation.

Parallelism uses thread contexts created by Chez Scheme threads (which
correspond to Racket places and future-running threads), but it
creates its own OS-level threads to perform collection. The number of
collection-helper threads is limited to the number of active Chez
Scheme threads. Only the main "sweep" pass runs in parallel --- that
is, after roots have been traversed, and before weak references and
finalization are handled --- but that's the bulk of collection work.
Also, memory-accounting collections always run as single-threaded.
2020-09-15 07:40:13 -06:00
Matthew Flatt
78fedb3b24 Chez Scheme: tweak segment test for double-pair copying 2020-09-15 07:23:54 -06:00
Matthew Flatt
f1e5f38a77 Chez Scheme: fix reducing maximum generation
Adjust recent changes to cooperrating with setting
`maximum-collect-generation` to a smaller value.
2020-09-06 06:22:41 -06:00
Matthew Flatt
78b7cc3fc9 cs: use thread-local allocation while sweeping in collector
This is a second step toward parallel collection.
2020-09-05 17:22:12 -06:00
Matthew Flatt
3f3cf5ab83 cs: more thread-local allocation
Improved support for thread-location allocation (and using more
fine-grained locks in fasl reading) may provide a small direct
benefit, but the change is mainly intended as setup for more
parallelism in the collector.
2020-09-05 08:47:07 -06:00
Matthew Flatt
b9e4b5dbb1 makefiles: enable ".boot" files in non-cross CS builds on Windows
There's a trade-off between keeping the distribution sizes small and
making ".boot" files available for convenient embedding, even though
embedding is relatively rare. For Unix platforms, since you have to
build from source to get a static library for embedding anyway, we'll
leave out ".boot" files. For Mac OS, the distribution's "Racket"
framework includes ".boot" files --- even though the framework is
itself unused for a normal distribution build, since signing and
notarization are handled by embedded the boot files in an executable,
but the framework was kept for a kind of backward compatibility. For
Windows, the Racket DLL can be used for embedding, so the ".boot"
files would be the only missing piece; also, they were already
included in a cross-built distribution.

Update "Inside" to note that ".boot" files must be built on Unix and
to clarify the location of ".boot" files on Mac OS.

Closes #3377
2020-09-03 07:31:01 -06:00
Matthew Flatt
3f0631116a Chez Scheme: improve repair for arm32 return-address reference
Since the offset is always a multiple of 4, expand the range of
compactly encoded offsets.
2020-09-03 06:46:46 -06:00
Matthew Flatt
f5895ebc97 Chez Scheme arm32: avoid bouncing in label-address assignment
The A32 instruction set has an interesting encoding of immediate
values where a larger value sometimes fits in a smaller set of
instructions. That turns out to be a bad property for loading a return
address, because it means that the as label computations push code
further away, a contracting return-address calculation can pull code
back nearer, and this push-and-pull can keep the label allocator from
arriving at a fixpoint.

This became a bigger problem with 8834597c1f, which creates
return-label references that go backwards and where the offset can be
much larger than the normal, forward references.
2020-09-02 18:37:15 -06:00
Ryan Culpepper
5c0d75fa3e datum: always force promise 2020-09-02 20:21:44 +02:00
Ryan Culpepper
45fb9b4d63 make datum variable in syntax template an error
Previously, a datum variable was treated as a constant.
2020-09-02 20:21:44 +02:00
Ryan Culpepper
25142daea5 change datum to work with syntax variables too 2020-09-02 20:21:44 +02:00
Matthew Flatt
bf1d99d9e0 expander: repair prompt that should be a barrier 2020-09-02 07:54:38 -06:00
Matthew Flatt
8ca49775b4 improve docs on issues with for bindings
See #3378: The possibility of mutation should be considered in
`:do-in` in somme rare cases, while it's not clear that there's
anything better to be done for mutation of the list accumulators in
`for/lists`. At least make the pitfalls clearer in the documentation.
2020-09-01 19:02:42 -06:00
Matthew Flatt
fb9bd97844 for/lists: repair body handling
Closes #3375
2020-09-01 19:02:42 -06:00
Matthew Flatt
f90b1f21bf makefile: more fixes for install of include files on Windows 2020-08-31 20:16:58 -06:00
Matthew Flatt
ba5cbaf2e2 Chez Scheme and rktboot: adapt to work with latest nanopass
This commit doesn't update nanopass itself, but adapts `rktboot`
so it can be used with the main Chez Scheme bbranch. It also
adjust "cpnanopass.ss" to avoid different behavior between the
old and newer versions of nanopass.
2020-08-31 12:48:10 -06:00
Matthew Flatt
60e6989620 Chez Scheme: further improve memory-use reporting
Remove counts for more GC-time administrative structures (counting
them only in the overhead).

Related to #3338
2020-08-31 12:46:37 -06:00
Matthew Flatt
c75d8d71c1 cs makefile: fix cross-compilation dependency 2020-08-31 08:59:25 -06:00
Matthew Flatt
ef9a4a4e29 cs makefiles: fix cross install for Windows to install include files
Closes #3374
2020-08-31 08:33:24 -06:00
Matthew Flatt
8834597c1f Chez Scheme: fix continuation on result-count exception
The Scheme stack pointer was left in call state when the number of
results is wrong, with the intent of exposing the enclosing function's
frame for debugging purposes, but there's no guanrantee that the
result address is still on the stack (i.e., the continuation make have
been captured). Reinstall the return address before calling the
exception handler.
2020-08-31 07:18:26 -06:00
Matthew Flatt
b83e598b20 makefile: fix gractketcgc dependency
This change was meant to be part of 979fbf551d.
2020-08-30 09:12:51 -06:00
Matthew Flatt
f1b98900f5 rumble: fix misuse of fx=
Looks like I previously changed the wrong `eq?` to `fx=`.
2020-08-30 09:11:40 -06:00
sorawee
6a685f52c6
track disappeared-use for case's else
Closes #3363
2020-08-29 06:21:05 -06:00
Matthew Flatt
c95775641d expt: improve for flonum base and exact integer exponent
Avoid coercing an integer to a flonum when doing so loses
precision. It's especially helpfu lto preserve oddness
versus evenness.

Closes #3360
Closes #3100
2020-08-28 16:18:46 -06:00
Matthew Flatt
f086075093 ffi/unsafe: fix _bitmask in non-application position
The exported `_bitmask` is a macro that picks up a compile-time name
when available, but the macro expanded inconsistently.

Closes #3367
2020-08-28 14:28:01 -06:00
Matthew Flatt
0ae3ef7b42 suppress built-in functions in stack traces
Experiment with removing built-in Racket functions in stack traces to
make the trace less noisy. "Built-in" is defined as code that exists
in the built-in modules. On CS, built-in code is detected as residing
in the static generation. (Also, on CS, the code must have a name but
no source location or detailed debugging information to be
suppressed.) On BC, a code object has a bit set if it's loaded at boot
time.

This change makes stack traces look more like Racket BC traces before
the macro expander was implemented in Racket. The frames for built-in
functions have been useful for implementing the expander and Racket
CS, but probably they're just noise for most users most of the time.

Set the `PLT_SHOW_BUILTIN_CONTEXT` environment variable to preserve
all available frames in the stack trace.
2020-08-28 13:01:47 -06:00
Matthew Flatt
95812bd7a5 cs: repair decoding of method names in stack traces 2020-08-28 11:05:15 -06:00
Matthew Flatt
a22550a963 prefer XDG paths, but fall back to old paths
Use "~/.racket" for 'pref-dir if it exists and "~/.config/racket"
doesn't, for example.

Based on discussion at #3268, especially with Ryan.
2020-08-28 09:26:40 -06:00
Ryan Culpepper
f52bff8a31 use XDG paths
'pref-dir = ${XDG_CONFIG_HOME:-~/.config}/racket/
 'pref-file = (build-path (find-system-path 'pref-dir) "racket-prefs.rktd")
 'addon-dir = ${XDG_DATA_HOME:-~/.local/share}/racket/
 'init-dir = ${XDG_CONFIG_HOME:-~/.config}/racket/
 'init-file = (build-path (find-system-path 'init-dir) "racketrc.rktl")
 'cache-dir = ${XDG_CACHE_HOME:-~/.cache}/racket/

... except actually the "~" uses PLTUSERHOME if set.

Use cache-dir as default "download-cache" parent dir.

related to #2740
2020-08-28 08:19:56 -06:00
Matthew Flatt
979fbf551d makefile: fix some dependency tracking
Add cm-accomplice tracking to the expander extractor, so changes to
"rktio.rktl" are picked up for "io".

Fix GRacket BC dependencies on rktio.
2020-08-27 17:41:02 -06:00
Matthew Flatt
d280462250 reader: treat BOM like whitespace in places where comments are allowed
Some text-editing tools on Windows include a BOM character (encoded)
at the start of a file that is intended as UTF-8. The general
recommendation for UTF-8 is to *not* include a BOM --- but, well,
Windows. When a BOM is there, meanwhile, the recommendation is to
preserve it in the stream, so always discarding an initial BOM at the
file-port level is not a good idea. A new file mode would make sense,
but distinctions like 'text and 'binary mode have turned out to be
best avoided.

Although I'm not sure it's really a good idea, treating a BOM
character as whitespace in the reader (at least in comment positions)
is an easy way around the problem for text files that are intended as
programs.

Closes #1114
2020-08-27 16:59:08 -06:00
Matthew Flatt
ace1c6a128 Mac OS: add libedit to the set of native libraries
The libedit library supplied by Mac OS is old and does not support
Unicode, so include a build that does support it.
2020-08-27 12:14:56 -06:00
Matthew Flatt
e5899bd3e6 cs: initialize locale on startup
The `current-locale` parameer value is transferred to the C lbrary via
`setlocale` on demand by Racket functions that depend on the locale,
but some libraries (like libedit) can also depend on the locale
setting. By default, the C library starts with the "C" locale, so it's
worthwhile to install the default locale on startup, even if that's
not a complete solution to support changes to `current-locale`.
2020-08-27 10:47:41 -06:00
Matthew Flatt
38570e3ea6 improve unsafe-linklet error message 2020-08-26 06:18:04 -06:00
Bogdan Popa
1177112970
rktio: get CPU count from the OS on FreeBSD and OpenBSD 2020-08-26 06:17:40 -06:00
Sorawee Porncharoenwase
66547f3aaf Change else in match to _
This fixes at least one "potential" bug in the file
`collects/pkg/private/create.rkt`, where `else` in the
`cond` is bound to `else` from `match` instead of `racket/base`.
(though it turns out that the format will always be
truthy, making the program happen to be correct.)
2020-08-25 09:37:02 -06:00
bdeket
6edc3dbfab gracket/gc2 makefile
Without this change, the below build fails for me.
This reflects the GRACKETLDFLAGS in the makefile one folder above. However I have no idea if this has wider implications...
```
mkdir build
cd build
..\configure --enable-bcdefault
make
```
2020-08-25 09:07:56 -06:00
Matthew Flatt
80ad628eef cs: avoid Chez Scheme fasl of immutable hash table
Change the ".zo" format to convert a linklet bundle hash table to a
list, which avoids probblems with stencil-vector encodings and cross
cimpilation between 32-bit and 64-bit platforms. Avoiding records,
stencil values, and hash code should make the fasled form simpler.
2020-08-23 20:20:07 -06:00
Matthew Flatt
b164f16681 compile-directory-zos: improvements for skip-path[s] and info 2020-08-23 19:34:55 -06:00
Matthew Flatt
b1aee01b8c cs: fix cross-compile depdency tracking 2020-08-23 19:34:55 -06:00
Matthew Flatt
1f18530719 cs: repair boot-reset linking for cross compiles 2020-08-23 19:34:55 -06:00
Matthew Flatt
71bf119460 Chez Scheme: repair pseudo-random for cross compile 2020-08-23 19:34:55 -06:00
Matthew Flatt
8d96a758d0 cs: support cross compile for Arm Linux 2020-08-23 19:34:55 -06:00
sorawee
a5b69b6594
Make struct* use static struct field information
This PR is largely based on #732

Fixes #3265
Closes #732
2020-08-21 05:47:07 -06:00
Mauer-Oats
da5f77e277 add guards to two uses of seen 2020-08-20 18:42:28 -06:00
Bogdan Popa
d259596a35 pkg: deduplicate dependency list for install command 2020-08-20 18:37:37 -06:00
Matthew Flatt
20cac0056c fix 32-bit ARM barrier preprocessor conditional 2020-08-20 08:58:00 -06:00
Matthew Flatt
ee467fbbb4 pb interpreter: work around old compiler bug 2020-08-20 08:51:36 -06:00
Matthew Flatt
9bde4bc009 update some native-lib build notes 2020-08-20 07:48:15 -06:00
Matthew Flatt
85f3e9f5cb arm32: using ARMv6 memory fence 2020-08-20 07:34:56 -06:00
Matthew Flatt
7a373de4cb Chez Scheme: repair ptr <-> void* conversions for pb on 32-bit 2020-08-20 06:46:23 -06:00
Matthew Flatt
1260f888c9 Chez Scheme: add test case for recent continuation GC repair 2020-08-19 09:04:21 -06:00
Matthew Flatt
2742962988 update "racket/src/native-libs" scripts
Repairs for tool drift and over-specific patch rules.
2020-08-18 16:40:44 -06:00
Robby Findler
afb68b29d4 improve contract0stronger? for between/c vs integer-in 2020-08-18 14:28:26 -05:00
Matthew Flatt
7d8a95a943 for/set: same body handling as for/list, etc.
Change `for/set` to use `split-for-body`. Also, adjust the
documentation of `for/fold/derived` to recommend using
`split-for-body`.

Closes #3351
2020-08-16 16:41:38 -06:00
Matthew Flatt
413106413d cs configure: use strip -S on racket with --enable-embedfw on Mac OS
Closes #3349
2020-08-16 16:00:38 -06:00
Matthew Flatt
4a4e12bc8c cs: repair register-finalizer-and-custodian-shutdown
Refine the approach in 91abd020d1 so that it's only used when needed
to work for the combination of custodian management and unsafe
finalization.

Also, improve the documentation to clarify the constraints on
`register-finalize` due to its implementation in CS by ordered
finalization. This constraint is also reflected in a new `#:ordered?`
argument to `register-custodian-shutdown`. Any existing code that uses
`register-custodian-shutdown` plus `register-finalizer` directly
instead of `register-finalizer-and-custodian-shutdown` would need to
be updated for Racket CS, but code like that should be rare to
nonexistent.

Closes #3352
2020-08-16 07:37:22 -06:00
Matthew Flatt
bf06162210 cs: revert custodian change that creates a leak
Reverts the repair attempt in 91abd020d1. The problem with switching
to a "late" reference is that it's based on ordered finalization in
Racket CS, which doesn't work on values that can refer back to
themselves.
2020-08-16 06:29:18 -06:00
Matthew Flatt
f42ddd2853 cs: scale GC trigger by number of running places
Since all places share the same pool of memory, scale the
amount of memory allowed before trigger a (minor) GC by
the number of running processes.
2020-08-15 19:29:32 -06:00
Matthew Flatt
e47260cb36 cs: fix memory accounting for large objects 2020-08-15 18:46:00 -06:00
Matthew Flatt
a2bc613a4c cs configure: improve propoagation of LIBS
Propagate `LIBS` to rktio's configure, and also move some flags in
`LIBS` that should be in `LDFLAGS`. The immediate result is to repair
the detection of iconv for rktio on FreeBSD.

Closes #3353
2020-08-15 16:22:28 -06:00
Matthew Flatt
61f701dcff io: avoid atomic-mode crash when locale converter is not available
Related to #3353
2020-08-15 16:11:24 -06:00
Matthew Flatt
91abd020d1 cs: allow unsafe finalizers on managed objects
Change the regular weak reference in a custodian, which allows
`will-executor`-based finalization, to a "late" weakk reference, which
allows both `will-executor` and `register-finalizer` finalization.

Closes #3352
2020-08-15 12:58:29 -06:00
Matthew Flatt
0f530dd9f4 cs: fix custodian callbackks to run on exit
Related to #3352
2020-08-15 12:58:29 -06:00
Matthew Flatt
c96673d198 Chez Scheme: repair for MinGW 2020-08-15 12:58:29 -06:00
Matthew Flatt
57be9a7702 fix FORCEINLINE for MinGW 2020-08-15 07:49:07 -06:00
Matthew Flatt
5894550833 makefile: adjust pb fetch for older git clients
Use `git fetch -q origin $(PB_BRANCH):remotes/origin/$(PB_BRANCH)` to
make sure a `remotes` branch is added locally.
2020-08-15 07:46:11 -06:00
Matthew Flatt
9619205a9d cs: update Rumble layer for incremental promotion in GC 2020-08-14 17:43:54 -06:00
Matthew Flatt
3aa2d99000 repairs to initial merge of incremental promotion of objects 2020-08-14 17:43:54 -06:00
dyb
48487ed6fb Added support for incremental promotion of objects
- the collector now promotes objects one generation higher at a time
  by default.  previously, it promoted every live oldspace object to
  the selected target generation, which could result in objects
  prematurely skipping one or more generations and thus being
  retained longer than their ages justify.  the biggest cost in
  terms of code complexity and performance is the recording of
  pointers from older newspace objects to younger newspace objects
  that could not previously occur.
    gc.c, alloc.c, externs.h
- the collect procedure now takes an additional optional minimum
  target generation argument to allow the new default behavior to
  be overridden.
    7.ss, primdata.ss,
    gcwrapper.c,
    7.ms, root-experr*,
    smgmt.stex, release_notes.stex
- added cn flag to control collect-notify
    mats/Mf-base
- resweep_weak_pairs now sets sweep_loc to orig_next_loc rather than
  first_loc since the latter could result in unnecessary sweeping of
  existing target-generation weak pairs.
    gc.c
- added set of S_child_processes[newg] to S_child_processes[oldg]
  in S_do_gc code handling decreases in the maximum generation.
    gcwrapper.c
- a specialized variant of the collector is used in the common case
  where the max copied generation is 0, the min and max target
  generations are 1, and there are no locked generation 0 objects
  is now used. with the default collection parameters and no locking
  of generation 0 objects, these collections account for 3/4 of all
  collections.
    gc.c, gc-011.c (new), gcwrapper.c, externs.h, c/Mf-base
- maybe-fire-collector no longer tries to be so precise and instead
  just counts the number of generation-bytes allocated since the
  last gc.  suprisingly, rebuilding the s directory requires about
  the same number of collections with this coarser (and less
  expensive) measurement.  this change also fixes a problem with
  too-frequent collections when the maximum-generation is set to
  zero.  to make the determination even less expensive, a running
  total of bytes in each generation is now maintained in a new
  bytes_of_generation vector, and maybe-fire-collector is no longer
  called when the collector is running.
    alloc.c, gc.c, gcwrapper.c, globals.h
- copy now copies two pairs at once only if they are in the same
  segment, which saves a few memonry references and tests and turns
  out not to reduce the number of opportunities significantly in
  tested programs.
    gc.c
- occupied_segments, first_loc, base_loc, next_loc, bytes_left,
  bytes_of_space, sweep_loc, and orig_next_loc are now indexed
  by [g][s] rather than [s][g] to improve locality in the default
  (and common) case where there are only a handful of active
  generations.
    globals.h, types.h, segment.c, gc.c, gcwrapper.c, prim5.c
- now maintaining 16-byte architectural stack alignment (if the
  incoming stack is so aligned) on all x86 platforms except
  i3nt/ti3nt.  more recent versions of gcc sometimes generate sse
  instructions that require 16-byte stack alignment.
    x86.ss

[Merge for Racket includes additional changes to combine with in-place
 marking - mflatt]
2020-08-14 17:08:04 -06:00
Matthew Flatt
45a84dcb97 schemify: drop variable names that are unused for errors
Using just a number makes the code smaller, and it makes the
checked-in ".scm" vary less going forward.
2020-08-13 16:04:20 -06:00
Matthew Flatt
be6312314b cs: check linklet imports when a procedure is expected 2020-08-13 15:52:45 -06:00
Matthew Flatt
ab1b164982 cs ffi: fix handling of struct results 2020-08-13 13:54:10 -06:00
Matthew Flatt
1e91db8053 raco setup: add debug logging to report available concurrency 2020-08-13 13:54:10 -06:00
Jesse Alama
b722d81059
Remove dead store identified by a static analyzer (#3341)
Evaluate to_quoted, possibly for side effect (emitting a
quote), but ignore its return value.

Co-authored-by: Jesse Alama <jesse@lisp.sh>
2020-08-11 19:11:54 +02:00
Matthew Flatt
543dab5964 cs: fix iteration on copy of a mutable hash table
Incorrect initialization of the copy's iteration state for a hash
table meant that table sizes larger than 32 looked like tables of only
32 elements when iterating (including when printing).

Closes #3344
2020-08-09 15:51:39 -06:00
Matthew Flatt
4f0290186b cs: fix optimizer bug
An optimization pass used mostly for inlining did not reqcognize
`quote`, and it could replace a quoted name with a constant-propagated
value.

Closes #3339
2020-08-08 13:03:40 -06:00
evdubs
980a9fbd4d Ensure sorting is applied for in-directory
In initial-state, the call to dir-list will sort the results of directory-list. However, in initial-state, there is a different path that will call directory-list without sorting. This change makes these paths consistent.
2020-08-07 07:59:00 -06:00
Matthew Flatt
776b69e399 avoid race on places and initialization for eval
Force visits on internal Chez Scheme modules before starting a place,
so that there won't be a race among places to visit the modules.
2020-08-07 07:19:58 -06:00
Fred Fu
e4dc27a2b8 fix typos in comments 2020-08-06 16:29:58 -06:00
Matthew Flatt
581f02d6f8 expander: fix make for generating BC source
Also, update "README.txt" to explain both CS and BC setup.
2020-08-06 14:09:53 -06:00
Matthew Flatt
06ed5bf8f5 cs gracket: unbreak zero-argument case on Unix 2020-08-06 07:45:19 -06:00
Matthew Flatt
6317669f51 cs gracket: fix handling of X11 flags and -singleInstance
X11 flags and -singlreInstance were being filtered from the command
line but not propagated to the `racket/gui`.
2020-08-05 18:01:21 -06:00
Matthew Flatt
65b69a91e5 add needed store fence in list-bits management 2020-08-05 06:25:12 -06:00
Paulo Matos
342e95cf32
Fix variable replacement (#3337)
By using `{$threadLibs}` it meant we ended up with a command line with `{hreadLibs}`, which breaks the arm32le build.
2020-08-05 14:10:17 +02:00
Matthew Flatt
29a6ca6737 Chez Scheme: increase FP registers for x86_64 2020-08-05 05:55:28 -06:00
Matthew Flatt
2b73b20704 Chez Scheme: on Arm64, implement popcount with CNT and ADDV
Initial measurements suggest that performance is unchanged, but it
at least generates less code.
2020-08-05 05:55:28 -06:00
Matthew Flatt
204d9d6f01 Chez Scheme: increase available registers on Arm64 2020-08-05 05:55:28 -06:00
Matthew Flatt
744e69c0c1 add flsingle
The `flsingle` function takes a flonum and discards precision that
wouldn't fit in a single-flonum. If single-precision arithmetic is
somehow useful, then combine flonum operations with `flsingle` to
discard precision on the result; even on Racket BC, that's likely to
perform better than using generic arithmetic on single flonums.
2020-08-05 05:55:28 -06:00
sorawee
dcf034280e
Preserve multivalued-ness of stream in stream operations 2020-08-04 07:02:40 -06:00
Sorawee Porncharoenwase
e2b8fdb553 cs: change multiple values mismatch error to match bc
Related to #3325
2020-08-04 06:53:11 -06:00
Jay McCarthy
09ff1344e8 git-checkout display repo on error 2020-08-03 10:30:11 -04:00
Matthew Flatt
fcd7295457 remove uuid lib from linking specs 2020-08-03 05:37:27 -06:00
Matthew Flatt
2d0961adcf avoid dependency on libuuid by using /dev/urandom on non-Windows 2020-08-02 18:33:13 -06:00
Matthew Flatt
2cca030eff Chez Scheme: fix tests to work outside of source directory 2020-08-02 18:30:43 -06:00
Matthew Flatt
b32b3178bc raco: recognize racobc when trying to distinguish from setup-plt 2020-08-02 14:58:51 -06:00
Matthew Flatt
9b5dd35adc makefile: fix cross builds 2020-08-02 14:28:45 -06:00
Matthew Flatt
2885df0347 update build guide and READMEs for CS as default 2020-08-02 07:57:12 -06:00
Matthew Flatt
e6752e9afc configure: switch default from BC to CS
This change brings the top-level makefile and `configure` back in
sync, but it affect source distributions by changing the `configure`
default there.
2020-08-02 07:57:12 -06:00
Matthew Flatt
093fcd1bc7 makefile: make Racket CS the default
The top-level makefile now builds Racket CS as `racket` by default.

Use `racket bc` to build Racket BC as `racket`. Use `make both` to
build both CS and BC (the latter with the `bc` suffix) overlayed in a
single build. By using `make both` insted of `make cs` plus `make bc`,
you can avoid redundant package downloads and documentation rendering.

To build Racket BC as `racket`, use `racket bc RACKETBC_SUFFIX=`, but
you must consistently use `RACKETBC_SUFFIX=` with `make` every time.
2020-08-01 17:33:53 -06:00
Matthew Flatt
1c181ffbd8 cs: change undefined-variable error to match bc
Add a missing "in".

Related to #3325
2020-08-01 12:47:08 -06:00
Matthew Flatt
351c45c78b rktio: fix use of POLL... where EPOLL... is intended 2020-08-01 09:10:26 -06:00
Matthew Flatt
ad3baffc8d fix gracketcgc install 2020-08-01 08:12:22 -06:00
Matthew Flatt
719cd66835 Chez Scheme makefiles: fix .bootquick when source has boot files 2020-08-01 07:52:04 -06:00
Matthew Flatt
6c59a722a1 makefiles: fix install of GRacket BC 2020-08-01 07:05:30 -06:00
Matthew Flatt
b0bd5061d5 Chez Scheme makefile: create correct directory on .bootquick 2020-08-01 06:17:22 -06:00
Matthew Flatt
2ae4ee4163 makefiles: build Chez Scheme in the "build" area
Instead of leaving Chez Scheme build artifacts in in the ChezScheme
source directory, keep them in a "build" directory like everything
else.
2020-07-31 16:33:07 -06:00
Matthew Flatt
c1cd9c499c adjust Chez Scheme configure script to work in any directory
Adjust `configure` and makefiles so that `configure` can be run in an
directory, not just the source directory. Initial boot files are found
at either the current directory or the source directory.

Also, add support for `-B` and `--Boot` flags to accept a path that is
resolved relative to the current directory, instead of relative to the
installation.
2020-07-31 16:32:19 -06:00
Matthew Flatt
fc5f846693 cs: fix Mac OS framework versioning 2020-07-31 12:47:07 -06:00
Matthew Flatt
6886dc2143 make bc and cs configure scripts more symmetric
The `--enable-cs` and `--enable-csdefault` flags now enabled just the
CS build, as long as pb boot files are present or
`--enable-racket=...` is supplied.
2020-07-31 11:08:42 -06:00
Matthew Flatt
ed415a3795 move "racket/src/racket" -> "racket/src/bc"
Also, move "racket/src/gracket" and "racket/src/foreign" to
subdirectories of "racket/src/bc".
2020-07-31 06:40:26 -06:00
Matthew Flatt
8ef22d6334 src/configure: unbreak main-target setup 2020-07-30 20:20:45 -06:00
Matthew Flatt
cde197125c support Racket BC build and installation with a "bc" suffix 2020-07-30 20:14:34 -06:00
Matthew Flatt
1d9db6eec3 makefile: make bc and cs rules more symmetic
Currently, `make` is the same as `make bc`, but the idea is that
`make` can become the same as `make cs` when some other pieces are in
place.

The source of the top-level makefile is now ".makefile", and it's
turned into "Makefile" using "racket/src/makemake.rkt". The
transformation makes non-GNU `make` variants and `nmake` act like GNU
make to propagate variables, which makes abstraction through targets
plus variables (admitedly an abuse of `make`) more reliable and
consistent.

Why abuse `make` this way? Because `make` variants and `nmake` are
similar enough that to constitute a portable scripting language, and
one that conveniently provides a large number of entry points.
2020-07-30 13:29:02 -06:00
Paulo Matos
a4b6ac701e
Solo Chez build/test workflow (#3316) 2020-07-30 13:19:49 +02:00
Matthew Flatt
7d7b8fb1e9 makefile: fix cs targets to not break non-cs targets 2020-07-29 13:37:39 -06:00
Matthew Flatt
8a0bb78ab1 unbreak windows CGC build 2020-07-29 10:06:31 -06:00
Matthew Flatt
0d279ca06d prune Boehm GC references from the MSVC projects 2020-07-29 09:25:22 -06:00
Matthew Flatt
ea096e1989 move cfg-racket to cfg-bc 2020-07-29 08:58:42 -06:00
Matthew Flatt
7c256a051d replace "traditional Racket" references with "Racket BC" 2020-07-29 08:27:58 -06:00
Matthew Flatt
e42dfffa3a update unixstyle-install for a source distribution 2020-07-29 06:56:24 -06:00
Matthew Flatt
af651ca435 Merge branch 'master' of github.com:racket/racket 2020-07-29 05:20:13 -06:00