Introduce standalone C parser for RBS with arena allocation#2398

Merged

soutaro merged 118 commits intoruby:masterfrom

May 2, 2025

Commits on Feb 25, 2025

Allocate lexer inside `alloc_parser()`

amomchilov
authored and
st0012
committed

Commits on Mar 13, 2025

Add new arena allocator

amomchilov
authored and
st0012
committed
Enable unused-result warnings

Morriar
authored and
st0012
committed
Move away from using VALUE and other Ruby data structs

Morriar
authored and
st0012
committed
Do not test inner type for shitlist

Morriar
authored and
st0012
committed
Move away from Ruby data types

authored and
st0012
committed
Move `constants.c`/`.h` to `rbs_extension/`

amomchilov
authored and
st0012
committed
Replace `rbs_abort`

Morriar
authored and
st0012
committed
Do not raise for syntax errors

amomchilov
authored and
st0012
committed
Make `parse_type_params` return a NODISCARD bool

Morriar
authored and
st0012
committed
Rename `syntax_error` to `set_syntax_error`

Morriar
authored and
st0012
committed
Merge `aborted` and `syntax_error`

Morriar
authored and
st0012
committed
Introduce `rbs_buffer`

Morriar
authored and
st0012
committed
Move extension parsing functions out of `parser.c`

Morriar
authored and
st0012
committed
Remove a few more `ruby.h`

Morriar
authored and
st0012
committed
Use a bare `char *` for type_name error

Morriar
authored and
st0012
committed
Add `rbs_translation_context_t` to `rbs_loc_to_ruby_location`

amomchilov
authored and
st0012
committed
Set locations’ `buffer` in translation layer

amomchilov
authored and
st0012
committed
Remove `cached_ruby_object` from `rbs_location_t`

amomchilov
authored and
st0012
committed
Dedupe `rbs_loc_add_required_child` body

amomchilov
authored and
st0012
committed
misc cleanup

amomchilov
authored and
st0012
committed
Migrate remaining uses of `rbs_unquote_string`

amomchilov
authored and
st0012
committed
Apply `rbs_parser_get_current_token()`

amomchilov
authored and
st0012
committed
Delete `rbs_other_ruby_value_t`

amomchilov
authored and
st0012
committed
Import encoding handling from Prism

Morriar
authored and
st0012
committed
Store encoding in the lexer state

Morriar
authored and
st0012
committed
Migrate `lexerstate` string to `rbs_string`

amomchilov
authored and
st0012
committed
Remove useless includes

Morriar
authored and
st0012
committed
Remove last `ruby/encoding` dependencies from parser.h

Morriar
authored and
st0012
committed
Move lexer out of the extension directory

Morriar
authored and
st0012
committed
Extract `alloc_lexer_from_buffer`

Morriar
authored and
st0012
committed
Move the Ruby out of `alloc_lexer`

Morriar
authored and
st0012
committed
Does not pass `parserstate` around for node translation

Morriar
authored and
st0012
committed
Do not store `rb_encoding` in `parserstate`

Morriar
authored and
st0012
committed
Delete `parser_advance_assert`

Morriar
authored and
st0012
committed
Raise errors without using parser state

amomchilov
authored and
st0012
committed
Do not use parserstate's buffer to parse comments

Morriar
authored and
st0012
committed
Remove buffer from parserstate

Morriar
authored and
st0012
committed
Rework some includes

Morriar
authored and
st0012
committed
Un-nest and use early return

amomchilov
authored and
st0012
committed
Add typecheck to prevent segfault

amomchilov
authored and
st0012
committed
Extract function to populate type var table

amomchilov
authored and
st0012
committed
Use `c_name` to rename C++ keywords

Morriar
authored and
st0012
committed
Move `declare_type_variables` to `main.c`

amomchilov
authored and
st0012
committed
Replace Ruby’s `PRINTF_ARGS`

amomchilov
authored and
st0012
committed
Remove `ruby.h` from `parserstate.h`

amomchilov
authored and
st0012
committed
Move parser and parserstate out of `rbs_extension/`

Morriar
authored and
st0012
committed
Move `NODISCARD` macro out of `parser.c`

amomchilov
authored and
st0012
committed
Remove `rb_raise` from typevar table functions

amomchilov
authored and
st0012
committed
Clean some `.h` includes

Morriar
authored and
st0012
committed
Enable implicit fall-through errors

amomchilov
authored and
st0012
committed
Extract `raise_error_if_any()`

amomchilov
authored and
st0012
committed
Add reverse lookup for nodes

Morriar
authored and
st0012
committed
Silence warning on missing range initializer

Morriar
authored and
st0012
committed
Give all nodes a location field

Morriar
authored and
st0012
committed
Don’t copy Ruby strings into extension

amomchilov
authored and
st0012
committed
Add `rbs_string_copy_slice()`

amomchilov
authored and
st0012
committed
Fix string handling in preperation for `free()`

amomchilov
authored and
st0012
committed
Delete `rbs_string_offset()`

amomchilov
authored and
st0012
committed
`rbs_string_strip_whitespace()` without copying

amomchilov
authored and
st0012
committed
`rbs_parser_peek_current_token()` without copying

amomchilov
authored and
st0012
committed
Copy RBS Strings into Ruby

amomchilov
authored and
st0012
committed
Delete `rbs_string_offset()`

amomchilov
authored and
st0012
committed
Free intermediate strings in `parser.c`

amomchilov
authored and
st0012
committed
Add `rbs_node_destroy()`

amomchilov
authored and
st0012
committed
Delete `rbs_string_offset()`

amomchilov
authored and
st0012
committed
Call `rbs_node_destroy()` on list and hash members

amomchilov
authored and
st0012
committed
Add VSCode debugger configuration

amomchilov
authored and
st0012
committed
Add scripts for profiling in Instruments

amomchilov
authored and
st0012
committed
Add missing stdint import
st0012
committed
Remove unused local to please RuboCop
st0012
committed
Avoid using vasprintf
st0012
committed
Fix MSVC compatibility issues
st0012
committed
Assert ids always gets assigned
st0012
committed
Avoid using rb_raise in parser
st0012
committed
Fix incorrect Qtrue usage and remove unnecessary import
st0012
committed
Remove debugging assignment
st0012
committed
Simplify rbs_location_current_token
st0012
committed
Allocate location with allocator
st0012
committed
Fix comment
st0012
committed
Fix location child memory leak (#10)

st0012
and
Morriar
committed
Remove unused rbs_constant_id_list and related functions (#12)
st0012
committed
Remove unnecessary re-allocations from child-adding functions (#11)

st0012
and
amomchilov
committed
Allocate parser error and result with allocator (#15)
st0012
committed
Allocate owned rbs_string_t using allocator
st0012
committed
Remove string type enum
st0012
committed
Allocate `rbs_buffer_t` with allocator (#13)
st0012
committed
Free parser before raising Ruby exceptions
st0012
committed
Merge pull request #17 from Shopify/add-allocate-many-function
st0012
committed
Fix code that triggers warnings when compiled with Sorbet (#19)
st0012
committed

Commits on Mar 17, 2025

Replace `assert` with `rbs_assert` for better assertion message (#23)
st0012
authored

Commits on Mar 26, 2025

Prefix internal lexer and encoding functions and types (#25)
st0012
authored

Commits on Mar 27, 2025

Merge `parserstate.c` and `.h` files into respective `parser` files + some cleanups (#26)
st0012
authored

Commits on Mar 28, 2025

Commits on Mar 31, 2025

Rename parser functions with `rbs_` prefix (#29)
st0012
authored

Commits on Apr 2, 2025

Always define the `is_power_of_two` function (#36)
st0012
authored

Commits on Apr 3, 2025

Make it easier to switch between allocator implementations
tekknolagi
committed

Commits on Apr 4, 2025

Use one massive slice of virtual memory per arena
tekknolagi
committed

Commits on Apr 10, 2025

Merge branch 'master' into c-api
st0012
committed

Commits on Apr 25, 2025

Commits on Apr 29, 2025

Remove files that won't be upstreamed (#42)
st0012
authored

Commits on Apr 30, 2025

Commits on May 1, 2025

Merge branch 'master' into c-api
st0012
committed