forked from PinkCrow007/arrow-rs
-
Notifications
You must be signed in to change notification settings - Fork 1
Variant shredding #2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
carpecodeum
wants to merge
45
commits into
main
Choose a base branch
from
variant-shredding
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
45 commits
Select commit
Hold shift + click to select a range
7b7aad2
Upgrade tonic dependencies to 0.13.0 version (try 2) (#7839)
alamb 0055f57
[Variant] Reserve capacity beforehand during large object building (#…
friendlymatthew 7af62d5
[Variant] Support appending complex variants in `VariantBuilder` (#7914)
friendlymatthew d4c0a32
[Variant] Add `variant_get` compute kernel (#7919)
Samyak2 03a837e
Add tests for `BatchCoalescer::push_batch_with_filter`, fix bug (#7774)
alamb d809f19
[Variant] Add documentation, tests and cleaner api for Variant::get_p…
alamb 7089786
[Variant] Avoid collecting offset iterator (#7934)
codephage2020 dfe907f
Minor: Support BinaryView and StringView builders in `make_builder` (…
kylebarron d0fa24e
[Variant] Impl `PartialEq` for VariantObject (#7943)
friendlymatthew 233dad3
Optimize partition_validity function used in sort kernels (#7937)
jhorstmann 722ef59
[Variant] Add ObjectBuilder::with_field for convenience (#7950)
alamb a984ca7
[Variant] Adding code to store metadata and value references in Varia…
abacef a5afda2
[Variant] VariantMetadata is allowed to contain the empty string (#7956)
scovich 71dd48e
[Variant] Add `variant_kernels` benchmark (#7944)
alamb a15f345
[Variant] Add ListBuilder::with_value for convenience (#7959)
codephage2020 4f5ab12
[Test] Add tests for VariantList equality (#7953)
alamb 55fbf5c
[Variant] remove VariantMetadata::dictionary_size (#7958)
codephage2020 99eb1bc
Add missing `parquet-variant-compute` crate to CI jobs (#7963)
alamb 82821e5
arrow-ipc: Remove all abilities to preserve dict IDs (#7940)
brancz 291e6e5
Add arrow-avro support for Impala Nullability (#7954)
veronica-m-ef b726b6f
Add additional integration tests to arrow-avro (#7974)
nathaniel-d-ef ed02131
arrow-schema: Remove dict_id from being required equal for merging (#…
brancz d4f1cfa
Implement Improved arrow-avro Reader Zero-Byte Record Handling (#7966)
jecsand838 6874ffa
[Variant] Avoid extra allocation in object builder (#7935)
klion26 dff67c9
GH-7686: [Parquet] Fix int96 min/max stats (#7687)
rahulketch f39461c
[Variant] Revisit VariantMetadata and Object equality (#7961)
friendlymatthew ec81db3
Add decimal32 and decimal64 support to Parquet, JSON and CSV readers …
CurtHagenlocher 4c1d6f2
[ADD] Path-based field extraction for VariantArray
carpecodeum 5ac22a7
[FIX] sanitise variant_array file
carpecodeum 1ef8926
[ADD] add hybrid approach for field access
carpecodeum d782197
[FIX] fix variant_array implementation
carpecodeum 948bb39
[ADD] add support for path operations on different data types
carpecodeum e16af07
[FIX] minor fixes
carpecodeum 3da46b8
[FIX] fix formatting issues
carpecodeum 7c03e21
[FIX] remove redundancy
carpecodeum eb8bb69
[FIX] improve the tests
carpecodeum 397c717
[FIX] refactor code for modularity
carpecodeum dda30ea
[FIX] fix issues with the spec
carpecodeum 32c55ea
remove redundancy with field_operations.rs and variant_parser.rs
carpecodeum 3b3c191
[REMOVE] revert field_operations.rs
carpecodeum 01f0be7
[REMOVE] remove extra lines in cargo.toml
carpecodeum eb23834
[REMOVE] remove variant_parser.rs file as decoder.rs already has majo…
carpecodeum cc5e149
[FIX] make code modular
carpecodeum 30e9cd2
[FIX] clippy and lint issues
carpecodeum 7dd6c23
[FIX] remove unsafe functions doing byte operations
carpecodeum File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
unrelated/noise?