Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add new_unchecked method for RecordBatch #7072

Closed
wants to merge 1 commit into from

Conversation

rluvaton
Copy link
Contributor

@rluvaton rluvaton commented Feb 4, 2025

Which issue does this PR close?

Closes #7071

Rationale for this change

See linked issue

What changes are included in this PR?

Added new_unchecked method for RecordBatch and changed all internal calls to use it

Are there any user-facing changes?

new function on record batch

@github-actions github-actions bot added the arrow Changes to the arrow crate label Feb 4, 2025
@tustvold
Copy link
Contributor

tustvold commented Feb 4, 2025

I'll comment on the issue, but if this is a bottleneck in your code it indicates a fairly major code smell. The cost of creating RecordBatch/arrays should be amortised over thousands of rows. Adding new_unchecked will not eliminate the fundamental problem with such code, and I'm therefore fairly lukewarm on this

@alamb
Copy link
Contributor

alamb commented Feb 6, 2025

Looks like there is an alternate approach described in #7071 (comment) so marking this one as draft .

@alamb alamb marked this pull request as draft February 6, 2025 17:26
@rluvaton rluvaton closed this Feb 6, 2025
@rluvaton rluvaton deleted the add-new-unchecked branch February 6, 2025 18:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
arrow Changes to the arrow crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Allow to create record batch without validation
3 participants