Skip to content

Complain when p_signal has low bit depth so that saving works reliably #546

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Ivorforce
Copy link
Contributor

@Ivorforce Ivorforce commented Jul 24, 2025

This may not be the best solution, but it's one that works.
I tried modifying adc to convert to 64 bit automatically instead on demand, but that wasn't enough. Only converting p_signal for all of the wrsamp process works. So there's definitely other factors at play.

An alternative solution might be to make the bounds calculation work with 32 bit, or at least be robust to it. But I'm not sure how feasible this is, since I can't figure out where exactly it's going wrong.
Making sure people use high-precision data for saving accuracy makes sense to me anyhow. Data may be lost elsewhere otherwise accidentally.

@Ivorforce Ivorforce force-pushed the complain-low-bitdepth branch from bd3bedd to fa92cb6 Compare July 24, 2025 12:44
@Ivorforce Ivorforce force-pushed the complain-low-bitdepth branch from fa92cb6 to ac48683 Compare July 24, 2025 12:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

calc_adc_params can produce off-by-one problems, crashing wrsamp
1 participant