Skip to content

Allow FUNSD benchmark to customize budget allocation#70

Merged
warrofua merged 2 commits into
mainfrom
codex/update-benchmarks-for-allocator-kwargs-9o8b2f
Oct 25, 2025
Merged

Allow FUNSD benchmark to customize budget allocation#70
warrofua merged 2 commits into
mainfrom
codex/update-benchmarks-for-allocator-kwargs-9o8b2f

Conversation

@warrofua
Copy link
Copy Markdown
Owner

Summary

  • add allocator_kwargs to the FUNSD benchmark helper and thread it through the shared evaluation path
  • instantiate a RegistryAwareBudgetAllocator once per evaluation and reuse it for primary and ablation bottlenecks
  • extend RegistryAwareBudgetAllocator to accept optional field weight and minimum quota overrides
  • fix ablation bottleneck instantiation so each ablation receives a shared allocator-backed bottleneck
  • log compression records for benchmark usage events so type checking can resolve CompressionRecord

Testing

  • pytest tests/bottleneck -q
  • mypy .

https://chatgpt.com/codex/tasks/task_e_68fce757359c832c9943dce3b04f4118

@warrofua warrofua merged commit 22079bd into main Oct 25, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant