Skip to content

Allow FUNSD benchmark to customize budget allocation#68

Closed
warrofua wants to merge 3 commits into
mainfrom
codex/update-benchmarks-for-allocator-kwargs
Closed

Allow FUNSD benchmark to customize budget allocation#68
warrofua wants to merge 3 commits into
mainfrom
codex/update-benchmarks-for-allocator-kwargs

Conversation

@warrofua
Copy link
Copy Markdown
Owner

Summary

  • add allocator_kwargs to the FUNSD benchmark helper and thread it through the shared evaluation path
  • instantiate a RegistryAwareBudgetAllocator once per evaluation and reuse it for primary and ablation bottlenecks
  • extend RegistryAwareBudgetAllocator to accept optional field weight and minimum quota overrides

Testing

  • pytest tests/bottleneck -q

https://chatgpt.com/codex/tasks/task_e_68fce757359c832c9943dce3b04f4118

@warrofua warrofua closed this Oct 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant