fix(eval): harden GEPA discovery and reuse - #88
Conversation
Port the eval safety and case-concurrency portion of fork/port/openrouter-fixes commit aedf712 onto current main. The dead budget option is removed; GEPA discovery and traversal remain a separate follow-up. Signed-off-by: Luke Parke <5702154+LukasParke@users.noreply.github.com>
Port item 5 from fork/port/openrouter-fixes commit aedf712: scoped discovery, stable tool paths, bounded proposals, judge reuse, and coding-agent timeout. Signed-off-by: Luke Parke <5702154+LukasParke@users.noreply.github.com>
|
@LukasParke is attempting to deploy a commit to the Matt Apperson's projects Team on Vercel. A member of the Team first needs to authorize it. |
|
Agent: Code CI/structural/DCO are green where configured; remaining external red checks are |
Run executeRunCode tests serially so their temporary global setTimeout proxy cannot capture delays from sibling tests under CI concurrency. Signed-off-by: Luke Parke <5702154+LukasParke@users.noreply.github.com>
Expose the pure retry-delay calculation for deterministic assertions instead of proxying global setTimeout, which captured sibling test timers under CI concurrency. Signed-off-by: Luke Parke <5702154+LukasParke@users.noreply.github.com>
|
Agent: Root-caused the repeated core CI failure to retry tests proxying global setTimeout and capturing sibling-test timers. Pushed a deterministic fix that tests the pure retry-delay function without mutating globals. DCO and Structural gate pass; CI rerun is in progress. |
Signed-off-by: Luke Parke <5702154+LukasParke@users.noreply.github.com>
|
Agent: Root cause was Bun |
What
Why
GEPA discovery ignored the requested scope, mutable tool names made candidate paths unstable, composite traversal missed current step shapes, and judge harnesses were rebuilt for every score call.
This ports item 5, the remainder of
fork/port/openrouter-fixescommitaedf712f, on top of item 4 #72.Test plan
sentrux check .Dependency
Depends on #72 for the shared run pool and removed dead budget option. The branch currently includes that prerequisite and must be rebased through main after merge.