Skip to content

Add managed benchmark runner image - #161

Merged
c-mongan merged 1 commit into
mainfrom
cmongan/public-managed-benchmark-runner-image
Jun 6, 2026
Merged

Add managed benchmark runner image#161
c-mongan merged 1 commit into
mainfrom
cmongan/public-managed-benchmark-runner-image

Conversation

@c-mongan

@c-mongan c-mongan commented Jun 6, 2026

Copy link
Copy Markdown
Owner

Summary

  • add a managed Copilot benchmark sandbox runner base image
  • add entrypoint checks for workspace, isolated COPILOT_HOME, and private Copilot CLI install
  • add product audit coverage and update eval-hardening docs

Verification

  • npm --prefix agentops-cli test
  • npm --prefix actioner test
  • npm --prefix benchmark-judges/hosted-judge test
  • node agentops-cli/src/index.js demo verify --runs 50 --json
  • node agentops-cli/src/index.js product audit --json
  • bash -n benchmark-runners/copilot-sandbox/docker-entrypoint.sh
  • git diff --check

Not verified

  • docker build: local Docker/OrbStack socket was unavailable

@c-mongan
c-mongan merged commit ecb3189 into main Jun 6, 2026
3 checks passed
@c-mongan
c-mongan deleted the cmongan/public-managed-benchmark-runner-image branch June 6, 2026 01:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant