Skip to content

Add hosted judge deployment artifact - #159

Merged
c-mongan merged 1 commit into
mainfrom
cmongan/hosted-judge-deployment-artifact-public
Jun 6, 2026
Merged

Add hosted judge deployment artifact#159
c-mongan merged 1 commit into
mainfrom
cmongan/hosted-judge-deployment-artifact-public

Conversation

@c-mongan

@c-mongan c-mongan commented Jun 6, 2026

Copy link
Copy Markdown
Owner

Summary

  • add a deployable hosted llm-judge service for benchmark semantic checks
  • add an Azure Container Apps Bicep module and Dockerfile for the service
  • update benchmark judge-provider guidance, product audit coverage, and product audit docs

Verification

  • npm --prefix benchmark-judges/hosted-judge test
  • npm --prefix agentops-cli test
  • npm --prefix actioner test
  • node agentops-cli/src/index.js product audit --json
  • node agentops-cli/src/index.js demo verify --runs 50 --json
  • az bicep build --file infra/bicep/hosted-judge.bicep --stdout
  • git diff --check

Adds a deployable Azure Container Apps hosted llm-judge service, Bicep module, Dockerfile, tests, guide updates, and product audit coverage.
@c-mongan
c-mongan merged commit de3e322 into main Jun 6, 2026
3 checks passed
@c-mongan
c-mongan deleted the cmongan/hosted-judge-deployment-artifact-public branch June 6, 2026 01:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant