Skip to content

feat: add auditable agent task experiments - #1

Merged
SuTang-vain merged 1 commit into
mainfrom
codex/agent-task-experiments
Aug 1, 2026
Merged

feat: add auditable agent task experiments#1
SuTang-vain merged 1 commit into
mainfrom
codex/agent-task-experiments

Conversation

@SuTang-vain

Copy link
Copy Markdown
Owner

Summary

  • harden extraction, asset resolution, Data Surface import, equivalence coverage, rules, and report path behavior
  • add versioned Agent Task manifests, isolated patch execution, file-policy enforcement, task-specific grading, and runtime/visual evidence adapters
  • add reproducible success-rate experiments with scripted and real-AI trial artifacts, digest audits, relocation checks, and explicit claim-level boundaries
  • document task, patch, grader, evidence, TaskRun, and experiment contracts

Validation

  • node --test tests/*.test.js: 188/188 passed
  • git diff --check: passed
  • credential-pattern scan: no findings
  • artifact audit: 30 TaskRuns and 188 artifacts verified
  • scripted experiment: 15/15 valid passes (harness-only)
  • real-AI experiment: 7/14 valid passes, 1 infra error (ai-static-contract-only)

Scope note

The committed reports intentionally do not claim complete runtime/visual component-library capability where producer evidence is unavailable.

@SuTang-vain
SuTang-vain merged commit 380191e into main Aug 1, 2026
2 checks passed
@SuTang-vain
SuTang-vain deleted the codex/agent-task-experiments branch August 1, 2026 10:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant