Search results

Support evals against mcp

Status: Open.

#147 In microsoft/waza;

· RickWinter opened on Mar 19, 2026

There's no way, within waza, way to get the list of models to enter

Status: Open.

#141 In microsoft/waza;

· richardpark-msft opened on Mar 18, 2026

Add support for the TestExpectation model field MayInclude (which maps to the yaml output_contains_any field.

Status: Open.

#137 In microsoft/waza;

· LarryOsterman opened on Mar 17, 2026

Add implementation of currently non-existent BehaviorRules max_response_time_ms field.

Status: Open.

#136 In microsoft/waza;

· LarryOsterman opened on Mar 17, 2026

Improve concurrency design

Status: Open.

Feature

#135 In microsoft/waza;

· chlowell opened on Mar 17, 2026

WAZA does not validate input yaml fields.

Status: Open.

#132 In microsoft/waza;

· LarryOsterman opened on Mar 16, 2026

Reconsider AgentEngine cancellation API

Status: Open.

Task

#129 In microsoft/waza;

· chlowell opened on Mar 16, 2026

Allow for control over which skills are loaded (ie, could be 'none') to do comparison grading

Status: Open.

#126 In microsoft/waza;

· richardpark-msft opened on Mar 13, 2026

Provide a way for users to debug/view into the temp workspace we setup

Status: Open.

#123 In microsoft/waza;

· richardpark-msft opened on Mar 12, 2026

Provide a way to start off with a large set of files in input files - for instance, the entirety of the git repo the test is running in

Status: Open.

#121 In microsoft/waza;

· richardpark-msft opened on Mar 12, 2026

Add in some tests for edge cases when parsing copilot logs

Status: Open.

#115 In microsoft/waza;

· richardpark-msft opened on Mar 12, 2026

Grader configuration can be incorrect with no visible error

Status: Open.

#113 In microsoft/waza;

· richardpark-msft opened on Mar 12, 2026