winml analyze - e2e test failed

[zhenchaoni]

test_analyze_e2e.py — e2e test failures

Status: 4 failed · 0 errors · 46 passed · 0 skipped · 50 total

Source: tests/e2e/test_analyze_e2e.py

How to reproduce locally:

uv run pytest tests/e2e/test_analyze_e2e.py -m e2e --timeout=1000 --no-cov -ra --tb=short

Failing tests

1. TestAnalyzeHappyPath::test_default_device_is_npu

• Node id: tests/e2e/test_analyze_e2e.py::TestAnalyzeHappyPath::test_default_device_is_npu
• Kind: failure
• Message: assert 1 == 0

Traceback excerpt

tests\e2e\test_analyze_e2e.py:328: in test_default_device_is_npu
    assert result.exit_code == 0
E   assert 1 == 0
E    +  where 1 = <Result SystemExit(1)>.exit_code

2. TestAnalyzeHappyPath::test_analyze_all_eps_when_ep_omitted

• Node id: tests/e2e/test_analyze_e2e.py::TestAnalyzeHappyPath::test_analyze_all_eps_when_ep_omitted
• Kind: failure
• Message: assert 2 in {0, 1}

Traceback excerpt

tests\e2e\test_analyze_e2e.py:337: in test_analyze_all_eps_when_ep_omitted
    assert result.exit_code in {0, 1}
E   assert 2 in {0, 1}
E    +  where 2 = <Result SystemExit(2)>.exit_code

3. TestAnalyzeBadPath::test_dml_with_cpu_device_rejected

• Node id: tests/e2e/test_analyze_e2e.py::TestAnalyzeBadPath::test_dml_with_cpu_device_rejected
• Kind: failure
• Message: AssertionError: assert 'only supports' in '[2026-05-25t16:28:51] error: no ep/device combination matched the current selection.\n'

Traceback excerpt

tests\e2e\test_analyze_e2e.py:525: in test_dml_with_cpu_device_rejected
    assert "only supports" in result.output.lower()
E   AssertionError: assert 'only supports' in '[2026-05-25t16:28:51] error: no ep/device combination matched the current selection.\n'
E    +  where '[2026-05-25t16:28:51] error: no ep/device combination matched the current selection.\n' = <built-in method lower of str object at 0x00000203166ED110>()
E    +    where <built-in method lower of str object at 0x00000203166ED110> = '[2026-05-25T16:28:51] ERROR: No EP/device combination matched the current selection.\n'.lower
E    +      where '[2026-05-25T16:28:51] ERROR: No EP/device combination matched the current selection.\n' = <Result SystemExit(2)>.output

4. TestAnalyzeBadPath::test_cpu_ep_with_npu_device_rejected

• Node id: tests/e2e/test_analyze_e2e.py::TestAnalyzeBadPath::test_cpu_ep_with_npu_device_rejected
• Kind: failure
• Message: AssertionError: assert 'only supports' in '[2026-05-25t16:28:51] error: no ep/device combination matched the current selection.\n'

Traceback excerpt

tests\e2e\test_analyze_e2e.py:542: in test_cpu_ep_with_npu_device_rejected
    assert "only supports" in result.output.lower()
E   AssertionError: assert 'only supports' in '[2026-05-25t16:28:51] error: no ep/device combination matched the current selection.\n'
E    +  where '[2026-05-25t16:28:51] error: no ep/device combination matched the current selection.\n' = <built-in method lower of str object at 0x00000202C696CC00>()
E    +    where <built-in method lower of str object at 0x00000202C696CC00> = '[2026-05-25T16:28:51] ERROR: No EP/device combination matched the current selection.\n'.lower
E    +      where '[2026-05-25T16:28:51] ERROR: No EP/device combination matched the current selection.\n' = <Result SystemExit(2)>.output