CI Flakiness Report (2026-03-29 to 2026-04-05)
Summary
| Metric |
Current |
24hr |
7-day |
| Total runs |
15 |
— |
— |
| Failed runs |
4 (26.7%) |
↓ -14 |
— |
| Unique flaky tests |
8 |
→ -2 |
— |
Failure Breakdown
| Category |
Count |
24hr |
7-day |
| API errors (503/timeout) |
7 |
↓ -58 |
— |
| Rate limit (429) |
1 |
↓ -8 |
— |
| Assertion failures |
1 |
→ |
— |
Top Flaky Tests
| Test |
Failures |
Category |
File |
multiturn::test_multiturn_tools_not_inherited |
2 |
api_errors |
function_calling_tests.rs |
config_fields::test_generation_config_new_fields_combined |
1 |
api_errors |
tools_and_config_tests.rs |
document::test_pdf_document_input_from_base64 |
1 |
rate_limit |
multimodal_tests.rs |
basic::test_stateful_conversation |
1 |
api_errors |
interactions_api_tests.rs |
bytes_loading::test_image_data_roundtrip |
1 |
api_errors |
multimodal_tests.rs |
basic::test_function_call_error_response |
1 |
api_errors |
function_calling_tests.rs |
sampling::test_generation_config_combined |
1 |
assertion_failures |
tools_and_config_tests.rs |
basic::test_simple_interaction |
1 |
api_errors |
interactions_api_tests.rs |
Recommendations
- Investigate API reliability — 7 failures due to backend/network issues (503, timeout, connection errors)
- Review rate limits — 1 failures due to quota issues (429, rate limit)
- Fix assertion failures — 1 tests with logic errors that need investigation
Generated automatically by CI Flakiness Report
CI Flakiness Report (2026-03-29 to 2026-04-05)
Summary
Failure Breakdown
Top Flaky Tests
multiturn::test_multiturn_tools_not_inheritedconfig_fields::test_generation_config_new_fields_combineddocument::test_pdf_document_input_from_base64basic::test_stateful_conversationbytes_loading::test_image_data_roundtripbasic::test_function_call_error_responsesampling::test_generation_config_combinedbasic::test_simple_interactionRecommendations
Generated automatically by CI Flakiness Report