CI Flakiness Report - Week of 2026-04-04

[github-actions]

CI Flakiness Report (2026-03-28 to 2026-04-04)

Summary

Metric	Current	24hr	7-day
Total runs	29	—	—
Failed runs	18 (62.1%)	→	—
Unique flaky tests	10	→	—

Failure Breakdown

Category	Count	24hr	7-day
API errors (503/timeout)	65	→	—
Rate limit (429)	9	→	—
Assertion failures	1	→	—
Panics	9	→	—

Top Flaky Tests

Test	Failures	Category	File
config_fields::test_generation_config_new_fields_combined	15	api_errors	tools_and_config_tests.rs
basic::test_stateful_conversation	15	api_errors	interactions_api_tests.rs
bytes_loading::test_image_data_roundtrip	15	api_errors	multimodal_tests.rs
basic::test_function_call_error_response	15	api_errors	function_calling_tests.rs
basic::test_simple_interaction	15	api_errors	interactions_api_tests.rs
conversations::test_long_conversation_chain	3	api_errors	interactions_api_tests.rs
builtins_multiturn::test_google_search_multi_turn	2	api_errors	function_calling_tests.rs
multiturn::test_multiturn_tools_not_inherited	2	api_errors	function_calling_tests.rs
document::test_pdf_document_input_from_base64	1	rate_limit	multimodal_tests.rs
sampling::test_generation_config_combined	1	assertion_failures	tools_and_config_tests.rs

Recommendations

1. Investigate API reliability — 65 failures due to backend/network issues (503, timeout, connection errors)
2. Review rate limits — 9 failures due to quota issues (429, rate limit)
3. Fix assertion failures — 1 tests with logic errors that need investigation
4. Investigate panics — 9 tests crashed unexpectedly

---

Generated automatically by CI Flakiness Report