Repository navigation
Prioritize recent flaky tests in the automated testing task - #8670
Merged
Merged
Conversation
gonzaloriestra
force-pushed
the
tests-prioritize-flaky-tests
branch
from
September 25, 2026 10:48
32b78cb to
ff055da
Compare
gonzaloriestra
marked this pull request as ready for review
September 25, 2026 10:50
Suleimanlatrsh
approved these changes
Sep 25, 2026
Suleimanlatrsh
left a comment
Contributor
There was a problem hiding this comment.
Nice, this makes the task way more useful. Did you get a chance to try it with a workflow_dispatch run? The permissions block doesn't list actions, so I wasn't sure the bot can read run logs.
Contributor
Author
|
@Suleimanlatrsh We can't try it until it gets merged. The repo is public, so I think you don't need permission to read the action logs. But let's merge and adjust if needed! |
Contributor
Author
|
@Suleimanlatrsh it worked, this PR mentions the flaky tests found. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
WHY are these changes introduced?
The automated testing task starts with coverage gaps, leaving recurring CI failures competing with new test coverage for attention.
WHAT is this pull request doing?
Prioritize flaky-test fixes by reviewing every Main tests workflow run from the last seven days, including failed attempts and matrix jobs. Require evidence, check for existing fixes, investigate the cause, and repeat focused tests. Fall back to coverage improvements only when no actionable, non-duplicate flake remains.
Keep fixes focused and preserve useful assertions instead of hiding failures with retries or larger timeouts. Include representative failed-job links and validation limits in the PR description.
Label maintenance PR notifications as "CLI maintenance PR" so their repository context is clear.
Validated the instruction flow, workflow reference, notification text, and diff formatting. Instruction and message-only changes; no test execution needed.
Checklist
patchfor bug fixes ·minorfor new features ·majorfor breaking changes) and added a changeset withpnpm changeset add