stackrox: make mpiit-data-router-reporter best_effort for ACS LP interop - #83415
Conversation
The periodic ACS layered-product interop jobs (cr--acs--tests-aws and acs--tests-aws-fips) on ocp-4.22-lpMainline were being marked FAILURE even when all QA e2e tests passed, because the post-phase mpiit-data-router-reporter step intermittently gets a 503 from datarouter.ccitredhat.com (Report Portal / Data Router service). This is a reporting step; its failure should not gate the product test verdict. Tracked upstream (unowned since June) as LPINTEROP-6864. Fix: inline the firewatch-ipi-aws-cr workflow into both tests and mark only the mpiit-data-router-reporter ref best_effort: true, so a Data Router outage no longer fails an otherwise-green job. The inlined pre/post steps reproduce the workflow exactly; firewatch-report-issues still runs and files Jira issues for real failures. Considered instead adding best_effort to the shared ref/workflow (fixes all LP interop consumers) but that is CSPI-QE-owned; this keeps the blast radius to the StackRox jobs we own. Prompt: "how can we wrap or prevent mpiit-data-router-reporter's failure from showing up as a whole-job failure" -> Option A (self-owned config inline). Partially generated with AI assistance (Claude).
|
Skipping CI for Draft Pull Request. |
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Repository YAML (base), Central YAML (inherited) Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (4)
WalkthroughThe change adds the ChangesStackRox Firewatch AWS workflow
Estimated code review effort: 2 (Simple) | ~10 minutes Merge Risk: 🔵 Low · up to The PR adds a post-only workflow wrapper and changes workflow selection in CI configuration. It is mergeable with owner awareness, but the workflow contract and regenerated CI metadata/job definitions should be validated before merge to avoid landing an invalid or incomplete configuration. Suggested reviewers: 🚥 Pre-merge checks | ✅ 15✅ Passed checks (15 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
@davdhacs, Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
|
/ok-to-test |
|
/uncc dvail |
… DR reporter Supersedes the previous config-inline attempt: ci-operator's config schema rejects `best_effort` set alongside a `ref` in post steps (it parses it as a malformed literal step). best_effort is only accepted inside the step-registry (a ref definition or a workflow), so the fix has to live there. Add a StackRox-owned workflow stackrox-firewatch-ipi-aws-cr that reproduces the shared firewatch-ipi-aws-cr exactly but sets allow_best_effort_post_steps and marks the mpiit-data-router-reporter post step best_effort. Point both ACS LP interop tests (cr--acs--tests-aws, acs--tests-aws-fips) at it. This keeps the blast radius to the StackRox jobs we own (rather than editing the CSPI-QE-owned shared ref/workflow) while ensuring an intermittent Data Router / Report Portal 503 (LPINTEROP-6864) no longer fails an otherwise-green job. firewatch-report-issues still runs and files Jira for real failures. Validated locally with determinize-ci-operator and ci-operator-checkconfig. Partially generated with AI assistance (Claude).
|
/pj-rehearse |
|
@davdhacs: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
verify-owners flagged the new OWNERS file with do-not-merge/invalid-owners-file because it listed mtesseract, who is not currently an openshift org member or collaborator. The parent stackrox/OWNERS is grandfathered, but a newly added OWNERS file may not introduce untrusted users. Remove that entry and regenerate the workflow metadata accordingly. Partially generated with AI assistance (Claude).
|
[REHEARSALNOTIFIER]
Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
|
/verify-owners |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: davdhacs, tommartensen The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
|
/pj-rehearse ack |
|
@davdhacs: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
@davdhacs: all tests passed! Full PR test history. Your PR dashboard. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
The interop jobs' post-phase
mpiit-data-router-reporterstep intermittently gets a503 Service Unavailablefrom the Report Portal.Fix: add
best_effort: true, so a Data Router outage no longer fails an otherwise-green job.Partially generated with AI assistance (Claude).
Summary by CodeRabbit
This PR updates StackRox ACS AWS and AWS FIPS interop jobs on
ocp-4.22-lpMainline.mpiit-data-router-reporteras best effort.503 Service Unavailableresponses from failing successful jobs.firewatch-report-issuesactive.