Skip to content

Conversation

@ethan-tyler
Copy link
Contributor

Summary

  • Completes parity-driven orchestration work on schedules + run UX (selection + reruns) with CI-gated proofs.
  • Hardens idempotency: canonical partitionKey contract + backward-compatible run_key fingerprinting and a bounded retry for rare reservation visibility races.
  • Adds explicit request size/cardiinality limits for trigger/rerun/backfill inputs (and caps legacy partitions-derived canonical partitionKey length).

Verification

  • cargo test -p arco-flow --lib
  • cargo test -p arco-api --all-features --tests
  • cargo fmt --all

Makes run_key_index/run_key_conflicts durable and adds deterministic sensor E2E coverage for CAS, idempotency, and conflicts.
Adds selection parsing/building utilities and expands orchestration routes/tests; updates OpenAPI contract.
- Add rerun modes (fromFailure/subset)

- Expose parentRunId + rerunKind on run read/list

- Reject reserved lineage labels; update OpenAPI wiring and parity gates
Sync checked-in OpenAPI JSON with current routes and schemas.
Add evidence links for rerun endpoint, lineage surfacing, and CI-gated parity tests.
Defines TriggerRun partitionKey contract and normalizes run_key fingerprints for backward-compatible dedupe. Adds Python canonical JSON/partition/id parity tests and runs them in CI to prevent cross-language drift.
Strip ANSI escapes before asserting on Typer help output and update lockfile test to validate UUID AssetId format.
Expose rerun-from-failure and subset reruns via both arco and arco-flow CLIs, including SDK/client wiring and lineage display. Update parity-08 documentation and matrix evidence.
Move Cargo artifacts to /mnt and reduce debuginfo to avoid disk exhaustion during linking.
Add bounded read-retry for rare run_key reservation visibility races and enforce explicit size/cardiinality limits on trigger/rerun/backfill inputs. Also cap legacy partitions-derived canonical partitionKey length to avoid DoS and drift.
Treat duplicate TaskKey/task_id plan build failures as a valid rejection in proptest, since the generator can produce duplicates.
@ethan-tyler ethan-tyler merged commit 018bfc9 into main Jan 23, 2026
17 checks passed
@ethan-tyler ethan-tyler deleted the feat/orchestration-parity-06-schedules branch January 23, 2026 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants