chore: trigger NVSkills CI for cuopt-routing-api-python by ramakrishnap-nv · Pull Request #1676 · NVIDIA/cuopt

ramakrishnap-nv · 2026-08-05T20:33:06Z

Trivial blank-line addition after SKILL.md frontmatter to trigger NVSkills CI — fetch updated skill card and benchmark for cuopt-routing-api-python.

ramakrishnap-nv · 2026-08-05T20:34:58Z

/nvskills-ci

coderabbitai · 2026-08-05T20:36:11Z

📝 Walkthrough

Walkthrough

The cuOpt routing skill package received updated documentation metadata, six evaluation cases, benchmark results and methodology, skill-card content, and in-toto attestation data.

Changes

Routing skill publication refresh

Layer / File(s)	Summary
Skill metadata and formatting `skills/cuopt-routing-api-python/SKILL.md`, `skills/cuopt-routing-api-python/skill-card.md`	Updated document spacing, wording, references, evaluator identifiers, evaluation tasks, benchmark dimensions, signals, and results.
Evaluation publication report `skills/cuopt-routing-api-python/evals/evals.json`, `skills/cuopt-routing-api-python/BENCHMARK.md`	Added six routing API evaluation cases and updated publication metadata, model results, findings, scoring methodology, thresholds, and regeneration criteria.
Attestation refresh `skills/cuopt-routing-api-python/skill.oms.sig`	Replaced the attestation payload, subject and resource digests, serialization metadata, and DSSE signature.

Estimated code review effort: 2 (Simple) | ~10 minutes

Suggested reviewers: iroy30, tmckayus

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title clearly states that the change triggers NVSkills CI for the specified routing API skill.
Description check	✅ Passed	The description accurately explains the blank-line change and its purpose of triggering CI and refreshing related reports.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests
Commit unit tests in branch chore/nvskills-ci-cuopt-routing-api-python

_{Comment @coderabbitai help to get the list of available commands.}

github-actions · 2026-08-05T21:08:48Z

CI Test Summary

⏭️ All 5 test job(s) skipped.

ramakrishnap-nv · 2026-08-05T21:58:54Z

/nvskills-ci

Signed-off-by: nvskills-svc-account <svc-nvskills-signing@nvidia.com>

copy-pr-bot · 2026-08-05T22:12:25Z

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

coderabbitai

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents

Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@skills/cuopt-routing-api-python/BENCHMARK.md`:
- Line 37: Correct the Codex overall uplift from +22 points to +23 points in
skills/cuopt-routing-api-python/BENCHMARK.md at lines 37-37 and
skills/cuopt-routing-api-python/skill-card.md at lines 70-70, then regenerate
skill.oms.sig to keep the benchmark artifacts consistent.

🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

Push a commit to this branch (recommended)
Create a new PR with the fixes

ℹ️ Review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 8f7b3efa-2b32-4796-999d-6d15f667fc1c

📥 Commits

Reviewing files that changed from the base of the PR and between fd2951f and bf0fe85.

📒 Files selected for processing (3)

skills/cuopt-routing-api-python/BENCHMARK.md
skills/cuopt-routing-api-python/skill-card.md
skills/cuopt-routing-api-python/skill.oms.sig

coderabbitai · 2026-08-05T22:16:09Z

-Underlying evaluation signals used in this run:
+| Measure | Claude Code (Baseline → Skill Uplift) | Codex (Baseline → Skill Uplift) |
+|---|---:|---:|
+| Overall | 52% → 95% (+43 points) | 60% → 83% (+22 points) |


🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win

Keep the Codex uplift consistent across both reports.

The documented formula is skill score - baseline score. The Codex result is 83% - 60% = +23 points, not +22 points. Correct both rows and regenerate skill.oms.sig.

skills/cuopt-routing-api-python/BENCHMARK.md#L37-L37: change the Codex overall uplift from +22 points to +23 points.

skills/cuopt-routing-api-python/skill-card.md#L70-L70: change the matching summary value from +22 points to +23 points.

Proposed correction

- | Overall | 52% → 95% (+43 points) | 60% → 83% (+22 points) | + | Overall | 52% → 95% (+43 points) | 60% → 83% (+23 points) |

📍 Affects 2 files

skills/cuopt-routing-api-python/BENCHMARK.md#L37-L37 (this comment)

skills/cuopt-routing-api-python/skill-card.md#L70-L70

🤖 Prompt for AI Agents

Verify each finding against current code. Fix only still-valid issues, skip the rest with a brief reason, keep changes minimal, and validate. In `@skills/cuopt-routing-api-python/BENCHMARK.md` at line 37, Correct the Codex overall uplift from +22 points to +23 points in skills/cuopt-routing-api-python/BENCHMARK.md at lines 37-37 and skills/cuopt-routing-api-python/skill-card.md at lines 70-70, then regenerate skill.oms.sig to keep the benchmark artifacts consistent.

ramakrishnap-nv · 2026-08-06T00:48:51Z

/ok to test bf0fe85

ramakrishnap-nv · 2026-08-06T14:46:31Z

/ok to test 22b6e5e

ramakrishnap-nv · 2026-08-07T17:53:26Z

/ok to test 7bccfef

A single eval gives the NVSkills Tier 3 live-agent evaluation almost no signal about the skill. Add six cases covering areas the skill documents but the existing eval does not exercise: solution status codes and the get_error_message / get_infeasible_orders triage path, add_capacity_dimension, set_pickup_delivery_pairs versus add_order_precedence, the explicit float32/int32 dtype requirement, the compute_waypoint_sequence in-place mutation gotcha, and the fact that routing has no C API. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Signed-off-by: Ramakrishna Prabhu <ramakrishnap@nvidia.com>

ramakrishnap-nv · 2026-08-12T15:18:13Z

/nvskills-ci

Signed-off-by: nvskills-svc-account <svc-nvskills-signing@nvidia.com>

coderabbitai

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents

Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@skills/cuopt-routing-api-python/BENCHMARK.md`:
- Line 40: Update the Claude Code Discoverability uplift from “+71 points” to
“+72 points” in skills/cuopt-routing-api-python/BENCHMARK.md lines 40-40 and the
matching entry in skills/cuopt-routing-api-python/skill-card.md lines 73-73;
then regenerate skills/cuopt-routing-api-python/skill.oms.sig to reflect both
publication changes.

🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

Push a commit to this branch (recommended)
Create a new PR with the fixes

ℹ️ Review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 0737cebc-34f9-4096-8204-0fddc0119e51

📥 Commits

Reviewing files that changed from the base of the PR and between 00a2573 and 14d7093.

📒 Files selected for processing (3)

skills/cuopt-routing-api-python/BENCHMARK.md
skills/cuopt-routing-api-python/skill-card.md
skills/cuopt-routing-api-python/skill.oms.sig

🚧 Files skipped from review as they are similar to previous changes (1)

skills/cuopt-routing-api-python/skill.oms.sig

coderabbitai · 2026-08-12T17:08:41Z

+| Overall | 54% → 91% (+37 points) | 60% → 86% (+26 points) |
+| Security | 100% → 100% (±0 points) | 100% → 100% (±0 points) |
+| Correctness | 77% → 91% (+14 points) | 80% → 100% (+20 points) |
+| Discoverability | 21% → 93% (+71 points) | 50% → 88% (+38 points) |


🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win

Correct the Discoverability uplift in both publication artifacts.

Both rows show 21% → 93% (+71 points). The correct uplift is +72 points.

skills/cuopt-routing-api-python/BENCHMARK.md#L40-L40: change the Claude Code Discoverability uplift to +72 points.

skills/cuopt-routing-api-python/skill-card.md#L73-L73: change the matching Discoverability uplift to +72 points.

Regenerate skills/cuopt-routing-api-python/skill.oms.sig after updating both reports.

📍 Affects 2 files

skills/cuopt-routing-api-python/BENCHMARK.md#L40-L40 (this comment)

skills/cuopt-routing-api-python/skill-card.md#L73-L73

🤖 Prompt for AI Agents

Verify each finding against current code. Fix only still-valid issues, skip the rest with a brief reason, keep changes minimal, and validate. In `@skills/cuopt-routing-api-python/BENCHMARK.md` at line 40, Update the Claude Code Discoverability uplift from “+71 points” to “+72 points” in skills/cuopt-routing-api-python/BENCHMARK.md lines 40-40 and the matching entry in skills/cuopt-routing-api-python/skill-card.md lines 73-73; then regenerate skills/cuopt-routing-api-python/skill.oms.sig to reflect both publication changes.

ramakrishnap-nv · 2026-08-13T16:17:19Z

/ok to test 14d7093

ramakrishnap-nv · 2026-08-13T18:09:21Z

/merge

chore: trigger NVSkills CI for cuopt-routing-api-python

fd2951f

ramakrishnap-nv requested a review from a team as a code owner August 5, 2026 20:33

ramakrishnap-nv requested a review from Iroy30 August 5, 2026 20:33

ramakrishnap-nv added improvement Improves an existing functionality non-breaking Introduces a non-breaking change labels Aug 5, 2026

Merge branch 'main' into chore/nvskills-ci-cuopt-routing-api-python

0446006

Attach NVSkills validation signatures

bf0fe85

Signed-off-by: nvskills-svc-account <svc-nvskills-signing@nvidia.com>

coderabbitai Bot reviewed Aug 5, 2026

View reviewed changes

Merge branch 'main' into chore/nvskills-ci-cuopt-routing-api-python

22b6e5e

Merge branch 'main' into chore/nvskills-ci-cuopt-routing-api-python

7bccfef

Iroy30 approved these changes Aug 7, 2026

View reviewed changes

coderabbitai Bot mentioned this pull request Aug 11, 2026

chore: trigger NVSkills CI for cuopt-skill-evolution #1678

Open

Merge branch 'main' into chore/nvskills-ci-cuopt-routing-api-python

20b8fbb

Attach NVSkills validation signatures

14d7093

Signed-off-by: nvskills-svc-account <svc-nvskills-signing@nvidia.com>

coderabbitai Bot reviewed Aug 12, 2026

View reviewed changes

This was referenced Aug 12, 2026

chore: trigger NVSkills CI for cuopt-install #1672

Open

chore: trigger NVSkills CI for cuopt-user-rules #1679

Merged

Iroy30 approved these changes Aug 13, 2026

View reviewed changes

rapids-bot Bot merged commit c5758d1 into main Aug 13, 2026
50 checks passed

Uh oh!

Conversation

ramakrishnap-nv commented Aug 5, 2026

Uh oh!

ramakrishnap-nv commented Aug 5, 2026

Uh oh!

coderabbitai Bot commented Aug 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Walkthrough

Changes

Uh oh!

github-actions Bot commented Aug 5, 2026

CI Test Summary

Uh oh!

ramakrishnap-nv commented Aug 5, 2026

Uh oh!

copy-pr-bot Bot commented Aug 5, 2026

Uh oh!

coderabbitai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

coderabbitai Bot Aug 5, 2026

Choose a reason for hiding this comment

Uh oh!

ramakrishnap-nv commented Aug 6, 2026

Uh oh!

ramakrishnap-nv commented Aug 6, 2026

Uh oh!

ramakrishnap-nv commented Aug 7, 2026

Uh oh!

ramakrishnap-nv commented Aug 12, 2026

Uh oh!

coderabbitai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

coderabbitai Bot Aug 12, 2026

Choose a reason for hiding this comment

Uh oh!

ramakrishnap-nv commented Aug 13, 2026

Uh oh!

ramakrishnap-nv commented Aug 13, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

coderabbitai Bot commented Aug 5, 2026 •

edited

Loading