Skip to content

chore: allow using a custom wheel on slurm#338

Open
mckornfield wants to merge 1 commit intomainfrom
allow-wheel-on-slurm/mck
Open

chore: allow using a custom wheel on slurm#338
mckornfield wants to merge 1 commit intomainfrom
allow-wheel-on-slurm/mck

Conversation

@mckornfield
Copy link
Copy Markdown
Collaborator

  • make the slurm matrix/ run scripts take in an optional nss-version

@mckornfield mckornfield requested a review from a team as a code owner April 1, 2026 19:50
Copilot AI review requested due to automatic review settings April 1, 2026 19:50
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds an option to run the Slurm experiment matrix using a published nemo-safe-synthesizer package version (via PyPI) instead of relying on a repo-based uv sync install, enabling faster/alternative dependency setup for cluster runs.

Changes:

  • Add --nss-version flag to the Slurm submission script and export it into the job environment.
  • Update the Slurm matrix runner to conditionally install nemo-safe-synthesizer==<version> into a versioned venv on Lustre and route executions through that install.
  • Switch the matrix runner to invoke the CLI via a configurable command (NSS_RUN_CMD) for repo vs PyPI modes.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 7 comments.

File Description
script/slurm/submit_slurm_jobs.sh Adds CLI flag + help text and exports NSS_VERSION for downstream Slurm jobs.
script/slurm/slurm_nss_matrix.sh Implements conditional PyPI install flow and uses NSS_RUN_CMD for train/generate/end-to-end runs.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@mckornfield mckornfield force-pushed the allow-wheel-on-slurm/mck branch from 0b3bdb5 to 77694fc Compare April 1, 2026 19:57
Copilot AI review requested due to automatic review settings April 1, 2026 20:47
@mckornfield mckornfield force-pushed the allow-wheel-on-slurm/mck branch from 77694fc to f6d32ca Compare April 1, 2026 20:47
@mckornfield mckornfield force-pushed the allow-wheel-on-slurm/mck branch from f6d32ca to 8e97076 Compare April 1, 2026 20:49
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Signed-off-by: Matt Kornfield <mkornfield@nvidia.com>
@mckornfield mckornfield force-pushed the allow-wheel-on-slurm/mck branch from 8e97076 to 3f0af94 Compare April 1, 2026 20:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants