Skip to content

refactor: Improve packaging job handling in SlurmExecutor#171

Merged
hemildesai merged 3 commits intomainfrom
hemil/fix-packaging-job-issues
Mar 11, 2025
Merged

refactor: Improve packaging job handling in SlurmExecutor#171
hemildesai merged 3 commits intomainfrom
hemil/fix-packaging-job-issues

Conversation

@hemildesai
Copy link
Contributor

@hemildesai hemildesai commented Mar 10, 2025

NOTE: For relevant diff see 8216055

  • Add get_packaging_job_key() to generate unique packaging job keys using experiment ID
  • Update packaging job tracking to use experiment-specific keys
  • Modify packaging job deserialization to handle legacy dictionary format
  • Enhance experiment initialization with optional component defaults
  • Improve tunnel scheduler initialization with optional experiment context

This refactoring ensures more robust and flexible packaging job management across different execution contexts.

- Add `get_packaging_job_key()` to generate unique packaging job keys using experiment ID
- Update packaging job tracking to use experiment-specific keys
- Modify packaging job deserialization to handle legacy dictionary format
- Enhance experiment initialization with optional component defaults
- Improve tunnel scheduler initialization with optional experiment context

This refactoring ensures more robust and flexible packaging job management across different execution contexts.

Signed-off-by: Hemil Desai <hemild@nvidia.com>
Signed-off-by: Hemil Desai <hemild@nvidia.com>
Signed-off-by: Hemil Desai <hemild@nvidia.com>
@titu1994
Copy link
Contributor

Is the uv lock part of this pr ? Otherwise looks good !

@hemildesai
Copy link
Contributor Author

hemildesai commented Mar 10, 2025

Is the uv lock part of this pr ? Otherwise looks good !

That's just an update to the dependency lockfile that got outdated. Should be safe.

@hemildesai hemildesai merged commit 7f0210c into main Mar 11, 2025
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants