Skip to content

feat(verl): add MigrationBench Megatron LoRA recipe - #114

Merged
luyuzhe111 merged 3 commits into
mainfrom
migration_agent
Aug 25, 2026
Merged

feat(verl): add MigrationBench Megatron LoRA recipe#114
luyuzhe111 merged 3 commits into
mainfrom
migration_agent

Conversation

@luyuzhe111

@luyuzhe111 luyuzhe111 commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add a MigrationBench GRPO recipe for Qwen3-Coder using Megatron, LoRA, AgentCore rollouts, and W&B
  • add a Python 3.12 Megatron dependency group with NVIDIA Megatron-Bridge and CUDA 13 Transformer Engine wheels
  • recognize Qwen3-Coder's chat template as the qwen3_5 tool-call schema

Validation

Screenshot 2026-08-24 at 4 15 08 PM
  • ran the recipe end to end against the deployed migration agent runtime
  • pytest -q tests/backends/experimental/verl (53 passed)
  • pytest -q tests/rollout_gateway/test_response_schemas.py (7 passed)
  • live Qwen3-Coder template-hash test (1 passed)
  • uv lock --check and locked Megatron sync dry run
  • pre-commit hooks

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this already in /examples/strands_migration_agent?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Linbo-Liu ah good catch. some functionalities do overlap. the code here however also addresses verl dataset format compatibility requirements.

we should in-theory reuse these functions but they are not really importable from the trainer environment. but to avoid inconsistencies i added a docstring to this file. does this work?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SG!

@luyuzhe111
luyuzhe111 merged commit bbb5e27 into main Aug 25, 2026
7 of 8 checks passed
@luyuzhe111
luyuzhe111 deleted the migration_agent branch August 25, 2026 22:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants