Skip to content

Migrate Kimi-K3 AgentX recipe benchmark placement for srt-slurm v2.43.4 / 迁移 Kimi-K3 AgentX 配置的 benchmark placement 以适配 srt-slurm v2.43.4 - #3767

Closed
cquil11 wants to merge 7 commits into
mainfrom
kimik3-agentx-placement-schema2
Closed

cquil11 wants to merge 7 commits into
mainfrom
kimik3-agentx-placement-schema2

Conversation

@cquil11

@cquil11 cquil11 commented Oct 6, 2026 •

Copy link
Copy Markdown
Collaborator

Description

Follow-up to #3755, targeting its branch. srt-slurm v2.43.4 rejects benchmark.client_placement as a pre-2.0 key, which breaks 11 Kimi-K3 vLLM AgentX recipes that #3755 did not touch (flagged by Alec Ibarra in review):

  • kimik3/vllm/gb200-fp4/agentx/: agg-dcp16-dspark4-maxseq2-mooncake, agg-dcp16-nospec-mooncake, agg-tp8pp2-mooncake-c{16,32,48,72,96}
  • kimik3/vllm/gb300-fp4/agentx/: disagg-1p1d-dcp8-dcp8-dspark4-mooncake, disagg-1p2d-dcp8-dcp8-dspark4-mooncake, disagg-1p3d-dcp8-dcp8-dspark4-mooncake, disagg-1p3d-dcp8-dcp8-dspark7-mooncake

Each file was rewritten with srtctl migrate --in-place from the v2.43.4 pin. The only change is client_placement: head -> placement: {node: head} under benchmark; placement is unchanged. Also adds a line to the #3755 changelog entry.

Local validation (v2.43.4 pin): all 11 recipes pass srtctl dry-run with their own benchmark.concurrencies; infx/tests/launch and changelog tests pass (227 tests); kimik3 full-sweep matrix generates. GPU execution remains unverified.

Note: a dry-run over every schema: 2 recipe also flags three override bundles unrelated to this change (glm5.2/sglang/h200-fp8/agentx/disagg-2p2d-pcp8-tp8-dp8-mtp.yaml, glm5.2/sglang/h200-fp8/agentx/disagg-1p1d-pcp8-tp8-dp8-mtp6-hicache.yaml, dsv4/sglang/h200-fp8/agentx/agg-tp8-mtp-kvoffload.yaml): "telemetry requires the discovery plane on the infra node". Not addressed here.

AI model disclosure

  • Model/version: The exact model identifier could not be verified from the runtime; Claude Opus (Anthropic) prepared this change.
  • Role: Ran the migration, validation, and drafted this PR. No delegated agents contributed.

Type of Change

  • Configuration change

Checklist

中文

改动说明

本 PR 是 #3755 的后续,目标分支为 #3755 的分支。srt-slurm v2.43.4 将 benchmark.client_placement 视为 2.0 之前的字段并拒绝加载,导致 #3755 未涉及的 11 个 Kimi-K3 vLLM AgentX 配置无法使用(由 Alec Ibarra 在评审中指出)。文件列表见上文英文部分。

每个文件均使用 v2.43.4 固定版本中的 srtctl migrate --in-place 重写。唯一改动是将 benchmark 下的 client_placement: head 改为 placement: {node: head},实际放置位置不变。同时在 #3755 的变更记录条目中追加一行说明。

本地验证(v2.43.4):11 个配置在使用各自的 benchmark.concurrencies 时均通过 srtctl dry-run;infx/tests/launch 与变更记录测试通过(227 项);kimik3 full-sweep 矩阵可正常生成。尚未验证 GPU 运行。

另外,对所有 schema: 2 配置执行 dry-run 时,还发现三个与本改动无关的覆盖配置报错("telemetry requires the discovery plane on the infra node"),本 PR 未处理。

AI 模型使用说明

  • 模型/版本:运行环境未提供可核实的完整模型标识;本次使用 Claude Opus(Anthropic)准备改动。
  • 工作内容:执行迁移与验证,并撰写本 PR。没有委派其他 agent。

改动类型与检查状态

配置改动已完成;本地测试已完成。尚未添加扫描标签,也未选择可复用的最终扫描。

RohitNagraj and others added 7 commits October 6, 2026 10:54
将 AgentX SRT 配置迁移至 schema 2,并更新共用的 srt-slurm 版本。

Signed-off-by: Rohit Pujar Nagraj <rpujarnagraj@nvidia.com>
将 schema 迁移的变更记录条目关联到此 PR。

Signed-off-by: Rohit Pujar Nagraj <rpujarnagraj@nvidia.com>
为归档校验测试指定固定参数 ID,避免并行收集时因 gzip 时间戳不同而失败。

Signed-off-by: Rohit Pujar Nagraj <rpujarnagraj@nvidia.com>
合并最新 main,以更新 PR 分支并保留现有配置及变更记录。

Signed-off-by: Rohit Pujar Nagraj <rpujarnagraj@nvidia.com>
合并最新 main,并让 AgentX 配置使用自动注入的黄金接受长度。
…v2.43.4

Replace benchmark.client_placement with benchmark.placement.node in eleven Kimi-K3 vLLM GB200/GB300 AgentX recipes, which the v2.43.4 pin rejects as a v1 key.

将十一个 Kimi-K3 vLLM GB200/GB300 AgentX 配置中的 benchmark.client_placement 替换为 benchmark.placement.node;v2.43.4 固定版本会将前者视为 v1 字段并拒绝加载。
Base automatically changed from srt-schema-2-agentx-recipes to main October 6, 2026 21:49
@cquil11

cquil11 commented Oct 6, 2026

Copy link
Copy Markdown
Collaborator Author

Closing as a duplicate: #3755 now includes these Kimi-K3 recipe migrations. / 作为重复 PR 关闭:#3755 已包含这些 Kimi-K3 配置迁移。

@cquil11 cquil11 closed this Oct 6, 2026
@cquil11
cquil11 deleted the kimik3-agentx-placement-schema2 branch October 6, 2026 21:51

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, straightforward mechanical config migration. I reviewed all 11 recipe diffs and confirmed each is structurally identical: removes the deprecated benchmark.client_placement: head field and adds the equivalent benchmark.placement: { node: head } nested field, with no other content (concurrencies, env, telemetry, topology) changed. The perf-changelog.yaml change is a single new English-only bullet appended at the physical end of the existing PR #3755 entry, consistent with the append-only convention.

Extended reasoning...

The diff touches 11 Kimi-K3 vLLM AgentX srt-slurm recipe YAMLs plus the changelog; verified via git diff that all 11 changes are byte-for-byte structurally identical (one field removed, one nested field added) with no other recipe content altered, and the changelog edit only appends a line at the tail. No security-sensitive surface (auth, crypto, permissions) is touched. No bugs were found by the bug hunting system and no third-party objections appear in the timeline, so this small, mechanical, schema-conformant change is safe to approve without further human review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants