What happened
On PR #3293, the code agent (run 32087179159) updated source.json to upstream commit 0a6959a and bumped metadata for 3 plugins as listed in issue #3290. However, the new upstream ref encompassed version changes for 6 plugins total — 3 intermediate plugins (ai-model-server 0.2.0→0.3.0, ai-resource-agent 0.2.1→0.4.0, ai-resource-extensions 0.4.0→0.5.0) were bumped in earlier Version Packages commits (44a5e4c, fc8ce3b) between the old and new refs. The human maintainer had to push 2 fix commits (0196e16, 33506b9) to correct the missing metadata, and the first /publish (run 32139842536) failed due to the version mismatch before the fixes were complete.
What could go better
The code agent faithfully implemented the issue specification, which only listed 3 plugins. The issue was manually created and did not account for intermediate version bumps between the old and new upstream refs. Existing issue #3032 proposes a workspace update procedure focused on supportedVersions/OCI tag alignment with versions.json, but does not address the completeness question: how to determine which plugins need updating. The code agent needs guidance to independently verify that ALL metadata versions in the workspace match the upstream source at the target ref, rather than relying solely on the issue description to enumerate which plugins changed. Confidence: high — the metadata validation gate is deterministic, and this same class of error (incomplete metadata updates) has occurred on prior PRs (#2896 per issue #2970, #3013 per issue #3032).
Proposed change
Add a step to the workspace update procedure in AGENTS.md (complementing the procedure proposed in #3032). After updating source.json, the code agent should:
- Read
plugins-list.yaml to enumerate all plugins exported from this workspace.
- For each plugin, check the upstream
package.json at the new repo-ref to get the actual version.
- Compare against the corresponding
metadata/*.yaml file's spec.version.
- Update any metadata file where the version differs — bumping
spec.version, spec.dynamicArtifact OCI tag, and any other version-dependent fields.
Example AGENTS.md text:
### Verifying metadata completeness on workspace updates
When updating `source.json` to a new upstream ref, do not rely solely on the
issue description to determine which plugins need metadata updates. The upstream
ref may encompass version changes across multiple intermediate commits.
Enumerate all plugins in `plugins-list.yaml`, check each plugin's `package.json`
at the new ref for its current version, and update any `metadata/*.yaml` file
where `spec.version` or the OCI tag no longer matches.
Validation criteria
The next 3 workspace version update PRs created by the code agent should include metadata updates for ALL plugins whose versions changed between the old and new upstream refs — not just the ones explicitly listed in the issue. Verify by checking that no /publish run fails with metadata version mismatch errors, and that no human fix commits are needed to add missing metadata updates.
Generated by retro agent from #3293
What happened
On PR #3293, the code agent (run 32087179159) updated
source.jsonto upstream commit0a6959aand bumped metadata for 3 plugins as listed in issue #3290. However, the new upstream ref encompassed version changes for 6 plugins total — 3 intermediate plugins (ai-model-server 0.2.0→0.3.0, ai-resource-agent 0.2.1→0.4.0, ai-resource-extensions 0.4.0→0.5.0) were bumped in earlier Version Packages commits (44a5e4c,fc8ce3b) between the old and new refs. The human maintainer had to push 2 fix commits (0196e16,33506b9) to correct the missing metadata, and the first/publish(run 32139842536) failed due to the version mismatch before the fixes were complete.What could go better
The code agent faithfully implemented the issue specification, which only listed 3 plugins. The issue was manually created and did not account for intermediate version bumps between the old and new upstream refs. Existing issue #3032 proposes a workspace update procedure focused on
supportedVersions/OCI tag alignment withversions.json, but does not address the completeness question: how to determine which plugins need updating. The code agent needs guidance to independently verify that ALL metadata versions in the workspace match the upstream source at the target ref, rather than relying solely on the issue description to enumerate which plugins changed. Confidence: high — the metadata validation gate is deterministic, and this same class of error (incomplete metadata updates) has occurred on prior PRs (#2896 per issue #2970, #3013 per issue #3032).Proposed change
Add a step to the workspace update procedure in AGENTS.md (complementing the procedure proposed in #3032). After updating
source.json, the code agent should:plugins-list.yamlto enumerate all plugins exported from this workspace.package.jsonat the newrepo-refto get the actual version.metadata/*.yamlfile'sspec.version.spec.version,spec.dynamicArtifactOCI tag, and any other version-dependent fields.Example AGENTS.md text:
Validation criteria
The next 3 workspace version update PRs created by the code agent should include metadata updates for ALL plugins whose versions changed between the old and new upstream refs — not just the ones explicitly listed in the issue. Verify by checking that no
/publishrun fails with metadata version mismatch errors, and that no human fix commits are needed to add missing metadata updates.Generated by retro agent from #3293