Add typed checkpoint weight records - #666
Conversation
Performance Comparison
|
b2b820e to
fabb835
Compare
fabb835 to
b1ea32f
Compare
b1ea32f to
e02875f
Compare
b549476 to
501c342
Compare
e02875f to
ea9c144
Compare
Resolve task roles, module paths, and HuggingFace source ownership into one immutable manifest. Switch inspection and optimization-role lookup to the shared metadata without changing graph or weight behavior. Signed-off-by: Xiaoyu Zhang <xiaoyuzhang@microsoft.com>
Derive candidate HuggingFace module names from component-local paths so later loader stages can apply exact and regex quantization exclusions consistently. Signed-off-by: Xiaoyu Zhang <xiaoyuzhang@microsoft.com>
Only derive HuggingFace module candidates when a declared source root shares an anchor with the component-local path, preventing unrelated roots such as lm_head from matching every decoder module. Signed-off-by: Xiaoyu Zhang <xiaoyuzhang@microsoft.com>
Allow model declarations to map component-local module prefixes to HuggingFace source prefixes when structural anchor inference is insufficient. Signed-off-by: Xiaoyu Zhang <xiaoyuzhang@microsoft.com>
Rename module_path to module_attribute_path and document task-defined optimization roles so callers cannot confuse Python module ownership with package or checkpoint prefixes. Signed-off-by: Xiaoyu Zhang <xiaoyuzhang@microsoft.com>
501c342 to
1f47daa
Compare
Group affine packed sidecars into component-owned logical records and introduce a quantization codec registry over the existing Olive, GPTQ, and AWQ normalization helpers. The active loader remains unchanged. Signed-off-by: Xiaoyu Zhang <xiaoyuzhang@microsoft.com>
Update typed weight fixtures for the clarified ComponentDescriptor API. Signed-off-by: Xiaoyu Zhang <xiaoyuzhang@microsoft.com>
ea9c144 to
15c0dfc
Compare
|
@copilot resolve the merge conflicts in this pull request |
…-pipeline # Conflicts: # src/mobius/_builder.py Co-authored-by: xiaoyu-work <85524621+xiaoyu-work@users.noreply.github.com>
Resolved in a471d34 (merge commit 010ae62): merged origin/main, conflict was in |
|
|
| config: QuantizationConfig, | ||
| ) -> WeightBundle: | ||
| """Group checkpoint sidecars into typed logical records.""" | ||
| ... |
| config: QuantizationConfig, | ||
| ) -> dict[str, torch.Tensor]: | ||
| """Convert one packed record to Mobius's canonical parameter layout.""" | ||
| ... |
Summary
WeightRecord,PackedWeight, and component-ownedWeightBundleabstractionsquant_methodStack
Validation