recipe(cross-encoder): add MiniLM L2 text-classification recipes#1143
Open
kujin66 wants to merge 1 commit into
Open
recipe(cross-encoder): add MiniLM L2 text-classification recipes#1143kujin66 wants to merge 1 commit into
kujin66 wants to merge 1 commit into
Conversation
kujin66
force-pushed
the
kujin66/add-cross-encoder-minilm-l2-recipe
branch
from
July 20, 2026 08:43
e882392 to
f9b7b63
Compare
Author
|
APPROVE (coverage: full for target EPs cpu and dml-gpu) Reviewer checks performed:
No requested changes. |
kujin66
marked this pull request as ready for review
July 20, 2026 08:48
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds catalog recipes for
cross-encoder/ms-marco-MiniLM-L2-v2as a BERT text-classification model. This is an L0 recipe-only contribution: currentorigin/mainalready builds the model via default BERT support, while the checked-in recipes make CPU/DML fp32/fp16 variants discoverable and reproducible. The producer-side Goal ladder reached L1 on reachable CPU and DML GPU EPs.1. Recipe Path(s)
examples/recipes/cross-encoder_ms-marco-MiniLM-L2-v2/cpu/cpu/text-classification_fp32_config.jsonexamples/recipes/cross-encoder_ms-marco-MiniLM-L2-v2/cpu/cpu/text-classification_fp16_config.jsonexamples/recipes/cross-encoder_ms-marco-MiniLM-L2-v2/dml/gpu/text-classification_fp32_config.jsonexamples/recipes/cross-encoder_ms-marco-MiniLM-L2-v2/dml/gpu/text-classification_fp16_config.json2. README Row
Added
cross-encoder/ms-marco-MiniLM-L2-v2 | text-classificationtoexamples/recipes/README.md; total count updated from 75 to 76.3. Build Output Dir
temp/baseline_cross_encoder_ms_marco_minilm_l2_v2_rebasedtemp/cross_encoder_ms_marco_minilm_l2_v2_cpu_fp32temp/cross_encoder_ms_marco_minilm_l2_v2_cpu_fp16_recipetemp/cross_encoder_ms_marco_minilm_l2_v2_dml_fp32temp/cross_encoder_ms_marco_minilm_l2_v2_dml_fp16_recipe4. Build Log
Baseline command:
Baseline result:
Build complete in 18.7s; final artifacttemp\baseline_cross_encoder_ms_marco_minilm_l2_v2_rebased\model.onnx.Recipe build results:
Build complete in 11.2s; final artifacttemp\cross_encoder_ms_marco_minilm_l2_v2_cpu_fp32\model.onnx.Build complete in 13.0s; FP16 stage ran; final artifacttemp\cross_encoder_ms_marco_minilm_l2_v2_cpu_fp16_recipe\model.onnx.Build complete in 11.9s; final artifacttemp\cross_encoder_ms_marco_minilm_l2_v2_dml_fp32\model.onnx.Build complete in 13.0s; FP16 stage ran; final artifacttemp\cross_encoder_ms_marco_minilm_l2_v2_dml_fp16_recipe\model.onnx.Structural validation:
5. Appended Findings
model_knowledge/bert.json,bert-001.winml analyzecould not run on this host becausesrc/winml/modelkit/analyze/rules/runtime_check_rulescontains onlyREADME.md; exact CLI error wasNo runtime rule parquet files were found.6. Optimum-Coverage Probe
winml inspect -m cross-encoder/ms-marco-MiniLM-L2-v2 --format jsonresolved:model_type:bertarchitectures:BertForSequenceClassificationtask:text-classificationBertIOConfigWinMLModelForSequenceClassification7. Claimed (Effort, Goal, Outcome)
{ "model_id": "cross-encoder/ms-marco-MiniLM-L2-v2", "model_type": "bert", "effort": "L0", "goal_ceiling": "L1", "outcome": "L0", "target_eps": ["cpu", "dml-gpu"], "optimum_probe": { "vendor": ["feature-extraction", "fill-mask", "multiple-choice", "question-answering", "text-classification", "token-classification"], "after_winml": ["feature-extraction", "fill-mask", "multiple-choice", "question-answering", "text-classification", "token-classification"], "added_by_winml": [], "verdict": "VENDOR-ONLY" }, "catalog_gate": { "baseline_build": "PASS", "baseline_head": "238bd386d77381b70e03377295a1f40a69982576", "winml_version": "0.2.0", "verdict": "catalog-needs-numbers", "file_pr": true } }8. Goal-Ladder Verdict Table
origin/mainPASS at238bd386d77381b70e03377295a1f40a69982576; CPU fp32/fp16 and DML fp32/fp16 recipe builds all completed; ONNX structural validation matched recipe I/O.['DmlExecutionProvider', 'CPUExecutionProvider']. Baseline CPU fp32: 17.641 ms mean, 56.69 samples/s. CPU fp32 recipe: 18.827 ms mean, 53.12 samples/s. CPU fp16 recipe: 27.079 ms mean, 36.93 samples/s. DML fp32 recipe: 15.724 ms mean, 63.60 samples/s. DML fp16 recipe: 13.416 ms mean, 74.54 samples/s.9. Methodology-Evolution Declaration
No methodology friction observed. The only host gap was missing analyze parquet rules; this is already covered by the reviewer guidance that accepts explicit analyze-unavailable evidence when the rules directory contains only
README.md.