Skip to content

Document ONNX operator contracts for TensorRT - #10

Draft
rui-ren with Copilot wants to merge 2 commits into
mainfrom
copilot/onnx-tensorrt-domains-schema-attributes
Draft

Document ONNX operator contracts for TensorRT#10
rui-ren with Copilot wants to merge 2 commits into
mainfrom
copilot/onnx-tensorrt-domains-schema-attributes

Conversation

Copilot AI commented Sep 4, 2026

Copy link
Copy Markdown

ONNX node semantics depend on the operator name, domain, imported opset, and schema. This adds Day 2 notes connecting those contracts to Mobius’s opset-24 requirements and TensorRT compatibility.

  • Operator semantics

    • Explains domains, opset imports, schemas, and attributes.
    • Distinguishes ordered tensor inputs from node configuration.
  • Mobius Attention contract

    • Identifies nonpad_kv_seqlen as tensor input index 6.
    • Identifies q_num_heads, kv_num_heads, scale, and is_causal as attributes.
  • Opset lowering

    • Documents why TensorScatter and populated Attention input 6 prevent safe lowering to opset 23.
  • TensorRT portability

    • Explains why checker-valid standard or vendor-domain nodes may remain unsupported by TensorRT.
    • Records the working-tree branch reference observed during inspection.
Attention(..., nonpad_kv_seqlen, q_num_heads=..., kv_num_heads=...)
               tensor input #6   attributes

Copilot AI linked an issue Sep 4, 2026 that may be closed by this pull request
5 tasks
Explain how domains, imported opsets, schemas, and attributes define node contracts. Document Mobius's opset-24 static-cache requirements and TensorRT parser portability risks.

Signed-off-by: GitHub <noreply@github.com>

Co-authored-by: rui-ren <15321482+rui-ren@users.noreply.github.com>
Copilot AI changed the title [WIP] Explain domains, opsets, schemas, and attributes in ONNX nodes Document ONNX operator contracts for TensorRT Sep 4, 2026
Copilot AI requested a review from rui-ren September 4, 2026 16:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ONNX for TensorRT — Day 2: Inspect what TensorRT must parse

2 participants