Repository navigation

fix(routing): classify tokenizer text before binary formats - #1629

Merged

mldangelo-oai merged 18 commits into

mainfrom

mdangelo/codex/hf-fp-t05-tokenizer-text-routing-20260610

Jun 12, 2026

Commits on Jun 10, 2026

fix(routing): classify tokenizer text before binary formats
mldangelo-oai
committed
5a60f92

Commits on Jun 11, 2026

Merge remote-tracking branch 'origin/main' into HEAD
mldangelo-oai
committed
9e2ae12
fix(routing): preserve fail-closed utf8 binary candidates
mldangelo-oai
committed
45360b7
fix(routing): bound large tokenizer text ownership
mldangelo-oai
committed
6d2621a
fix(routing): keep invalid json protobuf candidates fail-closed
mldangelo-oai
committed
752bfdf
fix(routing): require text structure for utf8 ownership
mldangelo-oai
committed
40c514f
fix(routing): preserve protobuf candidates under text suffixes
mldangelo-oai
committed
6e9eef5
fix(routing): keep text suffix binary probes fail-closed
mldangelo-oai
committed
7052960
test(routing): stabilize json protobuf candidate regression
mldangelo-oai
committed
16c6224
fix(routing): validate text protobuf candidate values
mldangelo-oai
committed
3b286cc
fix(routing): align HF tokenizer text routing\n\nMirror bounded text-owner routing in Hugging Face streaming selection so complete tokenizer/config text is not promoted to binary model scanners whi…
mldangelo-oai
committed
39c78cd
Merge current main into PR 1629
mldangelo-oai
authored
0edfb7d
Merge current main into PR 1629
mldangelo-oai
authored
6c2e39f
Merge current main into PR 1629
mldangelo-oai
authored
78668aa

Commits on Jun 12, 2026