Skip to content

Commit f5fbc9c

Browse files
authored
Expose p50k_edit encoding (openai#32)
1 parent fbaa86e commit f5fbc9c

File tree

2 files changed

+3
-0
lines changed

2 files changed

+3
-0
lines changed

tests/test_simple_public.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,3 +24,5 @@ def test_encoding_for_model():
2424
assert enc.name == "gpt2"
2525
enc = tiktoken.encoding_for_model("text-davinci-003")
2626
assert enc.name == "p50k_base"
27+
enc = tiktoken.encoding_for_model("text-davinci-edit-001")
28+
assert enc.name == "p50k_edit"

tiktoken_ext/openai_public.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -84,4 +84,5 @@ def cl100k_base():
8484
"r50k_base": r50k_base,
8585
"p50k_base": p50k_base,
8686
"cl100k_base": cl100k_base,
87+
"p50k_edit": p50k_edit,
8788
}

0 commit comments

Comments
 (0)