Skip to content

o3 and o3-mini support for tokenizer #7375

@Peter-Juhasz

Description

@Peter-Juhasz

Is your feature request related to a problem? Please describe.
Related to openai/tiktoken#374

Describe the solution you'd like
TiktokenTokenizer.CreateForModel support for new models

Describe alternatives you've considered
Configure encoding and tokenizer manually.

Additional context

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions