Will OpenAI release a tokenizer with more than 210000 tokens before 2026?
Basic
1
Ṁ792026
24%
chance
1D
1W
1M
ALL
Resolves YES if OpenAI adds support for a tokenizer with more than 210000 tokens to tiktoken (or its successor) before 2026.
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Related questions
Related questions
Will OpenAI release a tokenizer with vocab size > 150k by end of 2024?
42% chance
Will a OpenAI model have over 500k token capacity by the end of 2024.
20% chance
Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?
43% chance
Will OpenAI release an AI product with a cool name by Jan 1, 2025?
40% chance
Will the next major LLM by OpenAI use a new tokenizer?
77% chance
Will OpenAI release a version of Voice Engine by the end of 2024?
81% chance
Will OpenAI release o2 before 2026?
79% chance
Will OpenAI name a year by which they expect to have achieved AGI by 01/01/2025?
14% chance
Will OpenAI release a product with stateful AI agents by 2025?
80% chance
Will OpenAI disappear before 2034?
34% chance