Will a text model achieve 100% performance on the MMLU in five years?
Basic
3
Ṁ402028
28%
chance
1D
1W
1M
ALL
This video predicts that a model will achieve 100% performance on the Massive Multitask Language Understanding Benchmark.
This will resolve YES if a model is listed as having achieved 100 percent performance on the MMLU on papers with code, in a technical document, or published article by 3:00 PM EST June 28, 2028. This will resolve NO if a model is not listed as ahving achieved 100 percent performance on the MMLU.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Who will have the best Text-to-Image Model at the end of 2024 (as decided by the Artificial Analysis Leaderboard)?
End of pre-training era for language models: Will an LM fine-tune for more FLOPs than it is pre-trained for, before 2026
42% chance
Will a open source pure Mamaba LLM surpass 82 MMLU on MMLU (5-shot) before end of year 2024?
25% chance
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
56% chance
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
55% chance
Will the next LLM released by OpenAI be worse than GPT-4 at MMLU?
16% chance
What year will the first AI exceed 80% on MLE-bench?
Will an open-source text-to-music LLM model be able to create an entire album as convincing as a human by end of 2025?
37% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
By 2025 will there be a competitive large language model with >50% of the total training data generated from a large language model?
75% chance