Will a text model achieve 100% performance on the MMLU in five years?
Basic
3
Ṁ402028
28%
chance
1D
1W
1M
ALL
This video predicts that a model will achieve 100% performance on the Massive Multitask Language Understanding Benchmark.
This will resolve YES if a model is listed as having achieved 100 percent performance on the MMLU on papers with code, in a technical document, or published article by 3:00 PM EST June 28, 2028. This will resolve NO if a model is not listed as ahving achieved 100 percent performance on the MMLU.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
56% chance
What year will the first AI exceed 80% on MLE-bench?
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
69% chance
Who will have the best Text-to-Video Model at the end of 2025 (as decided by the Artificial Analysis Leaderboard)?
Will an open-source text-to-music LLM model be able to create an entire album as convincing as a human by end of 2025?
34% chance
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
End of pre-training era for language models: Will an LM fine-tune for more FLOPs than it is pre-trained for, before 2026
42% chance
By 2025 will there be a competitive large language model with >50% of the total training data generated from a large language model?
75% chance
By 2027, will it be generally agreed upon that LLM produced text > human text for training LLMs?
62% chance
Will LLMs' loss function achieve the level of entropy of human text by the end of 2030?
61% chance