When will humanity's last exam be saturated? (>80%)
Plus
43
Ṁ83312030
3%
2025
37%
2026
31%
2027
6%
2028
4%
2029
3%
2030
17%
later / never
Resolves to the year in which an AI first achieves an accuracy of at least 80%.
Text-only models are allowed. o3-mini (high) is currently in the lead with an accuracy of 13.0%
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
What does this resolve to if it never gets >80%, e.g. if more than 20% of the questions are broken? I'm guessing "later"
Related questions
Related questions
Humanity's Last Exam score in 2025?
-
Which of FrontierMath and Humanity's Last Exam will be saturated (>80%) first?
Top score on Humanity's Last Exam > 50% by 2028?
60% chance
Top score on Humanity's Last Exam > 80% by what year?
Top score on Humanity's Last Exam > 50% by 2029?
91% chance
Top score on Humanity's Last Exam > 50% by 2027?
50% chance
Top score on Humanity's Last Exam > 90% by what year?
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
Top score on Humanity's Last Exam > 70% by what year?
Top score on Humanity's Last Exam > 60% by what year?