What is Grok 4's performance on METR's task length evaluation?
10
Ṁ5442026
18%
0 to 1.5 Hours
42%
1.5 to 2 Hours
32%
2 to 2.5 Hours
7%
2.5 to 3 Hours
1.3%
More than 3 Hours
Resolves based on the METR's measurement of the duration of tasks that can complete with a 50% success rate.
https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/
Grok 4 Heavy does not count
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
Related questions
Related questions
What is Grok 4 Heavy's performance on METR's task length evaluation?
Open-source OpenAI model beats Grok 4 on LMArena?
23% chance
GPT-5 vs Grok-2+: who will be funnier?
Grok 4 Heavy gets on Humanity's Last Exam leaderboard?
32% chance
How well will Grok 4 do on Frontier Math?
-
Will Grok 4 Top the Chatbot Leaderboard?
3% chance