This market will resolve to the highest 50% time horizon, as reported by METR as of April 30, 2026, for any AI model released by February 28, 2026.
50% time horizon is a measure of AI autonomy based on the length of tasks that AI can do: roughly, it is the time that humans take to complete tasks that an AI system can successfully do 50% of the time. See METR's "Measuring AI Ability to Complete Long Tasks" for the technical definition. Claude 3.7 Sonnet, released in February 2025, was the leading model with a 50% horizon of 59 minutes.
Left bounds inclusive, right bounds exclusive.
Time horizon could vary based on the set of tasks used to measure it, so this market will be based on the time horizon for the most comprehensive set of tasks reported by METR (as of 2025, largely software and engineering tasks). This will be ambiguous if METR stops publishing time horizons across all of their autonomy tasks and only publishes separate results for different subsets; I might N/A in that scenario.
1,000
3.00@JoshYou 6-8 hours is the obvious bet to make based on current trends. I have a couple contrarian jim orders up for longer horizons
@JoshYou I am also curious about these preliminary evaluations, see https://www.lesswrong.com/posts/ohgGyu78DXLMaASpE/why-does-metr-score-o3-as-effective-for-such-a-long-time