Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027? | Manifold

Will an autonomous agent resolve 90% of tasks on SWE-bench by 2027?

Basic

7

Ṁ105

2026

72%

chance

1D

1W

1M

ALL

Resolves "Yes" if, at time of closure, there is an entry on the SWE-bench leaderboard (https://www.swebench.com/) with score greater or equal to 90%.

Linked Questions:

This question is managed and resolved by Manifold.

#Technical AI Timelines

Get

1,000

and

3.00

Related questions

By what factor will the cost for SotA SWE-agents drop from 2024 to 2025?

Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?

Will a smart agent pass our Turing test by the end of 2025?

Will any AI solve more than four of AI 2027 Marcus-Brundage tasks in 2025?

Will an AI system capable of doing 50% of knowledge job arrive by 2027?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

AI resolves at least X% on SWE-bench without any assistance, by 2028?

AI resolves at least X% on SWE-bench WITH assistance, by 2028?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

Will OpenAI models achieve ≥90% on SimpleBench by the end of 2025?

Related questions

By what factor will the cost for SotA SWE-agents drop from 2024 to 2025?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?

AI resolves at least X% on SWE-bench without any assistance, by 2028?

Will a smart agent pass our Turing test by the end of 2025?

AI resolves at least X% on SWE-bench WITH assistance, by 2028?

Will any AI solve more than four of AI 2027 Marcus-Brundage tasks in 2025?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

Will an AI system capable of doing 50% of knowledge job arrive by 2027?

Will OpenAI models achieve ≥90% on SimpleBench by the end of 2025?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules