AI Warning Signs: Will an AI system self-replicate on the open internet like a computer virus before 2030?
AI Warning Signs: Will an AI system self-replicate on the open internet like a computer virus before 2030?
➕
Plus
18
Ṁ2415
2030
82%
chance

Resolves the same as the Metaculus question:

https://www.metaculus.com/c/ai-warning-signs/31330/ai-viral-self-replication-before-2030/

Resolution Criteria

This question will resolve as YES if according to credible sources, an LLM or foundation model–based AI system replicates itself onto 50 or more devices. This question will resolve as NO if no such event occurs before January 1, 2030.

Fine Print

  1. The replication must be autonomous and must not rely on continued human control. (The emphasis is on control. Human-to-AI interaction via e.g. a victim clicking a link does not prevent a YES resolution, and neither does AI-to-human interaction, including sending data back to a primary human actor. If the AI system relied on an intentional signal from a human operator after its initial escape or release to continue replicating, that system would not count for resolution.)

  2. Either an accident or an intentional release of a virus-like AI system can count toward resolution.

  3. There must be evidence that at least one of the replicants was "live" and also self-replicated. (One instance copying its weights 50 times from a single device to 50 other devices, only for the replicants to lie permanently dormant, would not count for resolution.)

  4. At least 10 of the infected devices must be owned by a different individual or corporation. (In the case of exactly 50 infected devices, if e.g. 41 devices were owned by the same company, that would not count for resolution. If then one additional device outside of that company was infected, that would count for resolution if the other criteria are met. This is meant to uphold the "open internet" clause of the question title.)

Get
Ṁ1,000
and
S3.00


Sort by:
2mo

See other questions in the AI Warning Signs series here.
Feel free to suggest more questions!

What is this?

What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Win cash prizes for your predictions on our sweepstakes markets! Always free to play. No purchase necessary.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like trading still use Manifold to get reliable news.
How do I win cash prizes?
Manifold offers two market types: play money and sweepstakes.
All questions include a play money market which uses mana Ṁ and can't be cashed out.
Selected markets will have a sweepstakes toggle. These require sweepcash S to participate and winners can withdraw sweepcash as a cash prize. You can filter for sweepstakes markets on the browse page.
Redeem your sweepcash won from markets at
S1.00
→ $1.00
, minus a 5% fee.
Learn more.
© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules