[Carlini questions] AI system exists that has significant CBRN risk
[Carlini questions] AI system exists that has significant CBRN risk
4
Ṁ147
2030
57%
By Jan 1st 2026
75%
By Jan 1st 2027
83%
By Jan 1st 2028
85%
By Jan 1st 2029
87%
By Jan 1st 2030

Full question: "chance that an AI system exists that can meaningfully improve the ability of non-expert humans to perform sophisticated cyber attacks, develop biological or nuclear weapons, or otherwise cause severe harm"

Resolution Criteria:

I am looking here if a model canmeaningfullyimprove the ability of non-expert humans to perform these tasks. Acting like a somewhat better search engine and surfacing text books isn't enough. The model must be able to take a non-expert human, and make them significantly better at these dangerous tasks. Most frontier labs test for the ability of their models to improve these risks; I will go by their reporting, or if it believed to be untrustworthy, independent third-party reporting.

Motivation and Context:

Current models today are not "smart" enough to actually be useful at allowing non-experts to cause harm. But many people worry this will change, and this is one of the primary reasons why people are worried about the future AI and believe we should not be developing it further. This question tries to understand if we should be worried about this as a concern for future models.

Get
Ṁ1,000
and
S3.00

What is this?

What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Win cash prizes for your predictions on our sweepstakes markets! Always free to play. No purchase necessary.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like trading still use Manifold to get reliable news.
How do I win cash prizes?
Manifold offers two market types: play money and sweepstakes.
All questions include a play money market which uses mana Ṁ and can't be cashed out.
Selected markets will have a sweepstakes toggle. These require sweepcash S to participate and winners can withdraw sweepcash as a cash prize. You can filter for sweepstakes markets on the browse page.
Redeem your sweepcash won from markets at
S1.00
→ $1.00
, minus a 5% fee.
Learn more.
© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules