How much compute will be used to train GPT-5?
How much compute will be used to train GPT-5?
➕
Plus
17
Ṁ1404
2027
1.1%
Fewer than 5e25 FLOP
10%
Between 5e25 FLOP and 1.5e26 FLOP
28%
Between 1.5e26 FLOP and 4.5e26 FLOP
31%
Between 4.5e26 FLOP and 1.4e27 FLOP
22%
Between 1.4e27 FLOP and 4e27 FLOP
7%
More than 4e27 FLOP
  • This resolves as the bucket that contains the number of floating point operations (FLOP) used to train GPT-5

  • FLOP may be performed at any precision (INT8, FP16, etc.)

  • This resolves on the basis of the numbers reported by OpenAI, and, if they don't report this, on the basis of the first credible estimates reported in this database (details about the database may be found here)

  • If GPT-5 is not released by EOY, 2027, this resolves ambiguously

  • If the estimate is exactly on the edge of each range, we will resolve it as the largest of the two options

Get
Ṁ1,000
and
S3.00


Sort by:
23d

Epoch estimates that Grok-3 (released in February) was trained with 4.6e26 FLOPs. The trend for compute spent on frontier models has a doubling time of around five months. Since GPT-5 will likely be released 4-7 months after Grok-3, this trend predicts around 1e27 FLOPs.

5mo

a fuckton

1y

@TamayBesiroglu What happens if it's between 1e26 and 2.5e26? It seems there are two options for this

  • Between 5e25 FLOP and 2.5e26 FLOP

  • Between 1e26 FLOP and 5e26 FLOP

1y

Betting here based on the uneven log scale.

1y

@BoltonBailey Yea, it's tricky not to have a non-even log-scale and round numbers. I've now edited the buckets slightly to roughly incremenent by factors of three.

1y

@TamayBesiroglu I can see that. These buckets are much more even. I have sold my positions because the numbers on the options now no longer reflect what they were when I bought them. Luckily, no one seems to have traded in the interim.

1y

related

4%
Q4 2023
15%
Q1 2024
24%
Q2 2024
17%
Q3 2024
GPT-5 trained with >=24k GPUs?82% chance
35%
Nvidia H100
4%
Nvidia GH100 - INVALID
4%
Nvidia GH200
0.7%
Microsoft Athena

What is this?

What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Win cash prizes for your predictions on our sweepstakes markets! Always free to play. No purchase necessary.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like trading still use Manifold to get reliable news.
How do I win cash prizes?
Manifold offers two market types: play money and sweepstakes.
All questions include a play money market which uses mana Ṁ and can't be cashed out.
Selected markets will have a sweepstakes toggle. These require sweepcash S to participate and winners can withdraw sweepcash as a cash prize. You can filter for sweepstakes markets on the browse page.
Redeem your sweepcash won from markets at
S1.00
→ $1.00
, minus a 5% fee.
Learn more.
© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules