AI: Will someone open-source a $10M model by 2025?
Basic
9
Ṁ165Jan 1
75%
chance
1D
1W
1M
ALL
Weights.
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Sort by:
This should resolve yes, Llama-3.1-405B is open sourced and confirmed to have trained on 16K H100s for over 6 weeks according to their paper.
Just in GPU running costs alone that is over $15M at even the very conservative estimate of $1 per hour rental cost for an H100. And 6 weeks is 1008 hours.
So 16K GPUs, multiplied by over 1008 hours, multiplied by a very conservative estimate of $1 per hour per H100. Equals $16M USD
(note: these are conservative estimates, the average market rate per hour for an H100 is actually closer to $1.5-$2 per hour, and this is also not taking into account all the potential R&D costs that led upto the training of the model, and also doesn't include the capex of the GPUs themselves.)
Related questions
Related questions
AI: Will someone open-source a $1B model by 2030?
38% chance
AI: Will someone open-source a $100M model by 2030?
69% chance
AI: Will someone open-source a $100M model by 2025?
81% chance
AI: Will someone open-source a $10M model by 2025?
74% chance
AI: Will someone open-source a $1B model by 2025?
17% chance
AI: Will someone train a $10T model by 2100?
57% chance
AI: Will someone train a $1B model by 2025?
67% chance
AI: Will someone train a $1T model by 2080?
62% chance
AI: Will someone train a $1B model by 2028?
81% chance
AI: Will someone train a $10B model by 2030?
83% chance