By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers? | Manifold

By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers?

Plus

32

Ṁ3701

Dec 31

27%

chance

1D

1W

1M

ALL

If perplexity on Common Crawl is not available for models, I will use other benchmarks as a surrogate. This will inherently be a judgement process. If a model has not been announced by EOY 2025 and no benchmarks have been posted publicly, it will not be counted for the purpose of this market.

"Based on transformers" for the purpose of this question will be anything with multi-headed self-attention that feeds into an MLP.

This question is managed and resolved by Manifold.

Get

1,000

and

3.00

Sort by:

predictedNO

A MoE of transformer model still counts as "based on transformers" right?

predictedNO

Just to be clear here, if we think that it will be based on transformers, then we should vote No?

predictedNO

@jonsimon correct

@jonsimon wish they didn't not write the title with not so many double negatives

predictedNO

@ConnorMcCormick oh yeah that's definitely confusing people. We'll, better for us who do understand it :)

and thanks for the exit gigacasting! $1 -> $68 in five minutes

predictedNO

there are few situations where you want to buy a new market from 50% to 99.2%, you're just giving free money away, use limit oreders pls

lmao i beat michael's bot in buying shares

predictedNO

giving me a solid +2892.5% profit for m$1

i'mt not entirely sure what NO means on this market though

@jacksonpolack The API only refreshes the data every 15 seconds, so if you're quick on the draw, it's totally doable.

predictedNO

i'mt not entirely sure what NO means on this market though

Lol, me neither.

Related questions

Before 2028, will any AI model achieve the same or greater benchmarks as o3 high with <= 1 million tokens per question?

+14% 1d69% chance

By EOY 2026, will it seem as if deep learning hit a wall by EOY 2025?

When will a non-Transformer model become the top open source LLM?

Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?

Will transformers still be the dominant DL architecture in 2026?

Will Transformer based architectures still be SOTA for language modelling by 2026?

On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark

Will Adam optimizer no longer be the default optimizer for training the best open source models by the end of 2026?

By the start of 2026, will I still think that transformers are the main architecture for tasks related to natural language processing?

Major AI companies continue experiencing problems with public due to AI (based on transformer language model) overcome behavior limitations and acts "strange" by the end of 2027

Related questions

Before 2028, will any AI model achieve the same or greater benchmarks as o3 high with <= 1 million tokens per question?

Will Transformer based architectures still be SOTA for language modelling by 2026?

By EOY 2026, will it seem as if deep learning hit a wall by EOY 2025?

On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark

When will a non-Transformer model become the top open source LLM?

Will Adam optimizer no longer be the default optimizer for training the best open source models by the end of 2026?

Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?

By the start of 2026, will I still think that transformers are the main architecture for tasks related to natural language processing?

Will transformers still be the dominant DL architecture in 2026?

Major AI companies continue experiencing problems with public due to AI (based on transformer language model) overcome behavior limitations and acts "strange" by the end of 2027

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules