Will an AI win Advent of Code? (2024)
➕
Plus
59
Ṁ7374
Dec 26
3%
chance
Get
Ṁ1,000
and
S3.00
Sort by:

This is a badly written question and does not have any clear indication of when it is considered Yes/No. But I'd argue that the top 5 on the leaderboard were all LLMs/LLM users so this should count as a Yes resolution

@Soni He clarified in the 2023 market that he meant AI only, with "0 intervention" https://manifold.markets/Gigacasting/will-an-ai-win-advent-of-code-2023#E1ycIumNsb1jjZzvZDld .

Since the winner took 00:49:52 to solve day 21 part 2 I think it's unlikely that that was fully automated, but I would still resolve N/A as we can't be sure

@Lorenzo That still is too vague to say anything. What does "intervention" mean? Does he expect people to break the AoC TOS by never having a human in the loop? If not, what does "winning" mean here?

@Gigacasting If you make a market, please be prepared to actually understand it to adjudicate. Right now the question as framed is just a waste of M

@Soni Any use of LLMs for the leaderboard breaks AoC TOS. I think "winning" is well defined as getting #1 on the leaderboard

Yeah so basically the question can never resolve YES.

@Soni Many people broke AoC TOS this year, as you mentioned, I think it would have unambiguously resolved YES if the #1 player solved all problems in 9 seconds, for example

@Lorenzo I am not seeing any clarification from @Gigacasting about any of this, all I am seeing is your speculation on what they could have done and why they didn't do them now.

bought Ṁ20 YES

Under what condition will you close this as Yes/No?

I'd love a market about predicting GPT-5's performance on this year's AoC.

@jim i gotchu

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules