Keep Advent of Code LLM-Free

Good luck solving this problem.

The even brag about being an LLM expert on their github and linkedin (which their aoc account are mostly linked to). As if they are the ones solving the problems.

Time to remove the global leaderboard.

It's probably time to remove the leaderboard. It was a great marketing way for AoC, but by now AoC doesn't need it anymore and it might do more harm than good.

I have done every challenge of all the 10 years of AoC! At the moment 466 stars and counting. I have learned so much from doing the challenges and try to inspire lots of students to participate. Those who use LLMS to get to the top of the rankings really sends the wrong message to all the wannabe developers.

I've been doing AoC for years, I happily sponsor the events and I learned a ton of new algorithms through it. Leaderboard or no leaderboard, THAT is how AoC should be used. To learn and have fun doing it. People using LLMs to win these competitions are on the same level of stupidity as people using doping to win sports events. Sad.

As someone who's been successful on the global leaderboard in the past two years, it's been extremely disheartening to see people clearly cheat with times like 14 seconds, which is clearly impossible for a human. At the very least, people with unrealistic times or people whose GitHub shows that they used LLMs to solve AoC problems should be removed from the global leaderboard.

100% agree

I don't want to demonize or ban all-out LLM, just officially make an LLM ladder and make an opt-in clause to participate on the global leaderboard or on the LLM leaderboard or just participate for stars (and private leaderboards, but at that point everyone will just moderate themselves).

Get ride of the leaderboard. Analogous to my cycling mantra, "Nothing ruins a bike ride like a bike race."

Keep up the good work.

AI go away

I read the conversation with Eric. If there is no way of identifying the cheaters, why not think in a different direction. Make the leaderboard anonymous, maybe even remove it completely. Only provide the stats overview and the personal stats. On the personal stats only provide your personal time and a rough range or percentile of the rank you are in. You could still keep the private leaderboards. I don't know what motivates people using LLMs submitting their solutions while the top 100 leaderboard is still open. If it is that they want to see their name there, then this proposal might discourage them from participating. They could still share a screenshot of their personal stats or show that in a video, but that probably is not worth much.

I would like to enjoy AoC like before. Being in competition with humans not with LLMs. Thanks.

Create an AI-only leaderboard! Let people compete, let them indicate which models they're using, which hardware, GPU, etc. It'd be cool, and hopefully clean up the leaderboard for humans. Also, ban cheaters and actively remove them from the leaderboard.

i agreee

A separate leaderboard specifically for AI would be cool, obviously people don't have a chance to compete for the same category

:(

Ban AI cheaters in AOC

Traditionally, leaderboards have listed the top achievement, for the achievement owners to be proud of and for achievement audience to cheer. AOC Leaderboard is about listing achievements for handwritten programs that solves puzzles. There is no performance nor achievement in placing on AOC leaderboard using copy-paste to LLM prompts. Kinda like letting a bullet shot from a gun be allowed to compete in a 100 metres race against humans.