A new idea to curb cheating... incorporating arc agi elements

Revision en6, by supreme_999, 2025-07-12 11:39:51

So I know this is not a popular idea but how about changing the problem statements a bit atleast at lower division/ elo.

So as we all know that general llms can still not solve the arc agi test with a very high success rate <16% for the best model which in my opinion even a newbie will be able to solve with atleast >80% accuracy.

So my idea is simple incorporating arc agi benchmark style in the new problem statements. one particular example problem statement from today's arc agi test puzzle (Puzzle ID: 36a08778):

Today's arc agi test

This can easily be solved with a simple dfs/bfs given the input prompts and output the resulting solution. The input colors can obviously be replaced by numbers and the idea itself is pretty simple.

I dont think this question should be harder than 1300 probably and can definitely used as a div 2 b atleast. We can also flag accounts which have not solved the easier questions and have managed to do div 2 e/f (rainboy is an exception).

We can probably incorporate this style in other tags if we are a bit more creative.

Any thoughts?

Tags new problems, recent contest

History

 
 
 
 
Revisions
 
 
  Rev. Lang. By When Δ Comment
en6 English supreme_999 2025-07-12 11:39:51 28
en5 English supreme_999 2025-07-12 11:39:23 32
en4 English supreme_999 2025-07-12 11:35:16 173
en3 English supreme_999 2025-07-12 11:22:16 93
en2 English supreme_999 2025-07-12 11:16:21 70 (published)
en1 English supreme_999 2025-07-12 11:12:06 897 Initial revision (saved to drafts)