Pretests — what are they?

Revision ru1, by wRabbits_AlMag, 2018-06-24 09:48:48

Some time ago I've picked up a habit of visiting comment section during system testing after a round. Too excited for the results to not step away from a computer — might as well, right? I'm not a big contributor, so keeping it low, mostly reading. Took me awhile to notice polarizing attitudes toward pretests, that varied from contest to contest. Especially if a good percentage of solutions that passed pretests — failed system tests. Big comment threads start to grow about pretests being weak. I wondered, what are pretests? Additional validation in between tests from the problem statement and system tests. They're kind of saying that your solution is demoable. Happy path is working. If everything is ideal, input is small, etc, your solution might be useful and give correct answers. But they don't mean that solution is acceptable (literally), thus not taking away the pleasant feeling of slight anxiety when you block your solution to hack roommates. It's a double win — additional validation to your logic, and not enough validation for everyone else, giving you chance to hack. So personally i'm thankful for them, and especially because this platform is the only major one that provides them. I get interested when I saw this is not the only attitude people share. How do you view pretests? Is the measure of failed solutions an indicator of weak pretests? What is the expectation from these kinds of tests?

Tags teach a stranger, pretests, zeitgeist

History

 
 
 
 
Revisions
 
 
  Rev. Lang. By When Δ Comment
ru2 Russian wRabbits_AlMag 2019-08-15 08:58:12 2 (опубликовано)
ru1 Russian wRabbits_AlMag 2018-06-24 09:48:48 1467 Первая редакция (сохранено в черновиках)