johnchen902's blog

Why do we need "pending system testing"?
By johnchen902, 10 years ago, In English

I wonder what happened behind the scene during "pending system testing". It always takes so long...

  • Vote: I like it
  • +29
  • Vote: I do not like it

»
10 years ago, # |
  Vote: I like it +17 Vote: I do not like it

in my opinion, jury is appending hacks to the tests...

→ Reply
  • »
    »
    10 years ago, # ^ |
      Vote: I like it +8 Vote: I do not like it

    Right, that definitely. And maybe other stuff like skipping obvious cheating submissions?

    → Reply
  • »
    »
    10 years ago, # ^ |
      Vote: I like it +22 Vote: I do not like it

    Are the successful hacks really added to the tests? I did one during last match and it did not appear in final tests.

    → Reply
    • »
      »
      »
      10 years ago, # ^ |
      ← Rev. 2   Vote: I like it +14 Vote: I do not like it

      As far as I know, it is jury's decision to add or not to add an specific hack. I think they add a hack if the hacked solution would got AC with the current tests. I remember Gerald saying that in some post.

      → Reply
    • »
      »
      »
      10 years ago, # ^ |
        Vote: I like it +8 Vote: I do not like it

      If they were all added, it could be automated and then there wouldn't really be any need for the long time that Pending system testing takes, right?

      → Reply
    • »
      »
      »
      10 years ago, # ^ |
        Vote: I like it +11 Vote: I do not like it

      I think almost successful hacking tests aren't added to the system tests, as there can be many successful hacks (for example, in Codeforces Round 263 (Div. 2), problem B had 1193 successful hacks, but the final tests had only 41 tests).

      → Reply
»
10 years ago, # |
  Vote: I like it +11 Vote: I do not like it

I think when coding phase was ended, there are still some submissions and hacks in queue. Pending system testing phase will evaluate them.

→ Reply
  • »
    »
    10 years ago, # ^ |
      Vote: I like it +11 Vote: I do not like it

    That is really small amount of time compared to usual lasting time of "pending system testing" phase...

    → Reply