determinism's blog

Organizing An Offline Contest — Judge Suggestion
By determinism, history, 9 years ago, In English

I will hold a local offline programming contest in the near future. It will be in ACM-ICPC format. Which software do you suggest as a judge?

P.S. It would be really good if it's easy to set up.

  • Vote: I like it
  • +26
  • Vote: I do not like it

Comments Comments (5)
| Write comment?
»
9 years ago, # |
  Vote: I like it 0 Vote: I do not like it

PC^2. It's very easy to set up and it's used in all ACM-ICPC format contests in my country.

→ Reply
»
9 years ago, # |
← Rev. 3   Vote: I like it 0 Vote: I do not like it

CMS is being used for the IOI since 2012. It's not exactly "easy" to setup (being a distributed software), but it's well documented.

→ Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    In 2012 I succeeded in setting it up to run a training on it for Russian IOI team which I was a member of. Back then it was a pretty easy process, don't much about how it looks like now.

    → Reply
»
9 years ago, # |
  Vote: I like it +3 Vote: I do not like it

We used PC^2 in our university's last contest. it was very good and easy to learn. Competition done perfect but you must test systems and learn how to use application.

first we create a test competition with 6 participant for checking systems and it becames very important because we found some problems . I want to note somethings that we learnt :

  • the documentation must be read very carefully ( we had multi operating systems for judges,admins .. and it cause some problems for us but they were our mistakes and hopefully we fixed it before contest. So I suggest you to have same operating systems,file paths,compilers,... )

  • never touch computers that you selected for judges in competition time and use admin computers for checking answers and verdicts. ( because if server send submission to one of the judges and judge program was blocked, then submission will remain in Running status and that judge system will remain busy while that is doing nothing! we couldn't find any solution for that! )

→ Reply
»
9 years ago, # |
  Vote: I like it +3 Vote: I do not like it

I've used multiple judging systems and my favourite is by far DOMjudge (https://www.domjudge.org/). It is very reliable. It is used in several regional contests and is used as the shadow (backup) system for ICPC World Finals. Its biggest downfall is that it is non-trivial to set up (if you know what you're doing, it only takes about 20 minutes, but the first time you do it, it can easily take an afternoon). Some of their documentation is slightly behind, but if you send a question to their mailing list, you get a response quite quickly. Once it is set up, it is very worth it--we have been using it for a few years now. So if you want just a one-off contest, DOMjudge might not be the best system, but if you're planning on holding multiple contests, then you should consider it.

→ Reply