bboy_drain's blog

USACO Contests Now Have Judge Feedback!
By bboy_drain, 11 years ago, In English

Hello everyone,

I was just notified by a friend that the USACO contests provide judge feedback on your submissions, so it is possible to know your score before they are released!

Good luck on the first contest!

  • Vote: I like it
  • +23
  • Vote: I do not like it

»
11 years ago, hide # |
← Rev. 4  
Vote: I like it +22 Vote: I do not like it

UPD: I'm sorry, I didn't read the contest information!

If your program correctly solves the sample input case (included in the text of each problem), you will receive feedback on how it performs on each of our judging inputs. For example, you will be told if your program produced the right answer, timed out, experience a run-time error, etc. Note that although you receive this feedback, the remaining judge inputs beyond the sample case are not disclosed during the contest. Problems are intended to be challenging; it is rarely the case that a large number of competitors receive near-perfect scores!
→ Reply
»
11 years ago, hide # |
← Rev. 2  
Vote: I like it 0 Vote: I do not like it

Full feedback means things like tle, mle, runtime error or ac on ALL of the test cases. Am I right?

→ Reply
»
11 years ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

Does anyone know, that if you get a 1000 on the bronze contest, whether or not you get to take the silver contest on the same day?

→ Reply
»
11 years ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

It states that the Judge may add tests after the contest. So it might be possible that you are getting at least the feedback score in the final result but not full marks.

→ Reply
  • »
    »
    11 years ago, hide # ^ |
     
    Vote: I like it 0 Vote: I do not like it

    Thanks for pointing this out. However, I think this would be a rare situation. At least at the IOI, this should never happen.

    → Reply
    • »
      »
      »
      11 years ago, hide # ^ |
       
      Vote: I like it 0 Vote: I do not like it

      It's not as easy as it looks to make good test sets for problems. It may be case that one corner case is not present, or that incorrect greedy solutions are accepted, or that one particular bruteforce strategy fails to get time limit.

      But I agree that it's going to be rare, I think they'll use the opportunity to change test cases only if it's really disturbing the results (lots of wrong codes get accepted).

      Upon reading the instruction page, this rule looks a lot more bizarre: "it is NOT guaranteed that all possible legal datasets will be solvable within the time limit". What?

      → Reply
      • »
        »
        »
        »
        11 years ago, hide # ^ |
         
        Vote: I like it 0 Vote: I do not like it

        I agree that it's often difficult to design good tests. But adding new tests after the contest is a very bad idea when full feedback is used.

        → Reply
  • »
    »
    11 years ago, hide # ^ |
     
    Vote: I like it 0 Vote: I do not like it

    No, for this contest, these are the final tests.

    → Reply