Блог пользователя Puff_Puff_Pass

Автор Puff_Puff_Pass, 4 года назад, По-английски

I submitted the solution to 1367D - Task On The Board during the contest (**Pretest Passed**). Later on, someone hacked it, that's fine.

But after analyzing a bit I found my code wasn't even working correctly for TestCase 1, then how did it pass the pretests.

Here is my submission 83979354, kindly check my output on test1 of testcase1.

Input
Output

I don't have 2 'b's. This shouldn't have passed the checker was wrong itself during the contest.

It must have affected a lot of people as well.

Sorry to say but will this make the contest unrated?

UPD1: As expected my solution is hacked on Testcase 1 itself. The same checker first passes the solution, and later fails the solution on the same Testcase, does that make any sense?

  • Проголосовать: нравится
  • +98
  • Проголосовать: не нравится

»
4 года назад, # |
  Проголосовать: нравится +1 Проголосовать: не нравится

True! that ruined the contest completely, it shouldn't happen.

»
4 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

Wrong checker implies contest is unrated in most of the times, as far as i know. Obviously, Many people were affected by this

»
4 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

Yes ,it also effected me and later somebody hacked it with same testcase.

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится -12 Проголосовать: не нравится

    But why one will submit if his code is not working for sample input. So its fault from both the side

    • »
      »
      »
      4 года назад, # ^ |
        Проголосовать: нравится +7 Проголосовать: не нравится

      Doesn't make any sense. That what checker do!

      Tell you when your code isn't correct.

      • »
        »
        »
        »
        4 года назад, # ^ |
          Проголосовать: нравится -7 Проголосовать: не нравится

        But what was the point of submitting a code that you know will fail. Maybe you like wrong answer on test1?

        • »
          »
          »
          »
          »
          4 года назад, # ^ |
            Проголосовать: нравится +10 Проголосовать: не нравится

          I submit ( sometimes ) my problems for div2A , or even div3A , div3B without even compiling my code locally ( to save penulty minutes ) when I am very confident about my code.

          Maybe ; just maybe someone might have done the same for div3D as well ?!

        • »
          »
          »
          »
          »
          4 года назад, # ^ |
            Проголосовать: нравится +12 Проголосовать: не нравится

          There can be a lot of instances as to why that happens. One of'em which has happened to me, a lot of times, is when I submit a solution that passes the test case 1, but fails the pretests. So, when I go back to see the bug in my code, I often think up test cases on my own to check exactly where my code is failing. When I correct my code to fit the test case(the one that I thought of), I often submit the solution without checking for the official test case 1, assuming it might be right.Even if we ignore the tiny of chance of this happening to somebody, don't you think it's up to the person to submit a code without checking it(via official test cases)? Because, should that solution fail, (s)he and only (s)he will suffer the consequences of it.

          • »
            »
            »
            »
            »
            »
            4 года назад, # ^ |
              Проголосовать: нравится +25 Проголосовать: не нравится

            Oh com'on you have only solved A and B. It is quite obvious why you are taking this stand

            • »
              »
              »
              »
              »
              »
              »
              4 года назад, # ^ |
                Проголосовать: нравится +8 Проголосовать: не нравится

              I guess, you're right about that! But, having submitted just two solutions doesn't have anything to do with what I wrote. :)

        • »
          »
          »
          »
          »
          4 года назад, # ^ |
            Проголосовать: нравится +1 Проголосовать: не нравится

          Wrong checker doesn't mean anything then?

          There can be cases, where sample testcase was running fine, but other pretests got accepted even the code was generating the wrong answer. Then?

    • »
      »
      »
      4 года назад, # ^ |
        Проголосовать: нравится +16 Проголосовать: не нравится

      In the question they mentioned that any possible answer is accepted ,when i was getting different answer i checked if my answer was giving same array but i did not check it with the given string.

»
4 года назад, # |
  Проголосовать: нравится +4 Проголосовать: не нравится

So are you guys saying the whole contest is unrated or that particular question alone for rating calculation?

  • »
    »
    4 года назад, # ^ |
    Rev. 2   Проголосовать: нравится 0 Проголосовать: не нравится

    You can't counter the effect caused by this by just discarding one problem. The contest should be unrated.

    • »
      »
      »
      4 года назад, # ^ |
        Проголосовать: нравится +39 Проголосовать: не нравится

      In status I see 170 hacked solutions (out of them 111 come from official participants). Total number of accepted solutions for D were: 1765, 840 of which came from official participants. Seems to have had significant impact so I believie this should be unrated

»
4 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

I also faced the same issue. I didn't submitted because i could clearly see that it failed to pass even the first testcase on my own compiler!

»
4 года назад, # |
  Проголосовать: нравится +2 Проголосовать: не нравится

This is a major issue if hidden test cases fail despite an AC verdict. If the public, sample test cases fail on your own local machine, then shouldn't the responsibility fall on the candidate to ensure correctness?

  • »
    »
    4 года назад, # ^ |
    Rev. 2   Проголосовать: нравится 0 Проголосовать: не нравится

    Wrong checker doesn't mean anything then?

    There are cases, where sample testcase was running fine, but other pretests got accepted even the code was generating the wrong answer. Then?

    • »
      »
      »
      4 года назад, # ^ |
        Проголосовать: нравится +5 Проголосовать: не нравится

      This is a major issue if hidden test cases fail despite an AC verdict

      How many people were affected by this? 1000 people solved D correctly despite an incorrect checker. Moreover, the number of people affected by this issue seems small, less than 100 or so. Making the contest rated is unfair for them, but making the contest unrated is unfair to the other 11900 who participated.

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится 0 Проголосовать: не нравится

    Yes even there can be the situation that no such test cases are there in the pretests then I need to check for every possibility on my local machine I can't completely rely on the pretests verdict.

»
4 года назад, # |
  Проголосовать: нравится -22 Проголосовать: не нравится

I believe round should still be rated....
If you know that your code is not passing given example test case and you still submitted....??

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится 0 Проголосовать: не нравится

    Maybe, just a few minutes were left for the contest to finish, so he submitted without checking samples. But still you can't deny as to why his code was accepted.

    • »
      »
      »
      4 года назад, # ^ |
        Проголосовать: нравится 0 Проголосовать: не нравится

      In that case even if it has given wrong answer verdict then he/she can't debug it within the time.

      • »
        »
        »
        »
        4 года назад, # ^ |
          Проголосовать: нравится +21 Проголосовать: не нравится

        If the answer is not unique you might not realize your answer is wrong on sample if you forget one constraint/assume "it looks reasonable, I don't want waste time to check precisely if it is correct, I'll just submit and maybe get WA on test 1 which doesn't give me penalty time"/simply mess something up while checking all requirements.

        • »
          »
          »
          »
          »
          4 года назад, # ^ |
            Проголосовать: нравится 0 Проголосовать: не нравится

          I get your point but the thing is if there were no such tests in the pretests then it would have been a case of weak pretests which is very frequent in codeforces contests.

»
4 года назад, # |
  Проголосовать: нравится +3 Проголосовать: не нравится

OH!I think it's unfair whether it's rated or not.

»
4 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

It passed the checker I agree but then you got hacked which you therefore deserved so the net effect is 0 and so this round should NOT be unrated. Your code was wrong in the first place and so you got hacked as simple as that.

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится +6 Проголосовать: не нравится

    Yes I agree with your words but if you would have got wrong verdict during contest then you would have rechecked and most likely submit correct one. But once you got ac you moved to next question and later it was hacked with sample input itself

»
4 года назад, # |
  Проголосовать: нравится +6 Проголосовать: не нравится

Just curious, it seems your solution is hacked by exactly TestCase 1. If the checker is wrong, shouldn't the hacking attempt fail too?

»
4 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

If someone submitted the wrong solution then he/she was not thinking of the case where it fails . Even if checker would have been correct but there were no such testcases then it would give OK response initially and later on solutions will be hacked but now since checker was not correct at that time making it a reason for hacked submission is not fair.

»
4 года назад, # |
  Проголосовать: нравится +1 Проголосовать: не нравится

I mean, yes wrong solutions passed, but they later got apprehended in the hacking phase. Is that not the purpose of the hacking phase?

If anyhow a wrong solution is submitted, doesn't it make sense that it got hacked and then all is back to normal? If all solutions that cleared the pretests were complete correct by rule, a hacking phase would not make any sense imo

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится +13 Проголосовать: не нравится

    There can be other testcases where your code may fail, that's the purpose of hacking phase.

    Doesn't make sense when your solution hacked on testcase 1 itself.

    The same checker first pass the solution, later on fails the solution on same testcase, does that make sense?

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится +5 Проголосовать: не нравится

    The case here is that the solution was failing on pretests but got pretests passed verdict and then later got hacked with the pretest itself.

    If you say that's the point of hacking phase then i guess there would be no sense in having strong pretests itself or having pretests for that matter. but its like said here since number of people for which its unfair is small the round should/could still be rated. We just have to wait for an official announcement on this matter.

»
4 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

When contest was over, I saw many solutions where they were not even checking if they have count of character which needed. I think there are many such sol.

»
4 года назад, # |
  Проголосовать: нравится +14 Проголосовать: не нравится

I think the round should be rated. This case is the same as when pretests are weak and your solution passes. Since the hacks work, the checker is actually fixed

»
4 года назад, # |
  Проголосовать: нравится +6 Проголосовать: не нравится

I don't know how hard it's to do this, but making the round unrated for those who were wrongly judged in D makes more sense since it'll be equally unfair to make a mass decision that applies for all.

»
4 года назад, # |
  Проголосовать: нравится +28 Проголосовать: не нравится

It seems I'll exclude all affected participants from the rating. I don't see any reason to exclude any who didn't catch this mistake during the round.

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится +1 Проголосовать: не нравится

    Thanks, Mike i m gonna be Expert ...

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится +1 Проголосовать: не нравится

    You are the best Mike!

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится +5 Проголосовать: не нравится

    There are people who were affected by the checker in problem D but are still expecting a positive rating change. Will the round be unrated for them too?

  • »
    »
    4 года назад, # ^ |
    Rev. 3   Проголосовать: нравится 0 Проголосовать: не нравится

    I spent time and solved D correctly. Now it's removed. If I had not attempted D first, I would fair chances that I would have solved E. Just a suggestion that you should have removed only those who had a problem. Instead of removing it for everyone.

  • »
    »
    4 года назад, # ^ |
    Rev. 2   Проголосовать: нравится +14 Проголосовать: не нравится

    I think it'd be nice to have some guidelines on what happen when we find an error in problem/checker after the contest.

  • »
    »
    4 года назад, # ^ |
    Rev. 2   Проголосовать: нравится 0 Проголосовать: не нравится

    I was affected by the checker in problem D, but don't want to be excluded from the rating changes. Expecting a big chunk (yum-yum) of rating increment (under 80 official rank). It would be really nice if I can have my chunk (Please) !

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится 0 Проголосовать: не нравится

    I have correct solution for D, but my first solutions failed. You have excluded me from rating list... Please, can you return me back?

  • »
    »
    4 года назад, # ^ |
      Проголосовать: нравится 0 Проголосовать: не нравится

    I found this error after submitting D, so I submitted another correct code. If it is not rated, is it unfair?

»
4 года назад, # |
  Проголосовать: нравится +3 Проголосовать: не нравится

This contest was already unrated for u... XD

»
4 года назад, # |
  Проголосовать: нравится +3 Проголосовать: не нравится

Can someone tell me whether people affected by the D question still have a chance to get rating?