Блог пользователя icy_bird

Автор icy_bird, история, 6 лет назад, По-английски

Hi everyone! In recent contests, my friends and I did not perform well. However, our ratings still increased somehow. In addition, CF predictor is no longer precise these days. Maybe I'm not the only one who feel strange. Then, did Codeforces change their formula for rating system?

  • Проголосовать: нравится
  • +84
  • Проголосовать: не нравится

»
6 лет назад, скрыть # |
Rev. 2  
Проголосовать: нравится +12 Проголосовать: не нравится

I only solved Div2 [A — B] and my rating increased to 1653! I thought I was going back to Specialist LOL

»
6 лет назад, скрыть # |
 
Проголосовать: нравится +19 Проголосовать: не нравится

maybe it's because the number of participants has increased significantly due to lockdown

»
6 лет назад, скрыть # |
 
Проголосовать: нравится +35 Проголосовать: не нравится

CF Predictor has never been more than several points off for me personally. It's easy to trick yourself into thinking that you didn't do as well as you did, given the large number of participants in the past few rounds. Your rating change doesn't take into account your absolute rank, but rather how you perform relative to the rest of the pool of participants.

»
6 лет назад, скрыть # |
Rev. 2  
Проголосовать: нравится +7 Проголосовать: не нравится

Probably because so many users participate in rounds nowadays, when more users with higher rating than you gets below you in standings your rating will increase more.

About the predictor It was 100% precise with me, maybe you didn't reload the page and standings have changed after you took a look at the predictor???

Edit: I just compared the rating change, you are right the predictor have some mistakes in Div. 2

»
6 лет назад, скрыть # |
Rev. 2  
Проголосовать: нравится +59 Проголосовать: не нравится

I believe today was the first when more than 10k contestants took part in a rated round. As I remember, I didn't considered such option when I was developing CF-Predictor.

This should be quite easy fix, I'll work on it on weekends.

P.S. As you can see prediction for the div. 1 is accurate, so formula hasn't changed.

  • »
    »
    6 лет назад, скрыть # ^ |
     
    Проголосовать: нравится +3 Проголосовать: не нравится

    Thank you for your work @@

  • »
    »
    6 лет назад, скрыть # ^ |
     
    Проголосовать: нравится 0 Проголосовать: не нравится

    BTW, during the last contest, CF Predictor showed me a prediction of ~40 points drop, while I ended up gaining 18 points in rating, much to my surprise. Of note, my last solution came in just a few minutes before the time ended, so not sure if ratings take time to propagate.

    It worked very accurately until this point, so not sure if something changed recently or if it was just coincidence?

    • »
      »
      »
      6 лет назад, скрыть # ^ |
       
      Проголосовать: нравится +14 Проголосовать: не нравится

      Well, recently CF Predictor has not been giving correct deltas, probably this is connected to the recent change in how new accounts are rated.

      • »
        »
        »
        »
        6 лет назад, скрыть # ^ |
         
        Проголосовать: нравится +8 Проголосовать: не нравится

        Thanks, so this was not an isolated case. I'm fairly new to the plugin (installed it a few weeks back and it's mostly been fairly accurate until the last contest).

        • »
          »
          »
          »
          »
          6 лет назад, скрыть # ^ |
           
          Проголосовать: нравится 0 Проголосовать: не нравится

          Probably we should ping WasylF and hope he can fix this.

          • »
            »
            »
            »
            »
            »
            6 лет назад, скрыть # ^ |
             
            Проголосовать: нравится 0 Проголосовать: не нравится

            Yup, I've sent him a message

          • »
            »
            »
            »
            »
            »
            6 лет назад, скрыть # ^ |
             
            Проголосовать: нравится +11 Проголосовать: не нравится

            I got a response from him. To summarize:

            • He doesn't think that the new changes in rules (ratings for new contestants) should impact the predictor in any major way
            • The issue that I faced could be due to a delayed propagation (according to him, it seems to be taking 5-7 minutes to reflect results now, while it used to take 1-3 minutes pre-Covid, when there were fewer participants)
            • He's hosting this on a free tier of a cloud platform so resources are quite limited. This may be the reason for the performance impact.
            • He's investigating a potential fix, though it isn't certain that this will resolve the issue.

            So let's wait and see. Until then, assume that ratings lag by 5-10 minutes when there are as many participants as there are these days (~20k+)

            • »
              »
              »
              »
              »
              »
              »
              6 лет назад, скрыть # ^ |
               
              Проголосовать: нравится +16 Проголосовать: не нравится

              Great, thanks! I think the lag might not be the reason, as for the last round I am still seeing +345 predicted for top 1, while he got +344. And the difference is more extreme for less-rated users.

              P.S. Actually I am surprised it is still not a default CF feature. And some $100/year from crowdfunding could definitely rent a top hosting for such project :)

              • »
                »
                »
                »
                »
                »
                »
                »
                6 лет назад, скрыть # ^ |
                 
                Проголосовать: нравится 0 Проголосовать: не нравится

                For sure — both are good ideas. A near real-time rating indicator is a valuable feature. WasylF has already done some of the work required. Would be great to see this as part of the core feature set.

              • »
                »
                »
                »
                »
                »
                »
                »
                6 лет назад, скрыть # ^ |
                 
                Проголосовать: нравится +8 Проголосовать: не нравится

                Thanks for using CF-Predictor :)

                Yes, there is an effect from new rating rules. It's quite small for existent contestants, but significant for new users. MikeMirzayanov has told, that he's going to add trueRating field to API, but this hasn't happened yet.

                So, I'm just waiting for it. After this field become available, prediction be accurate for all users. New users will see actual rating rather than displayed rating. Not sure which one is more interesting, but actual rating is easier to compute :D

                About update: I've published a new version (1.3.0) of the extension in Chrome today. I expect it to work a bit faster, Will see when more people update to the new version.

                As for Opera and Firefox: I submitted extension to Opera 2 days ago, it's still on review stage. I'm going to sent it for Firefox on weekends, because Firefox want me to change something in the extension :(

                • »
                  »
                  »
                  »
                  »
                  »
                  »
                  »
                  »
                  6 лет назад, скрыть # ^ |
                  Rev. 2  
                  Проголосовать: нравится +16 Проголосовать: не нравится

                  Oh, and I temporarily added one more backend, so to use new version of the extension you'll need to accept new permission.

                  This fix is more about stability/reliability, rather then performance improvement. In a couple last rounds backends were down in the end of round, because of high QPS. I hope this update should fix that issue.

                • »
                  »
                  »
                  »
                  »
                  »
                  »
                  »
                  »
                  6 лет назад, скрыть # ^ |
                   
                  Проголосовать: нравится 0 Проголосовать: не нравится

                  Awesome work, thanks for doing this!

»
6 лет назад, скрыть # |
 
Проголосовать: нравится 0 Проголосовать: не нравится

It mainly happened because div2 C was solved by quite less number of participants. It is rated 1800 as you can see...So if a 1600 rated participant is not able to solve the 3rd problem and he solves the first two quickly, then his rating will definitely increase

»
6 лет назад, скрыть # |
 
Проголосовать: нравится 0 Проголосовать: не нравится

I think because the number of participants during the quarantine time is high. So the more the under-rating-participants there are in the contest, the more rating you will increase after the contest

»
6 лет назад, скрыть # |
 
Проголосовать: нравится +1 Проголосовать: не нравится

And I thought it is the power of FAN CLUB!!!

»
6 лет назад, скрыть # |
 
Проголосовать: нравится 0 Проголосовать: не нравится

I think maybe it's base on your rank ratio. Ex: your rank is 1000 and we have 10000 participants so you have rank ratio 0.1, it's same as you archive rank 100 and only 1000 participants in the contest.