angel_of_death's blog

Google Chrome extension for automatic sample case testing on Codeforces
By angel_of_death, 8 years ago, In English

Hello all, I'd like to share with you a google chrome extension called Sample Case Tester.

Like the name says, it helps you in easily testing your code against the given sample cases for any problem, both in a contest and in practice. It adds an editor to the problem page where you need to just paste your code and run it to see if your code passes the given sample cases for that problem or not.

If your program is giving wrong output for one or more of the sample cases, it'll show you that case along with your program's output and also the expected output. If there are any compilation or runtime errors, it'll show those as well. And ofcourse, if your program gives the right output for all the cases, it'll tell you that your code passed!

It can be very helpful to save time during contests and also when a problem has multiple sample cases and/or very long inputs and outputs.

Currently it supports C, C++, Java, Python, Ruby and Perl. This is the very first version of the extension which I released just yesterday. More languages will be added soon along with a lot more useful functionality in the upcoming versions and the extension will update itself whenever a new version is released.

Another thing I want to mention is that the extension currently does not check your program for TLE. This is one of the things in my to-do list for the coming future. There's a fixed amount of common execution time limit however which I've set in case the code has things like infinite loops.

I'm aware of other tools like hightail but this is just my own addition to the community which is extremely convenient to install and use in a way that you don't even need to switch tabs or switch to a different program and everything you need will be right there on the problem page in the browser itself.

So do check it out, rate it on the webstore and let me know if you guys find any bugs. And if you like it, please consider sharing it with your friends. Thank you! LINK HERE

EDIT: For problems which have multiple correct outputs, it'll say your code failed unless it gets the same output as the sample one. So watch out for that.

UPDATE: I've chosen to DISCONTINUE this extension. It will be unpublished from the chrome store so no new users can install it & will no longer work for existing users either. The reason I chose to do this is because I had built this extension purely out of passion & I'd been spending 20$/month out of my own pocket for the past year to keep the extension running. I was not making any money from the extension & neither did I intend to. My only goal was to make something that'd be helpful to people. When my remote compiler gets overloaded especially during a contest when there are multiple submissions, it's natural that the compiler takes too long to execute your code & might fail with various errors. I was expecting people to understand this & be forgiving which they clearly were not. Also, not only were the users not thankful for something I'd been providing for free at the expense of my own money, some of them were downvoting my replies here when I try to explain my situation, leaving bad reviews & ratings on the chrome store & demanding that the extension should always work for them 24/7 as if they'd paid me for this service. Considering all the above points I'm no longer going to support this extension.

  • Vote: I like it
  • +128
  • Vote: I do not like it

Comments Comments (45)
| Write comment?
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

dose it work if there's not internet connection ??

→ Reply
  • »
    »
    8 years ago, # ^ |
      Vote: I like it +8 Vote: I do not like it

    Unfortunately no. It needs internet connection.

    → Reply
    • »
      »
      »
      8 years ago, # ^ |
        Vote: I like it 0 Vote: I do not like it

      so it might be slow if there are many users use it !!

      → Reply
      • »
        »
        »
        »
        8 years ago, # ^ |
          Vote: I like it +4 Vote: I do not like it

        We'll have to see. I mean the compiler it's using is pretty efficient and the server it's running on can always be upgraded if it really does slow down due to too many users.

        → Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

nice

→ Reply
  • »
    »
    8 years ago, # ^ |
      Vote: I like it +10 Vote: I do not like it

    Can add a submit button to it ? ... i guess (Amooo :) ) mike can help in this ... U need tokens :?csrf_token=b76cc71a99d1fe01e0c6bc17783830b5 ...

    → Reply
    • »
      »
      »
      8 years ago, # ^ |
        Vote: I like it 0 Vote: I do not like it

      That's a great idea! It's on my list :) Will be adding it in the next few days.

      → Reply
      • »
        »
        »
        »
        8 years ago, # ^ |
          Vote: I like it 0 Vote: I do not like it

        but one may submit by mistake instead of Teste Code

        → Reply
        • »
          »
          »
          »
          »
          8 years ago, # ^ |
            Vote: I like it 0 Vote: I do not like it

          I was thinking of giving the option to submit only if the code passes.

          → Reply
          • »
            »
            »
            »
            »
            »
            8 years ago, # ^ |
              Vote: I like it +7 Vote: I do not like it

            This wouldn't work for problems with multiple correct outputs.

            → Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

Very nice extension, thank you.
Can you make the editor appear under the "notes" section? So that no one misses it

→ Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

if there is #ifndef ONLINE_JUDGE freopen("in.txt", "r", stdin); //freopen("out.txt", "w", stdout);

else

// online submission

endif

in code

it`s not working

hope to fix it

→ Reply
  • »
    »
    8 years ago, # ^ |
    ← Rev. 2   Vote: I like it 0 Vote: I do not like it

    The first line would give an error since in.txt does not exist on the server where it compiles the code.

    → Reply
    • »
      »
      »
      8 years ago, # ^ |
        Vote: I like it +15 Vote: I do not like it

      I think the point here is to include -DONLINE_JUDGE in your compilation command in the server, to make it the same as Codeforces grader since Codeforces also define ONLINE_JUDGE in the compilation command.

      Therefore, any part within #ifndef ONLINE_JUDGE will not be executed

      → Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

I tried running a code in Java and it's very slow.

→ Reply
»
8 years ago, # |
← Rev. 4   Vote: I like it +4 Vote: I do not like it

As the code compiles server-side, will it run a risk of having my solutions skipped?

(I trust you that you will neither public nor plagiarise the users' solutions during a contest, but you know... I have to play safe in a contest)

→ Reply
»
8 years ago, # |
  Vote: I like it +1 Vote: I do not like it

Sumbit button can also be added so that we can directly submit code from here. BTW its a good extension.

→ Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

This is amazing.... :)

→ Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

Obviously it's not working with questions that accepts multiple answers, which is quite normal, but just be careful.

→ Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

It didn't work for me during contest (however I tried only once). I got Compilation Time Exceeded. I guess it is a result of not testing it under heavy load.

→ Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

fix plz

Spoiler
→ Reply
  • »
    »
    8 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    Fixed it. Your extension will update itself within a few hours and it should work fine after that. I wasn't able to figure out what was causing the button to do that though, so that might continue being like that.

    → Reply
    • »
      »
      »
      8 years ago, # ^ |
        Vote: I like it 0 Vote: I do not like it

      I think it broke when i zoomed out page to make screenshot

      → Reply
»
8 years ago, # |
  Vote: I like it 0 Vote: I do not like it

fix strange multiple line cursor

→ Reply
»
8 years ago, # |
← Rev. 3   Vote: I like it 0 Vote: I do not like it

When I use my template code which contains header <bits/stdc++.h>, it gives following error:

"Compilation Error Compilation took too long. Maximum compilation time limit reached."

Also, it gives the same error, if I use many headers.

Please fix it soon.

→ Reply
  • »
    »
    8 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    Thanks for letting me know. If you don't mind, can you share your code and the exact language you chose? It will help me debug. I don't need to know which problem the code is for.

    → Reply
    • »
      »
      »
      8 years ago, # ^ |
      ← Rev. 3   Vote: I like it 0 Vote: I do not like it
      This is my c++ Code for problem 545D:
      → Reply
    • »
      »
      »
      7 years ago, # ^ |
        Vote: I like it +3 Vote: I do not like it

      same happening to me too.. c++11 c++14

      → Reply
    • »
      »
      »
      7 years ago, # ^ |
        Vote: I like it 0 Vote: I do not like it

      same problem. using c++11 or c++14 Compilation Error Compilation took too long. Maximum compilation time limit reached.1. -

      → Reply
»
7 years ago, # |
  Vote: I like it 0 Vote: I do not like it

not working.

→ Reply
»
7 years ago, # |
← Rev. 2   Vote: I like it 0 Vote: I do not like it

Hi. compilation time limit is very bad. my PC have low speed then compilation time is higher than normal and don't tell correct response to me. how i can change compilation time limit ?

→ Reply
»
7 years ago, # |
  Vote: I like it 0 Vote: I do not like it

c++11 and c++14 giving took a lot of time too compile error.. while same code runs for c++

→ Reply
»
7 years ago, # |
  Vote: I like it +4 Vote: I do not like it

Please, fix it. It is the best etension I've ever used.

→ Reply
»
7 years ago, # |
← Rev. 2   Vote: I like it +8 Vote: I do not like it

I've chosen to DISCONTINUE this extension. It will be unpublished from the chrome store so no new users can install it & will no longer work for existing users either. The reason I chose to do this is because I had built this extension purely out of passion & I'd been spending 20$/month out of my own pocket for the past year to keep the extension running. I was not making any money from the extension & neither did I intend to. My only goal was to make something that'd be helpful to people. When my remote compiler gets overloaded especially during a contest when there are multiple submissions, it's natural that the compiler takes too long to execute your code & might fail with various errors. I was expecting people to understand this & be forgiving which they clearly were not. Also, not only were the users not thankful for something I'd been providing for free at the expense of my own money, some of them were downvoting my replies here when I try to explain my situation, leaving bad reviews & ratings on the chrome store & demanding that the extension should always work for them 24/7 as if they'd paid me for this service. Considering all the above points I'm no longer going to support this extension. Go ahead & downvote this reply too. I don't care.

→ Reply
  • »
    »
    7 years ago, # ^ |
    ← Rev. 2   Vote: I like it +4 Vote: I do not like it

    I have recently formatted my Hard Disk and the first thing I did on chrome after installing was looking for your extension, just to find it missing from chrome store. I have just seen your comment and I'm really sorry for your decision.

    All the people I know who used your extension found it as a great help (we even began to sometimes code problem A inside it and check the samples before submitting, which made us solve problem A in almost no time). I'm sorry for people who down-voted you, I know most people were silently thanking you for it (including me for example). Hope one day you decide to bring the extension back!

    → Reply
»
6 years ago, # |
  Vote: I like it +3 Vote: I do not like it

This would be great if you make this project as Open Source, for further development.

→ Reply
»
6 years ago, # |
  Vote: I like it 0 Vote: I do not like it

the link isn't working

→ Reply
»
5 years ago, # |
  Vote: I like it 0 Vote: I do not like it

Please bring back this extension, it must have been really really helpful!!!! Please please please.

→ Reply
»
4 years ago, # |
  Vote: I like it 0 Vote: I do not like it

WTF is this

→ Reply
»
3 years ago, # |
  Vote: I like it -8 Vote: I do not like it

this extension doesn't work now, I think it would be a good idea to reactivate it or remake it again

→ Reply