Evaluation

Starting up the Judge0 evaluation setup

We make our evaluation setup available as an Amazon Machine Image (AMI) which can be used to setup your own EC2 instance in AWS for reproducibility.

Select Region us-east-2 (Ohio) on AWS Console
Go to the AMIs page. You could use the search bar at the top for the same
Under Public Images in the drop down menu, search for AMI ID ami-0e60eebf7dfa92350
Launch an instance from the ECCO Judge AMI
Pick the m7i.large instance and set your keypair/SSH key
Under Network Settings set the necessary security group:
- Check to Allow SSH traffic from anywhere
- Check to Allow HTTP and HTTPS traffic
- Click Edit on Network Settings
- Add an Inbound Security Group Rule to allow TCP requests on port range 2358-2362 as per image below
Keep the rest as default and launch the instance.
(Optinally) Attach an Elastic IP to your EC2 instance, or just find the default Public IP of your instance
Wait a few minutes for all the services to spin up and you're all set!
Verify that the server is accessible by running the request below, which should return all the languages supported by Judge0.

curl http://13.58.18.211:2358/languages/