SIO2 is a free platform for carrying out algorithmic contests and OIOIOI is its main component --- the web interface.
It should be easier to begin with a separate folder at first:
mkdir sio2 cd sio2
and to install OIOIOI inside a virtualenv:
virtualenv venv . venv/bin/activate
Then OIOIOI and its dependencies can be installed using the following commands:
git clone git://github.com/sio2project/oioioi.git cd oioioi pip install -r requirements.txt
OIOIOI is a set of Django Applications, so you need to create a folder with Django settings and other deployment configuration:
oioioi-create-config deployment cd deployment
The created deployment directory looks like a new Django project, but already configured to serve the OIOIOI portal. You need to at least set the database configuration in settings.py.
In case of using PostgreSQL, install Psycopg2:
pip install psycopg2
Finally initialize the database:
./manage.py syncdb ./manage.py migrate
We use PostgreSQL.
Then you need to copy static files, like images and styles, to the deployment directory:
./manage.py collectstatic
In the simple configuration, OIOIOI will use the system-installed compilers, and will not use the safe execution environment. User's programs will be run with the normal user privileges. This is not a safe configuration and the judging will run quite slowly. It is to easily make OIOIOI up and running for testing purposes.
Ensure that required dependencies are installed:
- gcc/g++ (Ubuntu package: build-essential)
- fpc (Ubuntu package: fp-compiler)
- latex with support for Polish (Ubuntu packages: texlive-latex-base, texlive-lang-polish)
- lessc (LESS compiler, minimum version 1.3.3; on Ubuntu install npm
and then run
sudo npm install --global less; can also be installed inside virtualenv)
and in one terminal run the Django web server:
./manage.py runserver 0.0.0.0:8000
and in the other the evaluation daemons:
./manage.py supervisor
The supervisor process monitors all processes needed by OIOIOI, except the web server. It has many nice features.
Finally, if you didn't create an administrator account when running syncdb, you can do it now:
./manage.py createsuperuser
If you see a locale error, you may want to circumvent it by providing another locale to the command:
LC_ALL=C ./manage.py createsuperuser
Now you're ready to access the site at http://localhost:8000.
Begin with the simple configuration described above.
Ensure that production-grade dependencies are installed:
- lighttpd binary (Ubuntu package: lighttpd, shall not be run as service.)
- uwsgi (pip install uwsgi)
Make sure you are in the deployment folder and the virtualenv is activated.
Install RabbitMQ. We tested version 2.8.6 from RabbitMQ Debian/Ubuntu Repos. Anything newer should work as well.
Uncomment and set BROKER_URL in settings.py to point to the configured RabbitMQ vhost. The default setting corresponds to the default RabbitMQ installation.
Download sandboxes:
./manage.py download_sandboxes
Disable system compilers and unsafe code execution by commenting out USE_UNSAFE_EXEC = True and USE_LOCAL_COMPILERS = True in settings.py.
(optionally) Disable starting the judging process on the server, especially if you want to configure judging machines (see below) for judging, what is strongly recommended. Comment out the RUN_LOCAL_WORKERS = True setting.
(optionally) Enable Filetracker server by uncommenting corresponding lines in settings.py and restart the daemons. This is required for dedicated judging machines.
Install and configure web server. We recommend using nginx with uwsgi plugin (included in nginx-full Ubuntu package). An example configuration is automatically created as nginx-site.conf. Have a look there. What you probably want to do is (as root):
cp nginx-site.conf /etc/nginx/sites-available/oioioi ln -s ../sites-available/oioioi /etc/nginx/sites-enabled/ service nginx reload
Once this is done, you no more need to run manage.py runserver.
If you prefer deploying with Apache, an example configuration is created as apache-site.conf. You would need to install apache2 and libapache2-mod-uwsgi packages.
Comment out DEBUG = True in settings.py. This is crucial for security and efficiency. Also set ALLOWED_HOSTS.
Set admin email in settings. Error reports and teacher account requests will be sent there.
Set SMTP server in settings. Otherwise new user registration (among others) will not work.
You probably want to run manage.py supervisor -d automatically when the system starts. One way is to add the following line to the OIOIOI user's crontab (
crontab -e):@reboot <deployment_folder>/start_supervisor.sh
(optionally) If you have efficiency problems or expect heavy load, you may consider using gevent as uwsgi event loop. To do so, install gevent and set UWSGI_USE_GEVENT flag in settings.py.
(optionally) You can also enable content caching. To do so, first you have to install dependencies:
- memcached (Ubuntu package: memcached)
- python-memcached (pip install python-memcached)
Next, you have to uncomment the corresponding lines under "Cache" in settings.py and set the address of your memcached instance. Note that you can run memcached locally or on a remote server. For more information about memcached configuration see official documentation.
(optionally) You can ensure users are automatically notified of certain events in the system - or notify them on your own - just enable the Notifications Server. For more information, consult the notifications/README.rst file.
Create a new user account for the judging processes and switch to it.
Set up virtualenv:
virtualenv venv . venv/bin/activate
Install the sioworkers package:
pip install sioworkers
Start the worker process:
sio-celery-worker BROKER_URL
The passed argument must point to the RabbitMQ server configured on the server machine.
That's all. You probably want to have the worker started automatically when system starts. We do not have a ready-made solution for this yet. Sorry!
The worker assumes that the Filetracker server is running on the same server as RabbitMQ, on the default port 9999. If this is not the case, you should pass the Filetracker server URL in the FILETRACKER_URL environment variable.
It is strongly recommended to install the librabbitmq Python module (on the server and the worker machines). We observed some not dispatched evaluation requests when running celery with its default AMQP binding library:
pip install librabbitmq
Celery will pick up the new library automatically, once you restart the daemons using:
./manage.py supervisor restart all
The sandboxes provided by the SIO2 Project contain 32-bit binaries. Therefore it is recommended that OIOIOI is installed on a 32-bit Linux system. Otherwise, required libraries may be missing. Here we list some of them, which we found needed when installing OIOIOI in a pristine Ubuntu Server 12.04 LTS (Precise Pangolin):
- libz (Ubuntu package: zlib1g:i386)
Make sure you are in the deployment folder and the virtualenv is activated. Then run:
pip install -e git://github.com/sio2project/oioioi.git#egg=oioioi ./manage.py syncdb ./manage.py migrate ./manage.py collectstatic ./manage.py supervisor restart all
and restart the judging machines.
When new features are added, the configuration files in your custom deployment directory may need an update. An example valid configuration can always be found in the oioioi sources (oioioi/deployment directory, *.template files). One of the simplest ways to learn about the changes is:
diff -u path_to_deployment/changed_file path_to_oioioi/oioioi/deployment/changed_file.template
Once you have made sure that your deployment directory is up-to-date, change CONFIG_VERSION in your custom deployment/settings.py so that it equals INSTALLATION_CONFIG_VERSION in oioioi/default_settings.py.
List of changes since the CONFIG_VERSION numbering was introduced:
Added unpackmgr queue entry to deployment/supervisord.conf.:
[program:unpackmgr] command={{ PYTHON }} {{ PROJECT_DIR }}/manage.py celeryd -E -l info -Q unpackmgr -c {{ settings.UNPACKMGR_CONCURRENCY }} startretries=0 stopwaitsecs=15 redirect_stderr=true stdout_logfile={{ PROJECT_DIR }}/logs/unpackmgr.logAdded USE_SINOLPACK_MAKEFILES and UNPACKMGR_CONCURRENCY options to deployment/settings.py.:
USE_SINOLPACK_MAKEFILES = False #UNPACKMGR_CONCURRENCY = 1
Added Notifications Server entries to deployment/supervisord.conf.:
[program:notifications-server] command={{ PYTHON }} {{ PROJECT_DIR }}/manage.py notifications_server redirect_stderr=true {% if not settings.NOTIFICATIONS_SERVER_ENABLED %}exclude=true{% endif %}Added NOTIFICATIONS_ options to deployment/settings.py.:
# Notifications configuration (client) # This one is for JavaScript socket.io client. # It should contain actual URL available from remote machines. NOTIFICATIONS_SERVER_URL = 'http://localhost:7887/' # Notifications configuration (server) NOTIFICATIONS_SERVER_ENABLED = False # URL connection string to a Notifications Server instance NOTIFICATIONS_OIOIOI_URL = 'http://localhost:8000/' # URL connection string for RabbitMQ instance used by Notifications Server NOTIFICATIONS_RABBITMQ_URL = 'amqp://localhost' # Port that the Notifications Server listens on NOTIFICATIONS_SERVER_PORT = 7887
Added prizesmgr queue entry to deployment/supervisord.conf:
[program:prizesmgr] command={{ PYTHON }} {{ PROJECT_DIR }}/manage.py celeryd -E -l info -Q prizesmgr -c 1 startretries=0 stopwaitsecs=15 redirect_stderr=true stdout_logfile={{ PROJECT_DIR }}/logs/prizesmgr.log
Well, we don't have a full-fledged User's Guide, but feel free to propose what should be added here.
To run a contest, you obviously need some tasks. To add a task to a contest in OIOIOI, you need to create an archive, called task package. Here are some pointers, how it should look like:
- example task packages used by our tests,
- a rudimentary task package format specification.
Should you have any further questions regarding installation, configuration or usage of OIOIOI, feel free to contact us by an e-mail, via IRC (#tagtag at freenode) or through github issues system. Please use English on github and English or Polish elsewhere. You may find some additional information on our official website and in the official project documentation. You can also look at what we are currently working on by browsing current tickets on our issue tracker.