Agent and scenario management

Agent management¶

If you select the first option in the menu, you will be taken into the package and agent management section. Its main purpose is to simplify adding and removing your agents. And if you plan to make only one, which will dominate the competition on the first try... well, you won't be seeing this section often.

Nevertheless, here are your options:

List installed agents: enables you to review, which agents are installed in your challenge environment.
List installed packages: shows you the packages that are available for installation. There is no complicated logic, it only lists directories in the agent/ directory not belonging to already installed packages.
Install package: gives you the option to install a package. One package can contain multiple agents.
Install all: attempts to install all packages in the agent/ directory.
Remove package: gives you the option to remove a specific package. As one package can contain multiple agents this option may remove multiple agents at once.
Remove all: removes all installed packages from the challenge environment. You mostly start from the clean slate.
Init agent: creates a skeleton of an agent. More on that in the agent creation section.

Scenario management¶

If you select the second option in the menu, you will be taken into the scenario management section. Its main purpose is to give you access to challenge scenarios which will be gradually released during the course of the challenge.

Your options are the following:

List remote scenarios: lets you check, which scenarios and variants are available.
List local scenarios: lets you check, which scenarios you actually have in your system.
Download scenarios: lets you download available scenarios and their variants.

When you list either remote or local scenarios, you are presented with the similar text:

For each scenario, you get its description:

Name: a distinct name of the scenario. You will be using this name in run configurations.
Description: a textual description of the setup and purpose of the scenario. It should give you enough information to prepare/select appropriate agent.
Goal: an objective for the agent in the scenario. More on giving the goal to the agent in the agent creation section.
Variants: available variations of the scenario. More on scenario variants in the challenge running section.

You are free to browse the scenarios/ directory and even make modifications to the scenarios to your liking (e.g., as an intermediary step when training your agent). That's why, when you choose to Download scenarios, you are given an option to not overwrite existing scenarios. Please note that the final evaluation is being done on our servers using completely different scenario variants, so a local scenario modification changes nothing wrt. to the final score. More on this in the challenge running section.

If you are not modifying the scenarios, either option should be fine, but we recommend to overwrite by default, in case we release a scenario bug fix (you will be notified in that case).

Note

The scenarios are not downloaded by default, if this is your first time running the challenge, it is recommended you download them.