Simulation Racing Series
ROAR provides a Python-based racing simulation environment that allows contenders to race their autonomous AI agents. Contenders can fully train and test their AI algorithms without any vehicle hardware in this series.
Fall 2022 Competition Results
Thank you to all of our contestants in Fall 2022 for participating in the S1/S2 Series Competition that featured our Berkeley Major Map. For the Fall 2022 season, we received 2 submissions by December 16. We ran each submission in three trials, and recorded the total number of crashes. These are the final results in terms of the average of three trials and # of crashes recorded.
|Rank||Team Name||Contestants||Sim time Elapsed(s)|
|1||Cougar||Aaron Xie||546.85 s|
|2||Crashy McCrashface||Aaron Chen||607.05 s|
We are very pleased to announce the winners for the 2022 Fall ROAR S1/S2 series:
Grand Prize: Aaron Xie (Record: 546.85 s)
Second Place: Aaron Chen (607.05 s)
Prime Directive (Fastest system that had zero crashes during competition): N/A
Spring 2023 Submissions
This submission page has been built for our competitors to submit and participate in the 2023 Spring Competition. Final submissions will be due on Friday, May 12. If you are having any issues submitting your agent, please email (firstname.lastname@example.org).
Important: By participating in ROAR Competition and submitting your code, you give the ROAR Committee the permission to evaluate and publicly release your competition results on our website.
- Grand Prize ($500 Amazon gift card):
This is awarded to the team who achieves the fastest total lap time after the completion of 1 lap. Any penalty due to major collision events does not disqualify the team.
- Second-Place Prize ($200 Amazon gift card):
This is awarded to the team who achieves the second fastest total lap time after the completion of 1 lap. Any penalty due to major collision events does not disqualify the team.
- Third-Place Prize ($100 Amazon gift card):
This is awarded to the team who achieves the third fastest total lap time after the completion of 1 lap. Any penalty due to major collision events does not disqualify the team.
- Prime-Directive Award:
This is awarded to the team who achieves the fastest total lap time after the completion of 1 lap and without encountering any major collision during the competition.
(Note: Please do not train or submit your ROAR Competition entries using earlier maps. The following links are only for benchmarking purposes to allow you to compare your new entries with past results. Your solutions trained on older maps may not be compatible with the Berkeley Major Map and subsequently may be subject to disqualification from the competition.)
Fall 2022 Schedule
*Submission form will open in early November.
Voluntary Test Script Submissions are due on Friday, May 5, 11:59 (PST) Midnight
Competitors can submit a test script to Huo Chao Kuan (email@example.com) by providing your GitHub repository.
Competitors can adjust their script as necessary before the Final Competition
Mandatory Final Submissions are due on Friday, May 12, 11:59 (PST) Midnight
Final Spring Competition will take place on Saturday, May 13
How to Submit
- Make sure that your code is updated on GitHub
2. Make sure that you did NOT modify your submodules
3. Make sure that you can run the agent via runner_competition_evaluator.py by replacing the default agent in line #79
- Feel free to change the num_trials and num_laps to smaller number to test, no need to do a full run through if it takes a long time.
How we will run your code
- If we see that submodules are modified
- We will execute git clone YOUR_REPO to fetch your repository
- We will manually copy-paste ROAR_Sim into the repository
- If submodules are not modified
- We will execute git clone –recursive YOUR_REPO to fetch your repository
- We will start the Berkeley Major map
- We will modify the num_trials and num_laps in the runner_competition_evaluator.py to just one
- We will run python runner_competition_evaluator.py with use_manual_control=False
- We will take the average of your 10 trials as your final result. For example, we will take the average of the time_elapsed(sec) column.
Guidelines for S1 Series
** Note that these guidelines are enforced in the ROAR_Sim repository and you SHOULD NOT do ANY modifications.
Here are the information provided about the map:
- Please make sure that your vehicle spawns at Spawn ID 0. You may change it at this file on line 101. Also indicated in the screenshot below.
- Your vehicle MUST be able to run CONTINUOUSLY for 1 laps without external interference
- Note that you are provided only ONE lap of waypoints, YOU must handle the regeneration of waypoint in lap 1
- Collision Penalty: If your vehicle collides with the static environment with intensity more than 10000, it will be regarded as a major collision. In such an event, your vehicle will be penalized by restarting from the beginning of the current lap. Depending on the location of the major collision, therefore, your vehicle will have to re-run the current lap.
- Note: It is possible that an auto-pilot that encounters a few major collisions could complete the 10 laps with a shorter total lap time than another that has zero major collisions. It is the contestant’s own responsibility to consider the trade off between safety and aggressiveness of the algorithm strategy.
- Synchronized mode should be utilized.
- Your Vehicle MUST pass the spawn point 12 at bounding box [2530, 99, 4064, 2543, 120, 4076] again to complete 1 lap.
- All vehicles must complete the 1 lap including any major (intensity < 10000) collision penalty within 30 minutes. If a vehicle could not complete the 1 laps within 30 minutes, the code will be terminated and the result will be recorded as Did Not Finish (DNF)
How are we going to run your code:
We are going to run runner_competition_evaluator.py.
- You may ONLY modify the code within the ROAR repo, NOT its submodules