Smart Team Play: Utility of Population-Based Training for Cooperative AI in Overcooked

Smart Team Play: Utility of Population-Based Training for Cooperative AI in Overcooked

Moreira-Kanaley, Janaína (TU Delft Electrical Engineering, Mathematics and Computer Science)

Loftin, R.T. (mentor)
Oliehoek, F.A. (mentor)
Verwer, S.E. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-06-27

In an ad-hoc teamwork environment, artificial intelligence agents have the potential to take on supportive roles and complete tasks in collaboration with human players. The following paper investigates the use of employing population-based training (PBT) for reinforcement learning agents in the multi-player game Overcooked. In addition to this, the research examines whether the incorporation of highly mutated agents, which serve to introduce noise into the initial population, could enhance the final performance of PBT. As the method used to answer the previous inquiries, the learning curve of a selected PBT agent is first evaluated and its final performance with a human proxy then examined within different layouts of the game. Following this method, it was concluded that PBT, and other self-play agents, have the tendency to drastically underperform against the human proxy and agents that are trained based on human data. Furthermore, while incorporating the mutated agents increased sample efficiency in layouts with low risk of collisions, it had negligible effect on the final performance of PBT with the human proxy.

Interactive Intelligence
Artifical Intelligence
Collaborative AI
Teamwork
Games
Cooperation

http://resolver.tudelft.nl/uuid:396f42bd-b50e-47c5-8f41-2b2e6f9b7ab0

Student theses

bachelor thesis

© 2022 Janaína Moreira-Kanaley