English
Related papers

Related papers: Obstacle Tower: A Generalization Challenge in Visi…

200 papers

Recent developments in deep reinforcement learning have enabled the creation of agents for solving a large variety of games given a visual input. These methods have been proven successful for 2D games, like the Atari games, or for simple…

Machine Learning · Computer Science 2018-07-06 Georgios Papoudakis , Kyriakos C. Chatzidimitriou , Pericles A. Mitkas

In this article we introduce the Arcade Learning Environment (ALE): both a challenge problem and a platform and methodology for evaluating the development of general, domain-independent AI technology. ALE provides an interface to hundreds…

Artificial Intelligence · Computer Science 2013-06-24 Marc G. Bellemare , Yavar Naddaf , Joel Veness , Michael Bowling

Artificial intelligence (AI) has enabled agents to master complex video games, from first-person shooters like Counter-Strike to real-time strategy games such as StarCraft II and racing games like Gran Turismo. While these achievements are…

The question of whether deep neural networks are good at generalising beyond their immediate training experience is of critical importance for learning-based approaches to AI. Here, we consider tests of out-of-sample generalisation that…

Artificial Intelligence · Computer Science 2020-02-20 Felix Hill , Andrew Lampinen , Rosalia Schneider , Stephen Clark , Matthew Botvinick , James L. McClelland , Adam Santoro

Recently, there have been several high-profile achievements of agents learning to play games against humans and beat them. In this paper, we study the problem of training intelligent agents in service of game development. Unlike the agents…

While deep reinforcement learning techniques have recently produced considerable achievements on many decision-making problems, their use in robotics has largely been limited to simulated worlds or restricted motions, since unconstrained…

Robotics · Computer Science 2018-02-26 Tu-Hoa Pham , Giovanni De Magistris , Ryuki Tachibana

Recent advances in artificial intelligence have been strongly driven by the use of game environments for training and evaluating agents. Games are often accessible and versatile, with well-defined state-transitions and goals allowing for…

Machine Learning · Computer Science 2019-09-19 Benjamin Beyret , José Hernández-Orallo , Lucy Cheke , Marta Halina , Murray Shanahan , Matthew Crosby

Interacting with human agents in complex scenarios presents a significant challenge for robotic navigation, particularly in environments that necessitate both collision avoidance and collaborative interaction, such as indoor spaces. Unlike…

Robotics · Computer Science 2024-11-07 Lingfeng Sun , Yixiao Wang , Pin-Yun Hung , Changhao Wang , Xiang Zhang , Zhuo Xu , Masayoshi Tomizuka

In fighting games, individual players of the same skill level often exhibit distinct strategies from one another through their gameplay. Despite this, the majority of AI agents for fighting games have only a single strategy for each "level"…

Machine Learning · Computer Science 2022-11-08 Emily Halina , Matthew Guzdial

Training agents to act competently in complex 3D environments from high-dimensional visual information is challenging. Reinforcement learning is conventionally used to train such agents, but requires a carefully designed reward function,…

Machine Learning · Computer Science 2025-12-30 Adam Jelley , Yuhan Cao , Dave Bignell , Amos Storkey , Sam Devlin , Tabish Rashid

Evaluating AI agents within complex, interactive environments that mirror real-world challenges is critical for understanding their practical capabilities. While existing agent benchmarks effectively assess skills like tool use or…

Artificial Intelligence · Computer Science 2025-08-15 Long Phan , Mantas Mazeika , Andy Zou , Dan Hendrycks

Most games have, or can be generalised to have, a number of parameters that may be varied in order to provide instances of games that lead to very different player experiences. The space of possible parameter settings can be seen as a…

Artificial Intelligence · Computer Science 2017-03-21 Jialin Liu , Julian Togelius , Diego Perez-Liebana , Simon M. Lucas

Recent advances in artificial intelligence have been driven by the presence of increasingly realistic and complex simulated environments. However, many of the existing environments provide either unrealistic visuals, inaccurate physics, low…

Exploration is a key part of many video games. We investigate the using an exploratory agent to provide feedback on the design of procedurally generated game levels, 5 engaging levels and 5 unengaging levels. We expand upon a framework…

Artificial Intelligence · Computer Science 2024-09-05 Bobby Khaleque , Mike Cook , Jeremy Gow

Autonomous agents operating within real-world environments often rely on automated planners to ascertain optimal actions towards desired goals or the optimization of a specified objective function. Integral to these agents are common…

Artificial Intelligence · Computer Science 2025-02-18 James Chao , Wiktor Piotrowski , Roni Stern , Héctor Ortiz-Peña , Mitch Manzanares , Shiwali Mohan , Douglas S. Lange

While current deep learning systems excel at tasks such as object classification, language processing, and gameplay, few can construct or modify a complex system such as a tower of blocks. We hypothesize that what these systems lack is a…

It is a widely accepted principle that software without tests has bugs. Testing reinforcement learning agents is especially difficult because of the stochastic nature of both agents and environments, the complexity of state-of-the-art…

Artificial Intelligence · Computer Science 2019-01-28 John Foley , Emma Tosch , Kaleigh Clary , David Jensen

We introduce a class of learning problems where the agent is presented with a series of tasks. Intuitively, if there is relation among those tasks, then the information gained during execution of one task has value for the execution of…

Machine Learning · Computer Science 2012-09-06 Christos Dimitrakakis

Reinforcement learning agents have traditionally been evaluated on small toy problems. With advances in computing power and the advent of the Arcade Learning Environment, it is now possible to evaluate algorithms on diverse and difficult…

Machine Learning · Computer Science 2014-11-03 Aaron Defazio , Thore Graepel

A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial…