English
Related papers

Related papers: Taking the Scenic Route: Automatic Exploration for…

200 papers

Text adventure games present unique challenges to reinforcement learning methods due to their combinatorially large action spaces and sparse rewards. The interplay of these two factors is particularly demanding because large action spaces…

Computation and Language · Computer Science 2022-03-17 Jens Tuyls , Shunyu Yao , Sham Kakade , Karthik Narasimhan

As the complexity and scope of game development increase, playtesting remains an essential activity to ensure the quality of video games. Yet, the manual, ad-hoc nature of playtesting gives space to improvements in the process. In this…

Software Engineering · Computer Science 2022-03-14 Cristiano Politowski , Yann-Gaël Guéhéneuc , Fabio Petrillo

Mainstream autonomous exploration methods usually perform excessively-repeated explorations for the same region, leading to long exploration time and exploration trajectory in complex scenes. To handle this issue, we propose a novel…

Robotics · Computer Science 2024-10-11 Jianfang Mao

In trick-taking card games, a two-step process of state sampling and evaluation is widely used to approximate move values. While the evaluation component is vital, the accuracy of move value estimates is also fundamentally linked to how…

Artificial Intelligence · Computer Science 2019-09-12 Christopher Solinas , Douglas Rebstock , Michael Buro

This survey comprehensively reviews the multi-dimensionality of game scenario diversity, spotlighting the innovative use of procedural content generation and other fields as cornerstones for enriching player experiences through diverse game…

Artificial Intelligence · Computer Science 2025-01-17 Yuchen Li , Ziqi Wang , Qingquan Zhang , Bo Yuan , Jialin Liu

The video game industry is larger than both the film and music industries combined. Recommender systems for video games have received relatively scant academic attention, despite the uniqueness of the medium and its data. In this paper, we…

Information Retrieval · Computer Science 2018-08-21 Hal Cooper , Garud Iyengar , Ching-Yung Lin

This short paper describes an ongoing research project that requires the automated self-play learning and evaluation of a large number of board games in digital form. We describe the approach we are taking to determine relevant features,…

Artificial Intelligence · Computer Science 2021-01-05 Cameron Browne , Dennis J. N. J. Soemers , Eric Piette

Most games have, or can be generalised to have, a number of parameters that may be varied in order to provide instances of games that lead to very different player experiences. The space of possible parameter settings can be seen as a…

Artificial Intelligence · Computer Science 2017-03-21 Jialin Liu , Julian Togelius , Diego Perez-Liebana , Simon M. Lucas

This paper considers the problem of efficient exploration of unseen environments, a key challenge in AI. We propose a `learning to explore' framework where we learn a policy from a distribution of environments. At test time, presented with…

Machine Learning · Computer Science 2019-10-30 Hanjun Dai , Yujia Li , Chenglong Wang , Rishabh Singh , Po-Sen Huang , Pushmeet Kohli

The complexity of computer games is ever increasing. In this setup, guiding an automated test algorithm to find a solution to solve a testing task in a game's huge interaction space is very challenging. Having a model of a system to…

Software Engineering · Computer Science 2022-11-15 Samira Shirzadehhajimahmood , I. S. W. B. Prasetya , Frank Dignum , Mehdi Dastani

This work introduces an automated testing approach that employs agents controlling game characters to detect potential bugs within a game level. Harnessing the power of Bayesian Optimization (BO) to execute sample-efficient search, the…

Artificial Intelligence · Computer Science 2025-08-19 Carlos Celemin

This paper proposes a novel deep reinforcement learning algorithm to perform automatic analysis and detection of gameplay issues in complex 3D navigation environments. The Curiosity-Conditioned Proximal Trajectories (CCPT) method combines…

Machine Learning · Computer Science 2022-02-22 Alessandro Sestini , Linus Gisslén , Joakim Bergdahl , Konrad Tollmar , Andrew D. Bagdanov

Games have always been a popular test bed for artificial intelligence techniques. Game developers are always in constant search for techniques that can automatically create computer games minimizing the developer's task. In this work we…

Neural and Evolutionary Computing · Computer Science 2014-06-03 Zahid Halim

This paper describes a method for generative player modeling and its application to the automatic testing of game content using archetypal player models called procedural personas. Theoretically grounded in psychological decision theory,…

Artificial Intelligence · Computer Science 2018-02-21 Christoffer Holmgård , Michael Cerny Green , Antonios Liapis , Julian Togelius

We present Mortar, a system for autonomously evolving game mechanics for automatic game design. Game mechanics define the rules and interactions that govern gameplay, and designing them manually is a time-consuming and expert-driven…

Artificial Intelligence · Computer Science 2026-01-05 Muhammad U. Nasir , Yuchen Li , Steven James , Julian Togelius

Modern AAA video games feature huge game levels and maps which are increasingly hard for level testers to cover exhaustively. As a result, games often ship with catastrophic bugs such as the player falling through the floor or being stuck…

Artificial Intelligence · Computer Science 2022-09-02 Cong Lu , Raluca Georgescu , Johan Verwey

We introduce an online active exploration algorithm for data-efficiently learning an abstract symbolic model of an environment. Our algorithm is divided into two parts: the first part quickly generates an intermediate Bayesian symbolic…

Artificial Intelligence · Computer Science 2017-11-02 Garrett Andersen , George Konidaris

In empirical game-theoretic analysis (EGTA), game models are extended iteratively through a process of generating new strategies based on learning from experience with prior strategies. The strategy exploration problem in EGTA is how to…

Multiagent Systems · Computer Science 2021-05-24 Yongzhao Wang , Qiurui Ma , Michael P. Wellman

Traffic scenarios are inherently interactive. Multiple decision-makers predict the actions of others and choose strategies that maximize their rewards. We view these interactions from the perspective of game theory which introduces various…

Machine Learning · Computer Science 2020-04-28 Christian Muench , Frans A. Oliehoek , Dariu M. Gavrila

Autonomous exploration is a widely studied problem where a robot incrementally builds a map of a previously unknown environment. The robot selects the next locations to reach using an exploration strategy. To do so, the robot has to balance…

Robotics · Computer Science 2025-08-15 Matteo Luperto , Valerii Stakanov , Giacomo Boracchi , Nicola Basilico , Francesco Amigoni