English
Related papers

Related papers: Automated Video Game Testing Using Synthetic and H…

200 papers

Achieving human-AI alignment in complex multi-agent games is crucial for creating trustworthy AI agents that enhance gameplay. We propose a method to evaluate this alignment using an interpretable task-sets framework, focusing on high-level…

Artificial Intelligence · Computer Science 2024-06-21 Sugandha Sharma , Guy Davidson , Khimya Khetarpal , Anssi Kanervisto , Udit Arora , Katja Hofmann , Ida Momennejad

We consider the problem of synthetically generating data that can closely resemble human decisions made in the context of an interactive human-AI system like a computer game. We propose a novel algorithm that can generate synthetic,…

Machine Learning · Computer Science 2023-04-17 Bryan Brandt , Prithviraj Dasgupta

Automatic evaluation of various text quality criteria produced by data-driven intelligent methods is very common and useful because it is cheap, fast, and usually yields repeatable results. In this paper, we present an attempt to automate…

Computation and Language · Computer Science 2020-06-08 Erion Çano , Ondřej Bojar

Recent years, there has been growing interests in experience-driven procedural level generation. Various metrics have been formulated to model player experience and help generate personalised levels. In this work, we question whether…

Artificial Intelligence · Computer Science 2022-07-06 Keyuan Zhang , Jiayu Bai , Jialin Liu

Extending the capabilities of Large Language Models (LLMs) with functions or tools for environment interaction has led to the emergence of the agent paradigm. In industry, training an LLM is not always feasible because of the scarcity of…

Computation and Language · Computer Science 2025-01-14 Saptarshi Sengupta , Harsh Vashistha , Kristal Curtis , Akshay Mallipeddi , Abhinav Mathur , Joseph Ross , Liang Gou

Similarity estimation is essential for many game AI applications, from the procedural generation of distinct assets to automated exploration with game-playing agents. While similarity metrics often substitute human evaluation, their…

Human-Computer Interaction · Computer Science 2024-03-01 Sebastian Berns , Vanessa Volz , Laurissa Tokarchuk , Sam Snodgrass , Christian Guckelsberger

This work introduces an automated testing approach that employs agents controlling game characters to detect potential bugs within a game level. Harnessing the power of Bayesian Optimization (BO) to execute sample-efficient search, the…

Artificial Intelligence · Computer Science 2025-08-19 Carlos Celemin

Group-agent reinforcement learning (GARL) is a newly arising learning scenario, where multiple reinforcement learning agents study together in a group, sharing knowledge in an asynchronous fashion. The goal is to improve the learning…

Machine Learning · Computer Science 2025-02-18 Kaiyue Wu , Xiao-Jun Zeng , Tingting Mu

Towards an embodied generalist for real-world interaction, Multimodal Large Language Model (MLLM) agents still suffer from challenging latency, sparse feedback, and irreversible mistakes. Video games offer an ideal testbed with rich visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Mingyu Ouyang , Siyuan Hu , Kevin Qinghong Lin , Hwee Tou Ng , Mike Zheng Shou

Virtual Reality (VR) has rapidly become a mainstream platform for gaming and interactive experiences, yet ensuring the quality, safety, and appropriateness of VR content remains a pressing challenge. Traditional human-based quality…

Machine Learning · Computer Science 2025-11-04 Yurun Wu , Yousong Sun , Burkhard Wunsche , Jia Wang , Elliott Wen

Recent advancements in procedural content generation via machine learning enable the generation of video-game levels that are aesthetically similar to human-authored examples. However, the generated levels are often unplayable without…

Artificial Intelligence · Computer Science 2020-10-15 Hejia Zhang , Matthew C. Fontaine , Amy K. Hoover , Julian Togelius , Bistra Dilkina , Stefanos Nikolaidis

Modern video games are becoming richer and more complex in terms of game mechanics. This complexity allows for the emergence of a wide variety of ways to play the game across the players. From the point of view of the game designer, this…

Artificial Intelligence · Computer Science 2022-11-30 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

The growing dependence on mobile phones and their apps has made multi-user interactive features, like chat calls, live streaming, and video conferencing, indispensable for bridging the gaps in social connectivity caused by physical and…

Software Engineering · Computer Science 2025-09-17 Sidong Feng , Changhao Du , Huaxiao Liu , Qingnan Wang , Zhengwei Lv , Mengfei Wang , Chunyang Chen

Automated testing tools typically create test cases that are different from what human testers create. This often makes the tools less effective, the created tests harder to understand, and thus results in tools providing less support to…

Software Engineering · Computer Science 2021-03-09 Eduard Enoiu , Robert Feldt

For software interacting directly with real-world end-users, it is common practice to script scenario tests validating the system's compliance with a number of its features. However, these do not accommodate the replication of the type of…

Software Engineering · Computer Science 2022-08-26 Pasquale Salza , Marco Edoardo Palma , Harald C. Gall

Testing plays a vital role in software development, but in the realm of video games, the process differs from traditional software development practices. Game developers typically rely on human testers who are provided with checklists to…

Software Engineering · Computer Science 2023-11-08 Vincent Mastain , Fabio Petrillo

With the widespread adoption of Graphical User Interface (GUI) agents for automating GUI interaction tasks, substantial research focused on improving GUI perception to ground task instructions into concrete action steps. However, the step…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Xuan Wang , Siyuan Su , Quantong Fu , Yongxiang Hu , Yangfan Zhou

Playtesting is the process in which people play a video game for testing. It is critical for the quality assurance of gaming software. Manual playtesting is time-consuming and expensive. However, automating this process is challenging, as…

Software Engineering · Computer Science 2025-07-15 Yan Zhao , Chiwei Tang

Deceptive games are games where the reward structure or other aspects of the game are designed to lead the agent away from a globally optimal policy. While many games are already deceptive to some extent, we designed a series of games in…

Artificial Intelligence · Computer Science 2018-02-06 Damien Anderson , Matthew Stephenson , Julian Togelius , Christian Salge , John Levine , Jochen Renz

A critical challenge in modelling Heterogeneous-Agent Teams is training agents to collaborate with teammates whose policies are inaccessible or non-stationary, such as humans. Traditional approaches rely on expensive human-in-the-loop data,…

Machine Learning · Computer Science 2025-10-08 Aju Ani Justus , Chris Baber