English
Related papers

Related papers: Comparing PCG metrics with Human Evaluation in Min…

200 papers

Achieving optimal balance in games is essential to their success, yet reliant on extensive manual work and playtesting. To facilitate this process, the Procedural Content Generation via Reinforcement Learning (PCGRL) framework has recently…

Human-Computer Interaction · Computer Science 2024-09-10 Florian Rupp , Alessandro Puddu , Christian Becker-Asano , Kai Eckert

Procedural content generation via machine learning (PCGML) is the process of procedurally generating game content using models trained on existing game content. PCGML methods can struggle to capture the true variance present in underlying…

Machine Learning · Computer Science 2021-07-28 Bowei Li , Ruohan Chen , Yuqing Xue , Ricky Wang , Wenwen Li , Matthew Guzdial

The development of generative artificial intelligence for human motion generation has expanded rapidly, necessitating a unified evaluation framework. This paper presents a detailed review of eight evaluation metrics for human motion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Ali Ismail-Fawaz , Maxime Devanne , Stefano Berretti , Jonathan Weber , Germain Forestier

The term Procedural Content Generation (PCG) refers to the (semi-)automatic generation of game content by algorithmic means, and its methods are becoming increasingly popular in game-oriented research and industry. A special class of these…

Artificial Intelligence · Computer Science 2023-02-17 Vanessa Volz , Boris Naujoks , Pascal Kerschke , Tea Tusar

Automatic evaluation metrics capable of replacing human judgments are critical to allowing fast development of new methods. Thus, numerous research efforts have focused on crafting such metrics. In this work, we take a step back and analyze…

Computation and Language · Computer Science 2022-10-10 Pierre Colombo , Maxime Peyrard , Nathan Noiry , Robert West , Pablo Piantanida

Understanding the quality of a performance evaluation metric is crucial for ensuring that model outputs align with human preferences. However, it remains unclear how well each metric captures the diverse aspects of these preferences, as…

Computation and Language · Computer Science 2025-03-04 Genta Indra Winata , David Anugraha , Lucky Susanto , Garry Kuwanto , Derry Tanti Wijaya

Similarity estimation is essential for many game AI applications, from the procedural generation of distinct assets to automated exploration with game-playing agents. While similarity metrics often substitute human evaluation, their…

Human-Computer Interaction · Computer Science 2024-03-01 Sebastian Berns , Vanessa Volz , Laurissa Tokarchuk , Sam Snodgrass , Christian Guckelsberger

Due to increasing popularity and strict performance requirements, online games have become a workload of interest for the performance engineering community. One of the most popular types of online games is the Minecraft-like Game (MLG), in…

Performance · Computer Science 2023-02-21 Jerrit Eickhoff , Jesse Donkervliet , Alexandru Iosup

In this work we proposing adapting the Minecraft builder task into an LLM benchmark suitable for evaluating LLM ability in spatially orientated tasks, and informing builder agent design. Previous works have proposed corpora with varying…

Computation and Language · Computer Science 2024-07-18 Chris Madge , Massimo Poesio

Procedural content generation (PCG) can be applied to a wide variety of tasks in games, from narratives, levels and sounds, to trees and weapons. A large amount of game content is comprised of graphical assets, such as clouds, buildings or…

Graphics · Computer Science 2025-06-30 Kaisei Fukaya , Damon Daylamani-Zad , Harry Agius

Procedural Music Generation (PMG) is an emerging field that algorithmically creates music content for video games. By leveraging techniques from simple rule-based approaches to advanced machine learning algorithms, PMG has the potential to…

Sound · Computer Science 2025-12-16 Shangxuan Luo , Joshua Reiss

Modern video games pose significant challenges for traditional automated testing algorithms, yet intensive testing is crucial to ensure game quality. To address these challenges, researchers designed gaming agents using Reinforcement…

Software Engineering · Computer Science 2026-02-23 Yifei Chen , Sarra Habchi , Lili Wei

Procedural Content Generation (PCG) is the algorithmic generation of content, often applied to games. PCG and PCG via Machine Learning (PCGML) have appeared in published games. However, it can prove difficult to apply these approaches in…

Artificial Intelligence · Computer Science 2023-09-26 Emily Halina , Matthew Guzdial

Algorithmic evaluation of procedurally generated content struggles to find metrics that align with human experience, particularly for composite artefacts. Automatic decomposition as a possible solution requires concepts that meet a range of…

Artificial Intelligence · Computer Science 2025-09-24 Victoire Hervé , Henrik Warpefelt , Christoph Salge

Procedural Content Generation via Machine Learning (PCGML) has enhanced game content creation, yet challenges in controllability and limited training data persist. This study addresses these issues by distilling a constructive PCG algorithm…

Artificial Intelligence · Computer Science 2025-02-04 Yuhe Nie , Michael Middleton , Tim Merino , Nidhushan Kanagaraja , Ashutosh Kumar , Zhan Zhuang , Julian Togelius

Machine learning has been a popular tool in many different fields, including procedural content generation. However, procedural content generation via machine learning (PCGML) approaches can struggle with controllability and coherence. In…

Machine Learning · Computer Science 2021-07-28 Kynan Sorochan , Jerry Chen , Yakun Yu , Matthew Guzdial

We develop a probabilistic graphical model (PGM) for artificially intelligent (AI) agents to infer human beliefs during a simulated urban search and rescue (USAR) scenario executed in a Minecraft environment with a team of three players.…

Machine Learning · Computer Science 2023-10-20 Paulo Soares , Adarsh Pyarelal , Kobus Barnard

Procedural Content Generation (PCG) methods are valuable tools to speed up the game development process. Moreover, PCG may also present in games as features, such as the procedural dungeon generation (PDG) in Moonlighter (Digital Sun,…

Artificial Intelligence · Computer Science 2022-04-08 Breno M. F. Viana , Leonardo T. Pereira , Claudio F. M. Toledo

Real-world tasks of interest are generally poorly defined by human-readable descriptions and have no pre-defined reward signals unless it is defined by a human designer. Conversely, data-driven algorithms are often designed to solve a…

Machine Learning · Computer Science 2022-05-13 Vinicius G. Goecks , Nicholas Waytowich , David Watkins-Valls , Bharat Prakash

Search-based procedural content generation (PCG) is a well-known method for level generation in games. Its key advantage is that it is generic and able to satisfy functional constraints. However, due to the heavy computational costs to run…

Artificial Intelligence · Computer Science 2022-08-26 Ahmed Khalifa , Michael Cerny Green , Julian Togelius