English
Related papers

Related papers: Learning Controllable 3D Level Generators

200 papers

Reinforcement learning is a powerful technique to train an agent to perform a task. However, an agent that is trained using reinforcement learning is only capable of achieving the single task that is specified via its reward function. Such…

Machine Learning · Computer Science 2018-07-24 Carlos Florensa , David Held , Xinyang Geng , Pieter Abbeel

Procedural Content Generation (PCG) is a technique to generate complex and diverse environments in an automated way. However, while generating content with PCG methods is often straightforward, generating meaningful content that reflects…

Artificial Intelligence · Computer Science 2023-11-09 Shyam Sudhakaran , Miguel González-Duque , Claire Glanois , Matthias Freiberger , Elias Najarro , Sebastian Risi

Generative models have made significant progress in synthesizing visual content, including images, videos, and 3D/4D structures. However, they are typically trained with surrogate objectives such as likelihood or reconstruction loss, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuanzhi Liang , Yijie Fang , Ke Hao , Rui Li , Ziqi Ni , Ruijie Su , Chi Zhang

Procedural content generation via machine learning (PCGML) in games involves using machine learning techniques to create game content such as maps and levels. 2D tile-based game levels have consistently served as a standard dataset for…

Machine Learning · Computer Science 2025-04-08 Mahsa Bazzaz , Seth Cooper

Procedural Content Generation (PCG) offers scalable methods for algorithmically creating complex, customizable worlds. However, controlling these pipelines requires the precise configuration of opaque technical parameters. We propose a…

Artificial Intelligence · Computer Science 2025-12-15 Lim Chien Her , Ming Yan , Yunshu Bai , Ruihao Li , Hao Zhang

In this paper, we introduce a new set of reinforcement learning (RL) tasks in Minecraft (a flexible 3D world). We then use these tasks to systematically compare and contrast existing deep reinforcement learning (DRL) architectures with our…

Artificial Intelligence · Computer Science 2016-05-31 Junhyuk Oh , Valliappa Chockalingam , Satinder Singh , Honglak Lee

Urban areas, as the primary human habitat in modern civilization, accommodate a broad spectrum of social activities. With the surge of embodied intelligence, recent years have witnessed an increasing presence of physical agents in urban…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shougao Zhang , Mengqi Zhou , Yuxi Wang , Chuanchen Luo , Rongyu Wang , Yiwei Li , Zhaoxiang Zhang , Junran Peng

The past decade has seen a rapid increase in the level of research interest in procedural content generation (PCG) for digital games, and there are now numerous research avenues focused on new approaches for driving and applying PCG…

Human-Computer Interaction · Computer Science 2022-10-06 Oliver Withington , Laurissa Tokarchuk

The attempt to utilize machine learning in PCG has been made in the past. In this survey paper, we investigate how generative artificial intelligence (AI), which saw a significant increase in interest in the mid-2010s, is being used for…

Artificial Intelligence · Computer Science 2024-07-15 Xinyu Mao , Wanli Yu , Kazunori D Yamada , Michael R. Zielewski

We introduce Procgen Benchmark, a suite of 16 procedurally generated game-like environments designed to benchmark both sample efficiency and generalization in reinforcement learning. We believe that the community will benefit from increased…

Machine Learning · Computer Science 2020-07-28 Karl Cobbe , Christopher Hesse , Jacob Hilton , John Schulman

We introduce the concept of Procedural Content Generation via Knowledge Transformation (PCG-KT), a new lens and framework for characterizing PCG methods and approaches in which content generation is enabled by the process of knowledge…

Artificial Intelligence · Computer Science 2023-05-02 Anurag Sarkar , Matthew Guzdial , Sam Snodgrass , Adam Summerville , Tiago Machado , Gillian Smith

Curriculum reinforcement learning (CRL) improves the learning speed and stability of an agent by exposing it to a tailored series of tasks throughout learning. Despite empirical successes, an open question in CRL is how to automatically…

Machine Learning · Computer Science 2020-10-26 Pascal Klink , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Recent procedural content generation via machine learning (PCGML) methods allow learning from existing content to produce similar content automatically. While these approaches are able to generate content for different games (e.g. Super…

Artificial Intelligence · Computer Science 2020-05-27 Vanessa Volz , Niels Justesen , Sam Snodgrass , Sahar Asadi , Sami Purmonen , Christoffer Holmgård , Julian Togelius , Sebastian Risi

Although significant progress has been made in many tasks within the field of Natural Language Processing (NLP), Controlled Text Generation (CTG) continues to face numerous challenges, particularly in achieving fine-grained conditional…

Computation and Language · Computer Science 2025-09-18 Xinxu Zhou , Jiaqi Bai , Zhenqi Sun , Fanxiang Zeng , Yue Liu

Procedural content generation (PCG) has recently become one of the hottest topics in computational intelligence and AI game researches. Among a variety of PCG techniques, search-based approaches overwhelmingly dominate PCG development at…

Artificial Intelligence · Computer Science 2013-10-10 Jonathan Roberts , Ke Chen

We study building multi-task agents in open-world environments. Without human demonstrations, learning to accomplish long-horizon tasks in a large open-world environment with reinforcement learning (RL) is extremely inefficient. To tackle…

Machine Learning · Computer Science 2023-12-05 Haoqi Yuan , Chi Zhang , Hongcheng Wang , Feiyang Xie , Penglin Cai , Hao Dong , Zongqing Lu

The idea of transfer in reinforcement learning (TRL) is intriguing: being able to transfer knowledge from one problem to another problem without learning everything from scratch. This promises quicker learning and learning more complex…

Machine Learning · Computer Science 2022-01-13 Matthias Müller-Brockhausen , Mike Preuss , Aske Plaat

Code generation, which aims to automatically generate source code from given programming requirements, has the potential to substantially improve software development efficiency. With the rapid advancement of large language models (LLMs),…

Software Engineering · Computer Science 2026-05-04 Shouyu Yin , Zhao Tian , Junjie Chen , Shikai Guo

This paper introduces the Procedural Content Generation Benchmark for evaluating generative algorithms on different game content creation tasks. The benchmark comes with 12 game-related problems with multiple variants on each problem.…

Artificial Intelligence · Computer Science 2025-03-31 Ahmed Khalifa , Roberto Gallotta , Matthew Barthet , Antonios Liapis , Julian Togelius , Georgios N. Yannakakis

We introduce Adaptive Procedural Task Generation (APT-Gen), an approach to progressively generate a sequence of tasks as curricula to facilitate reinforcement learning in hard-exploration problems. At the heart of our approach, a task…

Machine Learning · Computer Science 2021-03-19 Kuan Fang , Yuke Zhu , Silvio Savarese , Li Fei-Fei