English
Related papers

Related papers: CityX: Controllable Procedural Content Generation …

200 papers

Embodied AI and robotic systems increasingly depend on scalable, diverse, and physically grounded 3D content for simulation-based training and real-world deployment. While 3D generative modeling has advanced rapidly, embodied applications…

Robotics · Computer Science 2026-05-11 Tianwei Ye , Yifan Mao , Minwen Liao , Jian Liu , Chunchao Guo , Dazhao Du , Quanxin Shou , Fangqi Zhu , Song Guo

As humans, we aspire to create media content that is both freely willed and readily controlled. Thanks to the prominent development of generative techniques, we now can easily utilize 2D diffusion methods to synthesize images controlled by…

Graphics · Computer Science 2024-05-15 Wenqi Dong , Bangbang Yang , Lin Ma , Xiao Liu , Liyuan Cui , Hujun Bao , Yuewen Ma , Zhaopeng Cui

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Procedural Content Generation (PCG) refers to the practice, in videogames and other games, of generating content such as levels, quests, or characters algorithmically. Motivated by the need to make games replayable, as well as to reduce…

Artificial Intelligence · Computer Science 2020-03-18 Sebastian Risi , Julian Togelius

Generating realistic 3D indoor scenes from user inputs remains a challenging problem in computer vision and graphics, requiring careful balance of geometric consistency, spatial relationships, and visual realism. While neural generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mengqi Zhou , Xipeng Wang , Yuxi Wang , Zhaoxiang Zhang

3D content creation has long been a complex and time-consuming process, often requiring specialized skills and resources. While recent advancements have allowed for text-guided 3D object and scene generation, they still fall short of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xingyi Li , Yizheng Wu , Jun Cen , Juewen Peng , Kewei Wang , Ke Xian , Zhe Wang , Zhiguo Cao , Guosheng Lin

Human motion generation is a significant pursuit in generative computer vision with widespread applications in film-making, video games, AR/VR, and human-robot interaction. Current methods mainly utilize either diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Canxuan Gang

Procedural content generation (PCG) concerns all sorts of algorithms and tools which automatically produce game content, without requiring manual authoring by game artists. Besides generating com-plex static meshes, the PCG core usually…

Graphics · Computer Science 2018-08-02 Anthony Savidis

This paper explores the burgeoning field of 3D content generation within the landscape of Artificial Intelligence Generated Content (AIGC) and large-scale models. It investigates innovative methods like Text-to-3D and Image-to-3D, which…

Graphics · Computer Science 2024-05-27 Ke Zhao , Andreas Larsen

Generative artificial intelligence has recently progressed from static image and video synthesis to 3D content generation, culminating in the emergence of 4D generation-the task of synthesizing temporally coherent dynamic 3D assets guided…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Qiaowei Miao , Kehan Li , Jinsheng Quan , Zhiyuan Min , Shaojie Ma , Yichao Xu , Yi Yang , Ping Liu , Yawei Luo

While the games industry is moving towards procedural content generation (PCG) with tools available under popular platforms such as Unreal, Unity or Houdini, and video game titles like No Man's Sky and Horizon Zero Dawn taking advantage of…

Human-Computer Interaction · Computer Science 2020-05-20 Gorm Lai , William Latham , Frederic Fol Leymarie

Video generation has achieved impressive quality, but it still suffers from artifacts such as temporal inconsistency and violation of physical laws. Leveraging 3D scenes can fundamentally resolve these issues by providing precise control…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhaofang Qian , Abolfazl Sharifi , Tucker Carroll , Ser-Nam Lim

Manually creating 3D environments for AR/VR applications is a complex process requiring expert knowledge in 3D modeling software. Pioneering works facilitate this process by generating room meshes conditioned on textual style descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Jonas Schult , Sam Tsai , Lukas Höllein , Bichen Wu , Jialiang Wang , Chih-Yao Ma , Kunpeng Li , Xiaofang Wang , Felix Wimbauer , Zijian He , Peizhao Zhang , Bastian Leibe , Peter Vajda , Ji Hou

Procedural Content Generation via Reinforcement Learning (PCGRL) has been introduced as a means by which controllable designer agents can be trained based only on a set of computable metrics acting as a proxy for the level's quality and key…

Machine Learning · Computer Science 2024-08-23 Sam Earle , Zehua Jiang , Julian Togelius

Automating immersive VR scene creation remains a primary research challenge. Existing methods typically rely on complex geometry with post-simplification, resulting in inefficient pipelines or limited realism. In this paper, we introduce…

Graphics · Computer Science 2026-03-25 Jinyan Yuan , Bangbang Yang , Keke Wang , Panwang Pan , Lin Ma , Xuehai Zhang , Xiao Liu , Zhaopeng Cui , Yuewen Ma

Controllable generative models for images and videos have seen significant success, yet 3D scene generation, especially in unbounded scenarios like autonomous driving, remains underdeveloped. Existing methods lack flexible controllability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Ruiyuan Gao , Kai Chen , Zhihao Li , Lanqing Hong , Zhenguo Li , Qiang Xu

4D content generation aims to create dynamically evolving 3D content that responds to specific input objects such as images or 3D representations. Current approaches typically incorporate physical priors to animate 3D representations, but…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jiajing Lin , Zhenzhong Wang , Dejun Xu , Shu Jiang , YunPeng Gong , Min Jiang

The paper presents the PCGPT framework, an innovative approach to procedural content generation (PCG) using offline reinforcement learning and transformer networks. PCGPT utilizes an autoregressive model based on transformers to generate…

Machine Learning · Computer Science 2023-10-05 Sajad Mohaghegh , Mohammad Amin Ramezan Dehnavi , Golnoosh Abdollahinejad , Matin Hashemi

Continual learning refers to the ability of humans and animals to incrementally learn over time in a given environment. Trying to simulate this learning process in machines is a challenging task, also due to the inherent difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Enrico Meloni , Alessandro Betti , Lapo Faggi , Simone Marullo , Matteo Tiezzi , Stefano Melacci

Procedural content generation (PCG) is a growing field, with numerous applications in the video game industry and great potential to help create better games at a fraction of the cost of manual creation. However, much of the work in PCG is…

Artificial Intelligence · Computer Science 2023-07-20 Michael Beukman , Manuel Fokam , Marcel Kruger , Guy Axelrod , Muhammad Nasir , Branden Ingram , Benjamin Rosman , Steven James