English
Related papers

Related papers: PCGPT: Procedural Content Generation via Transform…

200 papers

The balancing process for game levels in a competitive two-player context involves a lot of manual work and testing, particularly in non-symmetrical game levels. In this paper, we propose an architecture for automated balancing of…

Machine Learning · Computer Science 2024-04-08 Florian Rupp , Manuel Eberhardinger , Kai Eckert

Scene graphs provide a rich, structured representation of a scene by encoding the entities (objects) and their spatial relationships in a graphical format. This representation has proven useful in several tasks, such as question answering,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Sanjoy Kundu , Sathyanarayanan N. Aakur

This paper proposes a procedural content generator which evolves Minecraft buildings according to an open-ended and intrinsic definition of novelty. To realize this goal we evaluate individuals' novelty in the latent space using a 3D…

Machine Learning · Computer Science 2022-09-08 Matthew Barthet , Antonios Liapis , Georgios N. Yannakakis

The irregular domain and lack of ordering make it challenging to design deep neural networks for point cloud processing. This paper presents a novel framework named Point Cloud Transformer(PCT) for point cloud learning. PCT is based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Meng-Hao Guo , Jun-Xiong Cai , Zheng-Ning Liu , Tai-Jiang Mu , Ralph R. Martin , Shi-Min Hu

Several families of continual learning techniques have been proposed to alleviate catastrophic interference in deep neural network training on non-stationary data. However, a comprehensive comparison and analysis of limitations remains…

Machine Learning · Computer Science 2021-12-14 Timm Hess , Martin Mundt , Iuliia Pliushch , Visvanathan Ramesh

We present Perceive-Represent-Generate (PRG), a novel three-stage framework that maps perceptual information of different modalities (e.g., visual or sound), corresponding to a sequence of instructions, to an adequate sequence of movements…

Robotics · Computer Science 2022-10-25 Fábio Vital , Miguel Vasco , Alberto Sardinha , Francisco Melo

Deep generative replay has emerged as a promising approach for continual learning in decision-making tasks. This approach addresses the problem of catastrophic forgetting by leveraging the generation of trajectories from previously…

Machine Learning · Computer Science 2024-06-18 William Yue , Bo Liu , Peter Stone

Deep learning-based graph generation approaches have remarkable capacities for graph data modeling, allowing them to solve a wide range of real-world problems. Making these methods able to consider different conditions during the generation…

Machine Learning · Computer Science 2023-01-11 Faezeh Faez , Negin Hashemi Dijujin , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

The fixed-size context of Transformer makes GPT models incapable of generating arbitrarily long text. In this paper, we introduce RecurrentGPT, a language-based simulacrum of the recurrence mechanism in RNNs. RecurrentGPT is built upon a…

Computation and Language · Computer Science 2023-05-23 Wangchunshu Zhou , Yuchen Eleanor Jiang , Peng Cui , Tiannan Wang , Zhenxin Xiao , Yifan Hou , Ryan Cotterell , Mrinmaya Sachan

Real-world processes often generate data that are a mix of categorical and numeric values that are recorded at irregular and informative intervals. Discrete token-based approaches are limited in numeric representation capacity while methods…

Machine Learning · Computer Science 2025-06-02 Andrew J. Loza , Jun Yup Kim , Shangzheng Song , Yihang Liu , Joseph J. Y. Sung , R Andrew Taylor , Dennis L. Shung

It has recently been shown that reinforcement learning can be used to train generators capable of producing high-quality game levels, with quality defined in terms of some user-specified heuristic. To ensure that these generators' output is…

Machine Learning · Computer Science 2021-05-10 Sam Earle , Maria Edwards , Ahmed Khalifa , Philip Bontrager , Julian Togelius

Autoregressive transformers have revolutionized generative models in language processing and shown substantial promise in image and video generation. However, these models face significant challenges when extended to 3D generation tasks due…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Jinzhi Zhang , Feng Xiong , Mu Xu

Neural video game simulators emerged as powerful tools to generate and edit videos. Their idea is to represent games as the evolution of an environment's state driven by the actions of its agents. While such a paradigm enables users to play…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Willi Menapace , Aliaksandr Siarohin , Stéphane Lathuilière , Panos Achlioptas , Vladislav Golyanik , Sergey Tulyakov , Elisa Ricci

In recent years, Artificial Intelligence Generated Content (AIGC) has advanced from text-to-image generation to text-to-video and multimodal video synthesis. However, generating playable games presents significant challenges due to the…

Artificial Intelligence · Computer Science 2024-12-03 Mingyu Yang , Junyou Li , Zhongbin Fang , Sheng Chen , Yangbin Yu , Qiang Fu , Wei Yang , Deheng Ye

Since the dawn of Trading Card Games, the genre has grown into a multi-billion-dollar industry engaging millions of analog and digital players worldwide. Popular TCGs rely on regular updates, balance adjustments, and rotating constraints to…

Artificial Intelligence · Computer Science 2026-05-01 Johannes Pfau , Panagiotis Vrettis

World model-based searching and planning are widely recognized as a promising path toward human-level physical intelligence. However, current driving world models primarily rely on video diffusion models, which specialize in visual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Yuntao Chen , Yuqi Wang , Zhaoxiang Zhang

We present DriveGPT, a scalable behavior model for autonomous driving. We model driving as a sequential decision-making task, and learn a transformer model to predict future agent states as tokens in an autoregressive fashion. We scale up…

Conversational Question Generation (CQG) enhances the interactivity of conversational question-answering systems in fields such as education, customer service, and entertainment. However, traditional CQG, focusing primarily on the immediate…

Computation and Language · Computer Science 2024-10-03 Shasha Guo , Lizi Liao , Jing Zhang , Cuiping Li , Hong Chen

Recently, the emergence of large language models (LLMs) has unlocked new opportunities for procedural content generation. However, recent attempts mainly focus on level generation for specific games with defined game rules such as Super…

Artificial Intelligence · Computer Science 2024-05-31 Chengpeng Hu , Yunlong Zhao , Jialin Liu

Modern game development faces significant challenges in creativity and cost due to predetermined content in traditional game engines. Recent breakthroughs in video generation models, capable of synthesizing realistic and interactive virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jiwen Yu , Yiran Qin , Haoxuan Che , Quande Liu , Xintao Wang , Pengfei Wan , Di Zhang , Xihui Liu