English
Related papers

Related papers: MultiGen: Level-Design for Editable Multiplayer Wo…

200 papers

Models that can simulate how environments change in response to actions can be used by agents to plan and act efficiently. We improve on previous environment simulators from high-dimensional pixel observations by introducing recurrent…

Artificial Intelligence · Computer Science 2017-04-20 Silvia Chiappa , Sébastien Racaniere , Daan Wierstra , Shakir Mohamed

In the game development process, creating character animations is a vital step that involves several stages. Typically for 2D games, illustrators begin by designing the main character image, which serves as the foundation for all subsequent…

Graphics · Computer Science 2025-03-18 Cheng-An Hsieh , Jing Zhang , Ava Yan

Emerging world models autoregressively generate video frames in response to actions, such as camera movements and text prompts, among other control signals. Due to limited temporal context window sizes, these models often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Tong Wu , Shuai Yang , Ryan Po , Yinghao Xu , Ziwei Liu , Dahua Lin , Gordon Wetzstein

The rapid evolution of video generation has enabled models to simulate complex physical dynamics and long-horizon causalities, positioning them as potential world simulators. However, a critical gap still remains between the theoretical…

Image and Video Processing · Electrical Eng. & Systems 2026-05-06 Muyang He , Hanzhong Guo , Junxiong Lin , Yizhou Yu

Diffusion models have made significant advances in text-guided synthesis tasks. However, editing user-provided images remains challenging, as the high dimensional noise input space of diffusion models is not naturally suited for image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Jiteng Mu , Michaël Gharbi , Richard Zhang , Eli Shechtman , Nuno Vasconcelos , Xiaolong Wang , Taesung Park

Recent advances in text-guided image synthesis has dramatically changed how creative professionals generate artistic and aesthetically pleasing visual assets. To fully support such creative endeavors, the process should possess the ability…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 K J Joseph , Prateksha Udhayanan , Tripti Shukla , Aishwarya Agarwal , Srikrishna Karanam , Koustava Goswami , Balaji Vasan Srinivasan

World models based on video generation demonstrate remarkable potential for simulating interactive environments but face persistent difficulties in two key areas: maintaining long-term content consistency when scenes are revisited and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Tianxing Xu , Zixuan Wang , Guangyuan Wang , Li Hu , Zhongyi Zhang , Peng Zhang , Bang Zhang , Song-Hai Zhang

Game level editing is the process of constructing a full game level starting from 3D asset libraries, e.g. 3d models, textures, shaders, scripts. In level editing, designers define the look and behavior of the whole level by placing…

Graphics · Computer Science 2016-03-03 Christian Santoni , Gabriele Salvati , Valentina Tibaldo , Fabio Pellacini

Large language models can generate plausible game code, but turning this capability into \emph{iterative creative improvement} remains difficult. In practice, single-shot generation often produces brittle runtime behavior, weak accumulation…

Artificial Intelligence · Computer Science 2026-04-23 Hongnan Ma , Han Wang , Shenglin Wang , Tieyue Yin , Yiwei Shi , Yucong Huang , Yingtian Zou , Muning Wen , Mengyue Yang

Interleaved multimodal generation enables capabilities beyond unimodal generation models, such as step-by-step instructional guides, visual planning, and generating visual drafts for reasoning. However, the quality of existing interleaved…

Producing long, coherent video sequences with stable 3D structure remains a major challenge, particularly in streaming scenarios. Motivated by this, we introduce Endless World, a real-time framework for infinite, 3D-consistent video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Ke Zhang , Yiqun Mei , Jiacong Xu , Vishal M. Patel

Humans possess a remarkable ability to mentally explore and replay 3D environments they have previously experienced. Inspired by this mental process, we present EvoWorld: a world model that bridges panoramic video generation with evolving…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiahao Wang , Luoxin Ye , TaiMing Lu , Junfei Xiao , Jiahan Zhang , Yuxiang Guo , Xijun Liu , Rama Chellappa , Cheng Peng , Alan Yuille , Jieneng Chen

Current game world models simulate environments from a subjective, player-centric perspective. However, by treating the Non-Player Character (NPC) merely as background pixels, these models cannot capture interactions between the player and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Zeqing Wang , Danze Chen , Zhaohu Xing , Zizhao Tong , Yinhan Zhang , Xingyi Yang , Yeying Jin

Recently, 3D generation methods have shown their powerful ability to automate 3D model creation. However, most 3D generation methods only rely on an input image or a text prompt to generate a 3D model, which lacks the control of each…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Peng Li , Suizhi Ma , Jialiang Chen , Yuan Liu , Congyi Zhang , Wei Xue , Wenhan Luo , Alla Sheffer , Wenping Wang , Yike Guo

Video models have recently been applied with success to problems in content generation, novel view synthesis, and, more broadly, world simulation. Many applications in generation and transfer rely on conditioning these models, typically…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Edoardo A. Dominici , Thomas Deixelberger , Konstantinos Vardis , Markus Steinberger

Modern game development faces significant challenges in creativity and cost due to predetermined content in traditional game engines. Recent breakthroughs in video generation models, capable of synthesizing realistic and interactive virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jiwen Yu , Yiran Qin , Haoxuan Che , Quande Liu , Xintao Wang , Pengfei Wan , Di Zhang , Xihui Liu

Diffusion models are advancing autonomous driving by enabling realistic data synthesis, predictive end-to-end planning, and closed-loop simulation, with a primary focus on temporally consistent generation. However, large-scale 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yu Yang , Alan Liang , Jianbiao Mei , Yukai Ma , Yong Liu , Gim Hee Lee

Despite the rapid progress in image generation, emotional image editing remains under-explored. The semantics, context, and structure of an image can evoke emotional responses, making emotional image editing techniques valuable for various…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Qing Lin , Jingfeng Zhang , Yew-Soon Ong , Mengmi Zhang

As 3D generation techniques continue to flourish, the demand for generating personalized content is rapidly rising. Users increasingly seek to apply various editing methods to polish generated 3D content, aiming to enhance its color, style,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Weitao Wang , Haoran Xu , Jun Meng , Haoqian Wang

Pretrained video diffusion models provide powerful spatiotemporal generative priors, making them a natural foundation for robotic world models. While recent world-action models jointly optimize future videos and actions, they predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zhaoyang Yang , Yurun Jin , Lizhe Qi , Cong Huang , Kai Chen