English
Related papers

Related papers: HunyuanWorld 1.0: Generating Immersive, Explorable…

200 papers

Building an efficient and physically consistent world model from limited observations is a long standing challenge in vision and robotics. Many existing world modeling pipelines are based on implicit generative models, which are hard to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Wenhao Hu , Xuexiang Wen , Xi Li , Gaoang Wang

Text- or image-to-3D generators and 3D scanners can now produce 3D assets with high-quality shapes and textures. These assets typically consist of a single, fused representation, like an implicit neural field, a Gaussian mixture, or a mesh,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Minghao Chen , Roman Shapovalov , Iro Laina , Tom Monnier , Jianyuan Wang , David Novotny , Andrea Vedaldi

Driving World Models (DWMs) have been developing rapidly with the advances of generative models. However, existing DWMs lack 3D scene understanding capabilities and can only generate content conditioned on input data, without the ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Tianchen Deng , Xuefeng Chen , Yi Chen , Qu Chen , Yuyao Xu , Lijin Yang , Le Xu , Yu Zhang , Bo Zhang , Wuxiong Huang , Hesheng Wang

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. Additionally, 3D scene generation is vital for advancing embodied AI and world models, which depend…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yuxin Zhang , Ziyu Lu , Hongbo Duan , Keyu Fan , Pengting Luo , Peiyu Zhuang , Mengyu Yang , Houde Liu

The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360$^{\circ}$ scene generation pipeline that facilitates the creation of comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Shijie Zhou , Zhiwen Fan , Dejia Xu , Haoran Chang , Pradyumna Chari , Tejas Bharadwaj , Suya You , Zhangyang Wang , Achuta Kadambi

Despite the impressive progress on understanding and generating images shown by the recent unified architectures, the integration of 3D tasks remains challenging and largely unexplored. In this paper, we introduce UniUGG, the first unified…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yueming Xu , Jiahui Zhang , Ze Huang , Yurui Chen , Yanpeng Zhou , Zhenyu Chen , Yu-Jie Yuan , Pengxiang Xia , Guowei Huang , Xinyue Cai , Zhongang Qi , Xingyue Quan , Jianye Hao , Hang Xu , Li Zhang

While 3D content generation has advanced significantly, existing methods still face challenges with input formats, latent space design, and output representations. This paper introduces a novel 3D generation framework that addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yushi Lan , Shangchen Zhou , Zhaoyang Lyu , Fangzhou Hong , Shuai Yang , Bo Dai , Xingang Pan , Chen Change Loy

Despite impressive progress in video generation, existing models remain limited to surface-level plausibility, lacking a coherent and unified understanding of the world. Prior approaches typically incorporate only a single form of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Boming Tan , Xiangdong Zhang , Ning Liao , Yuqing Zhang , Shaofeng Zhang , Xue Yang , Qi Fan , Yanyong Zhang

We are witnessing significant breakthroughs in the technology for generating 3D objects from text. Existing approaches either leverage large text-to-image models to optimize a 3D representation or train 3D generators on object-centric…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qihang Zhang , Chaoyang Wang , Aliaksandr Siarohin , Peiye Zhuang , Yinghao Xu , Ceyuan Yang , Dahua Lin , Bolei Zhou , Sergey Tulyakov , Hsin-Ying Lee

Real-world robotic tasks are long-horizon and often span multiple floors, demanding rich spatial reasoning. However, existing embodied benchmarks are largely confined to single-floor in-house environments, failing to reflect the complexity…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Lirong Che , Shuo Wen , Shan Huang , Chuang Wang , Yuzhe Yang , Gregory Dudek , Xueqian Wang , Jian Su

State-of-the-art novel view synthesis methods achieve impressive results for multi-view captures of static 3D scenes. However, the reconstructed scenes still lack "liveliness," a key component for creating engaging 3D experiences. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Thomas Wimmer , Michael Oechsle , Michael Niemeyer , Federico Tombari

Recent video foundation models demonstrate impressive visual synthesis but frequently suffer from geometric inconsistencies. While existing methods attempt to inject 3D priors via architectural modifications, they often incur high…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Weijie Wang , Xiaoxuan He , Youping Gu , Yifan Yang , Zeyu Zhang , Yefei He , Yanbo Ding , Xirui Hu , Donny Y. Chen , Zhiyuan He , Yuqing Yang , Bohan Zhuang

Text-to-3D scene generation holds immense potential for the gaming, film, and architecture sectors. Despite significant progress, existing methods struggle with maintaining high quality, consistency, and editing flexibility. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Haoran Li , Haolin Shi , Wenli Zhang , Wenjun Wu , Yong Liao , Lin Wang , Lik-hang Lee , Pengyuan Zhou

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

With the advancement of interactive video generation, diffusion models have increasingly demonstrated their potential as world models. However, existing approaches still struggle to simultaneously achieve memory-enabled long-term temporal…

Acquiring detailed 3D scenes typically demands costly equipment, multi-view data, or labor-intensive modeling. Therefore, a lightweight alternative, generating complex 3D scenes from a single top-down image, plays an essential role in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Kaizhi Zheng , Ruijian Zha , Zishuo Xu , Jing Gu , Jie Yang , Xin Eric Wang

Recent progress in image and video synthesis has inspired their use in advancing 3D scene generation. However, we observe that text-to-image and -video approaches struggle to maintain scene- and object-level consistency beyond a limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Manuel-Andreas Schneider , Angela Dai

Tremendous progress in visual scene generation now turns a single image into an explorable 3D world, yet immersion remains incomplete without sound. We introduce Image2AVScene, the task of generating a 3D audio-visual scene from a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Derong Jin , Xiyi Chen , Ming C. Lin , Ruohan Gao

We propose Infinite-World, a robust interactive world model capable of maintaining coherent visual memory over 1000+ frames in complex real-world environments. While existing world models can be efficiently optimized on synthetic data with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Ruiqi Wu , Xuanhua He , Meng Cheng , Tianyu Yang , Yong Zhang , Zhuoliang Kang , Xunliang Cai , Xiaoming Wei , Chunle Guo , Chongyi Li , Ming-Ming Cheng