中文
相关论文

相关论文: FantasyWorld: Geometry-Consistent World Modeling v…

200 篇论文

Despite impressive progress in video generation, existing models remain limited to surface-level plausibility, lacking a coherent and unified understanding of the world. Prior approaches typically incorporate only a single form of…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Boming Tan , Xiangdong Zhang , Ning Liao , Yuqing Zhang , Shaofeng Zhang , Xue Yang , Qi Fan , Yanyong Zhang

Previous works leveraging video models for image-to-3D scene generation tend to suffer from geometric distortions and blurry content. In this paper, we renovate the pipeline of image-to-3D scene generation by unlocking the potential of…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Yuhao Wan , Lijuan Liu , Jingzhi Zhou , Zihan Zhou , Xuying Zhang , Dongbo Zhang , Shaohui Jiao , Qibin Hou , Ming-Ming Cheng

Videos inherently represent 2D projections of a dynamic 3D world. However, our analysis suggests that video diffusion models trained solely on raw video data often fail to capture meaningful geometric-aware structure in their learned…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Haoyu Wu , Diankun Wu , Tianyu He , Junliang Guo , Yang Ye , Yueqi Duan , Jiang Bian

We present PanoWorld, a panoramic video world model that generates geometry-consistent 360$\degree$ video from a single image and a caption. Existing panoramic video methods optimize primarily for visual realism and do not explicitly…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Le Jiang , Xiangyu Bai , Bishoy Galoaa , Shayda Moezzi , Caleb James Lee , Tooba Imtiaz , Edmund Yeh , Jennifer Dy , Yanzhi Wang , Sarah Ostadabbas

Humans possess a remarkable ability to mentally explore and replay 3D environments they have previously experienced. Inspired by this mental process, we present EvoWorld: a world model that bridges panoramic video generation with evolving…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Jiahao Wang , Luoxin Ye , TaiMing Lu , Junfei Xiao , Jiahan Zhang , Yuxiang Guo , Xijun Liu , Rama Chellappa , Cheng Peng , Alan Yuille , Jieneng Chen

Recent developments in generative models and large-scale datasets have substantially advanced 3D world generation, facilitating a broad range of domains including spatial intelligence, embodied intelligence, and autonomous driving. While…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Hanxin Zhu , Cong Wang , Peiyan Tu , Jiayi Luo , Tianyu He , Xin Jin , Zhibo Chen

Producing long, coherent video sequences with stable 3D structure remains a major challenge, particularly in streaming scenarios. Motivated by this, we introduce Endless World, a real-time framework for infinite, 3D-consistent video…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Ke Zhang , Yiqun Mei , Jiacong Xu , Vishal M. Patel

World models have made significant progress in modeling dynamic environments; however, most embodied world models are still restricted to 2D representations, lacking the comprehensive multi-view information essential for embodied spatial…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Peiyan Tu , Hanxin Zhu , Jingwen Sun , Shaojie Ren , Cong Wang , Jiayi Luo , Xiaoqian Cheng , Zhibo Chen

World models that forecast scene evolution by generating future video frames devote the bulk of their capacity to photometric details, yet the resulting predictions often remain geometrically inconsistent. We present VGGT-World, a geometry…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Xiangyu Sun , Shijie Wang , Fengyi Zhang , Lin Liu , Caiyan Jia , Ziying Song , Zi Huang , Yadan Luo

Recent video foundation models demonstrate impressive visual synthesis but frequently suffer from geometric inconsistencies. While existing methods attempt to inject 3D priors via architectural modifications, they often incur high…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Weijie Wang , Xiaoxuan He , Youping Gu , Yifan Yang , Zeyu Zhang , Yefei He , Yanbo Ding , Xirui Hu , Donny Y. Chen , Zhiyuan He , Yuqing Yang , Bohan Zhuang

We present a novel method for generating geometrically realistic and consistent orbital videos from a single image of an object. Existing video generation works mostly rely on pixel-wise attention to enforce view consistency across frames.…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Rong Wang , Ruyi Zha , Ziang Cheng , Jiayu Yang , Pulak Purkait , Hongdong Li

Recent advances in video generation have enabled the synthesis of high-quality and visually realistic clips using diffusion transformer models. However, most existing approaches operate purely in the 2D pixel space and lack explicit…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Yunpeng Bai , Shaoheng Fang , Chaohui Yu , Fan Wang , Qixing Huang

World models aim to endow AI systems with the ability to represent, generate, and interact with dynamic environments in a coherent and temporally consistent manner. While recent video generation models have demonstrated impressive visual…

Understanding and predicting dynamics of the physical world can enhance a robot's ability to plan and interact effectively in complex environments. While recent video generation models have shown strong potential in modeling dynamic scenes,…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Zeyi Liu , Shuang Li , Eric Cousineau , Siyuan Feng , Benjamin Burchfiel , Shuran Song

Generating realistic 3D objects from single-view images requires natural appearance, 3D consistency, and the ability to capture multiple plausible interpretations of unseen regions. Existing approaches often rely on fine-tuning pretrained…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Pufan Li , Bi'an Du , Wei Hu

Existing diffusion-based 3D scene generation methods primarily operate in 2D image/video latent spaces, which makes maintaining cross-view appearance and geometric consistency inherently challenging. To bridge this gap, we present OneWorld,…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Sensen Gao , Zhaoqing Wang , Qihang Cao , Dongdong Yu , Changhu Wang , Tongliang Liu , Mingming Gong , Jiawang Bian

Recent advances in visual generative models have highlighted the promise of learning generative world models. However, most existing approaches frame world modeling as novel-view synthesis or future-frame prediction, emphasizing visual…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Yifan Yin , Zehao Wen , Jieneng Chen , Zehan Zheng , Nanru Dai , Haojun Shi , Suyu Ye , Aydan Huang , Zheyuan Zhang , Alan Yuille , Jianwen Xie , Ayush Tewari , Tianmin Shu

Emerging world models autoregressively generate video frames in response to actions, such as camera movements and text prompts, among other control signals. Due to limited temporal context window sizes, these models often struggle to…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Tong Wu , Shuai Yang , Ryan Po , Yinghao Xu , Ziwei Liu , Dahua Lin , Gordon Wetzstein

The landscape of video generation is shifting, from a focus on generating visually appealing clips to building virtual environments that support interaction and maintain physical plausibility. These developments point toward the emergence…

人工智能 · 计算机科学 2026-02-09 Jingtong Yue , Ziqi Huang , Zhaoxi Chen , Xintao Wang , Pengfei Wan , Ziwei Liu

Modern Vision-Language Models (VLMs) achieve strong semantic recognition, yet remain brittle on elementary spatial relations such as left of, on, behind, and between. One cause of this failure arises before language reasoning begins: the…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Renjie Gu , Kaichen Zhou , Yan Luo , Mengyu Wang
‹ 上一页 1 2 3 10 下一页 ›