English
Related papers

Related papers: WorldSplat: Gaussian-Centric Feed-Forward 4D Scene…

200 papers

Visuomotor policies learned from teleoperated demonstrations face challenges such as lengthy data collection, high costs, and limited data diversity. Existing approaches address these issues by augmenting image observations in RGB space or…

Robotics · Computer Science 2025-04-18 Sizhe Yang , Wenye Yu , Jia Zeng , Jun Lv , Kerui Ren , Cewu Lu , Dahua Lin , Jiangmiao Pang

Photorealistic 4D reconstruction of street scenes is essential for developing real-world simulators in autonomous driving. However, most existing methods perform this task offline and rely on time-consuming iterative processes, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Hao Lu , Tianshuo Xu , Wenzhao Zheng , Yunpeng Zhang , Wei Zhan , Dalong Du , Masayoshi Tomizuka , Kurt Keutzer , Yingcong Chen

LongSplat addresses critical challenges in novel view synthesis (NVS) from casually captured long videos characterized by irregular camera motion, unknown camera poses, and expansive scenes. Current methods often suffer from pose drift,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Chin-Yang Lin , Cheng Sun , Fu-En Yang , Min-Hung Chen , Yen-Yu Lin , Yu-Lun Liu

Feedforward 3D Gaussian Splatting (3DGS) often struggles in trajectory-based sparse-view driving scenes. Existing Gaussian repair methods mainly target optimization-based 3DGS, while diffusion-based repair is typically restricted to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rui Song , Tianhui Cai , Markus Gross , Xingcheng Zhou , Zewei Zhou , Zhiyu Huang , Olaf Wysocki , Jiaqi Ma

Feed-forward 3D Gaussian Splatting (3DGS) has shown great promise for real-time novel view synthesis, but its application to panoramic imagery remains challenging. Existing methods often rely on multi-view cost volumes for geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Qiwei Wang , Xianghui Ze , Jingyi Yu , Yujiao Shi

Creating 4D fields of Gaussian Splatting from images or videos is a challenging task due to its under-constrained nature. While the optimization can draw photometric reference from the input videos or be regulated by generative models,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Quankai Gao , Qiangeng Xu , Zhe Cao , Ben Mildenhall , Wenchao Ma , Le Chen , Danhang Tang , Ulrich Neumann

Sparse-view 3D reconstruction is increasingly addressed with feed-forward splatting networks that predict explicit primitives directly from images. Yet most existing methods remain centered on Gaussian primitives and expose surfaces only…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weijie Wang , Zimu Li , Jinchuan Shi , Zeyu Zhang , Botao Ye , Marc Pollefeys , Donny Y. Chen , Bohan Zhuang

Driving World Models (DWMs) have been developing rapidly with the advances of generative models. However, existing DWMs lack 3D scene understanding capabilities and can only generate content conditioned on input data, without the ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Tianchen Deng , Xuefeng Chen , Yi Chen , Qu Chen , Yuyao Xu , Lijin Yang , Le Xu , Yu Zhang , Bo Zhang , Wuxiong Huang , Hesheng Wang

Prevailing 2D-centric visuomotor policies exhibit a pronounced deficiency in novel view generalization, as their reliance on static observations hinders consistent action mapping across unseen views. In response, we introduce GenSplat, a…

Robotics · Computer Science 2026-04-01 Sen Wang , Huaiyi Dong , Jingyi Tian , Jiayi Li , Zhuo Yang , Tongtong Cao , Anlin Chen , Shuang Wu , Le Wang , Sanping Zhou

Recent progress in feed-forward 3D Gaussian Splatting (3DGS) has notably improved rendering quality. However, the spatially uniform and highly redundant 3DGS map generated by previous feed-forward 3DGS methods limits their integration into…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zicheng Zhang , Xiangting Meng , Ke Wu , Wenchao Ding

Novel View Synthesis (NVS) from sparse views presents a formidable challenge in 3D reconstruction, where limited multi-view constraints lead to severe overfitting, geometric distortion, and fragmented scenes. While 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Yu Ma , Guoliang Wei , Haihong Xiao , Yue Cheng

Recently, generalizable feed-forward methods based on 3D Gaussian Splatting have gained significant attention for their potential to reconstruct 3D scenes using finite resources. These approaches create a 3D radiance field, parameterized by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wonseok Roh , Hwanhee Jung , Jong Wook Kim , Seunggwan Lee , Innfarn Yoo , Andreas Lugmayr , Seunggeun Chi , Karthik Ramani , Sangpil Kim

Despite recent advances in leveraging generative prior from pre-trained diffusion models for 3D scene reconstruction, existing methods still face two critical limitations. First, due to the lack of reliable geometric supervision, they…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Junfeng Ni , Yixin Chen , Zhifei Yang , Yu Liu , Ruijie Lu , Song-Chun Zhu , Siyuan Huang

Feed-forward 3D Gaussian Splatting (3DGS) enables efficient one-pass scene reconstruction, providing 3D representations for novel view synthesis without per-scene optimization. However, existing methods typically predict pixel-aligned…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jongmin Park , Minh-Quan Viet Bui , Juan Luis Gonzalez Bello , Jaeho Moon , Jihyong Oh , Munchurl Kim

Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixin Xu , Hengyu Zhou , Yuan Liu , Wenhan Xue , Hao Pan , Wenping Wang , Bin Wang

We consider the problem of novel-view synthesis (NVS) for dynamic scenes. Recent neural approaches have accomplished exceptional NVS results for static 3D scenes, but extensions to 4D time-varying scenes remain non-trivial. Prior efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Yuanxing Duan , Fangyin Wei , Qiyu Dai , Yuhang He , Wenzheng Chen , Baoquan Chen

State-of-the-art novel view synthesis methods achieve impressive results for multi-view captures of static 3D scenes. However, the reconstructed scenes still lack "liveliness," a key component for creating engaging 3D experiences. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Thomas Wimmer , Michael Oechsle , Michael Niemeyer , Federico Tombari

4D driving simulation is essential for developing realistic autonomous driving simulators. Despite advancements in existing methods for generating driving scenes, significant challenges remain in view transformation and spatial-temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Lening Wang , Wenzhao Zheng , Dalong Du , Yunpeng Zhang , Yilong Ren , Han Jiang , Zhiyong Cui , Haiyang Yu , Jie Zhou , Jiwen Lu , Shanghang Zhang

Fast and flexible 3D scene reconstruction from unstructured image collections remains a significant challenge. We present YoNoSplat, a feedforward model that reconstructs high-quality 3D Gaussian Splatting representations from an arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Botao Ye , Boqi Chen , Haofei Xu , Daniel Barath , Marc Pollefeys

The accurate reconstruction of dynamic street scenes is critical for applications in autonomous driving, augmented reality, and virtual reality. Traditional methods relying on dense point clouds and triangular meshes struggle with moving…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Peizhen Zheng , Dongjing Jiang , Qingchong Jiao , Redouane EL Bouchtaoui , Flynnwell Jianfei Zhang