English
Related papers

Related papers: Taming Video Diffusion Prior with Scene-Grounding …

200 papers

We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Saptarshi Neil Sinha , Holger Graf , Michael Weinmann

3D Gaussian Splatting represents a breakthrough in the field of novel view synthesis. It establishes Gaussians as core rendering primitives for highly accurate real-world environment reconstruction. Recent advances have drastically…

Graphics · Computer Science 2025-06-25 Jonathan Haberl , Philipp Fleck , Clemens Arth

Recently, 3D Gaussian Splatting has emerged as a promising approach for modeling 3D scenes using mixtures of Gaussians. The predominant optimization method for these models relies on backpropagating gradients through a differentiable…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Toon Van de Maele , Ozan Catal , Alexander Tschantz , Christopher L. Buckley , Tim Verbelen

Standard 3D Gaussian Splatting (3DGS) relies on known or pre-computed camera poses and a sparse point cloud, obtained from structure-from-motion (SfM) preprocessing, to initialize and grow 3D Gaussians. We propose a novel SfM-Free 3DGS…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Bo Ji , Angela Yao

3D Gaussian Splatting (3DGS) has demonstrated impressive performance in synthesizing novel views after training on a given set of viewpoints. However, its rendering quality deteriorates when the synthesized view deviates significantly from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jiatong Xia , Lingqiao Liu

Previous surface reconstruction methods either suffer from low geometric accuracy or lengthy training times when dealing with real-world complex dynamic scenes involving multi-person activities, and human-object interactions. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Shuo Wang , Binbin Huang , Ruoyu Wang , Shenghua Gao

Image-based 3D generation has vast applications in robotics and gaming, where high-quality, diverse outputs and consistent 3D representations are crucial. However, existing methods have limitations: 3D diffusion models are limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ye Tao , Jiawei Zhang , Yahao Shi , Dongqing Zou , Bin Zhou

We consider the problem of filling in missing spatio-temporal regions of a video. We provide a novel flow-based solution by introducing a generative model of images in relation to the scene (without missing regions) and mappings from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Dong Lao , Peihao Zhu , Peter Wonka , Ganesh Sundaramoorthi

3D Gaussian Splatting (3DGS) enables real-time, photorealistic novel view synthesis, making it a highly attractive representation for model-based video tracking. However, leveraging the differentiability of the 3DGS renderer "in the wild"…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Avigail Cohen Rimon , Amir Mann , Mirela Ben Chen , Or Litany

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene reconstructions but…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mustafa Khan , Hamidreza Fazlali , Dhruv Sharma , Tongtong Cao , Dongfeng Bai , Yuan Ren , Bingbing Liu

3D Gaussian Splatting (3DGS) has emerged as an efficient approach for achieving photorealistic rendering. Recent MLP-based variants further improve visual fidelity but introduce substantial decoding overhead during rendering. To alleviate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Yuanyuan Gao , Yuning Gong , Yifei Liu , Li Jingfeng , Dingwen Zhang , Yanci Zhang , Dan Xu , Xiao Sun , Zhihang Zhong

3D Gaussian Splatting (3DGS) has revolutionized neural rendering with its efficiency and quality, but like many novel view synthesis methods, it heavily depends on accurate camera poses from Structure-from-Motion (SfM) systems. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhisheng Huang , Peng Wang , Jingdong Zhang , Yuan Liu , Xin Li , Wenping Wang

Recent advances in driving-scene generation and reconstruction have demonstrated significant potential for enhancing autonomous driving systems by producing scalable and controllable training data. Existing generation methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Ziyue Zhu , Zhanqian Wu , Zhenxin Zhu , Lijun Zhou , Haiyang Sun , Bing Wan , Kun Ma , Guang Chen , Hangjun Ye , Jin Xie , jian Yang

The emergence of 3D Gaussian Splatting (3DGS) has greatly accelerated the rendering speed of novel view synthesis. Unlike neural implicit representations like Neural Radiance Fields (NeRF) that represent a 3D scene with position and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Tong Wu , Yu-Jie Yuan , Ling-Xiao Zhang , Jie Yang , Yan-Pei Cao , Ling-Qi Yan , Lin Gao

3D Gaussian Splatting (GS) significantly struggles to accurately represent the underlying 3D scene geometry, resulting in inaccuracies and floating artifacts when rendering depth maps. In this paper, we address this limitation, undertaking…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sadra Safadoust , Fabio Tosi , Fatma Güney , Matteo Poggi

Feed-forward 3D reconstruction has revolutionized 3D vision, providing a powerful baseline for downstream tasks such as novel-view synthesis with 3D Gaussian Splatting. Previous works explore fixing the corrupted rendering results with a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yiming Huang , Baixiang Huang , Beilei Cui , Chi Kit Ng , Long Bai , Hongliang Ren

Recent progress in pre-trained diffusion models and 3D generation have spurred interest in 4D content creation. However, achieving high-fidelity 4D generation with spatial-temporal consistency remains a challenge. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yifei Zeng , Yanqin Jiang , Siyu Zhu , Yuanxun Lu , Youtian Lin , Hao Zhu , Weiming Hu , Xun Cao , Yao Yao

Dynamic Gaussian Splatting approaches have achieved remarkable performance for 4D scene reconstruction. However, these approaches rely on dense-frame video sequences for photorealistic reconstruction. In real-world scenarios, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Changyue Shi , Chuxiao Yang , Xinyuan Hu , Minghao Chen , Wenwen Pan , Yan Yang , Jiajun Ding , Zhou Yu , Jun Yu

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distilling pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zi-Xin Zou , Weihao Cheng , Yan-Pei Cao , Shi-Sheng Huang , Ying Shan , Song-Hai Zhang

Feedforward 3D Gaussian Splatting (3DGS) often struggles in trajectory-based sparse-view driving scenes. Existing Gaussian repair methods mainly target optimization-based 3DGS, while diffusion-based repair is typically restricted to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rui Song , Tianhui Cai , Markus Gross , Xingcheng Zhou , Zewei Zhou , Zhiyu Huang , Olaf Wysocki , Jiaqi Ma