English
Related papers

Related papers: Self-Calibrating 4D Novel View Synthesis from Mono…

200 papers

Novel view synthesis from raw images provides superior high dynamic range (HDR) information compared to reconstructions from low dynamic range RGB images. However, the inherent noise in unprocessed raw images compromises the accuracy of 3D…

Image and Video Processing · Electrical Eng. & Systems 2024-06-13 Zhihao Li , Yufei Wang , Alex Kot , Bihan Wen

Dynamic and static components in scenes often exhibit distinct properties, yet most 4D reconstruction methods treat them indiscriminately, leading to suboptimal performance in both cases. This work introduces SDD-4DGS, the first framework…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Dai Sun , Huhao Guan , Kun Zhang , Xike Xie , S. Kevin Zhou

Existing NeRF-based methods for large scene reconstruction often have limitations in visual quality and rendering speed. While the recent 3D Gaussian Splatting works well on small-scale and object-centric scenes, scaling it up to large…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jiaqi Lin , Zhihao Li , Xiao Tang , Jianzhuang Liu , Shiyong Liu , Jiayue Liu , Yangdi Lu , Xiaofei Wu , Songcen Xu , Youliang Yan , Wenming Yang

X-ray is widely applied for transmission imaging due to its stronger penetration than natural light. When rendering novel view X-ray projections, existing methods mainly based on NeRF suffer from long training time and slow inference speed.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-29 Yuanhao Cai , Yixun Liang , Jiahao Wang , Angtian Wang , Yulun Zhang , Xiaokang Yang , Zongwei Zhou , Alan Yuille

Feed-forward based 3D Gaussian Splatting methods have demonstrated exceptional capability in real-time novel view synthesis for human models. However, current approaches are confined to either dense viewpoint configurations or restricted…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yingdong Hu , Zhening Liu , Jiawei Shao , Zehong Lin , Jun Zhang

We introduce Mono4DGS-HDR, the first system for reconstructing renderable 4D high dynamic range (HDR) scenes from unposed monocular low dynamic range (LDR) videos captured with alternating exposures. To tackle such a challenging problem, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jinfeng Liu , Lingtong Kong , Mi Zhou , Jinwen Chen , Dan Xu

High-fidelity visual reconstruction and novel-view synthesis are essential for realistic closed-loop evaluation in autonomous driving. While 4D Gaussian Splatting (4DGS) offers a promising balance of accuracy and efficiency, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Haibao Yu , Kuntao Xiao , Jiahang Wang , Ruiyang Hao , Yuxin Huang , Guoran Hu , Haifang Qin , Bowen Jing , Yuntian Bo , Ping Luo

Dynamic scene rendering opens new avenues in autonomous driving by enabling closed-loop simulations with photorealistic data, which is crucial for validating end-to-end algorithms. However, the complex and highly dynamic nature of traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Rui Song , Chenwei Liang , Yan Xia , Walter Zimmer , Hu Cao , Holger Caesar , Andreas Festag , Alois Knoll

Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Denis Gridusov , Maxim Popov , Sergey Kolyubin

Differentiable volumetric rendering-based methods made significant progress in novel view synthesis. On one hand, innovative methods have replaced the Neural Radiance Fields (NeRF) network with locally parameterized structures, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Hugo Blanc , Jean-Emmanuel Deschaud , Alexis Paljic

Novel view synthesis is a fundamental task in 3D computer vision that aims to reconstruct photorealistic images from novel viewpoints given a set of posed images. However, reconstruction quality degrades sharply under sparse-view conditions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Wenjun Lu , Haodong Chen , Anqi Yi , Guoxi Huang , Yuk Ying Chung , Kun Hu , Zhiyong Wang

3D Gaussian Splatting (3DGS) is a powerful reconstruction technique, but it needs to be initialized from accurate camera poses and high-fidelity point clouds. Typically, the initialization is taken from Structure-from-Motion (SfM)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jizong Peng , Tze Ho Elden Tse , Kai Xu , Wenchao Gao , Angela Yao

We introduce NovelGS, a diffusion model for Gaussian Splatting (GS) given sparse-view images. Recent works leverage feed-forward networks to generate pixel-aligned Gaussians, which could be fast rendered. Unfortunately, the method was…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jinpeng Liu , Jiale Xu , Weihao Cheng , Yiming Gao , Xintao Wang , Ying Shan , Yansong Tang

Sensor simulation is pivotal for scalable validation of autonomous driving systems, yet existing Neural Radiance Fields (NeRF) based methods face applicability and efficiency challenges in industrial workflows. This paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xianming Zeng , Sicong Du , Qifeng Chen , Lizhe Liu , Haoyu Shu , Jiaxuan Gao , Jiarun Liu , Jiulong Xu , Jianyun Xu , Mingxia Chen , Yiru Zhao , Peng Chen , Yapeng Xue , Chunming Zhao , Sheng Yang , Qiang Li

Radiance fields represented by 3D Gaussians excel at synthesizing novel views, offering both high training efficiency and fast rendering. However, with sparse input views, the lack of multi-view consistency constraints results in poorly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yuru Xiao , Deming Zhai , Wenbo Zhao , Kui Jiang , Junjun Jiang , Xianming Liu

In this paper, we propose a 3D geometry-aware deformable Gaussian Splatting method for dynamic view synthesis. Existing neural radiance fields (NeRF) based solutions learn the deformation in an implicit manner, which cannot incorporate 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zhicheng Lu , Xiang Guo , Le Hui , Tianrui Chen , Min Yang , Xiao Tang , Feng Zhu , Yuchao Dai

3D Gaussian Splatting (3DGS) has shown remarkable potential for static scene reconstruction, and recent advancements have extended its application to dynamic scenes. However, the quality of reconstructions depends heavily on high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yiren Lu , Yunlai Zhou , Disheng Liu , Tuo Liang , Yu Yin

High-quality novel view synthesis for large-scale scenes presents a challenging dilemma in 3D computer vision. Existing methods typically partition large scenes into multiple regions, reconstruct a 3D representation using Gaussian splatting…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xiaohan Zhang , Sitong Wang , Yushen Yan , Yi Yang , Mingda Xu , Qi Liu

We present MoBGS, a novel motion deblurring 3D Gaussian Splatting (3DGS) framework capable of reconstructing sharp and high-quality novel spatio-temporal views from blurry monocular videos in an end-to-end manner. Existing dynamic novel…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Minh-Quan Viet Bui , Jongmin Park , Juan Luis Gonzalez Bello , Jaeho Moon , Jihyong Oh , Munchurl Kim

3D Gaussian Splatting (3DGS) techniques have achieved satisfactory 3D scene representation. Despite their impressive performance, they confront challenges due to the limitation of structure-from-motion (SfM) methods on acquiring accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Ao Gao , Luosong Guo , Tao Chen , Zhao Wang , Ying Tai , Jian Yang , Zhenyu Zhang