English
Related papers

Related papers: RNG: Relightable Neural Gaussians

200 papers

Radiance Field methods have recently revolutionized novel-view synthesis of scenes captured with multiple photos or videos. However, achieving high visual quality still requires neural networks that are costly to train and render, while…

Graphics · Computer Science 2023-08-09 Bernhard Kerbl , Georgios Kopanas , Thomas Leimkühler , George Drettakis

The accurate reconstruction of dynamic street scenes is critical for applications in autonomous driving, augmented reality, and virtual reality. Traditional methods relying on dense point clouds and triangular meshes struggle with moving…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Peizhen Zheng , Dongjing Jiang , Qingchong Jiao , Redouane EL Bouchtaoui , Flynnwell Jianfei Zhang

Novel view synthesis has advanced significantly with the development of neural radiance fields (NeRF) and 3D Gaussian splatting (3DGS). However, achieving high quality without compromising real-time rendering remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhongpai Gao , Benjamin Planche , Meng Zheng , Anwesa Choudhuri , Terrence Chen , Ziyan Wu

Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have advanced 3D reconstruction and novel view synthesis, but remain heavily dependent on accurate camera poses and dense viewpoint coverage. These requirements limit their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiahui Lu , Haihong Xiao , Xueyan Zhao , Wenxiong Kang

Reconstructing urban scenes is challenging due to their complex geometries and the presence of potentially dynamic objects. 3D Gaussian Splatting (3DGS)-based methods have shown strong performance, but existing approaches often incorporate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziwen Li , Jiaxin Huang , Runnan Chen , Yunlong Che , Yandong Guo , Tongliang Liu , Fakhri Karray , Mingming Gong

Existing neural implicit surface reconstruction methods have achieved impressive performance in multi-view 3D reconstruction by leveraging explicit geometry priors such as depth maps or point clouds as regularization. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Hanlin Chen , Chen Li , Yunsong Wang , Gim Hee Lee

Referenced-based scene stylization that edits the appearance based on a content-aligned reference image is an emerging research area. Starting with a pretrained neural radiance field (NeRF), existing methods typically learn a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yiqun Mei , Jiacong Xu , Vishal M. Patel

Novel view synthesis has demonstrated impressive progress recently, with 3D Gaussian splatting (3DGS) offering efficient training time and photorealistic real-time rendering. However, reliance on Cartesian coordinates limits 3DGS's…

Graphics · Computer Science 2025-03-26 Xinpeng Liu , Zeyi Huang , Fumio Okura , Yasuyuki Matsushita

Existing Gaussian splatting methods often fall short in achieving satisfactory novel view synthesis in driving scenes, primarily due to the absence of crafty designs and geometric constraints for the involved elements. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xi Shi , Lingli Chen , Peng Wei , Xi Wu , Tian Jiang , Yonggang Luo , Lecheng Xie

We present Real-time Gaussian SLAM (RTG-SLAM), a real-time 3D reconstruction system with an RGBD camera for large-scale environments using Gaussian splatting. The system features a compact Gaussian representation and a highly efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zhexi Peng , Tianjia Shao , Yong Liu , Jingke Zhou , Yin Yang , Jingdong Wang , Kun Zhou

3D Gaussian Splatting (3D-GS) has made a notable advancement in the field of neural rendering, 3D scene reconstruction, and novel view synthesis. Nevertheless, 3D-GS encounters the main challenge when it comes to accurately representing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Rui Zhang , Tianyue Luo , Weidong Yang , Ben Fei , Jingyi Xu , Qingyuan Zhou , Keyi Liu , Ying He

3D Gaussian Splatting (3DGS) enables high-fidelity reconstruction of scene geometry and appearance. Building on this capability, inserting external mesh objects into reconstructed 3DGS scenes enables interactive editing and content…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Tianyu Huang , Zhenyang Ren , Zhenchen Wan , Jiyang Zheng , Wenjie Wang , Runnan Chen , Mingming Gong , Tongliang Liu

3D Gaussian Splatting (3DGS) is a powerful alternative to Neural Radiance Fields (NeRF), excelling in complex scene reconstruction and efficient rendering. However, it relies on high-quality point clouds from Structure-from-Motion (SfM),…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ziao Liu , Zhenjia Li , Yifeng Shi , Xiangang Li

We introduce NovelGS, a diffusion model for Gaussian Splatting (GS) given sparse-view images. Recent works leverage feed-forward networks to generate pixel-aligned Gaussians, which could be fast rendered. Unfortunately, the method was…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jinpeng Liu , Jiale Xu , Weihao Cheng , Yiming Gao , Xintao Wang , Ying Shan , Yansong Tang

3D Gaussian Splatting has shown impressive novel view synthesis results; nonetheless, it is vulnerable to dynamic objects polluting the input data of an otherwise static scene, so called distractors. Distractors have severe impact on the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Paul Ungermann , Armin Ettenhofer , Matthias Nießner , Barbara Roessle

3D Gaussian splatting (3DGS) has shown its detailed expressive ability and highly efficient rendering speed in the novel view synthesis (NVS) task. The application to inverse rendering still faces several challenges, as the discrete nature…

Graphics · Computer Science 2025-07-22 Zuo-Liang Zhu , Jian Yang , Beibei Wang

Recent advancements in neural rendering techniques have significantly enhanced the fidelity of 3D reconstruction. Notably, the emergence of 3D Gaussian Splatting (3DGS) has marked a significant milestone by adopting a discrete scene…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Licheng Shen , Ho Ngai Chow , Lingyun Wang , Tong Zhang , Mengqiu Wang , Yuxing Han

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

In this paper, we propose a 3D geometry-aware deformable Gaussian Splatting method for dynamic view synthesis. Existing neural radiance fields (NeRF) based solutions learn the deformation in an implicit manner, which cannot incorporate 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zhicheng Lu , Xiang Guo , Le Hui , Tianrui Chen , Min Yang , Xiao Tang , Feng Zhu , Yuchao Dai

Volumetric rendering based methods, like NeRF, excel in HDR view synthesis from RAWimages, especially for nighttime scenes. While, they suffer from long training times and cannot perform real-time rendering due to dense sampling…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Xin Jin , Pengyi Jiao , Zheng-Peng Duan , Xingchao Yang , Chun-Le Guo , Bo Ren , Chongyi Li