English
Related papers

Related papers: Generalizable and Relightable Gaussian Splatting f…

200 papers

Scene view synthesis, which generates novel views from limited perspectives, is increasingly vital for applications like virtual reality, augmented reality, and robotics. Unlike object-based tasks, such as generating 360{\deg} views of a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Xiaofeng Jin , Yan Fang , Matteo Frosi , Jianfei Ge , Jiangjian Xiao , Matteo Matteucci

Differentiable 3D Gaussian splatting has emerged as an efficient and flexible rendering technique for representing complex scenes from a collection of 2D views and enabling high-quality real-time novel-view synthesis. However, its reliance…

Graphics · Computer Science 2025-01-16 Meenakshi Krishnan , Liam Fowl , Ramani Duraiswami

The field of 3D reconstruction from images has rapidly evolved in the past few years, first with the introduction of Neural Radiance Field (NeRF) and more recently with 3D Gaussian Splatting (3DGS). The latter provides a significant edge…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Avinash Paliwal , Wei Ye , Jinhui Xiong , Dmytro Kotovenko , Rakesh Ranjan , Vikas Chandra , Nima Khademi Kalantari

Novel View Synthesis (NVS) from unconstrained photo collections is challenging in computer graphics. Recently, 3D Gaussian Splatting (3DGS) has shown promise for photorealistic and real-time NVS of static scenes. Building on 3DGS, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yuze Wang , Junyi Wang , Yue Qi

3D Gaussian Splatting (3DGS) has recently emerged as a fast, high-quality method for novel view synthesis (NVS). However, its use of low-degree spherical harmonics limits its ability to capture spatially varying color and view-dependent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Hoang Chuong Nguyen , Wei Mao , Jose M. Alvarez , Miaomiao Liu

Generalizable Gaussian Splatting aims to synthesize novel views for unseen scenes without per-scene optimization. In particular, recent advancements utilize feed-forward networks to predict per-pixel Gaussian parameters, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuxi Hu , Jun Zhang , Kuangyi Chen , Zhe Zhang , Friedrich Fraundorfer

We present a multispectral extension to 3D Gaussian Splatting (3DGS) for wavelength-aware view synthesis. Each Gaussian is augmented with spectral radiance, represented via per-band spherical harmonics, and optimized under a dual-loss…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Iris Zheng , Guojun Tang , Alexander Doronin , Paul Teal , Fang-Lue Zhang

Novel view synthesis techniques predominantly utilize RGB cameras, inheriting their limitations such as the need for sufficient lighting, susceptibility to motion blur, and restricted dynamic range. In contrast, event cameras are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Sohaib Zahid , Viktor Rudnev , Eddy Ilg , Vladislav Golyanik

Recently, 3D Gaussian Splatting (3DGS) has exceled in novel view synthesis (NVS) with its real-time rendering capabilities and superior quality. However, it faces challenges for high-resolution novel view synthesis (HRNVS) due to the coarse…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Shiyun Xie , Zhiru Wang , Xu Wang , Yinghao Zhu , Chengwei Pan , Xiwang Dong

We introduce NovelGS, a diffusion model for Gaussian Splatting (GS) given sparse-view images. Recent works leverage feed-forward networks to generate pixel-aligned Gaussians, which could be fast rendered. Unfortunately, the method was…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jinpeng Liu , Jiale Xu , Weihao Cheng , Yiming Gao , Xintao Wang , Ying Shan , Yansong Tang

High dynamic range (HDR) novel view synthesis (NVS) aims to reconstruct HDR scenes by leveraging multi-view low dynamic range (LDR) images captured at different exposure levels. Current training paradigms with 3D tone mapping often result…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jinfeng Liu , Lingtong Kong , Bo Li , Dan Xu

High-quality image acquisition in real-world environments remains challenging due to complex illumination variations and inherent limitations of camera imaging pipelines. These issues are exacerbated in multi-view capture, where differences…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Ziteng Cui , Shuhong Liu , Xiaoyu Dong , Xuangeng Chu , Lin Gu , Ming-Hsuan Yang , Tatsuya Harada

3D Gaussian Splatting (3DGS) has emerged as a powerful technique for novel view synthesis. However, existing methods struggle to adaptively optimize the distribution of Gaussian primitives based on scene characteristics, making it…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Hongbi Zhou , Zhangkai Ni

3D Gaussian Splatting (3DGS) has shown a powerful capability for novel view synthesis due to its detailed expressive ability and highly efficient rendering speed. Unfortunately, creating relightable 3D assets and reconstructing faithful…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Zuo-Liang Zhu , Beibei Wang , Jian Yang

We present Bidirectional Gaussian Primitives, an image-based novel view synthesis technique designed to represent and render 3D objects with surface and volumetric materials under dynamic illumination. Our approach integrates light…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhenyuan Liu , Yu Guo , Xinyuan Li , Bernd Bickel , Ran Zhang

Recent advancements in 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) have achieved impressive results in real-time 3D reconstruction and novel view synthesis. However, these methods struggle in large-scale, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Niluthpol Chowdhury Mithun , Tuan Pham , Qiao Wang , Ben Southall , Kshitij Minhas , Bogdan Matei , Stephan Mandt , Supun Samarasekera , Rakesh Kumar

Inverse rendering of glossy objects from RGB imagery remains fundamentally limited by inherent ambiguity. Although NeRF-based methods achieve high-fidelity reconstruction via dense-ray sampling, their computational cost is prohibitive.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Xingyuan Yang , Min Wei

Photographs captured in unstructured tourist environments frequently exhibit variable appearances and transient occlusions, challenging accurate scene reconstruction and inducing artifacts in novel view synthesis. Although prior approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jiacong Xu , Yiqun Mei , Vishal M. Patel

3D Gaussian Splatting (3DGS) has become a standard approach to reconstruct and render photorealistic 3D head avatars. A major challenge is to relight the avatars to match any scene illumination. For high quality relighting, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yingyan Xu , Pramod Rao , Sebastian Weiss , Gaspard Zoss , Markus Gross , Christian Theobalt , Marc Habermann , Derek Bradley

3D Gaussian Splatting (3DGS) has shown remarkable performance in novel view synthesis. However, its rendering quality deteriorates with sparse inphut views, leading to distorted content and reduced details. This limitation hinders its…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zongqi He , Zhe Xiao , Kin-Chung Chan , Yushen Zuo , Jun Xiao , Kin-Man Lam