English
Related papers

Related papers: RT-GS: Gaussian Splatting with Reflection and Tran…

200 papers

We introduce a simple yet effective approach for separating transmitted and reflected light. Our key insight is that the powerful novel view synthesis capabilities provided by modern inverse rendering methods (e.g.,~3D Gaussian splatting)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Mingyang Xie , Haoming Cai , Sachin Shah , Yiran Xu , Brandon Y. Feng , Jia-Bin Huang , Christopher A. Metzler

3D Gaussian Splatting showcases notable advancements in photo-realistic and real-time novel view synthesis. However, it faces challenges in modeling mirror reflections, which exhibit substantial appearance variations from different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jiayue Liu , Xiao Tang , Freeman Cheng , Roy Yang , Zhihao Li , Jianzhuang Liu , Yi Huang , Jiaqi Lin , Shiyong Liu , Xiaofei Wu , Songcen Xu , Chun Yuan

Recent advancements in 3D Gaussian Splatting (3D-GS) have revolutionized novel view synthesis, facilitating real-time, high-quality image rendering. However, in scenarios involving reflective surfaces, particularly mirrors, 3D-GS often…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zihan Wang , Shuzhe Wang , Matias Turkulainen , Junyuan Fang , Juho Kannala

Accurately rendering scenes with reflective surfaces remains a significant challenge in novel view synthesis, as existing methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) often misinterpret reflections as physical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Jiayi Song , Zihan Ye , Qingyuan Zhou , Weidong Yang , Ben Fei , Jingyi Xu , Ying He , Wanli Ouyang

3D Gaussian splatting (GS) has emerged as a transformative technique in radiance fields. Unlike mainstream implicit neural models, 3D GS uses millions of learnable 3D Gaussians for an explicit scene representation. Paired with a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Guikun Chen , Wenguan Wang

Recently, the 3D Gaussian Splatting (3D-GS) method has achieved great success in novel view synthesis, providing real-time rendering while ensuring high-quality rendering results. However, this method faces challenges in modeling specular…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Zhiru Wang , Shiyun Xie , Chengwei Pan , Guoping Wang

While 3D Gaussian splatting (3DGS) offers explicit and efficient scene representations for cone-beam computed tomography reconstruction, conventional photometric optimization inherently suffers from spectral bias under ultra sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Jian Lin , Jiancheng Fang , Shaoyu Wang , Changan Lai , Yikun Zhang , Yang Chen , Qiegen Liu

In this paper, we introduce Textured-GS, an innovative method for rendering Gaussian splatting that incorporates spatially defined color and opacity variations using Spherical Harmonics (SH). This approach enables each Gaussian to exhibit a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Zhentao Huang , Minglun Gong

Recent 3D Gaussian Splatting (3DGS) methods have demonstrated the feasibility of self-driving scene reconstruction and novel view synthesis. However, most existing methods either rely solely on cameras or use LiDAR only for Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 ZY Chen , F Zhu , H Zhu , DY Kong , XK Kuang , YJ Zhang , CM Jiang

Neural Radiance Fields (NeRFs) have demonstrated the remarkable potential of neural networks to capture the intricacies of 3D objects. By encoding the shape and color information within neural network weights, NeRFs excel at producing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dawid Malarz , Weronika Smolak , Jacek Tabor , Sławomir Tadeja , Przemysław Spurek

We present Bidirectional Gaussian Primitives, an image-based novel view synthesis technique designed to represent and render 3D objects with surface and volumetric materials under dynamic illumination. Our approach integrates light…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhenyuan Liu , Yu Guo , Xinyuan Li , Bernd Bickel , Ran Zhang

Reconstructing transparent surfaces is essential for tasks such as robotic manipulation in labs, yet it poses a significant challenge for 3D reconstruction techniques like 3D Gaussian Splatting (3DGS). These methods often encounter a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Mingwei Li , Pu Pang , Hehe Fan , Hua Huang , Yi Yang

Rendering novel view images in dynamic scenes is a crucial yet challenging task. Current methods mainly utilize NeRF-based methods to represent the static scene and an additional time-variant MLP to model scene deformations, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Diwen Wan , Ruijie Lu , Gang Zeng

In this work, we address specular appearance in inverse rendering using 2D Gaussian splatting with deferred shading and argue for a refinement stage to improve specular detail, thereby bridging the gap with reconstruction-only methods. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Georgios Kouros , Minye Wu , Tinne Tuytelaars

3D reconstruction and relighting of objects made from scattering materials present a significant challenge due to the complex light transport beneath the surface. 3D Gaussian Splatting introduced high-quality novel view synthesis at…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jan-Niklas Dihlmann , Arjun Majumdar , Andreas Engelhardt , Raphael Braun , Hendrik P. A. Lensch

We present LiDAR-GS, a Gaussian Splatting (GS) method for real-time, high-fidelity re-simulation of LiDAR scans in public urban road scenes. Recent GS methods proposed for cameras have achieved significant advancements in real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Qifeng Chen , Sheng Yang , Sicong Du , Tao Tang , Rengan Xie , Peng Chen , Yuchi Huo

Mirror-containing environments pose unique challenges for 3D reconstruction and novel view synthesis (NVS), as reflective surfaces introduce view-dependent distortions and inconsistencies. While cutting-edge methods such as Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zijing Guo , Yunyang Zhao , Lin Wang

3D Gaussian Splatting (3DGS) has significantly advanced 3D scene reconstruction and novel view synthesis. However, like Neural Radiance Fields (NeRF), 3DGS struggles with accurately modeling physical reflections, particularly in mirrors,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jiarui Meng , Haijie Li , Yanmin Wu , Qiankun Gao , Shuzhou Yang , Jian Zhang , Siwei Ma

Opaque objects reconstructed by 3DGS often exhibit a falsely transparent surface, leading to inconsistent background and internal patterns under camera motion in interactive viewing. This issue stems from the ill-posed optimization in 3DGS.…

Graphics · Computer Science 2025-10-20 Aly El Hakie , Yiren Lu , Yu Yin , Michael Jenkins , Yehe Liu

Reconstructing static 3D scene from monocular video with dynamic objects is important for numerous applications such as virtual reality and autonomous driving. Current approaches typically rely on background for static scene reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Yedong Shen , Shiqi Zhang , Sha Zhang , Yifan Duan , Xinran Zhang , Wenhao Yu , Lu Zhang , Jiajun Deng , Yanyong Zhang