English
Related papers

Related papers: Flexible Techniques for Differentiable Rendering w…

200 papers

3D scene representations have gained immense popularity in recent years. Methods that use Neural Radiance fields are versatile for traditional tasks such as novel view synthesis. In recent times, some work has emerged that aims to extend…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Shijie Zhou , Haoran Chang , Sicheng Jiang , Zhiwen Fan , Zehao Zhu , Dejia Xu , Pradyumna Chari , Suya You , Zhangyang Wang , Achuta Kadambi

In this paper, we propose UniGS, a unified map representation and differentiable framework for high-fidelity multimodal 3D reconstruction based on 3D Gaussian Splatting. Our framework integrates a CUDA-accelerated rasterization pipeline…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yusen Xie , Zhenmin Huang , Jianhao Jiao , Dimitrios Kanoulas , Jun Ma

In the context of novel view synthesis, 3D Gaussian Splatting (3DGS) has recently emerged as an efficient and competitive counterpart to Neural Radiance Field (NeRF), enabling high-fidelity photorealistic rendering in real time. Beyond…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shuting He , Peilin Ji , Yitong Yang , Changshuo Wang , Jiayi Ji , Yinglin Wang , Henghui Ding

Novel view synthesis has experienced significant advancements owing to increasingly capable NeRF- and 3DGS-based methods. However, reflective object reconstruction remains challenging, lacking a proper solution to achieve real-time,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yuxuan Yao , Zixuan Zeng , Chun Gu , Xiatian Zhu , Li Zhang

This survey aims to investigate fundamental deep learning (DL) based 3D reconstruction techniques that produce photo-realistic 3D models and scenes, highlighting Neural Radiance Fields (NeRFs), Latent Diffusion Models (LDM), and 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yonge Bai , LikHang Wong , TszYin Twan

3D Gaussian Splatting (3D-GS) is a recent 3D scene reconstruction technique that enables real-time rendering of novel views by modeling scenes as parametric point clouds of differentiable 3D Gaussians. However, its rendering speed and model…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Alex Hanson , Allen Tu , Geng Lin , Vasu Singla , Matthias Zwicker , Tom Goldstein

3D Gaussian Splatting (3DGS) has emerged as a powerful explicit representation enabling real-time, high-fidelity 3D reconstruction and novel view synthesis. However, its practical use is hindered by the massive memory and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Seokhyun Youn , Soohyun Lee , Geonho Kim , Weeyoung Kwon , Sung-Ho Bae , Jihyong Oh

Recently, 3D Gaussian Splatting (3DGS) has emerged as a powerful alternative to NeRF-based approaches, enabling real-time, high-quality novel view synthesis through explicit, optimizable 3D Gaussians. However, 3DGS suffers from significant…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zipeng Wang , Dan Xu

Although 3D Gaussian Splatting has been widely studied because of its realistic and efficient novel-view synthesis, it is still challenging to extract a high-quality surface from the point-based representation. Previous works improve the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Hanlin Chen , Fangyin Wei , Chen Li , Tianxin Huang , Yunsong Wang , Gim Hee Lee

Recent advances in 3D Gaussian Splatting have enabled impressive photorealistic novel view synthesis. However, to transition from a pure rendering engine to a reliable spatial map for autonomous agents and safety-critical applications,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Chamuditha Jayanga Galappaththige , Thomas Gottwald , Peter Stehr , Edgar Heinert , Niko Suenderhauf , Dimity Miller , Matthias Rottmann

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis performance. While conventional methods require per-scene optimization, more recently several feed-forward methods have been proposed to generate pixel-aligned…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Shengjun Zhang , Xin Fei , Fangfu Liu , Haixu Song , Yueqi Duan

Gaussian Splatting has revolutionized the world of novel view synthesis by achieving high rendering performance in real-time. Recently, studies have focused on enriching these 3D representations with semantic information for downstream…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Mihnea-Bogdan Jurca , Remco Royen , Ion Giosan , Adrian Munteanu

Neural Radiance Fields (NeRFs) have demonstrated the remarkable potential of neural networks to capture the intricacies of 3D objects. By encoding the shape and color information within neural network weights, NeRFs excel at producing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dawid Malarz , Weronika Smolak , Jacek Tabor , Sławomir Tadeja , Przemysław Spurek

3D reconstruction and relighting of objects made from scattering materials present a significant challenge due to the complex light transport beneath the surface. 3D Gaussian Splatting introduced high-quality novel view synthesis at…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jan-Niklas Dihlmann , Arjun Majumdar , Andreas Engelhardt , Raphael Braun , Hendrik P. A. Lensch

Novel view synthesis (NVS) and surface reconstruction (SR) are essential tasks in 3D Gaussian Splatting (3D-GS). Despite recent progress, these tasks are often addressed independently, with GS-based rendering methods struggling under…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Qingyuan Zhou , Yuehu Gong , Weidong Yang , Jiaze Li , Yeqi Luo , Baixin Xu , Shuhao Li , Ben Fei , Ying He

3D Gaussian splatting enables high-quality novel view synthesis (NVS) at real-time frame rates. However, its quality drops sharply as we depart from the training views. Thus, dense captures are needed to match the high-quality expectations…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tobias Fischer , Samuel Rota Bulò , Yung-Hsu Yang , Nikhil Keetha , Lorenzo Porzi , Norman Müller , Katja Schwarz , Jonathon Luiten , Marc Pollefeys , Peter Kontschieder

Exploring the capabilities of Neural Radiance Fields (NeRF) and Gaussian-based methods in the context of 3D scene reconstruction, this study contrasts these modern approaches with traditional Simultaneous Localization and Mapping (SLAM)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yiming Zhou , Zixuan Zeng , Andi Chen , Xiaofan Zhou , Haowei Ni , Shiyao Zhang , Panfeng Li , Liangxi Liu , Mengyao Zheng , Xupeng Chen

We present MVSGaussian, a new generalizable 3D Gaussian representation approach derived from Multi-View Stereo (MVS) that can efficiently reconstruct unseen scenes. Specifically, 1) we leverage MVS to encode geometry-aware Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Tianqi Liu , Guangcong Wang , Shoukang Hu , Liao Shen , Xinyi Ye , Yuhang Zang , Zhiguo Cao , Wei Li , Ziwei Liu

Radiance fields produce high fidelity images with high rendering speed, but are difficult to manipulate. We effectively perform avatar texture transfer across different appearances by combining benefits from radiance fields and mesh…

Reconstructing a 3D scene from images is challenging due to the different ways light interacts with surfaces depending on the viewer's position and the surface's material. In classical computer graphics, materials can be classified as…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Mateusz Nowak , Wojciech Jarosz , Peter Chin