English
Related papers

Related papers: 3D Gaussian Splatting in Robotics: A Survey

200 papers

Reconstructing 3D scenes and synthesizing novel views has seen rapid progress in recent years. Neural Radiance Fields demonstrated that continuous volumetric radiance fields can achieve high-quality image synthesis, but their long training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Jan Held , Renaud Vandeghen , Sanghyun Son , Daniel Rebain , Matheus Gadelha , Yi Zhou , Ming C. Lin , Marc Van Droogenbroeck , Andrea Tagliasacchi

Recent advancements in 3D Gaussian Splatting (3D-GS) have revolutionized novel view synthesis, facilitating real-time, high-quality image rendering. However, in scenarios involving reflective surfaces, particularly mirrors, 3D-GS often…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zihan Wang , Shuzhe Wang , Matias Turkulainen , Junyuan Fang , Juho Kannala

The field of novel-view synthesis has recently witnessed the emergence of 3D Gaussian Splatting, which represents scenes in a point-based manner and renders through rasterization. This methodology, in contrast to Radiance Fields that rely…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Fengyi Zhang , Yadan Luo , Tianjun Zhang , Lin Zhang , Zi Huang

We propose a framework for active next best view and touch selection for robotic manipulators using 3D Gaussian Splatting (3DGS). 3DGS is emerging as a useful explicit 3D scene representation for robotics, as it has the ability to represent…

Robotics · Computer Science 2025-03-11 Matthew Strong , Boshu Lei , Aiden Swann , Wen Jiang , Kostas Daniilidis , Monroe Kennedy

Gaussian Splatting (GS) has become one of the most important neural rendering algorithms. GS represents 3D scenes using Gaussian components with trainable color and opacity. This representation achieves high-quality renderings with fast…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Krzysztof Byrski , Grzegorz Wilczyński , Weronika Smolak-Dyżewska , Piotr Borycki , Dawid Baran , Sławomir Tadeja , Przemysław Spurek

Recently, 3D Gaussian splatting has gained attention for its capability to generate high-fidelity rendering results. At the same time, most applications such as games, animation, and AR/VR use mesh-based representations to represent and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jaehoon Choi , Yonghan Lee , Hyungtae Lee , Heesung Kwon , Dinesh Manocha

Mirror-containing environments pose unique challenges for 3D reconstruction and novel view synthesis (NVS), as reflective surfaces introduce view-dependent distortions and inconsistencies. While cutting-edge methods such as Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zijing Guo , Yunyang Zhao , Lin Wang

Radiance fields have emerged as a predominant representation for modeling 3D scene appearance. Neural formulations such as Neural Radiance Fields provide high expressivity but require costly ray marching for rendering, whereas…

Photographs captured in unstructured tourist environments frequently exhibit variable appearances and transient occlusions, challenging accurate scene reconstruction and inducing artifacts in novel view synthesis. Although prior approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jiacong Xu , Yiqun Mei , Vishal M. Patel

3D Gaussian Splatting (3DGS) enables real-time novel view synthesis with high visual quality. However, existing methods struggle with semi-transparent specular surfaces that exhibit both complex reflections and clear transmission, often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ji Shi , Xianghua Ying , Bowei Xing , Ruohao Guo , Wenzhen Yue

3D reconstruction and relighting of objects made from scattering materials present a significant challenge due to the complex light transport beneath the surface. 3D Gaussian Splatting introduced high-quality novel view synthesis at…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jan-Niklas Dihlmann , Arjun Majumdar , Andreas Engelhardt , Raphael Braun , Hendrik P. A. Lensch

Efficiently synthesizing novel views from sparse inputs while maintaining accuracy remains a critical challenge in 3D reconstruction. While advanced techniques like radiance fields and 3D Gaussian Splatting achieve rendering quality and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Chenlu Zhan , Yufei Zhang , Yu Lin , Gaoang Wang , Hongwei Wang

Ensuring the safety of autonomous robots, such as self-driving vehicles, requires extensive testing across diverse driving scenarios. Simulation is a key ingredient for conducting such testing in a cost-effective and scalable way. Neural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Georg Hess , Carl Lindström , Maryam Fatemi , Christoffer Petersson , Lennart Svensson

Recent advancements in 3D Gaussian Splatting (3DGS) have substantially improved novel view synthesis, enabling high-quality reconstruction and real-time rendering. However, blurring artifacts, such as floating primitives and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haodong Chen , Runnan Chen , Qiang Qu , Zhaoqing Wang , Tongliang Liu , Xiaoming Chen , Yuk Ying Chung

Recent years have witnessed the rapid emergence of 3D Gaussian splatting (3DGS) as a powerful approach for 3D reconstruction and novel view synthesis. Its explicit representation with Gaussian primitives enables fast training, real-time…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Haato Watanabe , Nobuyuki Umetani

Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to guarantee. To achieve real-time dynamic scene rendering while also…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Guanjun Wu , Taoran Yi , Jiemin Fang , Lingxi Xie , Xiaopeng Zhang , Wei Wei , Wenyu Liu , Qi Tian , Xinggang Wang

3D Gaussian splatting (3DGS) is a popular radiance field method, with many application-specific extensions. Most variants rely on the same core algorithm: depth-sorting of Gaussian splats then rasterizing in primitive order. This ensures…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Shakiba Kheradmand , Delio Vicini , George Kopanas , Dmitry Lagun , Kwang Moo Yi , Mark Matthews , Andrea Tagliasacchi

Photorealistic 3D reconstruction of street scenes is a critical technique for developing real-world simulators for autonomous driving. Despite the efficacy of Neural Radiance Fields (NeRF) for driving scenes, 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Nan Huang , Xiaobao Wei , Wenzhao Zheng , Pengju An , Ming Lu , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Shanghang Zhang

We present a multispectral extension to 3D Gaussian Splatting (3DGS) for wavelength-aware view synthesis. Each Gaussian is augmented with spectral radiance, represented via per-band spherical harmonics, and optimized under a dual-loss…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Iris Zheng , Guojun Tang , Alexander Doronin , Paul Teal , Fang-Lue Zhang

3D Gaussian Splatting SLAM has emerged as a widely used technique for high-fidelity mapping in spatial intelligence. However, existing methods often rely on a single representation scheme, which limits their performance in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Wenkai Zhu , Xu Li , Qimin Xu , Benwu Wang , Kun Wei , Yiming Peng , Zihang Wang