English
Related papers

Related papers: Semantic Consistent Language Gaussian Splatting fo…

200 papers

We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Saptarshi Neil Sinha , Holger Graf , Michael Weinmann

We present a novel-view rendering algorithm, Mode-GS, for ground-robot trajectory datasets. Our approach is based on using anchored Gaussian splats, which are designed to overcome the limitations of existing 3D Gaussian splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yonghan Lee , Jaehoon Choi , Dongki Jung , Jaeseong Yun , Soohyun Ryu , Dinesh Manocha , Suyong Yeon

Vision-language models (VLMs) have demonstrated impressive zero-shot transfer capabilities in image-level visual perception tasks. However, they fall short in 3D instance-level segmentation tasks that require accurate localization and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Junyuan Fang , Zihan Wang , Yejun Zhang , Shuzhe Wang , Iaroslav Melekhov , Juho Kannala

Transient objects in casual multi-view captures cause ghosting artifacts in 3D Gaussian Splatting (3DGS) reconstruction. Existing solutions relied on scene decomposition at significant memory cost or on motion-based heuristics that were…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Aditi Prabakaran , Priyesh Shukla

3D scene understanding is fundamental for embodied AI and robotics, supporting reliable perception for interaction and navigation. Recent approaches achieve zero-shot, open-vocabulary 3D semantic mapping by assigning embedding vectors to 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Mohamad Amin Mirzaei , Pantea Amoie , Ali Ekhterachian , Matin Mirzababaei , Babak Khalaj

We introduce ShelfGaussian, an open-vocabulary multi-modal Gaussian-based 3D scene understanding framework supervised by off-the-shelf vision foundation models (VFMs). Gaussian-based methods have demonstrated superior performance and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Lingjun Zhao , Yandong Luo , James Hays , Lu Gan

The emergence of neural representations has revolutionized our means for digitally viewing a wide range of 3D scenes, enabling the synthesis of photorealistic images rendered from novel views. Recently, several techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Gal Fiebelman , Tamir Cohen , Ayellet Morgenstern , Peter Hedman , Hadar Averbuch-Elor

With the emergence of Gaussian Splats, recent efforts have focused on large-scale scene geometric reconstruction. However, most of these efforts either concentrate on memory reduction or spatial space division, neglecting information in the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Butian Xiong , Xiaoyu Ye , Tze Ho Elden Tse , Kai Han , Shuguang Cui , Zhen Li

Recent developments in 3D Gaussian Splatting have made significant advances in surface reconstruction. However, scaling these methods to large-scale scenes remains challenging due to high computational demands and the complex dynamic…

Graphics · Computer Science 2025-06-24 Shihan Chen , Zhaojin Li , Zeyu Chen , Qingsong Yan , Gaoyang Shen , Ran Duan

We propose NEDS-SLAM, a dense semantic SLAM system based on 3D Gaussian representation, that enables robust 3D semantic mapping, accurate camera tracking, and high-quality rendering in real-time. In the system, we propose a Spatially…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yiming Ji , Yang Liu , Guanghu Xie , Boyu Ma , Zongwu Xie

Recent advances in Gaussian Splatting based 3D scene representation have shown two major trends: semantics-oriented approaches that focus on high-level understanding but lack explicit 3D geometry modeling, and structure-oriented approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yuhang Ming , Chenxin Fang , Xingyuan Yu , Fan Zhang , Weichen Dai , Wanzeng Kong , Guofeng Zhang

Recent advancements in open-vocabulary 3D scene understanding heavily rely on 3D Gaussian Splatting (3DGS) to register vision-language features into 3D space. However, we identify two critical limitations in these approaches: the spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Fusang Wang , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Fabien Moutarde

Embedding a language field in a 3D representation enables richer semantic understanding of spatial environments by linking geometry with descriptive meaning. This allows for a more intuitive human-computer interaction, enabling querying or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shai Krakovsky , Gal Fiebelman , Sagie Benaim , Hadar Averbuch-Elor

We propose a neural regularization method that refines the noisy 3D semantic field produced by lifting multi-view inconsistent 2D features, in order to obtain an accurate and robust 3D semantic Gaussian Splatting. The 2D features extracted…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Zaiyan Yang , Xinpeng Liu , Heng Guo , Jinglei Shi , Zhanyu Ma , Fumio Okura

Gaussian Splatting (GS), a recent technique for converting discrete points into continuous spatial representations, has shown promising results in 3D scene modeling and 2D image super-resolution. In this paper, we explore its untapped…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Hongyu Li , Chaofeng Chen , Xiaoming Li , Guangming Lu

Recent advances in 3D Gaussian Splatting (3DGS) have enabled Simultaneous Localization and Mapping (SLAM) systems to build photorealistic maps. However, these maps lack the open-vocabulary semantic understanding required for advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Sibaek Lee , Seongbo Ha , Kyeongsu Kang , Joonyeol Choi , Seungjun Tak , Hyeonwoo Yu

3D semantic segmentation provides high-level scene understanding for applications in robotics, autonomous systems, \textit{etc}. Traditional methods adapt exclusively to either task-specific goals (open-vocabulary segmentation) or scene…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Doriand Petit , Steve Bourgeois , Vincent Gay-Bellile , Florian Chabot , Loïc Barthe

Differentiable rendering techniques have recently shown promising results for free-viewpoint video synthesis of characters. However, such methods, either Gaussian Splatting or neural implicit rendering, typically necessitate per-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Boyao Zhou , Shunyuan Zheng , Hanzhang Tu , Ruizhi Shao , Boning Liu , Shengping Zhang , Liqiang Nie , Yebin Liu

Open-vocabulary semantic mapping enables robots to spatially ground previously unseen concepts without requiring predefined class sets. Current training-free methods commonly rely on multi-view fusion of semantic embeddings into a 3D map,…

Three-dimensional reconstruction in scenes with extreme depth variations remains challenging due to inconsistent supervisory signals between near-field and far-field regions. Existing methods fail to simultaneously address inaccurate depth…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yu Deng , Baozhu Zhao , Junyan Su , Xiaohan Zhang , Qi Liu