English
Related papers

Related papers: Taking Language Embedded 3D Gaussian Splatting int…

200 papers

3D Gaussian Splatting (3DGS) has revolutionized fast novel view synthesis, yet its opacity-based formulation makes surface extraction fundamentally difficult. Unlike implicit methods built on Signed Distance Fields or occupancy, 3DGS lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Diego Gomez , Antoine Guédon , Nissim Maruani , Bingchen Gong , Maks Ovsjanikov

Lifting 2D open-vocabulary understanding into 3D Gaussian Splatting (3DGS) scenes is a critical challenge. Mainstream methods, built on an embedding paradigm, suffer from three key flaws: (i) geometry-semantic inconsistency, where points,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jiayu Ding , Xinpeng Liu , Zhiyi Pan , Shiqiang Long , Ge Li

Egocentric scenes exhibit frequent occlusions, varied viewpoints, and dynamic interactions compared to typical scene understanding tasks. Occlusions and varied viewpoints can lead to multi-view semantic inconsistencies, while dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Di Li , Jie Feng , Jiahao Chen , Weisheng Dong , Guanbin Li , Guangming Shi , Licheng Jiao

Three-dimensional Gaussian Splatting (3DGS) has recently emerged as an efficient representation for novel-view synthesis, achieving impressive visual quality. However, in scenes dominated by large and low-texture regions, common in indoor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Xirui Jin , Renbiao Jin , Boying Li , Danping Zou , Wenxian Yu

Constructing a 3D scene capable of accommodating open-ended language queries, is a pivotal pursuit, particularly within the domain of robotics. Such technology facilitates robots in executing object manipulations based on human language…

3D scene reconstruction and understanding have gained increasing popularity, yet existing methods still struggle to capture fine-grained, language-aware 3D representations from 2D images. In this paper, we present GALA, a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Elena Alegret , Kunyi Li , Sen Wang , Siyun Liang , Michael Niemeyer , Stefano Gasperini , Nassir Navab , Federico Tombari

Articulated objects are ubiquitous in daily environments, and their 3D reconstruction holds great significance across various fields. However, existing articulated object reconstruction methods typically require costly inputs such as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Di Wu , Liu Liu , Xueyu Yuan , Wenxiao Chen , Lijun Yue , Liuzhu Chen , Yiming Tang , Meng Wang

Recovering 3D information from scenes via multi-view stereo reconstruction (MVS) and novel view synthesis (NVS) is inherently challenging, particularly in scenarios involving sparse-view setups. The advent of 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Shubhendu Jena , Shishir Reddy Vutukur , Adnane Boukhayma

Generalizable 3D Gaussian Splatting reconstruction showcases advanced Image-to-3D content creation but requires substantial computational resources and large datasets, posing challenges to training models from scratch. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Xiufeng Huang , Ka Chun Cheung , Runmin Cong , Simon See , Renjie Wan

Applying Gaussian Splatting to perception tasks for 3D scene understanding is becoming increasingly popular. Most existing works primarily focus on rendering 2D feature maps from novel viewpoints, which leads to an imprecise 3D language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hao Li , Minghan Qin , Zhengyu Zou , Diqi He , Xinhao Ji , Bohan Li , Bingquan Dai , Dingewn Zhang , Junwei Han

Recently, several studies have combined Gaussian Splatting to obtain scene representations with language embeddings for open-vocabulary 3D scene understanding. While these methods perform well, they essentially require very dense multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jun Hu , Zhang Chen , Zhong Li , Yi Xu , Juyong Zhang

The problem of 3D reconstruction from posed images is undergoing a fundamental transformation, driven by continuous advances in 3D Gaussian Splatting (3DGS). By modeling scenes explicitly as collections of 3D Gaussians, 3DGS enables…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Vitor Pereira Matias , Daniel Perazzo , Vinicius Silva , Alberto Raposo , Luiz Velho , Afonso Paiva , Tiago Novello

We introduce GeoGS3D, a novel two-stage framework for reconstructing detailed 3D objects from single-view images. Inspired by the success of pre-trained 2D diffusion models, our method incorporates an orthogonal plane decomposition…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Qijun Feng , Zhen Xing , Zuxuan Wu , Yu-Gang Jiang

We present GaussExplorer, a framework for embodied exploration and reasoning built on 3D Gaussian Splatting (3DGS). While prior approaches to language-embedded 3DGS have made meaningful progress in aligning simple text queries with Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Kim Yu-Ji , Dahye Lee , Kim Jun-Seong , GeonU Kim , Nam Hyeon-Woo , Yongjin Kwon , Yu-Chiang Frank Wang , Jaesung Choe , Tae-Hyun Oh

Understanding a 3D scene immediately with its exploration is essential for embodied tasks, where an agent must construct and comprehend the 3D scene in an online and nearly real-time manner. In this study, we propose EmbodiedSplat, an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Seungjun Lee , Zihan Wang , Yunsong Wang , Gim Hee Lee

We introduce Referring 3D Gaussian Splatting Segmentation (R3DGS), a new task that aims to segment target objects in a 3D Gaussian scene based on natural language descriptions, which often contain spatial relationships or object attributes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Shuting He , Guangquan Jie , Changshuo Wang , Yun Zhou , Shuming Hu , Guanbin Li , Henghui Ding

Photographs captured in unstructured tourist environments frequently exhibit variable appearances and transient occlusions, challenging accurate scene reconstruction and inducing artifacts in novel view synthesis. Although prior approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jiacong Xu , Yiqun Mei , Vishal M. Patel

Recent advances in 3D Gaussian Splatting (3DGS) have enabled Simultaneous Localization and Mapping (SLAM) systems to build photorealistic maps. However, these maps lack the open-vocabulary semantic understanding required for advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Sibaek Lee , Seongbo Ha , Kyeongsu Kang , Joonyeol Choi , Seungjun Tak , Hyeonwoo Yu

Humans naturally interact with their 3D surroundings using language, and modeling 3D language fields for scene understanding and interaction has gained growing interest. This paper introduces ChatSplat, a system that constructs a 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hanlin Chen , Fangyin Wei , Gim Hee Lee

Recent advancements in open-vocabulary 3D scene understanding heavily rely on 3D Gaussian Splatting (3DGS) to register vision-language features into 3D space. However, we identify two critical limitations in these approaches: the spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Fusang Wang , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Fabien Moutarde