English
Related papers

Related papers: OpenSplat3D: Open-Vocabulary 3D Instance Segmentat…

200 papers

Reconstructing dynamic driving scenes is essential for developing autonomous systems through sensor-realistic simulation. Although recent methods achieve high-fidelity reconstructions, they either rely on costly human annotations for object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Carl Lindström , Mahan Rafidashti , Maryam Fatemi , Lars Hammarstrand , Martin R. Oswald , Lennart Svensson

The emergence of 3D Gaussian Splatting (3DGS) has greatly accelerated the rendering speed of novel view synthesis. Unlike neural implicit representations like Neural Radiance Fields (NeRF) that represent a 3D scene with position and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Tong Wu , Yu-Jie Yuan , Ling-Xiao Zhang , Jie Yang , Yan-Pei Cao , Ling-Qi Yan , Lin Gao

3D Gaussian Splatting (3DGS) is a recent approach for scene rendering. Although primarily designed for view synthesis, its potential for scene understanding tasks remains underexplored. In this work, we conduct a comparative evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Julia Farganus , Krzysztof Żurawicki , Arkadiusz Gaweł , Weronika Jakubowska , Halina Kwaśnicka

Bridging natural language and 3D geometry is a crucial step toward flexible, language-driven scene understanding. While recent advances in 3D Gaussian Splatting (3DGS) have enabled fast and high-quality scene reconstruction, research has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Shaohui Dai , Yansong Qu , Zheyan Li , Xinyang Li , Shengchuan Zhang , Liujuan Cao

Lifting 2D open-vocabulary understanding into 3D Gaussian Splatting (3DGS) scenes is a critical challenge. Mainstream methods, built on an embedding paradigm, suffer from three key flaws: (i) geometry-semantic inconsistency, where points,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jiayu Ding , Xinpeng Liu , Zhiyi Pan , Shiqiang Long , Ge Li

3D Gaussian Splatting (3DGS) provides an explicit and efficient scene representation, but its primitives lack inherent object-level identity, hindering downstream tasks such as open-vocabulary scene understanding. Existing methods typically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Guiyu Liu , Niklas Vaara , Janne Mustaniemi , Juho Kannala , Janne Heikkilä

3D scene understanding has become an essential area of research with applications in autonomous driving, robotics, and augmented reality. Recently, 3D Gaussian Splatting (3DGS) has emerged as a powerful approach, combining explicit modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Haijie Li , Yanmin Wu , Jiarui Meng , Qiankun Gao , Zhiyao Zhang , Ronggang Wang , Jian Zhang

TL;DR: Gaussian Splatting is a widely adopted approach for 3D scene representation, offering efficient, high-quality reconstruction and rendering. A key reason for its success is the simplicity of representing scenes with sets of Gaussians,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiahuan Cheng , Jan-Nico Zaech , Luc Van Gool , Danda Pani Paudel

3D Gaussian Splatting (3DGS) serves as a highly performant and efficient encoding of scene geometry, appearance, and semantics. Moreover, grounding language in 3D scenes has proven to be an effective strategy for 3D scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Mengjiao Ma , Qi Ma , Yue Li , Jiahuan Cheng , Runyi Yang , Bin Ren , Nikola Popovic , Mingqiang Wei , Nicu Sebe , Luc Van Gool , Theo Gevers , Martin R. Oswald , Danda Pani Paudel

3D Gaussian Splatting (3DGS) has emerged as a promising approach for 3D scene representation, offering a reduction in computational overhead compared to Neural Radiance Fields (NeRF). However, 3DGS is susceptible to high-frequency artifacts…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Shen Chen , Jiale Zhou , Lei Li

Humans naturally interact with their 3D surroundings using language, and modeling 3D language fields for scene understanding and interaction has gained growing interest. This paper introduces ChatSplat, a system that constructs a 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hanlin Chen , Fangyin Wei , Gim Hee Lee

Open-vocabulary scene understanding using 3D Gaussian (3DGS) representations has garnered considerable attention. However, existing methods mostly lift knowledge from large 2D vision models into 3DGS on a scene-by-scene basis, restricting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Runnan Chen , Xiangyu Sun , Zhaoqing Wang , Youquan Liu , Jiepeng Wang , Lingdong Kong , Jiankang Deng , Mingming Gong , Liang Pan , Wenping Wang , Tongliang Liu

Applying Gaussian Splatting to perception tasks for 3D scene understanding is becoming increasingly popular. Most existing works primarily focus on rendering 2D feature maps from novel viewpoints, which leads to an imprecise 3D language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hao Li , Minghan Qin , Zhengyu Zou , Diqi He , Xinhao Ji , Bohan Li , Bingquan Dai , Dingewn Zhang , Junwei Han

As multimodal language models advance, their application to 3D scene understanding is a fast-growing frontier, driving the development of 3D Vision-Language Models (VLMs). Current methods show strong dependence on object detectors,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Anna-Maria Halacheva , Jan-Nico Zaech , Xi Wang , Danda Pani Paudel , Luc Van Gool

Humans live in a 3D world and commonly use natural language to interact with a 3D scene. Modeling a 3D language field to support open-ended language queries in 3D has gained increasing attention recently. This paper introduces LangSplat,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Minghan Qin , Wanhua Li , Jiawei Zhou , Haoqian Wang , Hanspeter Pfister

To enable AI agents to interact seamlessly with both humans and 3D environments, they must not only perceive the 3D world accurately but also align human language with 3D spatial representations. While prior work has made significant…

Artificial Intelligence · Computer Science 2025-09-26 Saimouli Katragadda , Cho-Ying Wu , Yuliang Guo , Xinyu Huang , Guoquan Huang , Liu Ren

Recent advancements in 3D Gaussian Splatting(3DGS) have significantly improved semantic scene understanding, enabling natural language queries to localize objects within a scene. However, existing methods primarily focus on embedding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xihan Wang , Dianyi Yang , Yu Gao , Yufeng Yue , Yi Yang , Mengyin Fu

Recently, 3D Gaussian Splatting (3DGS) has shown encouraging performance for open vocabulary scene understanding tasks. However, previous methods cannot distinguish 3D instance-level information, which usually predicts a heatmap between the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Hongjia Zhai , Hai Li , Zhenzhe Li , Xiaokun Pan , Yijia He , Guofeng Zhang

The recent Gaussian Splatting achieves high-quality and real-time novel-view synthesis of the 3D scenes. However, it is solely concentrated on the appearance and geometry modeling, while lacking in fine-grained object-level scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Mingqiao Ye , Martin Danelljan , Fisher Yu , Lei Ke

Referring 3D Gaussian Splatting (R3DGS), which utilizes natural language for 3D object segmentation, has emerged as a crucial capability for embodied AI. However, existing methods typically rely on expensive per-scene manual annotation and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yuyang Tan , Renhe Zhang , Hang Zhang , Ao Li , Xin Tan