中文
相关论文

相关论文: CAGS: Open-Vocabulary 3D Scene Understanding with …

200 篇论文

We introduce Referring 3D Gaussian Splatting Segmentation (R3DGS), a new task that aims to segment target objects in a 3D Gaussian scene based on natural language descriptions, which often contain spatial relationships or object attributes.…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Shuting He , Guangquan Jie , Changshuo Wang , Yun Zhou , Shuming Hu , Guanbin Li , Henghui Ding

3D scene understanding has become an essential area of research with applications in autonomous driving, robotics, and augmented reality. Recently, 3D Gaussian Splatting (3DGS) has emerged as a powerful approach, combining explicit modeling…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Haijie Li , Yanmin Wu , Jiarui Meng , Qiankun Gao , Zhiyao Zhang , Ronggang Wang , Jian Zhang

As 3D Gaussian Splatting (3DGS) gains popularity as a 3D representation of real scenes, enabling user-friendly deformation to create novel scenes while preserving fine details from the original 3DGS has attracted significant research…

图形学 · 计算机科学 2025-04-18 Yifei Tong , Runze Tian , Xiao Han , Dingyao Liu , Fenggen Yu , Yan Zhang

Recent advancements in 3D Gaussian Splatting have significantly improved the efficiency and quality of dense semantic SLAM. However, previous methods are generally constrained by limited-category pre-trained classifiers and implicit…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Dianyi Yang , Yu Gao , Xihan Wang , Yufeng Yue , Yi Yang , Mengyin Fu

Accurate object segmentation is crucial for high-quality scene understanding in the 3D vision domain. However, 3D segmentation based on 3D Gaussian Splatting (3DGS) struggles with accurately delineating object boundaries, as Gaussian…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Jiaxin Zhang , Junjun Jiang , Youyu Chen , Kui Jiang , Xianming Liu

Open-vocabulary scene understanding is crucial for robotic applications, enabling robots to comprehend complex 3D environmental contexts and supporting various downstream tasks such as navigation and manipulation. However, existing methods…

机器人学 · 计算机科学 2026-03-19 Siting Zhu , Ziyun Lu , Guangming Wang , Chenguang Huang , Yongbo Chen , I-Ming Chen , Wolfram Burgard , Hesheng Wang

Gaussian Splatting has rapidly emerged as a transformative technique for real-time 3D scene representation, offering a highly efficient and expressive alternative to Neural Radiance Fields (NeRF). Its ability to render complex scenes with…

图形学 · 计算机科学 2025-08-20 Mahmoud Chick Zaouali , Todd Charter , Yehor Karpichev , Brandon Haworth , Homayoun Najjaran

Generalizable Gaussian Splatting aims to synthesize novel views for unseen scenes without per-scene optimization. In particular, recent advancements utilize feed-forward networks to predict per-pixel Gaussian parameters, enabling…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Yuxi Hu , Jun Zhang , Kuangyi Chen , Zhe Zhang , Friedrich Fraundorfer

3D Gaussian Splatting (3DGS) serves as a highly performant and efficient encoding of scene geometry, appearance, and semantics. Moreover, grounding language in 3D scenes has proven to be an effective strategy for 3D scene understanding.…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Mengjiao Ma , Qi Ma , Yue Li , Jiahuan Cheng , Runyi Yang , Bin Ren , Nikola Popovic , Mingqiang Wei , Nicu Sebe , Luc Van Gool , Theo Gevers , Martin R. Oswald , Danda Pani Paudel

3D Gaussian Splatting (3DGS) is a recent approach for scene rendering. Although primarily designed for view synthesis, its potential for scene understanding tasks remains underexplored. In this work, we conduct a comparative evaluation of…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Julia Farganus , Krzysztof Żurawicki , Arkadiusz Gaweł , Weronika Jakubowska , Halina Kwaśnicka

This paper introduces OpenGaussian, a method based on 3D Gaussian Splatting (3DGS) capable of 3D point-level open vocabulary understanding. Our primary motivation stems from observing that existing 3DGS-based open vocabulary methods mainly…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Yanmin Wu , Jiarui Meng , Haijie Li , Chenming Wu , Yahao Shi , Xinhua Cheng , Chen Zhao , Haocheng Feng , Errui Ding , Jingdong Wang , Jian Zhang

Injecting semantics into 3D Gaussian Splatting (3DGS) has recently garnered significant attention. While current approaches typically distill 3D semantic features from 2D foundational models (e.g., CLIP and SAM) to facilitate novel view…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Wenbo Zhang , Lu Zhang , Ping Hu , Liqian Ma , Yunzhi Zhuge , Huchuan Lu

Egocentric scenes exhibit frequent occlusions, varied viewpoints, and dynamic interactions compared to typical scene understanding tasks. Occlusions and varied viewpoints can lead to multi-view semantic inconsistencies, while dynamic…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Di Li , Jie Feng , Jiahao Chen , Weisheng Dong , Guanbin Li , Guangming Shi , Licheng Jiao

Open-vocabulary querying in 3D space is crucial for enabling more intelligent perception in applications such as robotics, autonomous systems, and augmented reality. However, most existing methods rely on 2D pixel-level parsing, leading to…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Yiren Lu , Yunlai Zhou , Yiran Qiao , Chaoda Song , Tuo Liang , Jing Ma , Huan Wang , Yu Yin

Recent advancements in 3D Gaussian Splatting (3D-GS) enable high-quality 3D scene reconstruction from RGB images. Many studies extend this paradigm for language-driven open-vocabulary scene understanding. However, most of them simply…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Jiazhong Cen , Xudong Zhou , Jiemin Fang , Changsong Wen , Lingxi Xie , Xiaopeng Zhang , Wei Shen , Qi Tian

Capturing and re-animating the 3D structure of articulated objects present significant barriers. On one hand, methods requiring extensively calibrated multi-view setups are prohibitively complex and resource-intensive, limiting their…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Heng Yu , Joel Julin , Zoltán Á. Milacski , Koichiro Niinuma , László A. Jeni

Applying Gaussian Splatting to perception tasks for 3D scene understanding is becoming increasingly popular. Most existing works primarily focus on rendering 2D feature maps from novel viewpoints, which leads to an imprecise 3D language…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Hao Li , Minghan Qin , Zhengyu Zou , Diqi He , Xinhao Ji , Bohan Li , Bingquan Dai , Dingewn Zhang , Junwei Han

Open-vocabulary scene understanding using 3D Gaussian (3DGS) representations has garnered considerable attention. However, existing methods mostly lift knowledge from large 2D vision models into 3DGS on a scene-by-scene basis, restricting…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Runnan Chen , Xiangyu Sun , Zhaoqing Wang , Youquan Liu , Jiepeng Wang , Lingdong Kong , Jiankang Deng , Mingming Gong , Liang Pan , Wenping Wang , Tongliang Liu

3D Gaussian Splatting (3DGS) has emerged as a real-time, differentiable representation for neural scene understanding. However, existing 3DGS-based methods struggle to represent hierarchical 3D semantic structures and capture whole-part…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Jingbin You , Zehao Li , Hao Jiang , Xinzhu Ma , Shuqin Gao , Honglong Zhao , Congcong Zheng , Tianlu Mao , Feng Dai , Yucheng Zhang , Zhaoqi Wang

3D Gaussian Splatting (3DGS) has emerged as a transformative method in the field of real-time novel synthesis. Based on 3DGS, recent advancements cope with large-scale scenes via spatial-based partition strategy to reduce video memory and…

计算机视觉与模式识别 · 计算机科学 2025-01-06 Tengfei Wang , Xin Wang , Yongmao Hou , Yiwei Xu , Wendi Zhang , Zongqian Zhan