English
Related papers

Related papers: SegSplat: Feed-forward Gaussian Splatting and Open…

200 papers

Gaussian Splatting has rapidly emerged as a transformative technique for real-time 3D scene representation, offering a highly efficient and expressive alternative to Neural Radiance Fields (NeRF). Its ability to render complex scenes with…

Graphics · Computer Science 2025-08-20 Mahmoud Chick Zaouali , Todd Charter , Yehor Karpichev , Brandon Haworth , Homayoun Najjaran

Recognizing arbitrary or previously unseen categories is essential for comprehensive real-world 3D scene understanding. Currently, all existing methods rely on 2D or textual modalities during training or together at inference. This…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yue Li , Qi Ma , Runyi Yang , Huapeng Li , Mengjiao Ma , Bin Ren , Nikola Popovic , Nicu Sebe , Ender Konukoglu , Theo Gevers , Luc Van Gool , Martin R. Oswald , Danda Pani Paudel

Humans live in a 3D world and commonly use natural language to interact with a 3D scene. Modeling a 3D language field to support open-ended language queries in 3D has gained increasing attention recently. This paper introduces LangSplat,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Minghan Qin , Wanhua Li , Jiawei Zhou , Haoqian Wang , Hanspeter Pfister

Precisely perceiving the geometric and semantic properties of real-world 3D objects is crucial for the continued evolution of augmented reality and robotic applications. To this end, we present Foundation Model Embedded Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xingxing Zuo , Pouya Samangouei , Yunwen Zhou , Yan Di , Mingyang Li

Scene reconstruction has emerged as a central challenge in computer vision, with approaches such as Neural Radiance Fields (NeRF) and Gaussian Splatting achieving remarkable progress. While Gaussian Splatting demonstrates strong performance…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Alexander Valverde , Brian Xu , Yuyin Zhou , Meng Xu , Hongyun Wang

We present FAST-Splat for fast, ambiguity-free semantic Gaussian Splatting, which seeks to address the main limitations of existing semantic Gaussian Splatting methods, namely: slow training and rendering speeds; high memory usage; and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Ola Shorinwa , Jiankai Sun , Mac Schwager

3D Gaussian Splatting has emerged as a powerful paradigm for explicit 3D scene representation, yet achieving efficient and consistent 3D segmentation remains challenging. Existing segmentation approaches typically rely on high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wentao Sun , Quanyun Wu , Hanqing Xu , Kyle Gao , Zhengsen Xu , Yiping Chen , Dedong Zhang , Lingfei Ma , John S. Zelek , Jonathan Li

Open-vocabulary 3D scene understanding is crucial for applications requiring natural language-driven spatial interpretation, such as robotics and augmented reality. While 3D Gaussian Splatting (3DGS) offers a powerful representation for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Wei Sun , Yanzhao Zhou , Jianbin Jiao , Yuan Li

Recent advancements in 3D content generation from text or a single image struggle with limited high-quality 3D datasets and inconsistency from 2D multi-view generation. We introduce DiffSplat, a novel 3D generative framework that natively…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Chenguo Lin , Panwang Pan , Bangbang Yang , Zeming Li , Yadong Mu

Understanding 3D scenes is pivotal for autonomous driving, robotics, and augmented reality. Recent semantic Gaussian Splatting approaches leverage large-scale 2D vision models to project 2D semantic features onto 3D scenes. However, they…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tianyu Huang , Runnan Chen , Dongting Hu , Fengming Huang , Mingming Gong , Tongliang Liu

Surface reconstruction has been widely studied in computer vision and graphics. However, existing surface reconstruction works struggle to recover accurate scene geometry when the input views are extremely sparse. To address this issue, we…

Graphics · Computer Science 2025-11-26 Hanzhi Chang , Ruijie Zhu , Wenjie Chang , Mulin Yu , Yanzhe Liang , Jiahao Lu , Zhuoyuan Li , Tianzhu Zhang

We propose a feed-forward Gaussian Splatting model that unifies 3D scene and semantic field reconstruction. Combining 3D scenes with semantic fields facilitates the perception and understanding of the surrounding environment. However, key…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Qijian Tian , Xin Tan , Jingyu Gong , Yuan Xie , Lizhuang Ma

We introduce Ilov3Splat, a novel framework for instance-level open-vocabulary 3D scene understanding built on 3D Gaussian Splatting (3D-GS). Most prior work depends on 2D rendering-based matching or point-level semantic association, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Binh Long Nguyen , Kien Nguyen , Sridha Sridharan , Clinton Fookes , Peyman Moghadam

Injecting semantics into 3D Gaussian Splatting (3DGS) has recently garnered significant attention. While current approaches typically distill 3D semantic features from 2D foundational models (e.g., CLIP and SAM) to facilitate novel view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wenbo Zhang , Lu Zhang , Ping Hu , Liqian Ma , Yunzhi Zhuge , Huchuan Lu

Feed-forward 3D Gaussian Splatting models offer fast single-pass reconstruction,but scaling them to match per-scene optimization quality is fundamentally hindered by the scarcity of large-scale 3D annotations. A practical compromise is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yuke Li , Weihang Liu , Cheng Zhang , Yuefeng Zhang , Jiadi Cui , Zixuan Wang , Junran Ding , Haoyu Wu , Yujiao Shi , Jingyi Yu , Xin Lou

Understanding open-vocabulary 3D scenes with Gaussian-based representations remains challenging due to fragmented and spatially inconsistent semantic predictions across multi-view observations. In this paper, we present OpenGaFF, a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Kunyi Li , Michael Niemeyer , Sen Wang , Stefano Gasperini , Nassir Navab , Federico Tombari

Humans naturally interact with their 3D surroundings using language, and modeling 3D language fields for scene understanding and interaction has gained growing interest. This paper introduces ChatSplat, a system that constructs a 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hanlin Chen , Fangyin Wei , Gim Hee Lee

Novel view synthesis has seen significant advancements with 3D Gaussian Splatting (3DGS), enabling real-time photorealistic rendering. However, the inherent fuzziness of Gaussian Splatting presents challenges for 3D scene understanding,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Abdalla Arafa , Didier Stricker

Recent advancements in 3D reconstruction methods and vision-language models have propelled the development of multi-modal 3D scene understanding, which has vital applications in robotics, autonomous driving, and virtual/augmented reality.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Qucheng Peng , Benjamin Planche , Zhongpai Gao , Meng Zheng , Anwesa Choudhuri , Terrence Chen , Chen Chen , Ziyan Wu

3D Gaussian Splatting (3DGS) serves as a highly performant and efficient encoding of scene geometry, appearance, and semantics. Moreover, grounding language in 3D scenes has proven to be an effective strategy for 3D scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Mengjiao Ma , Qi Ma , Yue Li , Jiahuan Cheng , Runyi Yang , Bin Ren , Nikola Popovic , Mingqiang Wei , Nicu Sebe , Luc Van Gool , Theo Gevers , Martin R. Oswald , Danda Pani Paudel