English
Related papers

Related papers: Query-based Semantic Gaussian Field for Scene Repr…

200 papers

Holistic 3D scene understanding, which jointly models geometry, appearance, and semantics, is crucial for applications like augmented reality and robotic interaction. Existing feed-forward 3D scene understanding methods (e.g., LSM) are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Qijing Li , Jingxiang Sun , Liang An , Zhaoqi Su , Hongwen Zhang , Yebin Liu

Building semantic 3D maps is valuable for searching for objects of interest in offices, warehouses, stores, and homes. We present a mapping system that incrementally builds a Language-Embedded Gaussian Splat (LEGS): a detailed 3D scene…

Constructing a 3D scene capable of accommodating open-ended language queries, is a pivotal pursuit, particularly within the domain of robotics. Such technology facilitates robots in executing object manipulations based on human language…

TL;DR: Gaussian Splatting is a widely adopted approach for 3D scene representation, offering efficient, high-quality reconstruction and rendering. A key reason for its success is the simplicity of representing scenes with sets of Gaussians,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiahuan Cheng , Jan-Nico Zaech , Luc Van Gool , Danda Pani Paudel

Existing NeRF-based methods for large scene reconstruction often have limitations in visual quality and rendering speed. While the recent 3D Gaussian Splatting works well on small-scale and object-centric scenes, scaling it up to large…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jiaqi Lin , Zhihao Li , Xiao Tang , Jianzhuang Liu , Shiyong Liu , Jiayue Liu , Yangdi Lu , Xiaofei Wu , Songcen Xu , Youliang Yan , Wenming Yang

Open-vocabulary 3D scene understanding is crucial for applications requiring natural language-driven spatial interpretation, such as robotics and augmented reality. While 3D Gaussian Splatting (3DGS) offers a powerful representation for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Wei Sun , Yanzhao Zhou , Jianbin Jiao , Yuan Li

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

We propose a neural regularization method that refines the noisy 3D semantic field produced by lifting multi-view inconsistent 2D features, in order to obtain an accurate and robust 3D semantic Gaussian Splatting. The 2D features extracted…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Zaiyan Yang , Xinpeng Liu , Heng Guo , Jinglei Shi , Zhanyu Ma , Fumio Okura

The ability for robots to perform efficient and zero-shot grasping of object parts is crucial for practical applications and is becoming prevalent with recent advances in Vision-Language Models (VLMs). To bridge the 2D-to-3D gap for…

Robotics · Computer Science 2024-09-04 Mazeyu Ji , Ri-Zhao Qiu , Xueyan Zou , Xiaolong Wang

Neural 3D representations such as Neural Radiance Fields (NeRF), excel at producing photo-realistic rendering results but lack the flexibility for manipulation and editing which is crucial for content creation. Previous works have attempted…

Graphics · Computer Science 2025-03-25 Xiangjun Gao , Xiaoyu Li , Yiyu Zhuang , Qi Zhang , Wenbo Hu , Chaopeng Zhang , Yao Yao , Ying Shan , Long Quan

The 3D Gaussian Splatting (3D-GS) is a novel method for scene representation and view synthesis. Although Scaffold-GS achieves higher quality real-time rendering compared to the original 3D-GS, its fine-grained rendering of the scene is…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Chenyang Xu , XingGuo Deng , Rui Zhong

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to guarantee. To achieve real-time dynamic scene rendering while also…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Guanjun Wu , Taoran Yi , Jiemin Fang , Lingxi Xie , Xiaopeng Zhang , Wei Wei , Wenyu Liu , Qi Tian , Xinggang Wang

Point cloud registration is a fundamental problem for large-scale 3D scene scanning and reconstruction. With the help of deep learning, registration methods have evolved significantly, reaching a nearly-mature stage. As the introduction of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiahao Chang , Yinglin Xu , Yihao Li , Yuantao Chen , Xiaoguang Han

This paper presents DENSER, an efficient and effective approach leveraging 3D Gaussian splatting (3DGS) for the reconstruction of dynamic urban environments. While several methods for photorealistic scene representations, both implicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mahmud A. Mohamad , Gamal Elghazaly , Arthur Hubert , Raphael Frank

Novel view synthesis has seen major advances in recent years, with 3D Gaussian splatting offering an excellent level of visual quality, fast training and real-time rendering. However, the resources needed for training and rendering…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bernhard Kerbl , Andréas Meuleman , Georgios Kopanas , Michael Wimmer , Alexandre Lanvin , George Drettakis

Recent advancements in camera-based occupancy prediction have focused on the simultaneous prediction of 3D semantics and scene flow, a task that presents significant challenges due to specific difficulties, e.g., occlusions and unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ziyue Zhu , Shenlong Wang , Jin Xie , Jiang-jiang Liu , Jingdong Wang , Jian Yang

3D Gaussian Splatting (3D-GS) has emerged as a significant advancement in the field of Computer Graphics, offering explicit scene representation and novel view synthesis without the reliance on neural networks, such as Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ben Fei , Jingyi Xu , Rui Zhang , Qingyuan Zhou , Weidong Yang , Ying He

The recent advent of 3D Gaussian Splatting (3DGS) has revolutionized the 3D scene reconstruction space enabling high-fidelity novel view synthesis in real-time. However, with the exception of RawNeRF, all prior 3DGS and NeRF-based methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Shreyas Singh , Aryan Garg , Kaushik Mitra