中文
相关论文

相关论文: CAGS: Open-Vocabulary 3D Scene Understanding with …

200 篇论文

Recently, several studies have combined Gaussian Splatting to obtain scene representations with language embeddings for open-vocabulary 3D scene understanding. While these methods perform well, they essentially require very dense multi-view…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Jun Hu , Zhang Chen , Zhong Li , Yi Xu , Juyong Zhang

Abstract representations of 3D scenes play a crucial role in computer vision, enabling a wide range of applications such as mapping, localization, surface reconstruction, and even advanced tasks like SLAM and rendering. Among these…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Chenggang Yang , Yuang Shi

We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Saptarshi Neil Sinha , Holger Graf , Michael Weinmann

Articulated object manipulation remains a critical challenge in robotics due to the complex kinematic constraints and the limited physical reasoning of existing methods. In this work, we introduce ArtGS, a novel framework that extends 3D…

机器人学 · 计算机科学 2025-07-04 Qiaojun Yu , Xibin Yuan , Yu jiang , Junting Chen , Dongzhe Zheng , Ce Hao , Yang You , Yixing Chen , Yao Mu , Liu Liu , Cewu Lu

3D Gaussian Splatting (3DGS) has revolutionized 3D scene reconstruction, which effectively balances rendering quality, efficiency, and speed. However, existing 3DGS approaches usually generate plausible outputs and face significant…

图形学 · 计算机科学 2025-07-22 Beizhen Zhao , Yifan Zhou , Sicheng Yu , Zijian Wang , Hao Wang

3D Gaussian Splatting (3DGS) has demonstrated impressive performance in scene reconstruction. However, most existing GS-based surface reconstruction methods focus on 3D objects or limited scenes. Directly applying these methods to…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Yuanyuan Gao , Yalun Dai , Hao Li , Weicai Ye , Junyi Chen , Danpeng Chen , Dingwen Zhang , Tong He , Guofeng Zhang , Junwei Han

Recently, generalizable feed-forward methods based on 3D Gaussian Splatting have gained significant attention for their potential to reconstruct 3D scenes using finite resources. These approaches create a 3D radiance field, parameterized by…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Wonseok Roh , Hwanhee Jung , Jong Wook Kim , Seunggwan Lee , Innfarn Yoo , Andreas Lugmayr , Seunggeun Chi , Karthik Ramani , Sangpil Kim

Reconstructing a 3D scene from images is challenging due to the different ways light interacts with surfaces depending on the viewer's position and the surface's material. In classical computer graphics, materials can be classified as…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Mateusz Nowak , Wojciech Jarosz , Peter Chin

3D scene understanding is fundamental for embodied AI and robotics, supporting reliable perception for interaction and navigation. Recent approaches achieve zero-shot, open-vocabulary 3D semantic mapping by assigning embedding vectors to 2D…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Mohamad Amin Mirzaei , Pantea Amoie , Ali Ekhterachian , Matin Mirzababaei , Babak Khalaj

While 3D Gaussian Splatting (3DGS) excels in static scene modeling, its extension to dynamic scenes introduces significant challenges. Existing dynamic 3DGS methods suffer from either over-smoothing due to low-rank decomposition or feature…

图形学 · 计算机科学 2025-08-08 Yifan Zhou , Beizhen Zhao , Pengcheng Wu , Hao Wang

Open-vocabulary scene understanding with online panoptic mapping is essential for embodied applications to perceive and interact with environments. However, existing methods are predominantly offline or lack instance-level understanding,…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Hongjia Zhai , Qi Zhang , Xiaokun Pan , Xiyu Zhang , Yitong Dong , Huaqi Zhang , Dan Xu , Guofeng Zhang

We present ProFuse, an efficient context-aware framework for open-vocabulary 3D scene understanding with 3D Gaussian Splatting (3DGS). The pipeline enhances cross-view consistency and intra-mask cohesion within a direct registration setup,…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Yen-Jen Chiou , Wei-Tse Cheng , Yuan-Fu Yang

Scene understanding based on 3D Gaussian Splatting (3DGS) has recently achieved notable advances. Although 3DGS related methods have efficient rendering capabilities, they fail to address the inherent contradiction between the anisotropic…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Q. G. Duan , Benyun Zhao , Mingqiao Han Yijun Huang , Ben M. Chen

Recent advancements in multi-modal 3D pre-training methods have shown promising efficacy in learning joint representations of text, images, and point clouds. However, adopting point clouds as 3D representation fails to fully capture the…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Haoyuan Li , Yanpeng Zhou , Tao Tang , Jifei Song , Yihan Zeng , Michael Kampffmeyer , Hang Xu , Xiaodan Liang

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

Modeling and understanding the 3D world is crucial for various applications, from augmented reality to robotic navigation. Recent advancements based on 3D Gaussian Splatting have integrated semantic information from multi-view images into…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Xingrui Wang , Cuiling Lan , Hanxin Zhu , Zhibo Chen , Yan Lu

This paper investigates an open research challenge of reconstructing high-quality, large 3D open scenes from images. It is observed existing methods have various limitations, such as requiring precise camera poses for input and dense…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Chong Cheng , Gaochao Song , Yiyang Yao , Qinzheng Zhou , Gangjian Zhang , Hao Wang

While 3D Gaussian Splatting (3DGS) enables high-quality, real-time rendering for bounded scenes, its extension to large-scale urban environments gives rise to critical challenges in terms of geometric consistency, memory efficiency, and…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Changbai Li , Haodong Zhu , Hanlin Chen , Xiuping Liang , Tongfei Chen , Shuwei Shao , Linlin Yang , Huobin Tan , Baochang Zhang

Simultaneous Localization and Mapping (SLAM) is pivotal in robotics, with photorealistic scene reconstruction emerging as a key challenge. To address this, we introduce Computational Alignment for Real-Time Gaussian Splatting SLAM (CaRtGS),…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Dapeng Feng , Zhiqiang Chen , Yizhen Yin , Shipeng Zhong , Yuhua Qi , Hongbo Chen

3D Gaussian Splatting (3DGS) has shown promising performance in novel view synthesis. Previous methods adapt it to obtaining surfaces of either individual 3D objects or within limited scenes. In this paper, we make the first attempt to…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Junyi Chen , Weicai Ye , Yifan Wang , Danpeng Chen , Di Huang , Wanli Ouyang , Guofeng Zhang , Yu Qiao , Tong He