English
Related papers

Related papers: DCSEG: Decoupled 3D Open-Set Segmentation using Ga…

200 papers

3D Gaussian Splatting (3DGS) has emerged as a promising approach for 3D scene representation, offering a reduction in computational overhead compared to Neural Radiance Fields (NeRF). However, 3DGS is susceptible to high-frequency artifacts…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Shen Chen , Jiale Zhou , Lei Li

We design an open-vocabulary image segmentation model to organize an image into meaningful regions indicated by arbitrary texts. Recent works (CLIP and ALIGN), despite attaining impressive open-vocabulary classification accuracy with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Golnaz Ghiasi , Xiuye Gu , Yin Cui , Tsung-Yi Lin

Gaussian Splatting (GS) has recently marked a significant advancement in 3D reconstruction, delivering both rapid rendering and high-quality results. However, existing 3DGS methods pose challenges in understanding underlying 3D semantics,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yuyang Zhang , Baao Xie , Hu Zhu , Qi Wang , Huanting Guo , Xin Jin , Wenjun Zeng

This paper presents SAGA (Segment Any 3D GAussians), a highly efficient 3D promptable segmentation method based on 3D Gaussian Splatting (3D-GS). Given 2D visual prompts as input, SAGA can segment the corresponding 3D target represented by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Jiazhong Cen , Jiemin Fang , Chen Yang , Lingxi Xie , Xiaopeng Zhang , Wei Shen , Qi Tian

Joint rendering and deformation of mesh and 3D Gaussian Splatting (3DGS) have significant value as both representa tions offer complementary advantages for graphics applica tions. However, due to differences in representation and ren dering…

Skins wrapping around our bodies, leathers covering over the sofa, sheet metal coating the car - it suggests that objects are enclosed by a series of continuous surfaces, which provides us with informative geometry prior for objectness…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Hongru Yan , Yu Zheng , Yueqi Duan

3D scene understanding is fundamental for embodied AI and robotics, supporting reliable perception for interaction and navigation. Recent approaches achieve zero-shot, open-vocabulary 3D semantic mapping by assigning embedding vectors to 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Mohamad Amin Mirzaei , Pantea Amoie , Ali Ekhterachian , Matin Mirzababaei , Babak Khalaj

3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (VLMs) for 2D-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yunhan Yang , Yukun Huang , Yuan-Chen Guo , Liangjun Lu , Xiaoyang Wu , Edmund Y. Lam , Yan-Pei Cao , Xihui Liu

Recently, Gaussian Splatting, a method that represents a 3D scene as a collection of Gaussian distributions, has gained significant attention in addressing the task of novel view synthesis. In this paper, we highlight a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Haoxuan Qu , Zhuoling Li , Hossein Rahmani , Yujun Cai , Jun Liu

Sparse-view synthesis remains a challenging problem due to the difficulty of recovering accurate geometry and appearance from limited observations. While recent advances in 3D Gaussian Splatting (3DGS) have enabled real-time rendering with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yi-Hsin Li , Thomas Sikora , Sebastian Knorr , Mårten Sjöström

Injecting semantics into 3D Gaussian Splatting (3DGS) has recently garnered significant attention. While current approaches typically distill 3D semantic features from 2D foundational models (e.g., CLIP and SAM) to facilitate novel view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wenbo Zhang , Lu Zhang , Ping Hu , Liqian Ma , Yunzhi Zhuge , Huchuan Lu

Recent advances in 3D datasets and multimodal models have greatly improved natural language 3D scene understanding. However, most 3D referring segmentation methods do not explicitly represent the observer viewpoint, making spatial relations…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ayaka Nanri , Klara Reichard , Mert Kiray , Federico Tombari , Benjamin Busam , Asako Kanezaki

3D Gaussian Splatting (3DGS) serves as a highly performant and efficient encoding of scene geometry, appearance, and semantics. Moreover, grounding language in 3D scenes has proven to be an effective strategy for 3D scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Mengjiao Ma , Qi Ma , Yue Li , Jiahuan Cheng , Runyi Yang , Bin Ren , Nikola Popovic , Mingqiang Wei , Nicu Sebe , Luc Van Gool , Theo Gevers , Martin R. Oswald , Danda Pani Paudel

Accurate 3D reconstruction of dynamic surgical scenes from endoscopic video is essential for robotic-assisted surgery. While recent 3D Gaussian Splatting methods have shown promise in achieving high-quality reconstructions with fast…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jialei Chen , Xin Zhang , Mobarakol Islam , Francisco Vasconcelos , Danail Stoyanov , Daniel S. Elson , Baoru Huang

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

Recently, 3D Gaussian Splatting (3D-GS) has prevailed in novel view synthesis, achieving high fidelity and efficiency. However, it often struggles to capture rich details and complete geometry. Our analysis reveals that the 3D-GS…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yanzhe Lyu , Kai Cheng , Xin Kang , Xuejin Chen

We propose a novel 3D deepfake generation framework based on 3D Gaussian Splatting that enables realistic, identity-preserving face swapping and reenactment in a fully controllable 3D space. Compared to conventional 2D deepfake approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Wending Liu , Siyun Liang , Huy H. Nguyen , Isao Echizen

Point-cloud semantic segmentation underpins a wide range of critical applications. Although recent deep architectures and large-scale datasets have driven impressive closed-set performance, these models struggle to recognize or properly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wang Fang , Shirin Rahimi , Olivia Bennett , Sophie Carter , Mitra Hassani , Xu Lan , Omid Javadi , Lucas Mitchell

Recovering 3D information from scenes via multi-view stereo reconstruction (MVS) and novel view synthesis (NVS) is inherently challenging, particularly in scenarios involving sparse-view setups. The advent of 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Shubhendu Jena , Shishir Reddy Vutukur , Adnane Boukhayma

Open-vocabulary segmentation of 3D scenes is a fundamental function of human perception and thus a crucial objective in computer vision research. However, this task is heavily impeded by the lack of large-scale and diverse 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Kunhao Liu , Fangneng Zhan , Jiahui Zhang , Muyu Xu , Yingchen Yu , Abdulmotaleb El Saddik , Christian Theobalt , Eric Xing , Shijian Lu