English
Related papers

Related papers: Segment Any 3D Gaussians

200 papers

We introduce Contrastive Gaussian Clustering, a novel approach capable of provide segmentation masks from any viewpoint and of enabling 3D segmentation of the scene. Recent works in novel-view synthesis have shown how to model the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Myrna C. Silva , Mahtab Dahaghin , Matteo Toso , Alessio Del Bue

We introduce PointGauss, a novel point cloud-guided framework for real-time multi-object segmentation in Gaussian Splatting representations. Unlike existing methods that suffer from prolonged initialization and limited multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Wentao Sun , Hanqing Xu , Quanyun Wu , Dedong Zhang , Yiping Chen , Lingfei Ma , John S. Zelek , Jonathan Li

3D Gaussian Splatting (3DGS) has emerged as a novel explicit representation for 3D scenes, offering both high-fidelity reconstruction and efficient rendering. However, 3DGS lacks 3D segmentation ability, which limits its applicability in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Yupeng Zhang , Dezhi Zheng , Ping Lu , Han Zhang , Lei Wang , Liping xiang , Cheng Luo , Kaijun Deng , Xiaowen Fu , Linlin Shen , Jinbao Wang

Improving robustness of the Segment Anything Model (SAM) to input degradations is critical for its deployment in high-stakes applications such as autonomous driving and robotics. Our approach to this challenge prioritizes three key aspects:…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Sohyun Lee , Yeho Gwon , Lukas Hoyer , Suha Kwak

This study addresses the challenge of accurately segmenting 3D Gaussian Splatting from 2D masks. Conventional methods often rely on iterative gradient descent to assign each Gaussian a unique label, leading to lengthy optimization and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Qiuhong Shen , Xingyi Yang , Xinchao Wang

Following the advent of NeRFs, 3D Gaussian Splatting (3D-GS) has paved the way to real-time neural rendering overcoming the computational burden of volumetric methods. Following the pioneering work of 3D-GS, several methods have attempted…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Evangelos Ververas , Rolandos Alexandros Potamias , Jifei Song , Jiankang Deng , Stefanos Zafeiriou

Unsupervised point cloud segmentation is critical for embodied artificial intelligence and autonomous driving, as it mitigates the prohibitive cost of dense point-level annotations required by fully supervised methods. While integrating 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yixiao Song , Qingyong Li , Wen Wang , Zhicheng Yan

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu

3D Gaussian Splatting (3DGS) enables high-fidelity real-time rendering, a key requirement for immersive applications. However, the extension of 3DGS to dynamic scenes remains limitations on the substantial data volume of dense Gaussians and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Jiayu Yang , Weijian Su , Songqian Zhang , Yuqi Han , Jinli Suo , Qiang Zhang

Gaussian Probability Path based Generative Models (GPPGMs) generate data by reversing a stochastic process that progressively corrupts samples with Gaussian noise. Despite state-of-the-art results in 3D molecular generation, their…

Machine Learning · Computer Science 2026-02-23 Jingxiang Qu , Wenhan Gao , Ruichen Xu , Yi Liu

The Segment-Anything Model (SAM) is a vision foundation model for segmentation with a prompt-driven framework. SAM generates class-agnostic masks based on user-specified instance-referring prompts. However, adapting SAM for automated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Hussni Mohd Zakir , Eric Tatt Wei Ho

3D Gaussian Splatting (3DGS) has emerged as a powerful representation for neural scene reconstruction, offering high-quality novel view synthesis while maintaining computational efficiency. In this paper, we extend the capabilities of 3DGS…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jens Piekenbrinck , Christian Schmidt , Alexander Hermans , Narunas Vaskevicius , Timm Linder , Bastian Leibe

Grasp detection requires flexibility to handle objects of various shapes without relying on prior knowledge of the object, while also offering intuitive, user-guided control. This paper introduces GraspSAM, an innovative extension of the…

Robotics · Computer Science 2024-09-24 Sangjun Noh , Jongwon Kim , Dongwoo Nam , Seunghyeok Back , Raeyoung Kang , Kyoobin Lee

Given the growing need for automatic 3D content creation pipelines, various 3D representations have been studied to generate 3D objects from a single image. Due to its superior rendering efficiency, 3D Gaussian splatting-based models have…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Dejia Xu , Ye Yuan , Morteza Mardani , Sifei Liu , Jiaming Song , Zhangyang Wang , Arash Vahdat

3D Gaussian Splatting (3DGS) has begun incorporating rich information from 2D foundation models. However, most approaches rely on a bottom-up optimization process that treats raw 2D features as ground truth, incurring increased…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Hyunjoon Lee , Joonkyu Min , Jaesik Park

Segment anything models (SAMs) are gaining attention for their zero-shot generalization capability in segmenting objects of unseen classes and in unseen domains when properly prompted. Interactivity is a key strength of SAMs, allowing users…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Yiqing Shen , Jingxing Li , Xinyuan Shao , Blanca Inigo Romillo , Ankush Jindal , David Dreizin , Mathias Unberath

In this work we introduce a new optimisation method called SAGA in the spirit of SAG, SDCA, MISO and SVRG, a set of recently proposed incremental gradient algorithms with fast linear convergence rates. SAGA improves on the theory behind SAG…

Machine Learning · Computer Science 2014-12-17 Aaron Defazio , Francis Bach , Simon Lacoste-Julien

3D Gaussian Splatting (3DGS) has emerged as a real-time, differentiable representation for neural scene understanding. However, existing 3DGS-based methods struggle to represent hierarchical 3D semantic structures and capture whole-part…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jingbin You , Zehao Li , Hao Jiang , Xinzhu Ma , Shuqin Gao , Honglong Zhao , Congcong Zheng , Tianlu Mao , Feng Dai , Yucheng Zhang , Zhaoqi Wang

The Segment Anything Model (SAM) has demonstrated its effectiveness in segmenting any part of 2D RGB images. However, SAM exhibits a stronger emphasis on texture information while paying less attention to geometry information when…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Jun Cen , Yizheng Wu , Kewei Wang , Xingyi Li , Jingkang Yang , Yixuan Pei , Lingdong Kong , Ziwei Liu , Qifeng Chen

Recent advancements in 3D Gaussian Splatting(3DGS) have significantly improved semantic scene understanding, enabling natural language queries to localize objects within a scene. However, existing methods primarily focus on embedding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xihan Wang , Dianyi Yang , Yu Gao , Yufeng Yue , Yi Yang , Mengyin Fu