English
Related papers

Related papers: SA3DIP: Segment Any 3D Instance with Potential 3D …

200 papers

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (VLMs) for 2D-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yunhan Yang , Yukun Huang , Yuan-Chen Guo , Liangjun Lu , Xiaoyang Wu , Edmund Y. Lam , Yan-Pei Cao , Xihui Liu

Recent works on open-vocabulary 3D instance segmentation show strong promise, but at the cost of slow inference speed and high computation requirements. This high computation cost is typically due to their heavy reliance on 3D clip…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Mohamed El Amine Boudjoghra , Angela Dai , Jean Lahoud , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Fahad Shahbaz Khan

We introduce Open3DIS, a novel solution designed to tackle the problem of Open-Vocabulary Instance Segmentation within 3D scenes. Objects within 3D environments exhibit diverse shapes, scales, and colors, making precise instance-level…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Phuc D. A. Nguyen , Tuan Duc Ngo , Evangelos Kalogerakis , Chuang Gan , Anh Tran , Cuong Pham , Khoi Nguyen

3D instance segmentation is crucial for applications demanding comprehensive 3D scene understanding. In this paper, we introduce a novel method that simultaneously learns coefficients and prototypes. Employing an overcomplete sampling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Remco Royen , Leon Denis , Adrian Munteanu

The Segment Anything Model (SAM) has recently demonstrated significant potential in medical image segmentation. Although SAM is primarily trained on 2D images, attempts have been made to apply it to 3D medical image segmentation. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Fangda Chen , Jintao Tang , Pancheng Wang , Ting Wang , Shasha Li , Ting Deng

Recently, Meta AI Research approaches a general, promptable Segment Anything Model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Wei Ji , Jingjing Li , Qi Bi , Tingwei Liu , Wenbo Li , Li Cheng

Interactive medical image segmentation (IMIS) has shown significant potential in enhancing segmentation accuracy by integrating iterative feedback from medical professionals. However, the limited availability of enough 3D medical data…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chuyun Shen , Wenhao Li , Yuhang Shi , Xiangfeng Wang

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

Vision foundation models such as Contrastive Vision-Language Pre-training (CLIP) and Segment Anything (SAM) have demonstrated impressive zero-shot performance on image classification and segmentation tasks. However, the incorporation of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Runnan Chen , Youquan Liu , Lingdong Kong , Nenglun Chen , Xinge Zhu , Yuexin Ma , Tongliang Liu , Wenping Wang

3D instance segmentation is crucial for obtaining an understanding of a point cloud scene. This paper presents a novel neural network architecture for performing instance segmentation on 3D point clouds. We propose to jointly learn…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Remco Royen , Leon Denis , Adrian Munteanu

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

Leveraging the extensive training data from SA-1B, the Segment Anything Model (SAM) demonstrates remarkable generalization and zero-shot capabilities. However, as a category-agnostic instance segmentation method, SAM heavily relies on prior…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Keyan Chen , Chenyang Liu , Hao Chen , Haotian Zhang , Wenyuan Li , Zhengxia Zou , Zhenwei Shi

The recent Segment Anything Models (SAMs) have emerged as foundational visual models for general interactive segmentation. Despite demonstrating robust generalization abilities, they still suffer performance degradations in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yuan Yao , Qiushi Yang , Miaomiao Cui , Liefeng Bo

Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Xie , Hao Tang , Dawen Cai , Yan Yan , Gady Agam

Previous top-performing approaches for point cloud instance segmentation involve a bottom-up strategy, which often includes inefficient operations or complex pipelines, such as grouping over-segmented components, introducing additional…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Tong He , Chunhua Shen , Anton van den Hengel

With the development of large language models, many remarkable linguistic systems like ChatGPT have thrived and achieved astonishing success on many tasks, showing the incredible power of foundation models. In the spirit of unleashing the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Dingyuan Zhang , Dingkang Liang , Hongcheng Yang , Zhikang Zou , Xiaoqing Ye , Zhe Liu , Xiang Bai

Semantic segmentation of 3D LiDAR point clouds, essential for autonomous driving and infrastructure management, is best achieved by supervised learning, which demands extensive annotated datasets and faces the problem of domain shifts. We…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Andrew Caunes , Thierry Chateau , Vincent Frémont

Foundation segmentation models such as SAM and SAM-2 perform well on natural images but struggle with brain MRIs where structures like the caudate and thalamus lack sharp boundaries and have low contrast. Rather than fine tune these models…

Image and Video Processing · Electrical Eng. & Systems 2025-11-26 Keith Moore

To address prevalent issues in medical imaging, such as data acquisition challenges and label availability, transfer learning from natural to medical image domains serves as a viable strategy to produce reliable segmentation results.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz