English
Related papers

Related papers: Surgical-DeSAM: Decoupling SAM for Instrument Segm…

200 papers

The Segment Anything Model (SAM) exhibits remarkable versatility and zero-shot learning abilities, owing largely to its extensive training data (SA-1B). Recognizing SAM's dependency on manual guidance given its category-agnostic nature, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Xiyu Qi , Yifan Wu , Yongqiang Mao , Wenhui Zhang , Yidan Zhang

With the development of Deep Neural Networks (DNNs), many efforts have been made to handle medical image segmentation. Traditional methods such as nnUNet train specific segmentation models on the individual datasets. Plenty of recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xiaobao Wei , Jiajun Cao , Yizhu Jin , Ming Lu , Guangyu Wang , Shanghang Zhang

Although SAM-based single-source domain generalization models for medical image segmentation can mitigate the impact of domain shift on the model in cross-domain scenarios, these models still face two major challenges. First, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Huanli Zhuo , Leilei Ma , Haifeng Zhao , Shiwei Zhou , Dengdi Sun , Yanping Fu

The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model (SAM), have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Chen Gong , Dong Liang

The Segment Anything Model 2 (SAM 2) is the latest generation foundation model for image and video segmentation. Trained on the expansive Segment Anything Video (SA-V) dataset, which comprises 35.5 million masks across 50.9K videos, SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Ange Lou , Yamin Li , Yike Zhang , Robert F. Labadie , Jack Noble

Segmenting 3D objects into parts is a long-standing challenge in computer vision. To overcome taxonomy constraints and generalize to unseen 3D objects, recent works turn to open-world part segmentation. These approaches typically transfer…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zhe Zhu , Le Wan , Rui Xu , Yiheng Zhang , Honghua Chen , Zhiyang Dou , Cheng Lin , Yuan Liu , Mingqiang Wei

Adapting large pre-trained foundation models, e.g., SAM, for medical image segmentation remains a significant challenge. A crucial step involves the formulation of a series of specialized prompts that incorporate specific clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiuqi Zheng , Yuhang Zhang , Haoran Zhang , Hongrui Liang , Xueqi Bao , Zhuqing Jiang , Qicheng Lao

The Segment Anything Model (SAM) has set a new standard in interactive image segmentation, offering robust performance across various tasks. However, its significant computational requirements limit its deployment in real-time or…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Kunal Dasharath Patil , Gowthamaan Palani , Ganapathy Krishnamurthi

Surgical video segmentation is a critical task in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has shown superior advancements in image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Haofeng Liu , Erli Zhang , Junde Wu , Mingxuan Hong , Yueming Jin

This paper introduces a new Segment Anything Model with Depth Perception (DSAM) for Camouflaged Object Detection (COD). DSAM exploits the zero-shot capability of SAM to realize precise segmentation in the RGB-D domain. It consists of the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhenni Yu , Xiaoqin Zhang , Li Zhao , Yi Bin , Guobao Xiao

This paper provides insights on the effectiveness of the zero shot, prompt-based Segment Anything Model (SAM) and its updated versions, SAM 2 and SAM 2.1, along with the non-promptable conventional neural network (CNN), for segmenting solar…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Osher Rafaeli , Tal Svoray , Roni Blushtein-Livnon , Ariel Nahlieli

Leveraging pre-trained models with tailored prompts for in-context learning has proven highly effective in NLP tasks. Building on this success, recent studies have applied a similar approach to the Segment Anything Model (SAM) within a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Hangyul Yoon , Doohyuk Jang , Jungeun Kim , Eunho Yang

Delineating lesions and anatomical structure is important for image-guided interventions. Point-supervised medical image segmentation (PSS) has great potential to alleviate costly expert delineation labeling. However, due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xiaofeng Liu , Jonghye Woo , Chao Ma , Jinsong Ouyang , Georges El Fakhri

Few-shot segmentation has garnered significant attention. Many recent approaches attempt to introduce the Segment Anything Model (SAM) to handle this task. With the strong generalization ability and rich object-specific extraction ability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jin Wang , Bingfeng Zhang , Jian Pang , Weifeng Liu , Baodi Liu , Honglong Chen

Large foundation models, known for their strong zero-shot generalization capabilities, can be applied to a wide range of downstream tasks. However, developing foundation models for medical image segmentation poses a significant challenge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Sihan Yang , Jiadong Feng , Xuande Mi , Haixia Bi , Hai Zhang , Jian Sun

Advances in machine learning, especially the introduction of transformer architectures and vision transformers, have led to the development of highly capable computer vision foundation models. The segment anything model (known colloquially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Kenneth Ball , Erin Taylor , Nirav Patel , Andrew Bartels , Gary Koplik , James Polly , Jay Hineman

Camouflaged object detection (COD) approaches heavily rely on pixel-level annotated datasets. Weakly-supervised COD (WSCOD) approaches use sparse annotations like scribbles or points to reduce annotation effort, but this can lead to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jian Hu , Jiayi Lin , Weitong Cai , Shaogang Gong

Medical image segmentation often faces the challenge of prohibitively expensive annotation costs. While few-shot learning offers a promising solution to alleviate this burden, conventional approaches still rely heavily on pre-training with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jie Xu , Xiaokang Li , Chengyu Yue , Yuanyuan Wang , Yi Guo

Tongue segmentation serves as the primary step in automated TCM tongue diagnosis, which plays a significant role in the diagnostic results. Currently, numerous deep learning based methods have achieved promising results. However, when…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shan Cao , Qunsheng Ruan , Linjian Ma

Melanoma segmentation in Whole Slide Images (WSIs) is useful for prognosis and the measurement of crucial prognostic factors such as Breslow depth and primary invasive tumor size. In this paper, we present a novel approach that uses the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Qingyuan Liu , Avideh Zakhor