English
Related papers

Related papers: Learnable Ophthalmology SAM

200 papers

The CLIP and Segment Anything Model (SAM) are remarkable vision foundation models (VFMs). SAM excels in segmentation tasks across diverse domains, whereas CLIP is renowned for its zero-shot recognition capabilities. This paper presents an…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Haobo Yuan , Xiangtai Li , Chong Zhou , Yining Li , Kai Chen , Chen Change Loy

The segment anything model (SAM) was released as a foundation model for image segmentation. The promptable segmentation model was trained by over 1 billion masks on 11M licensed and privacy-respecting images. The model supports zero-shot…

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei

Segment Anything Model (SAM) represents a large-scale segmentation model that enables powerful zero-shot capabilities with flexible prompts. While SAM can segment any object in zero-shot, it requires user-provided prompts for each target…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Kosuke Sakurai , Ryotaro Shimizu , Masayuki Goto

The Segment Anything Model 2 (SAM2) has demonstrated remarkable promptable visual segmentation capabilities in video data, showing potential for extension to medical image segmentation (MIS) tasks involving 3D volumes and temporally…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Meng Lan , Lefei Zhang , Xiaomeng Li

The Segment Anything model (SAM) has shown a generalized ability to group image pixels into patches, but applying it to semantic-aware segmentation still faces major challenges. This paper presents SAM-CP, a simple approach that establishes…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Pengfei Chen , Lingxi Xie , Xinyue Huo , Xuehui Yu , Xiaopeng Zhang , Yingfei Sun , Zhenjun Han , Qi Tian

The universality of deep neural networks across different modalities and their generalization capabilities to unseen domains play an essential role in medical image segmentation. The recent segment anything model (SAM) has demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Qing Xu , Jiaxuan Li , Xiangjian He , Chenxin Li , Fiseha B. Tesem , Wenting Duan , Zhen Chen , Rong Qu , Jonathan M. Garibaldi , Chang Wen Chen

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

The Segment Anything Model (SAM) has demonstrated strong and versatile segmentation capabilities, along with intuitive prompt-based interactions. However, customizing SAM for medical image segmentation requires massive amounts of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhonghao Yan , Zijin Yin , Tianyu Lin , Xiangzhu Zeng , Kongming Liang , Zhanyu Ma

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

Medical image segmentation has been traditionally approached by training or fine-tuning the entire model to cater to any new modality or dataset. However, this approach often requires tuning a large number of parameters during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jay N. Paranjape , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

In medical image segmentation, heterogeneous privacy policies across institutions often make joint training on pooled datasets infeasible, motivating continual image segmentation-learning from data streams without catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiayi Wang , Wei Dai , Haoyu Wang , Sihan Yang , Haixia Bi , Jian Sun

The objective of this paper is motion segmentation -- discovering and segmenting the moving objects in a video. This is a much studied area with numerous careful, and sometimes complex, approaches and training schemes including:…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Junyu Xie , Charig Yang , Weidi Xie , Andrew Zisserman

Segment anything model (SAM) has shown its spectacular performance in segmenting universal objects, especially when elaborate prompts are provided. However, the drawback of SAM is twofold. On the first hand, it fails to segment specific…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Leiping Jie , Hui Zhang

The emerging scale segmentation model, Segment Anything (SAM), exhibits impressive capabilities in zero-shot segmentation for natural images. However, when applied to medical images, SAM suffers from noticeable performance drop. To make SAM…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Xinrong Hu , Xiaowei Xu , Yiyu Shi

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

Segment Anything Model (SAM), a new AI model from Meta AI released in April 2023, is an ambitious tool designed to identify and separate individual objects within a given image through semantic interpretation. The advanced capabilities of…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Gabriel Bellon de Carvalho , Jurandy Almeida