English
Related papers

Related papers: AD-SAM: Fine-Tuning the Segment Anything Vision Fo…

200 papers

Vision foundation models like the Segment Anything Model (SAM), pretrained on large-scale natural image datasets, often struggle in medical image segmentation due to a lack of domain-specific adaptation. In clinical practice, fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zelin Liu , Sicheng Dong , Bocheng Li , Yixuan Yang , Jiacheng Ruan , Chenxu Zhou , Suncheng Xiang

Hyperspectral Imaging (HSI) is known for its advantages over traditional RGB imaging in remote sensing, agriculture, and medicine. Recently, it has gained attention for enhancing Advanced Driving Assistance Systems (ADAS) perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Imad Ali Shah , Jiarong Li , Martin Glavin , Edward Jones , Enda Ward , Brian Deegan

Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Nhat-Tan Bui , Dinh-Hieu Hoang , Minh-Triet Tran , Gianfranco Doretto , Donald Adjeroh , Brijesh Patel , Arabinda Choudhary , Ngan Le

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu

Segment anything model (SAM) has emerged as the leading approach for zero-shot learning in segmentation tasks, offering the advantage of avoiding pixel-wise annotations. It is particularly appealing in medical image segmentation, where the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-29 Ziyi Huang , Hongshan Liu , Haofeng Zhang , Xueshen Li , Haozhe Liu , Fuyong Xing , Andrew Laine , Elsa Angelini , Christine Hendon , Yu Gan

There has been a lot of recent research on improving the efficiency of fine-tuning foundation models. In this paper, we propose a novel efficient fine-tuning method that allows the input image size of Segment Anything Model (SAM) to be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Sota Kato , Hinako Mitsuoka , Kazuhiro Hotta

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

We introduce a pioneering unified library that leverages depth anything, segment anything models to augment neural comprehension in language-vision model zero-shot understanding. This library synergizes the capabilities of the Depth…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Mingxiao Huo , Pengliang Ji , Haotian Lin , Junchen Liu , Yixiao Wang , Yijun Chen

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

The development of 2D foundation models for image segmentation has been significantly advanced by the Segment Anything Model (SAM). However, achieving similar success in 3D models remains a challenge due to issues such as non-unified data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Yuchen Zhou , Jiayuan Gu , Tung Yen Chiang , Fanbo Xiang , Hao Su

The Segment Anything Model (SAM) has demonstrated its effectiveness in segmenting any part of 2D RGB images. However, SAM exhibits a stronger emphasis on texture information while paying less attention to geometry information when…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Jun Cen , Yizheng Wu , Kewei Wang , Xingyi Li , Jingkang Yang , Yixuan Pei , Lingdong Kong , Ziwei Liu , Qifeng Chen

Segment Anything Model 2 (SAM2) has emerged as a strong base model in various pinhole imaging segmentation tasks. However, when applying it to $360^\circ$ domain, the significant field-of-view (FoV) gap between pinhole ($70^\circ \times…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Ding Zhong , Xu Zheng , Chenfei Liao , Yuanhuiyi Lyu , Jialei Chen , Shengyang Wu , Linfeng Zhang , Xuming Hu

Image segmentation is a critical enabler for tasks ranging from medical diagnostics to autonomous driving. However, the correct segmentation semantics - where are boundaries located? what segments are logically similar? - change depending…

Recent advancements in foundation models, such as the Segment Anything Model (SAM), have shown strong performance in various vision tasks, particularly image segmentation, due to their impressive zero-shot segmentation capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Pengfei Gu , Haoteng Tang , Islam A. Ebeid , Jose A. Nunez , Fabian Vazquez , Diego Adame , Marcus Zhan , Huimin Li , Bin Fu , Danny Z. Chen

We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos. We build a data engine, which improves model and data via user interaction, to collect the largest video…

Purpose: Recent developments in computational pathology have been driven by advances in Vision Foundation Models, particularly the Segment Anything Model (SAM). This model facilitates nuclei segmentation through two primary methods:…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Xueyuan Li , Can Cui , Ruining Deng , Yucheng Tang , Quan Liu , Tianyuan Yao , Shunxing Bao , Naweed Chowdhury , Haichun Yang , Yuankai Huo

Segmentation is an essential step for remote sensing image processing. This study aims to advance the application of the Segment Anything Model (SAM), an innovative image segmentation model by Meta AI, in the field of remote sensing image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Lucas Prado Osco , Qiusheng Wu , Eduardo Lopes de Lemos , Wesley Nunes Gonçalves , Ana Paula Marques Ramos , Jonathan Li , José Marcato Junior

Vision Foundation Models (VFMs) such as the Segment Anything Model (SAM) allow zero-shot or interactive segmentation of visual contents, thus they are quickly applied in a variety of visual scenes. However, their direct use in many Remote…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Lei Ding , Kun Zhu , Daifeng Peng , Hao Tang , Kuiwu Yang , Lorenzo Bruzzone

Given a single labeled example, in-context segmentation aims to segment corresponding objects. This setting, known as one-shot segmentation in few-shot learning, explores the segmentation model's generalization ability and has been applied…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Mengshi Qi , Pengfei Zhu , Xiangtai Li , Xiaoyang Bi , Lu Qi , Huadong Ma , Ming-Hsuan Yang

Foundation segmentation models such as the Segment Anything Model (SAM) exhibit strong zero-shot generalization through large-scale pretraining, but adapting them to domain-specific semantic segmentation remains challenging, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Salim Khazem