English
Related papers

Related papers: DarkSAM: Fooling Segment Anything Model to Segment…

200 papers

Defect detection plays a crucial role in infrared non-destructive testing systems, offering non-contact, safe, and efficient inspection capabilities. However, challenges such as low resolution, high noise, and uneven heating in infrared…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Bozhen Hu , Bin Gao , Cheng Tan , Tongle Wu , Stan Z. Li

Weakly supervised visual recognition using inexact supervision is a critical yet challenging learning problem. It significantly reduces human labeling costs and traditionally relies on multi-instance learning and pseudo-labeling. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Lianghui Zhu , Junwei Zhou , Yan Liu , Xin Hao , Wenyu Liu , Xinggang Wang

General purpose segmentation models are able to generate (semantic) segmentation masks from a variety of prompts, including visual (points, boxed, etc.) and textual (object names) ones. In particular, input images are pre-processed by an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Francesco Croce , Matthias Hein

Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Xie , Hao Tang , Dawen Cai , Yan Yan , Gady Agam

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Image segmentation foundation models (SFMs) like Segment Anything Model (SAM) have achieved impressive zero-shot and interactive segmentation across diverse domains. However, they struggle to segment objects with certain structures,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Yixin Zhang , Nicholas Konz , Kevin Kramer , Maciej A. Mazurowski

Robust and accurate segmentation of scenes has become one core functionality in various visual recognition and navigation tasks. This has inspired the recent development of Segment Anything Model (SAM), a foundation model for general mask…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Naoto Yokoya , Shijian Lu

Few-shot segmentation has garnered significant attention. Many recent approaches attempt to introduce the Segment Anything Model (SAM) to handle this task. With the strong generalization ability and rich object-specific extraction ability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jin Wang , Bingfeng Zhang , Jian Pang , Weifeng Liu , Baodi Liu , Honglong Chen

There has been a lot of recent research on improving the efficiency of fine-tuning foundation models. In this paper, we propose a novel efficient fine-tuning method that allows the input image size of Segment Anything Model (SAM) to be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Sota Kato , Hinako Mitsuoka , Kazuhiro Hotta

Segment Anything Model (SAM) has gained significant attention because of its ability to segment various objects in images given a prompt. The recently developed SAM 2 has extended this ability to video inputs. This opens an opportunity to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Haoyu Dong , Hanxue Gu , Yaqian Chen , Jichen Yang , Yuwen Chen , Maciej A. Mazurowski

The Segment Anything Model (SAM) has demonstrated its effectiveness in segmenting any part of 2D RGB images. However, SAM exhibits a stronger emphasis on texture information while paying less attention to geometry information when…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Jun Cen , Yizheng Wu , Kewei Wang , Xingyi Li , Jingkang Yang , Yixuan Pei , Lingdong Kong , Ziwei Liu , Qifeng Chen

The introduction of the Segment Anything Model (SAM) has paved the way for numerous semantic segmentation applications. For several tasks, quantifying the uncertainty of SAM is of particular interest. However, the ambiguous nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Timo Kaiser , Thomas Norrenbrock , Bodo Rosenhahn

Curating annotations for medical image segmentation is a labor-intensive and time-consuming task that requires domain expertise, resulting in "narrowly" focused deep learning (DL) models with limited translational utility. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Pranav Kulkarni , Adway Kanhere , Dharmam Savani , Andrew Chan , Devina Chatterjee , Paul H. Yi , Vishwa S. Parekh

Semantic segmentations of pathological entities have crucial clinical value in computational pathology workflows. Foundation models, such as the Segment Anything Model (SAM), have been recently proposed for universal use in segmentation…

Image and Video Processing · Electrical Eng. & Systems 2023-07-20 Jingwei Zhang , Ke Ma , Saarthak Kapse , Joel Saltz , Maria Vakalopoulou , Prateek Prasanna , Dimitris Samaras

Fundamental models, trained on large-scale datasets and adapted to new data using innovative learning methods, have revolutionized various fields. In materials science, microstructure image segmentation plays a pivotal role in understanding…

Materials Science · Physics 2024-07-09 Xudong Ma , Yuqi Zhang , Chenchong Wang , Wei Xu

Semi-supervised learning has attracted much attention due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods, which is especially important for medical image segmentation which…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yichi Zhang , Jin Yang , Yuchen Liu , Yuan Cheng , Yuan Qi

We introduce the Segment Anything (SA) project: a new task, model, and dataset for image segmentation. Using our efficient model in a data collection loop, we built the largest segmentation dataset to date (by far), with over 1 billion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Alexander Kirillov , Eric Mintun , Nikhila Ravi , Hanzi Mao , Chloe Rolland , Laura Gustafson , Tete Xiao , Spencer Whitehead , Alexander C. Berg , Wan-Yen Lo , Piotr Dollár , Ross Girshick

The recent Segment Anything Model (SAM) is a significant advancement in natural image segmentation, exhibiting potent zero-shot performance suitable for various downstream image segmentation tasks. However, directly utilizing the pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Mingjin Zhang , Yuchun Wang , Jie Guo , Yunsong Li , Xinbo Gao , Jing Zhang

The Segment Anything Model (SAM) was originally designed for label-agnostic mask generation. Does this model also possess inherent semantic understanding, of value to broader visual tasks? In this work we follow a multi-staged approach…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Miguel Espinosa , Chenhongyi Yang , Linus Ericsson , Steven McDonagh , Elliot J. Crowley

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou