English
Related papers

Related papers: BadSAM: Exploring Security Vulnerabilities of SAM …

200 papers

The Segment Anything Model (SAM) made an eye-catching debut recently and inspired many researchers to explore its potential and limitation in terms of zero-shot generalization capability. As the first promptable foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dongjie Cheng , Ziyuan Qin , Zekun Jiang , Shaoting Zhang , Qicheng Lao , Kang Li

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

The interactive segmentation task consists in the creation of object segmentation masks based on user interactions. The most common way to guide a model towards producing a correct segmentation consists in clicks on the object and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Robin Schön , Julian Lorenz , Katja Ludwig , Rainer Lienhart

The advent of large models, also known as foundation models, has significantly transformed the AI research landscape, with models like Segment Anything (SAM) achieving notable success in diverse image segmentation scenarios. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Tianrun Chen , Ankang Lu , Lanyun Zhu , Chaotao Ding , Chunan Yu , Deyi Ji , Zejian Li , Lingyun Sun , Papa Mao , Ying Zang

In light of the diminishing returns of traditional methods for enhancing transmission rates, the domain of semantic communication presents promising new frontiers. Focusing on image transmission, this paper explores the application of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Shehbaz Tariq , Brian Estadimas Arfeto , Chaoning Zhang , Hyundong Shin

In medical image segmentation, heterogeneous privacy policies across institutions often make joint training on pooled datasets infeasible, motivating continual image segmentation-learning from data streams without catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiayi Wang , Wei Dai , Haoyu Wang , Sihan Yang , Haixia Bi , Jian Sun

As a promptable generic object segmentation model, segment anything model (SAM) has recently attracted significant attention, and also demonstrates its powerful performance. Nevertheless, it still meets its Waterloo when encountering…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Leiping Jie , Hui Zhang

The segment anything model (SAM) was released as a foundation model for image segmentation. The promptable segmentation model was trained by over 1 billion masks on 11M licensed and privacy-respecting images. The model supports zero-shot…

While the Segment Anything Model (SAM) transforms interactive segmentation with zero-shot abilities, its inherent vulnerabilities present a single-point risk, potentially leading to the failure of numerous downstream applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yi Qin , Rui Wang , Tao Huang , Tong Xiao , Liping Jing

The recent wave of foundation models has witnessed tremendous success in computer vision (CV) and beyond, with the segment anything model (SAM) having sparked a passion for exploring task-agnostic visual foundation models. Empowered by its…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Chunhui Zhang , Yawen Cui , Weilin Lin , Guanjie Huang , Yan Rong , Li Liu , Shiguang Shan

Despite significant advances in deep learning for image and video segmentation, existing models continue to face challenges in cross-domain adaptability and generalization. Image and video segmentation are fundamental tasks in computer…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhang Jiaxing , Tang Hao

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou

Segmentation is an essential step for remote sensing image processing. This study aims to advance the application of the Segment Anything Model (SAM), an innovative image segmentation model by Meta AI, in the field of remote sensing image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Lucas Prado Osco , Qiusheng Wu , Eduardo Lopes de Lemos , Wesley Nunes Gonçalves , Ana Paula Marques Ramos , Jonathan Li , José Marcato Junior

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

The Segment Anything Model (SAM), a foundation model pretrained on millions of images and segmentation masks, has significantly advanced semantic segmentation, a fundamental task in computer vision. Despite its strengths, SAM encounters two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Li Zhang , Youwei Liang , Ruiyi Zhang , Amirhosein Javadi , Pengtao Xie

Segment anything model (SAM) has demonstrated excellent generalizability in common vision scenarios, yet falling short of the ability to understand specialized data. Recently, several methods have combined parameter-efficient techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yiran Song , Qianyu Zhou , Xuequan Lu , Zhiwen Shao , Lizhuang Ma

The Segment Anything Model (SAM) has drawn significant attention from researchers who work on medical image segmentation because of its generalizability. However, researchers have found that SAM may have limited performance on medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yihao Liu , Jiaming Zhang , Andres Diaz-Pinto , Haowei Li , Alejandro Martin-Gomez , Amir Kheradmand , Mehran Armand

Visual State Space Models (VSSM) have shown remarkable performance in various computer vision tasks. However, backdoor attacks pose significant security challenges, causing compromised models to predict target labels when specific triggers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Cheng-Yi Lee , Yu-Hsuan Chiang , Zhong-You Wu , Chia-Mu Yu , Chun-Shien Lu

The segmentation foundation model, e.g., Segment Anything Model (SAM), has attracted increasing interest in the medical image community. Early pioneering studies primarily concentrated on assessing and improving SAM's performance from the…

Image and Video Processing · Electrical Eng. & Systems 2024-06-19 Qin Li , Yizhe Zhang , Yan Li , Jun Lyu , Meng Liu , Longyu Sun , Mengting Sun , Qirong Li , Wenyue Mao , Xinran Wu , Yajing Zhang , Yinghua Chu , Shuo Wang , Chengyan Wang

In this paper, we address the challenge of image resolution variation for the Segment Anything Model (SAM). SAM, known for its zero-shot generalizability, exhibits a performance degradation when faced with datasets with varying image sizes.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yiran Song , Qianyu Zhou , Xiangtai Li , Deng-Ping Fan , Xuequan Lu , Lizhuang Ma