English
Related papers

Related papers: Robust SAM: On the Adversarial Robustness of Visio…

200 papers

The Segment Anything Model (SAM) has demonstrated strong performance in image segmentation of natural scene images. However, its effectiveness diminishes markedly when applied to specific scientific domains, such as Scanning Probe…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yao Shen , Ziwei Wei , Chunmeng Liu , Shuming Wei , Qi Zhao , Kaiyang Zeng , Guangyao Li

With the proposal of the Segment Anything Model (SAM), fine-tuning SAM for medical image segmentation (MIS) has become popular. However, due to the large size of the SAM model and the significant domain gap between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Jinfeng Wang , Sifan Song , Xinkun Wang , Yiyi Wang , Yiyi Miao , Jionglong Su , S. Kevin Zhou

As Segment Anything Model (SAM) becomes a popular foundation model in computer vision, its adversarial robustness has become a concern that cannot be ignored. This works investigates whether it is possible to attack SAM with image-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Dongshen Han , Chaoning Zhang , Sheng Zheng , Chang Lu , Yang Yang , Heng Tao Shen

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

In light of the diminishing returns of traditional methods for enhancing transmission rates, the domain of semantic communication presents promising new frontiers. Focusing on image transmission, this paper explores the application of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Shehbaz Tariq , Brian Estadimas Arfeto , Chaoning Zhang , Hyundong Shin

The Segment-Anything Model (SAM) is a vision foundation model for segmentation with a prompt-driven framework. SAM generates class-agnostic masks based on user-specified instance-referring prompts. However, adapting SAM for automated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Hussni Mohd Zakir , Eric Tatt Wei Ho

Segment anything model (SAM) demonstrates strong generalization ability on natural image segmentation. However, its direct adaptation in medical image segmentation tasks shows significant performance drops. It also requires an excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Heng Guo , Jianfeng Zhang , Jiaxing Huang , Tony C. W. Mok , Dazhou Guo , Ke Yan , Le Lu , Dakai Jin , Minfeng Xu

Semi-supervised learning (SSL) has achieved notable progress in medical image segmentation. To achieve effective SSL, a model needs to be able to efficiently learn from limited labeled data and effectively exploiting knowledge from abundant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Juzheng Miao , Cheng Chen , Keli Zhang , Jie Chuai , Quanzheng Li , Pheng-Ann Heng

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei

Recently segment anything model (SAM) has attracted widespread concerns, and it is often treated as a vision foundation model for universal segmentation. Some researchers have attempted to directly apply the foundation model to the RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jia Lin , Xiaofei Zhou , Jiyuan Liu , Runmin Cong , Guodao Zhang , Zhi Liu , Jiyong Zhang

Segment Anything Model (SAM) has recently gained much attention for its outstanding generalization to unseen data and tasks. Despite its promising prospect, the vulnerabilities of SAM, especially to universal adversarial perturbation (UAP)…

Artificial Intelligence · Computer Science 2024-09-27 Ziqi Zhou , Yufei Song , Minghui Li , Shengshan Hu , Xianlong Wang , Leo Yu Zhang , Dezhong Yao , Hai Jin

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

The vulnerability of deep neural networks to imperceptible adversarial perturbations has attracted widespread attention. Inspired by the success of vision-language foundation models, previous efforts achieved zero-shot adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yiwei Zhou , Xiaobo Xia , Zhiwei Lin , Bo Han , Tongliang Liu

Fully supervised deep learning (DL) models for surgical video segmentation have been shown to struggle with non-adversarial, real-world corruptions of image quality including smoke, bleeding, and low illumination. Foundation models for…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Yiqing Shen , Hao Ding , Xinyuan Shao , Mathias Unberath

This paper presents the Autonomous Driving Segment Anything Model (AD-SAM), a fine-tuned vision foundation model for semantic segmentation in autonomous driving (AD). AD-SAM extends the Segment Anything Model (SAM) with a dual-encoder and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Mario Camarena , Het Patel , Fatemeh Nazari , Evangelos Papalexakis , Mohamadhossein Noruzoliaee , Jia Chen

Deep State Space Models (SSMs) have proven effective in numerous task scenarios but face significant security challenges due to Adversarial Perturbations (APs) in real-world deployments. Adversarial Training (AT) is a mainstream approach to…

Machine Learning · Computer Science 2024-10-10 Biqing Qi , Yang Luo , Junqi Gao , Pengfei Li , Kai Tian , Zhiyuan Ma , Bowen Zhou

Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation (UDA-RSSeg) addresses the challenge of adapting a model trained on source domain data to target domain samples, thereby minimizing the need for annotated data across…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Shuchang Lyu , Qi Zhao , Guangliang Cheng , Yiwei He , Zheng Zhou , Guangbiao Wang , Zhenwei Shi

Few-shot segmentation has garnered significant attention. Many recent approaches attempt to introduce the Segment Anything Model (SAM) to handle this task. With the strong generalization ability and rich object-specific extraction ability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jin Wang , Bingfeng Zhang , Jian Pang , Weifeng Liu , Baodi Liu , Honglong Chen

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae