English
Related papers

Related papers: Robustness Analysis on Foundational Segmentation M…

200 papers

Medical image segmentation models built on Segment Anything Model (SAM) achieve strong performance on clean benchmarks, yet their reliability often degrades under realistic image corruptions such as noise, blur, motion artifacts, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jieru Li , Matthew Chen , Micky C. Nnamdi , J. Ben Tamo , Benoit L. Marteau , May D. Wang

The Segment Anything Model (SAM) is a widely used vision foundation model with diverse applications, including image segmentation, detection, and tracking. Given SAM's wide applications, understanding its robustness against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jiahuan Long , Zhengqin Xu , Tingsong Jiang , Wen Yao , Shuai Jia , Chao Ma , Xiaoqian Chen

Biomedical Foundation Models (FMs) are rapidly transforming AI-enabled healthcare research and entering clinical validation. However, their susceptibility to learning non-biological technical features -- including variations in…

AI models, including both time-series-specific and general-purpose Foundation Models (FMs), have demonstrated strong potential in time-series forecasting across sectors like finance. However, these models are highly sensitive to input…

Large Vision Language Models (LVLMs) excel in various vision-language tasks. Yet, their robustness to visual variations in position, scale, orientation, and context that objects in natural scenes inevitably exhibit due to changes in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zhiyuan Fan , Yumeng Wang , Sandeep Polisetty , Yi R. Fung

Machine learning models are vulnerable to tiny adversarial input perturbations optimized to cause a very large output error. To measure this vulnerability, we need reliable methods that can find such adversarial perturbations. For image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Levente Halmosi , Bálint Mohos , Márk Jelasity

With Vision Transformers (ViTs) making great advances in a variety of computer vision tasks, recent literature have proposed various variants of vanilla ViTs to achieve better efficiency and efficacy. However, it remains unclear how their…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Rui Tian , Zuxuan Wu , Qi Dai , Han Hu , Yu-Gang Jiang

Earth observation foundation models have shown strong generalization across multiple Earth observation tasks, but their robustness under real-world perturbations remains underexplored. To bridge this gap, we introduce REOBench, the first…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Xiang Li , Yong Tao , Siyuan Zhang , Siwei Liu , Zhitong Xiong , Chunbo Luo , Lu Liu , Mykola Pechenizkiy , Xiao Xiang Zhu , Tianjin Huang

Data-driven models, especially deep learning classifiers often demonstrate great success on clean datasets. Yet, they remain vulnerable to common data distortions such as adversarial and common corruption perturbations. These perturbations…

Motivated by the increasing popularity of transformers in computer vision, in recent times there has been a rapid development of novel architectures. While in-domain performance follows a constant, upward trend, properties like robustness…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Pau de Jorge , Riccardo Volpi , Philip Torr , Gregory Rogez

The performance of promptable video object segmentation (PVOS) models substantially degrades under input corruptions, which prevents PVOS deployment in safety-critical domains. This paper offers the first comprehensive study on robust PVOS…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Sohyun Lee , Yeho Gwon , Lukas Hoyer , Konrad Schindler , Christos Sakaridis , Suha Kwak

Image segmentation foundation models (SFMs) like Segment Anything Model (SAM) have achieved impressive zero-shot and interactive segmentation across diverse domains. However, they struggle to segment objects with certain structures,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Yixin Zhang , Nicholas Konz , Kevin Kramer , Maciej A. Mazurowski

Vision Foundation Models (VFMs) are large-scale, pre-trained models that serve as general-purpose backbones for various computer vision tasks. As VFMs' popularity grows, there is an increasing interest in understanding their effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Volodymyr Havrylov , Haiwen Huang , Dan Zhang , Andreas Geiger

Achieving robustness against adversarial input perturbation is an important and intriguing problem in machine learning. In the area of semantic image segmentation, a number of adversarial training approaches have been proposed as a defense…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Levente Halmosi , Mark Jelasity

By default neural networks are not robust to changes in data distribution. This has been demonstrated with simple image corruptions, such as blurring or adding noise, degrading image classification performance. Many methods have been…

Machine Learning · Computer Science 2023-06-16 Ian Mason , Anirban Sarkar , Tomotake Sasaki , Xavier Boix

The robustness of Vision Language Models (VLMs) is commonly assessed through output-level invariance, implicitly assuming that stable predictions reflect stable multimodal processing. In this work, we argue that this assumption is…

Although vision foundation models (VFMs) are increasingly reused for biomedical image analysis, it remains unclear whether the latent representations they provide are general enough to support effective transfer and reuse across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Caterina Fuster-Barceló , Virginie Uhlmann

Vision foundation models (FMs) have become the predominant architecture in computer vision, providing highly transferable representations learned from large-scale, multimodal corpora. Nonetheless, they exhibit persistent limitations on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Fatemeh Ziaeetabar

Segment anything model (SAM) has presented impressive objectness identification capability with the idea of prompt learning and a new collected large-scale dataset. Given a prompt (e.g., points, bounding boxes, or masks) and an input image,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Yihao Huang , Yue Cao , Tianlin Li , Felix Juefei-Xu , Di Lin , Ivor W. Tsang , Yang Liu , Qing Guo

This study investigates the vulnerability of semantic segmentation models to adversarial input perturbations, in the domain of off-road autonomous driving. Despite good performance in generic conditions, the state-of-the-art classifiers are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Pankaj Deoli , Rohit Kumar , Axel Vierling , Karsten Berns