English
Related papers

Related papers: Adversarial Robustness of Vision in Open Foundatio…

200 papers

Visual-Language-Action (VLA) models report impressive success rates on robotic manipulation benchmarks, yet these results may mask fundamental weaknesses in robustness. We perform a systematic vulnerability analysis by introducing…

Large Vision-Language Models (VLMs) have achieved remarkable success in understanding complex real-world scenarios and supporting data-driven decision-making processes. However, VLMs exhibit significant vulnerability against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xiaosen Wang , Shaokang Wang , Zhijin Ge , Yuyang Luo , Shudong Zhang

Large-scale vision models have become integral in many applications due to their unprecedented performance and versatility across downstream tasks. However, the robustness of these foundation models has primarily been explored for a single…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Antoni Kowalczuk , Jan Dubiński , Atiyeh Ashari Ghomi , Yi Sui , George Stein , Jiapeng Wu , Jesse C. Cresswell , Franziska Boenisch , Adam Dziedzic

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Benefiting from the rapid development of deep learning, 2D and 3D computer vision applications are deployed in many safe-critical systems, such as autopilot and identity authentication. However, deep learning models are not trustworthy…

Machine Learning · Computer Science 2023-10-03 Yanjie Li , Bin Xie , Songtao Guo , Yuanyuan Yang , Bin Xiao

Large Vision-Language Models (LVLMs) have transformed multi-modal understanding, excelling in tasks like image captioning and visual question answering by integrating visual and textual inputs. However, their robustness against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Xiang Fang , Wanlong Fang , Changshuo Wang

Vision State Space Models (VSSMs), a novel architecture that combines the strengths of recurrent neural networks and latent variable models, have demonstrated remarkable performance in visual perception tasks by efficiently capturing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Hashmat Shadab Malik , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar , Fahad Shahbaz Khan , Salman Khan

Recent studies show that models trained by continual learning can achieve the comparable performances as the standard supervised learning and the learning flexibility of continual learning models enables their wide applications in the real…

Machine Learning · Computer Science 2023-04-03 Tao Bai , Chen Chen , Lingjuan Lyu , Jun Zhao , Bihan Wen

While vision and multimodal foundation models underpin critical tasks from perception to complex reasoning, they remain highly vulnerable to adversarial attacks. However, traditional adversarial attacks are typically limited to single,…

Cryptography and Security · Computer Science 2026-05-20 Ye Sun , Xin Wang , Jiaming Zhang , Yifeng Gao , Yixu Wang , Yifan Ding , Qixian Zhang , Henghui Ding , Xingjun Ma , Yu-Gang Jiang

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

Machine Learning · Computer Science 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

Despite demonstrating superior rate-distortion (RD) performance, learning-based image compression (LIC) algorithms have been found to be vulnerable to malicious perturbations in recent studies. However, the adversarial attacks considered in…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Chenhao Wu , Qingbo Wu , Haoran Wei , Shuai Chen , Lei Wang , King Ngi Ngan , Fanman Meng , Hongliang Li

Non-adversarial robustness, also known as natural robustness, is a property of deep learning models that enables them to maintain performance even when faced with distribution shifts caused by natural variations in data. However, achieving…

Machine Learning · Computer Science 2023-05-25 Gorana Gojić , Vladimir Vincan , Ognjen Kundačina , Dragiša Mišković , Dinu Dragan

As Large Language Models (LLMs) become increasingly integrated into real-world decision-making systems, understanding their behavioural vulnerabilities remains a critical challenge for AI safety and alignment. While existing evaluation…

Artificial Intelligence · Computer Science 2025-05-20 Lili Zhang , Haomiaomiao Wang , Long Cheng , Libao Deng , Tomas Ward

With the advent of Large Vision-Language Models (LVLMs), new attack vectors, such as cognitive bias, prompt injection, and jailbreaking, have emerged. Understanding these attacks promotes system robustness improvement and neural networks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Chiyu Zhang , Lu Zhou , Xiaogang Xu , Jiafei Wu , Zhe Liu

In this paper, we investigate the impact of adversarial attacks on the explainability of deep learning models, which are commonly criticized for their black-box nature despite their capacity for autonomous feature extraction. This black-box…

Machine Learning · Computer Science 2024-12-17 Gazi Nazia Nur , Mohammad Ahnaf Sadat

Recent advances in vision-language models (VLMs) trained on web-scale image-text pairs have enabled impressive zero-shot transfer across a diverse range of visual tasks. However, comprehensive and independent evaluation beyond standard…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jia Chengyu , AprilPyone MaungMaung , Huy H. Nguyen , Jinyin Chen , Isao Echizen

Adversarial patches exemplify the tangible manifestation of the threat posed by adversarial attacks on Machine Learning (ML) models in real-world scenarios. Robustness against these attacks is of the utmost importance when designing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Bilel Tarchoun , Quazi Mishkatul Alam , Nael Abu-Ghazaleh , Ihsen Alouani

The vulnerability of deep neural networks to imperceptible adversarial perturbations has attracted widespread attention. Inspired by the success of vision-language foundation models, previous efforts achieved zero-shot adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yiwei Zhou , Xiaobo Xia , Zhiwei Lin , Bo Han , Tongliang Liu

Visual Question Answering (VQA), as the representative multimodal task, serves as a key benchmark for evaluating the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, existing evaluations largely rely on static…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Quanxing Xu , Yuhao Tian , Ling Zhou , Xian Zhong , Xiaohua Huang , Rubing Huang , Chia-Wen Lin

Viewpoint invariance remains challenging for visual recognition in the 3D world, as altering the viewing directions can significantly impact predictions for the same object. While substantial efforts have been dedicated to making neural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shouwei Ruan , Yinpeng Dong , Hang Su , Jianteng Peng , Ning Chen , Xingxing Wei