English
Related papers

Related papers: Adversarial Attacks Against MLLMs via Progressive …

200 papers

Deep neural networks are vulnerable to adversarial examples, which can mislead classifiers by adding imperceptible perturbations. An intriguing property of adversarial examples is their good transferability, making black-box attacks…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu

Multimodal Large Language Models (MLLMs) have achieved remarkable performance across vision-language tasks. Recent advancements allow these models to process multiple images as inputs. However, the vulnerabilities of multi-image MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Alvi Md Ishmam , Najibul Haque Sarker , Zaber Ibn Abdul Hakim , Chris Thomas

The integration of new modalities enhances the capabilities of multimodal large language models (MLLMs) but also introduces additional vulnerabilities. In particular, simple visual jailbreaking attacks can manipulate open-source MLLMs more…

Machine Learning · Computer Science 2026-03-03 Runqi Lin , Alasdair Paren , Suqin Yuan , Muyang Li , Philip Torr , Adel Bibi , Tongliang Liu

Vision Large Language Models (VLLMs) integrate visual data processing, expanding their real-world applications, but also increasing the risk of generating unsafe responses. In response, leading companies have implemented Multi-Layered…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yijun Yang , Lichao Wang , Xiao Yang , Lanqing Hong , Jun Zhu

Large Vision-Language Models (LVLMs) have transformed multi-modal understanding, excelling in tasks like image captioning and visual question answering by integrating visual and textual inputs. However, their robustness against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Xiang Fang , Wanlong Fang , Changshuo Wang

Large vision-language models (VLMs) are vulnerable to transfer-based adversarial perturbations, enabling attackers to optimize on surrogate models and manipulate black-box VLM outputs. Prior targeted transfer attacks often overfit…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Haobo Wang , Weiqi Luo , Xiaojun Jia , Xiaochun Cao

Multimodal Language Models (MMLMs) typically undergo post-training alignment to prevent harmful content generation. However, these alignment stages focus primarily on the assistant role, leaving the user role unaligned, and stick to a fixed…

Cryptography and Security · Computer Science 2025-04-08 Erfan Shayegani , G M Shahariar , Sara Abdali , Lei Yu , Nael Abu-Ghazaleh , Yue Dong

Visual language pre-training (VLP) models have demonstrated significant success across various domains, yet they remain vulnerable to adversarial attacks. Addressing these adversarial vulnerabilities is crucial for enhancing security in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Dehong Kong , Siyuan Liang , Xiaopeng Zhu , Yuansheng Zhong , Wenqi Ren

Deep neural networks (DNNs) have been shown to be vulnerable to adversarial examples, which can produce erroneous predictions by injecting imperceptible perturbations. In this work, we study the transferability of adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Zeyu Qin , Yanbo Fan , Yi Liu , Li Shen , Yong Zhang , Jue Wang , Baoyuan Wu

Large Vision-Language Models (LVLMs) are foundational to modern multimodal applications, yet their susceptibility to adversarial attacks remains a critical concern. Prior white-box attacks rarely generalize across tasks, and black-box…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hefei Mei , Zirui Wang , Chang Xu , Jianyuan Guo , Minjing Dong

Deep neural networks have achieved unprecedented success on diverse vision tasks. However, they are vulnerable to adversarial noise that is imperceptible to humans. This phenomenon negatively affects their deployment in real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Jianping Zhang , Jen-tse Huang , Wenxuan Wang , Yichen Li , Weibin Wu , Xiaosen Wang , Yuxin Su , Michael R. Lyu

It has been shown that Large Language Model (LLM) alignments can be circumvented by appending specially crafted attack suffixes with harmful queries to elicit harmful responses. To conduct attacks against private target models whose…

Traditional adversarial attacks typically aim to alter the predicted labels of input images by generating perturbations that are imperceptible to the human eye. However, these approaches often lack explainability. Moreover, most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Akram Heidarizadeh , Connor Hatfield , Lorenzo Lazzarotto , HanQin Cai , George Atia

Pre-trained contextualized language models (PrLMs) have led to strong performance gains in downstream natural language understanding tasks. However, PrLMs can still be easily fooled by adversarial word substitution, which is one of the most…

Computation and Language · Computer Science 2021-06-01 Rongzhou Bao , Jiayi Wang , Hai Zhao

Face Recognition (FR) models are vulnerable to adversarial examples that subtly manipulate benign face images, underscoring the urgent need to improve the transferability of adversarial attacks in order to expose the blind spots of these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Fengfan Zhou , Bangjie Yin , Hefei Ling , Qianyu Zhou , Wenxuan Wang

Current adversarial attacks for evaluating the robustness of vision-language pre-trained (VLP) models in multi-modal tasks suffer from limited transferability, where attacks crafted for a specific model often struggle to generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Peng-Fei Zhang , Guangdong Bai , Zi Huang

Adversarial attacks on Face Recognition (FR) systems have demonstrated significant effectiveness against standalone FR models. However, their practicality diminishes in complete FR systems that incorporate Face Anti-Spoofing (FAS) models,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Fengfan Zhou , Qianyu Zhou , Hefei Ling , Xuequan Lu

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

Adversarial prompts generated using gradient-based methods exhibit outstanding performance in performing automatic jailbreak attacks against safety-aligned LLMs. Nevertheless, due to the discrete nature of texts, the input gradient of LLMs…

Cryptography and Security · Computer Science 2024-11-04 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Transfer adversarial attack is a non-trivial black-box adversarial attack that aims to craft adversarial perturbations on the surrogate model and then apply such perturbations to the victim model. However, the transferability of…

Machine Learning · Computer Science 2021-12-14 Shuman Fang , Jie Li , Xianming Lin , Rongrong Ji