English
Related papers

Related papers: Improving Adversarial Transferability in MLLMs via…

200 papers

Large Vision-Language Models (VLMs) have revolutionized computer vision, enabling tasks such as image classification, captioning, and visual question answering. However, they remain highly vulnerable to adversarial attacks, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Atharv Mittal , Agam Pandey , Amritanshu Tiwari , Sukrit Jindal , Swadesh Swain

Due to their multimodal capabilities, Vision-Language Models (VLMs) have found numerous impactful applications in real-world scenarios. However, recent studies have revealed that VLMs are vulnerable to image-based adversarial attacks.…

Machine Learning · Computer Science 2025-03-31 Jiaming Zhang , Junhong Ye , Xingjun Ma , Yige Li , Yunfan Yang , Yunhao Chen , Jitao Sang , Dit-Yan Yeung

Vision-language pre-training (VLP) models exhibit remarkable capabilities in comprehending both images and text, yet they remain susceptible to multimodal adversarial examples (AEs). Strengthening attacks and uncovering vulnerabilities,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sensen Gao , Xiaojun Jia , Xuhong Ren , Ivor Tsang , Qing Guo

Vision-language models (VLMs) are increasingly used in autonomous driving because they combine visual perception with language-based reasoning, supporting more interpretable decision-making, yet their robustness to physical adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 David Fernandez , Pedram MohajerAnsari , Amir Salarpour , Mert D. Pese

Multimodal Large Language Models (MLLMs) have achieved remarkable performance across vision-language tasks. Recent advancements allow these models to process multiple images as inputs. However, the vulnerabilities of multi-image MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Alvi Md Ishmam , Najibul Haque Sarker , Zaber Ibn Abdul Hakim , Chris Thomas

Vision Language Action (VLA) models have recently shown great potential in bridging multimodal perception with robotic control. However, existing methods often rely on direct fine-tuning of pre-trained Vision-Language Models (VLMs), feeding…

Robotics · Computer Science 2026-02-04 Kun Wang , Xiao Feng , Mingcheng Qu , Tonghua Su

Recent studies on AI security have highlighted the vulnerability of Vision-Language Pre-training (VLP) models to subtle yet intentionally designed perturbations in images and texts. Investigating multimodal systems' robustness via…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Haonan Zheng , Wen Jiang , Xinyang Deng , Wenrui Li

With the rapid advancement of multimodal learning, pre-trained Vision-Language Models (VLMs) such as CLIP have demonstrated remarkable capacities in bridging the gap between visual and language modalities. However, these models remain…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiaming Zhang , Xingjun Ma , Xin Wang , Lingyu Qiu , Jiaqi Wang , Yu-Gang Jiang , Jitao Sang

The growing deployment of Large Vision-Language Models (VLMs) raises safety concerns, as adversaries may exploit model vulnerabilities to induce harmful outputs, with targeted black-box adversarial attacks posing a particularly severe…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Yiming Cao , Yanjie Li , Kaisheng Liang , Bin Xiao

Video Multimodal Large Language Models (V-MLLMs) have shown impressive capabilities in temporal reasoning and cross-modal understanding, yet their vulnerability to adversarial attacks remains underexplored due to unique challenges: complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiaming Zhang , Rui Hu , Qing Guo , Wei Yang Bryan Lim

Vision Large Language Models (VLLMs) integrate visual data processing, expanding their real-world applications, but also increasing the risk of generating unsafe responses. In response, leading companies have implemented Multi-Layered…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yijun Yang , Lichao Wang , Xiao Yang , Lanqing Hong , Jun Zhu

3D Vision-Language Models (VLMs), such as PointLLM and GPT4Point, have shown strong reasoning and generalization abilities in 3D understanding tasks. However, their adversarial robustness remains largely unexplored. Prior work in 2D VLMs…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Chao Liu , Ngai-Man Cheung

Despite inheriting security measures from underlying language models, Vision-Language Models (VLMs) may still be vulnerable to safety alignment issues. Through empirical analysis, we uncover two critical findings: scenario-matched images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shuyang Hao , Bryan Hooi , Jun Liu , Kai-Wei Chang , Zi Huang , Yujun Cai

Despite the substantial advancements in Vision-Language Pre-training (VLP) models, their susceptibility to adversarial attacks poses a significant challenge. Existing work rarely studies the transferability of attacks on VLP models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiyuan Fu , Zhaoyu Chen , Kaixun Jiang , Haijing Guo , Jiafeng Wang , Shuyong Gao , Wenqiang Zhang

Large Vision-Language Models (VLMs) have demonstrated remarkable performance across multimodal tasks by integrating vision encoders with large language models (LLMs). However, these models remain vulnerable to adversarial attacks. Among…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Hee-Seon Kim , Minbeom Kim , Changick Kim

Multi-modal Large Language Models (MLLMs) have recently achieved enhanced performance across various vision-language tasks including visual grounding capabilities. However, the adversarial robustness of visual grounding remains unexplored…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Kuofeng Gao , Yang Bai , Jiawang Bai , Yong Yang , Shu-Tao Xia

Recent Multimodal Large Language Models (MLLMs) have demonstrated significant progress in perceiving and reasoning over multimodal inquiries, ushering in a new research era for foundation models. However, vision-language misalignment in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Wei-Yao Wang , Zhao Wang , Helen Suzuki , Yoshiyuki Kobayashi

Multimodal large language models (MLLMs) remain vulnerable to transferable adversarial examples. While existing methods typically achieve targeted attacks by aligning global features-such as CLIP's [CLS] token-between adversarial and target…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xiaojun Jia , Sensen Gao , Simeng Qin , Tianyu Pang , Chao Du , Yihao Huang , Xinfeng Li , Yiming Li , Bo Li , Yang Liu

Black-box adversarial attacks on Large Vision-Language Models (LVLMs) are challenging due to missing gradients and complex multimodal boundaries. While prior state-of-the-art transfer-based approaches like M-Attack perform well using local…

Machine Learning · Computer Science 2026-02-20 Xiaohan Zhao , Zhaoyi Li , Yaxin Luo , Jiacheng Cui , Zhiqiang Shen

Multimodal large language models (MLLMs) integrate information from multiple modalities such as text, images, audio, and video, enabling complex capabilities such as visual question answering and audio translation. While powerful, this…

Cryptography and Security · Computer Science 2026-03-31 Bhavuk Jain , Sercan Ö. Arık , Hardeo K. Thakur