English
Related papers

Related papers: Adversarial Attacks to Multi-Modal Models

200 papers

Deep learning has shown impressive performance on challenging perceptual tasks and has been widely used in software to provide intelligent services. However, researchers found deep neural networks vulnerable to adversarial examples. Since…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Haowen Liu , Ping Yi , Hsiao-Ying Lin , Jie Shi , Weidong Qiu

This work examines the vulnerability of multimodal (image + text) models to adversarial threats similar to those discussed in previous literature on unimodal (image- or text-only) models. We introduce realistic assumptions of partial model…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Ivan Evtimov , Russel Howes , Brian Dolhansky , Hamed Firooz , Cristian Canton Ferrer

Despite the notable advancements and versatility of multi-modal diffusion models, such as text-to-image models, their susceptibility to adversarial inputs remains underexplored. Contrary to expectations, our investigations reveal that the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Xiaosen Wang , Zhijin Ge , Shaokang Wang

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

The existence of adversarial attacks (or adversarial examples) brings huge concern about the machine learning (ML) model's safety issues. For many safety-critical ML tasks, such as financial forecasting, fraudulent detection, and anomaly…

Machine Learning · Computer Science 2022-10-19 Han Xu , Menghai Pan , Zhimeng Jiang , Huiyuan Chen , Xiaoting Li , Mahashweta Das , Hao Yang

As collaborative learning and the outsourcing of data collection become more common, malicious actors (or agents) which attempt to manipulate the learning process face an additional obstacle as they compete with each other. In backdoor…

Machine Learning · Computer Science 2021-10-12 Siddhartha Datta , Giulio Lovisotto , Ivan Martinovic , Nigel Shadbolt

Deep neural networks are susceptible to adversarial attacks, which pose a significant threat to their security and reliability in real-world applications. The most notable adversarial attacks are transfer-based attacks, where an adversary…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Kunyu Wang , Juluan Shi , Wenxuan Wang

Adversarial examples, crafted by adding perturbations imperceptible to humans, can deceive neural networks. Recent studies identify the adversarial transferability across various models, \textit{i.e.}, the cross-model attack ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Rongyi Zhu , Zeliang Zhang , Susan Liang , Zhuo Liu , Chenliang Xu

The fine-tuning technique for text-to-image diffusion models facilitates image customization but risks privacy breaches and opinion manipulation. Current research focuses on prompt- or image-level adversarial attacks for anti-customization,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Long Tang , Dengpan Ye , Sirun Chen , Xiuwen Shi , Yunna Lv , Ziyi Liu

We propose a universal adversarial attack on multimodal Large Language Models (LLMs) that leverages a single optimized image to override alignment safeguards across diverse queries and even multiple models. By backpropagating through the…

Artificial Intelligence · Computer Science 2025-06-06 Temurbek Rahmatullaev , Polina Druzhinina , Nikita Kurdiukov , Matvey Mikhalchuk , Andrey Kuznetsov , Anton Razzhigaev

Deep neural networks are widely used in various fields because of their powerful performance. However, recent studies have shown that deep learning models are vulnerable to adversarial attacks, i.e., adding a slight perturbation to the…

Machine Learning · Computer Science 2022-05-17 Youhuan Yang , Lei Sun , Leyu Dai , Song Guo , Xiuqing Mao , Xiaoqin Wang , Bayi Xu

Deep neural network-based image compression has been extensively studied. However, the model robustness which is crucial to practical application is largely overlooked. We propose to examine the robustness of prevailing learned image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Tong Chen , Zhan Ma

We consider adversarial attacks to a black-box model when no queries are allowed. In this setting, many methods directly attack surrogate models and transfer the obtained adversarial examples to fool the target model. Plenty of previous…

Machine Learning · Computer Science 2021-09-08 Yunxiao Qin , Yuanhao Xiong , Jinfeng Yi , Cho-Jui Hsieh

This paper studies the fast adaptive beamforming for the multiuser multiple-input single-output downlink. Existing deep learning-based approaches assume that training and testing channels follow the same distribution which causes task…

Information Theory · Computer Science 2021-09-21 Juping Zhang , Yi Yuan , Gan Zheng , Ioannis Krikidis , Kai-Kit Wong

This paper focuses on learning transferable adversarial examples specifically against defense models (models to defense adversarial attacks). In particular, we show that a simple universal perturbation can fool a series of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Yingwei Li , Song Bai , Cihang Xie , Zhenyu Liao , Xiaohui Shen , Alan L. Yuille

Transfer learning is a popular method for tuning pretrained (upstream) models for different downstream tasks using limited data and computational resources. We study how an adversary with control over an upstream model used in transfer…

Machine Learning · Computer Science 2023-03-22 Yulong Tian , Fnu Suya , Anshuman Suri , Fengyuan Xu , David Evans

Deep neural networks have achieved impressive performance in various areas, but they are shown to be vulnerable to adversarial attacks. Previous works on adversarial attacks mainly focused on the single-task setting. However, in real…

Machine Learning · Computer Science 2020-11-20 Pengxin Guo , Yuancheng Xu , Baijiong Lin , Yu Zhang

Backdoor attacks on reinforcement learning implant a backdoor in a victim agent's policy. Once the victim observes the trigger signal, it will switch to the abnormal mode and fail its task. Most of the attacks assume the adversary can…

Multiagent Systems · Computer Science 2022-11-22 Shuo Chen , Yue Qiu , Jie Zhang

We investigate a new method for injecting backdoors into machine learning models, based on compromising the loss-value computation in the model-training code. We use it to demonstrate new classes of backdoors strictly more powerful than…

Cryptography and Security · Computer Science 2021-02-22 Eugene Bagdasaryan , Vitaly Shmatikov

Deep neural networks have proven to be quite effective in a wide variety of machine learning tasks, ranging from improved speech recognition systems to advancing the development of autonomous vehicles. However, despite their superior…

Machine Learning · Computer Science 2016-12-14 Qinglong Wang , Wenbo Guo , Alexander G. Ororbia , Xinyu Xing , Lin Lin , C. Lee Giles , Xue Liu , Peng Liu , Gang Xiong