English
Related papers

Related papers: Adversarial Attacks to Multi-Modal Models

200 papers

Food computing is playing an increasingly important role in human daily life, and has found tremendous applications in guiding human behavior towards smart food consumption and healthy lifestyle. An important task under the food-computing…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hao Wang , Doyen Sahoo , Chenghao Liu , Ee-peng Lim , Steven C. H. Hoi

Multimodal contrastive learning models like CLIP have demonstrated remarkable vision-language alignment capabilities, yet their vulnerability to backdoor attacks poses critical security risks. Attackers can implant latent triggers that…

Cryptography and Security · Computer Science 2025-06-17 Mengyuan Sun , Yu Li , Yuchen Liu , Bo Du , Yunjie Ge

Multimodal pretrained models are vulnerable to backdoor attacks, yet most existing methods rely on visual or multimodal triggers, which are impractical since visually embedded triggers rarely occur in real-world data. To overcome this…

Cryptography and Security · Computer Science 2026-04-08 Yiyang Zhang , Chaojian Yu , Ziming Hong , Yuanjie Shao , Qinmu Peng , Tongliang Liu , Xinge You

Though deep neural networks perform challenging tasks excellently, they are susceptible to adversarial examples, which mislead classifiers by applying human-imperceptible perturbations on clean inputs. Under the query-free black-box…

Machine Learning · Computer Science 2020-11-05 Zifei Zhang , Kai Qiao , Jian Chen , Ningning Liang

Deep neural networks are vulnerable to adversarial examples, which can mislead classifiers by adding imperceptible perturbations. An intriguing property of adversarial examples is their good transferability, making black-box attacks…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu

In recent years, there has been significant research focusing on addressing security concerns in single-modal person re-identification (ReID) systems that are based on RGB images. However, the safety of cross-modality scenarios, which are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yunpeng Gong , Zhun Zhong , Yansong Qu , Zhiming Luo , Rongrong Ji , Min Jiang

Transferable attacks generate adversarial examples on surrogate models to fool unknown victim models, posing real-world threats and growing research interest. Despite focusing on flat losses for transferable adversarial examples, recent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Zhixuan Zhang , Pingyu Wang , Xingjian Zheng , Linbo Qing , Qi Liu

Adversarial attacks are small, carefully crafted perturbations, imperceptible to the naked eye; that when added to an image cause deep learning models to misclassify the image with potentially detrimental outcomes. With the rise of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Rohan Reddy Mekala , Gudjon Einar Magnusson , Adam Porter , Mikael Lindvall , Madeline Diep

Recent studies have shown that Deep Leaning models are susceptible to adversarial examples, which are data, in general images, intentionally modified to fool a machine learning classifier. In this paper, we present a multi-objective nested…

Machine Learning · Computer Science 2026-02-24 A. E. Baia , G. Di Bari , V. Poggioni

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

State-of-the-art deep neural networks are known to be vulnerable to adversarial examples, formed by applying small but malicious perturbations to the original inputs. Moreover, the perturbations can \textit{transfer across models}:…

Machine Learning · Statistics 2018-02-28 Lei Wu , Zhanxing Zhu , Cheng Tai , Weinan E

Machine learning models were shown to be vulnerable to model stealing attacks, which lead to intellectual property infringement. Among other methods, substitute model training is an all-encompassing attack applicable to any machine learning…

Machine Learning · Computer Science 2025-03-11 Daryna Oliynyk , Rudolf Mayer , Andreas Rauber

Adversarial examples have attracted widespread attention in security-critical applications because of their transferability across different models. Although many methods have been proposed to boost adversarial transferability, a gap still…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Xingxing Wei , Shiji Zhao

Deep neural networks are vulnerable to adversarial examples, which can fool deep models by adding subtle perturbations. Although existing attacks have achieved promising results, it still leaves a long way to go for generating transferable…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Yexin Duan , Junhua Zou , Xingyu Zhou , Wu Zhang , Jin Zhang , Zhisong Pan

Utilizing a shared embedding space, emerging multimodal models exhibit unprecedented zero-shot capabilities. However, the shared embedding space could lead to new vulnerabilities if different modalities can be misaligned. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Shaeke Salman , Md Montasir Bin Shams , Xiuwen Liu

Deepfakes utilise Artificial Intelligence (AI) techniques to create synthetic media where the likeness of one person is replaced with another. There are growing concerns that deepfakes can be maliciously used to create misleading and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Nyee Thoang Lim , Meng Yi Kuan , Muxin Pu , Mei Kuan Lim , Chun Yong Chong

The proliferation of sophisticated AI-generated deepfakes poses critical challenges for digital media authentication and societal security. While existing detection methods perform well within specific generative domains, they exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Naseem Khan , Tuan Nguyen , Amine Bermak , Issa Khalil

Leveraging information across diverse modalities is known to enhance performance on multimodal segmentation tasks. However, effectively fusing information from different modalities remains challenging due to the unique characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

While diffusion models have revolutionized visual content generation, their rapid adoption has underscored the critical need to investigate vulnerabilities, e.g., to backdoor attacks. In multimodal diffusion models, it is natural to expect…

Machine Learning · Computer Science 2026-03-09 Qitong Wang , Haoran Dai , Haotian Zhang , Christopher Rasmussen , Binghui Wang

Adversarial examples have revealed the vulnerability of deep learning models and raised serious concerns about information security. The transfer-based attack is a hot topic in black-box attacks that are practical to real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Jian-Wei Li , Wen-Ze Shao