English
Related papers

Related papers: MMCert: Provable Defense against Adversarial Attac…

200 papers

The advent of multimodal deep learning models, such as CLIP, has unlocked new frontiers in a wide range of applications, from image-text understanding to classification tasks. However, these models are not safe for adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Md. Iqbal Hossain , Afia Sajeeda , Neeresh Kumar Perla , Ming Shao

Adversarial machine learning attacks on video action recognition models is a growing research area and many effective attacks were introduced in recent years. These attacks show that action recognition models can be breached in many ways.…

Cryptography and Security · Computer Science 2024-04-18 Furkan Mumcu , Yasin Yilmaz

Multimodal learning has shown significant superiority on various tasks by integrating multiple modalities. However, the interdependencies among modalities increase the susceptibility of multimodal models to adversarial attacks. Existing…

Machine Learning · Computer Science 2025-11-25 Junrui Zhang , Xinyu Zhao , Jie Peng , Chenjie Wang , Jianmin Ji , Tianlong Chen

Multi-Modal Language Models (MLLMs) have transformed artificial intelligence by combining visual and text data, making applications like image captioning, visual question answering, and multi-modal content creation possible. This ability to…

Cryptography and Security · Computer Science 2024-11-11 Pete Janowczyk , Linda Laurier , Ave Giulietta , Arlo Octavia , Meade Cleti

Multimodal diffusion models for image editing generate outputs conditioned on both textual instructions and visual inputs, aiming to modify target regions while preserving the rest of the image. Although diffusion models have been shown to…

Cryptography and Security · Computer Science 2025-06-02 Ji Guo , Peihong Chen , Wenbo Jiang , Xiaolei Wen , Jiaming He , Jiachen Li , Guoming Lu , Aiguo Chen , Hongwei Li

Pretrained vision-language models (VLMs) like CLIP exhibit exceptional generalization across diverse downstream tasks. While recent studies reveal their vulnerability to adversarial attacks, research to date has primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Wanqi Zhou , Shuanghao Bai , Danilo P. Mandic , Qibin Zhao , Badong Chen

Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak attacks. While existing work focuses on explicit attacks, where malicious content resides in a single…

Cryptography and Security · Computer Science 2026-04-28 Xu Zhang , Hao Li , Zhichao Lu

Transformer-based pre-trained models of code (PTMC) have been widely utilized and have achieved state-of-the-art performance in many mission-critical applications. However, they can be vulnerable to adversarial attacks through identifier…

Cryptography and Security · Computer Science 2023-11-27 Xiaohu Du , Ming Wen , Zichao Wei , Shangwen Wang , Hai Jin

Defenses against adversarial examples, such as adversarial training, are typically tailored to a single perturbation type (e.g., small $\ell_\infty$-noise). For other perturbations, these defenses offer no guarantees and, at times, even…

Machine Learning · Computer Science 2019-10-21 Florian Tramèr , Dan Boneh

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Despite being popularly used in many applications, neural network models have been found to be vulnerable to adversarial examples, i.e., carefully crafted examples aiming to mislead machine learning models. Adversarial examples can pose…

Machine Learning · Computer Science 2019-07-30 Siwakorn Srisakaokul , Yuhao Zhang , Zexuan Zhong , Wei Yang , Tao Xie , Bo Li

As audio-visual systems are being deployed for safety-critical tasks such as surveillance and malicious content filtering, their robustness remains an under-studied area. Existing published work on robustness either does not scale to…

Sound · Computer Science 2022-04-22 Juncheng B Li , Shuhui Qu , Xinjian Li , Po-Yao Huang , Florian Metze

Multimodal foundation models (MMFMs) play a crucial role in various applications, including autonomous driving, healthcare, and virtual assistants. However, several studies have revealed vulnerabilities in these models, such as generating…

Detection of adversarial examples has been a hot topic in the last years due to its importance for safely deploying machine learning algorithms in critical applications. However, the detection methods are generally validated by assuming a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Federica Granese , Marine Picot , Marco Romanelli , Francisco Messina , Pablo Piantanida

Over the years, most research towards defenses against adversarial attacks on machine learning models has been in the image recognition domain. The ML-based malware detection domain has received less attention despite its importance.…

Machine Learning · Computer Science 2023-04-25 Aqib Rashid , Jose Such

Deep learning models, while achieving state-of-the-art performance on many tasks, are susceptible to adversarial attacks that exploit inherent vulnerabilities in their architectures. Adversarial attacks manipulate the input data with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shreyasi Mandal

Recently, the newly emerged multimodal models, which leverage both visual and linguistic modalities to train powerful encoders, have gained increasing attention. However, learning from a large-scale unlabeled dataset also exposes the model…

Cryptography and Security · Computer Science 2023-06-06 Ziqing Yang , Xinlei He , Zheng Li , Michael Backes , Mathias Humbert , Pascal Berrang , Yang Zhang

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

Machine Learning · Computer Science 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

Multi-label classification, which predicts a set of labels for an input, has many applications. However, multiple recent studies showed that multi-label classification is vulnerable to adversarial examples. In particular, an attacker can…

Cryptography and Security · Computer Science 2022-10-04 Jinyuan Jia , Wenjie Qu , Neil Zhenqiang Gong

The bulk of existing research in defending against adversarial examples focuses on defending against a single (typically bounded Lp-norm) attack, but for a practical setting, machine learning (ML) models should be robust to a wide variety…

Machine Learning · Computer Science 2023-07-21 Sihui Dai , Saeed Mahloujifar , Chong Xiang , Vikash Sehwag , Pin-Yu Chen , Prateek Mittal