English
Related papers

Related papers: Adversarial-Guided Diffusion for Multimodal LLM At…

200 papers

Advances in deep learning have enabled a wide range of promising applications. However, these systems are vulnerable to Adversarial Machine Learning (AML) attacks; adversarially crafted perturbations to their inputs could cause them to…

Cryptography and Security · Computer Science 2022-01-06 Amira Guesmi , Khaled N. Khasawneh , Nael Abu-Ghazaleh , Ihsen Alouani

Recent developments in adversarial machine learning have highlighted the importance of building robust AI systems to protect against increasingly sophisticated attacks. While frameworks like AI Guardian are designed to defend against these…

Machine Learning · Computer Science 2024-05-06 Trinath Sai Subhash Reddy Pittala , Uma Maheswara Rao Meleti , Geethakrishna Puligundla

Medical multimodal large language models (MLLMs) are becoming an instrumental part of healthcare systems, assisting medical personnel with decision making and results analysis. Models for radiology report generation are able to interpret…

Cryptography and Security · Computer Science 2025-02-05 Yaling Shen , Zhixiong Zhuang , Kun Yuan , Maria-Irina Nicolae , Nassir Navab , Nicolas Padoy , Mario Fritz

Vision-Language Models (VLMs) extend the capabilities of Large Language Models (LLMs) by incorporating visual information, yet they remain vulnerable to jailbreak attacks, especially when processing noisy or corrupted images. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiawei Wang , Yushen Zuo , Yuanjun Chai , Zhendong Liu , Yicheng Fu , Yichun Feng , Kin-Man Lam

Adversarial attacks have been fairly explored for computer vision and vision-language models. However, the avenue of adversarial attack for the vision language segmentation models (VLSMs) is still under-explored, especially for medical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Anjila Budathoki , Manish Dhakal

With the rise in popularity of machine and deep learning models, there is an increased focus on their vulnerability to malicious inputs. These adversarial examples drift model predictions away from the original intent of the network and are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Richard Tran , David Patrick , Michael Geyer , Amanda Fernandez

It is widely accepted that medical imaging systems should be objectively assessed via task-based image quality (IQ) measures that ideally account for all sources of randomness in the measured image data, including the variation in the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xichen Xu , Wentao Chen , Weimin Zhou

Diffusion Probabilistic Models (DPMs) have emerged as a powerful class of deep generative models, achieving remarkable performance in image synthesis tasks. However, these models face challenges in terms of widespread adoption due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kidist Amde Mekonnen , Nicola Dall'Asen , Paolo Rota

With the rapid advancement of multimodal learning, pre-trained Vision-Language Models (VLMs) such as CLIP have demonstrated remarkable capacities in bridging the gap between visual and language modalities. However, these models remain…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiaming Zhang , Xingjun Ma , Xin Wang , Lingyu Qiu , Jiaqi Wang , Yu-Gang Jiang , Jitao Sang

Adversarial attacks in the input (pixel) space typically incorporate noise margins such as $L_1$ or $L_{\infty}$-norm to produce imperceptibly perturbed data that confound deep learning networks. Such noise margins confine the magnitude of…

Machine Learning · Computer Science 2023-04-11 Nitish Shukla , Sudipta Banerjee

Recently, detecting AI-generated images produced by diffusion-based models has attracted increasing attention due to their potential threat to safety. Among existing approaches, reconstruction-based methods have emerged as a prominent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Haoyang Jiang , Mingyang Yi , Shaolei Zhang , Junxian Cai , Qingbin Liu , Xi Chen , Ju Fan

The purpose of this work is to contribute to the state of the art of deep-learning methods for diffeomorphic registration. We propose an adversarial learning LDDMM method for pairs of 3D mono-modal images based on Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Ubaldo Ramon , Monica Hernandez , Elvira Mayordomo

Adversarial training for LLMs is one of the most promising methods to reliably improve robustness against adversaries. However, despite significant progress, models remain vulnerable to simple in-distribution exploits, such as rewriting…

Machine Learning · Computer Science 2026-02-19 Chengzhi Hu , Jonas Dornbusch , David Lüdke , Stephan Günnemann , Leo Schwinn

Generating adversarial examples is the art of creating a noise that is added to an input signal of a classifying neural network, and thus changing the network's classification, while keeping the noise as tenuous as possible. While the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Roee Ben-Shlomo , Yevgeniy Men , Ido Imanuel

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ…

Machine Learning · Computer Science 2023-10-03 Quang H. Nguyen , Yingjie Lao , Tung Pham , Kok-Seng Wong , Khoa D. Doan

Attacking Neural Machine Translation models is an inherently combinatorial task on discrete sequences, solved with approximate heuristics. Most methods use the gradient to attack the model on each sample independently. Instead of…

Computation and Language · Computer Science 2021-09-02 Badr Youbi Idrissi , Stéphane Clinchant

We answer the question in the title, showing that adversarial training (AT) for diffusion models (DMs) fundamentally differs from classifiers: while AT in classifiers enforces output invariance, AT in DMs requires equivariance to keep the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Briglia Maria Rosaria , Mujtaba Hussain Mirza , Giuseppe Lisanti , Iacopo Masi

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

Deep neural networks (DNNs) have achieved excellent performance on several tasks and have been widely applied in both academia and industry. However, DNNs are vulnerable to adversarial machine learning attacks, in which noise is added to…

Machine Learning · Computer Science 2020-01-01 Huy H. Nguyen , Minoru Kuribayashi , Junichi Yamagishi , Isao Echizen

Deep neural networks have been demonstrated to be vulnerable to adversarial attacks, where small perturbations intentionally added to the original inputs can fool the classifier. In this paper, we propose a defense method, Featurized…

Machine Learning · Computer Science 2018-10-02 Ruying Bao , Sihang Liang , Qingcan Wang