English

Diffusion LLMs are Natural Adversaries for any LLM

Machine Learning 2025-11-04 v1 Machine Learning

Abstract

We introduce a novel framework that transforms the resource-intensive (adversarial) prompt optimization problem into an \emph{efficient, amortized inference task}. Our core insight is that pretrained, non-autoregressive generative LLMs, such as Diffusion LLMs, which model the joint distribution over prompt-response pairs, can serve as powerful surrogates for prompt search. This approach enables the direct conditional generation of prompts, effectively replacing costly, per-instance discrete optimization with a small number of parallelizable samples. We provide a probabilistic analysis demonstrating that under mild fidelity assumptions, only a few conditional samples are required to recover high-reward (harmful) prompts. Empirically, we find that the generated prompts are low-perplexity, diverse jailbreaks that exhibit strong transferability to a wide range of black-box target models, including robustly trained and proprietary LLMs. Beyond adversarial prompting, our framework opens new directions for red teaming, automated prompt optimization, and leveraging emerging Flow- and Diffusion-based LLMs.

Keywords

Cite

@article{arxiv.2511.00203,
  title  = {Diffusion LLMs are Natural Adversaries for any LLM},
  author = {David Lüdke and Tom Wollschläger and Paul Ungermann and Stephan Günnemann and Leo Schwinn},
  journal= {arXiv preprint arXiv:2511.00203},
  year   = {2025}
}
R2 v1 2026-07-01T07:16:26.931Z