English
Related papers

Related papers: Re-Mask and Redirect: Exploiting Denoising Irrever…

200 papers

Masked Diffusion Language Models (MDLMs) enable parallel token decoding, providing a promising alternative to the sequential nature of autoregressive generation. However, their iterative denoising process remains computationally expensive…

Computation and Language · Computer Science 2026-03-10 Younjoo Lee , Junghoo Lee , Seungkyun Dan , Jaiyoung Park , Jung Ho Ahn

Recent research has shown that Large Language Models (LLMs) are vulnerable to automated jailbreak attacks, where adversarial suffixes crafted by algorithms appended to harmful queries bypass safety alignment and trigger unintended…

Computation and Language · Computer Science 2025-11-10 Chung-En Sun , Xiaodong Liu , Weiwei Yang , Tsui-Wei Weng , Hao Cheng , Aidan San , Michel Galley , Jianfeng Gao

Diffusion Language Models (DLMs) have emerged as a compelling alternative to autoregressive approaches, enabling parallel text generation with competitive performance. Despite these advantages, there is a critical instability in DLMs: the…

Computation and Language · Computer Science 2026-02-24 Zihou Zhang , Zheyong Xie , Li Zhong , Haifeng Liu , Yao Hu , Shaosheng Cao

Existing training-time safety alignment techniques for large language models (LLMs) remain vulnerable to jailbreak attacks. Direct preference optimization (DPO), a widely deployed alignment method, exhibits limitations in both experimental…

Computation and Language · Computer Science 2025-10-31 Xuandong Zhao , Will Cai , Tianneng Shi , David Huang , Licong Lin , Song Mei , Dawn Song

A fundamental issue in deep learning has been adversarial robustness. As these systems have scaled, such issues have persisted. Currently, large language models (LLMs) with billions of parameters suffer from adversarial attacks just like…

Machine Learning · Computer Science 2025-02-11 Brian Formento , Chuan Sheng Foo , See-Kiong Ng

Ensuring the safety alignment of Large Language Models (LLMs) is critical for generating responses consistent with human values. However, LLMs remain vulnerable to jailbreaking attacks, where carefully crafted prompts manipulate them into…

Computation and Language · Computer Science 2025-07-03 Yukai Zhou , Jian Lou , Zhijie Huang , Zhan Qin , Yibei Yang , Wenjie Wang

Many jailbreak attacks on large language models (LLMs) rely on a common objective: making the model respond with the prefix ``Sure, here is (harmful request)''. While straightforward, this objective has two limitations: limited control over…

Machine Learning · Computer Science 2025-12-30 Sicheng Zhu , Brandon Amos , Yuandong Tian , Chuan Guo , Ivan Evtimov

Large Language Models (LLMs) face threats from jailbreak prompts. Existing methods for defending against jailbreak attacks are primarily based on auxiliary models. These strategies, however, often require extensive data collection or…

Cryptography and Security · Computer Science 2025-11-21 Zhuoran Yang , Yanyong Zhang

Diffusion Large Language Models (dLLMs) are rapidly emerging alongside autoregressive models as a powerful paradigm for complex reasoning, with reinforcement learning increasingly used for downstream alignment. Existing trajectory-based RL…

Machine Learning · Computer Science 2025-11-20 Ranfei Chen , Ming Chen , Kaifei Wang

Large language model (LLM)-based embedding models, benefiting from large scale pre-training and post-training, have begun to surpass BERT and T5-based models on general-purpose text embedding tasks such as document retrieval. However, a…

Computation and Language · Computer Science 2025-05-22 Siyue Zhang , Yilun Zhao , Liyuan Geng , Arman Cohan , Anh Tuan Luu , Chen Zhao

Despite substantial investment in safety alignment, the vulnerability of large language models to sophisticated multi-turn adversarial attacks remains poorly characterized, and whether model scale or inference mode affects robustness is…

Computation and Language · Computer Science 2025-12-09 Richard Young

We present a controlled empirical comparison between autoregressive (AR) and masked diffusion (MDLM) language models. Both models are trained on identical data (50M tokens from TinyStories), identical compute budget (20,000 steps, batch…

Computation and Language · Computer Science 2026-03-24 Caio Vicentino

Although pre-trained language models (PrLMs) have achieved significant success, recent studies demonstrate that PrLMs are vulnerable to adversarial attacks. By generating adversarial examples with slight perturbations on different levels…

Computation and Language · Computer Science 2022-08-23 Jiayi Wang , Rongzhou Bao , Zhuosheng Zhang , Hai Zhao

Large language models (LLMs) have acquired the ability to handle longer context lengths and understand nuances in text, expanding their dialogue capabilities beyond a single utterance. A popular user-facing application of LLMs is the…

Computation and Language · Computer Science 2024-10-29 Terry Tong , Jiashu Xu , Qin Liu , Muhao Chen

As Large Language Models (LLMs) become integral to computing infrastructure, safety alignment serves as the primary security control preventing the generation of harmful payloads. However, this defense remains brittle. Existing jailbreak…

Cryptography and Security · Computer Science 2026-02-19 Mingrui Liu , Sixiao Zhang , Cheng Long , Kwok Yan Lam

The "reversal curse" refers to the phenomenon where large language models (LLMs) exhibit predominantly unidirectional behavior when processing logically bidirectional relationships. Prior work attributed this to autoregressive training --…

Computation and Language · Computer Science 2026-01-13 Shaokai He , Kaiwen Wei , Xinyi Zeng , Xiang Chen , Xue Yang , Zhenyang Li , Jiang Zhong , Yu Tian

Diffusion-based Large Language Models (D-LLMs) represent a promising frontier in generative AI, offering fully parallel token generation that can lead to significant throughput advantages and superior GPU utilization over the traditional…

Machine Learning · Computer Science 2026-05-15 Michael Rottoli , Subhankar Roy , Stefano Paraboschi

Diffusion large language models (dLLMs) generate text via iterative denoising but consistently underperform on multi-step reasoning. We hypothesize this gap stems from a coordination problem: AR models build coherence token-by-token, while…

Artificial Intelligence · Computer Science 2026-03-17 Earl J St Sauver

Large Language Models (LLMs) remain vulnerable to multi-turn jailbreak attacks. We introduce HarmNet, a modular framework comprising ThoughtNet, a hierarchical semantic network; a feedback-driven Simulator for iterative query refinement;…

Cryptography and Security · Computer Science 2025-10-22 Sidhant Narula , Javad Rafiei Asl , Mohammad Ghasemigol , Eduardo Blanco , Daniel Takabi

The safety alignment of current Large Language Models (LLMs) is vulnerable. Relatively simple attacks, or even benign fine-tuning, can jailbreak aligned models. We argue that many of these vulnerabilities are related to a shared underlying…

Cryptography and Security · Computer Science 2024-06-11 Xiangyu Qi , Ashwinee Panda , Kaifeng Lyu , Xiao Ma , Subhrajit Roy , Ahmad Beirami , Prateek Mittal , Peter Henderson