English
Related papers

Related papers: Multi-Stream Perturbation Attack: Breaking Safety …

200 papers

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks. Nevertheless, they still pose notable safety risks due to potential misuse for malicious purposes. Jailbreaking, which seeks to induce models to…

Computation and Language · Computer Science 2025-09-30 Hua Tang , Lingyong Yan , Yukun Zhao , Shuaiqiang Wang , Jizhou Huang , Dawei Yin

As deep learning advances, Large Language Models (LLMs) and their multimodal counterparts, Multimodal Large Language Models (MLLMs), have shown exceptional performance in many real-world tasks. However, MLLMs face significant security…

Cryptography and Security · Computer Science 2024-10-23 Fenghua Weng , Yue Xu , Chengyan Fu , Wenjie Wang

While reasoning large language models (LLMs) demonstrate remarkable performance across various tasks, they also contain notable security vulnerabilities. Recent research has uncovered a "thinking-stopped" vulnerability in DeepSeek-R1, where…

Cryptography and Security · Computer Science 2025-04-30 Yu Cui , Yujun Cai , Yiwei Wang

Jailbreak attacks pose a serious threat to the safety of Large Language Models (LLMs) by crafting adversarial prompts that bypass alignment mechanisms, causing the models to produce harmful, restricted, or biased content. In this paper, we…

Machine Learning · Computer Science 2025-08-22 Xiangman Li , Xiaodong Wu , Qi Li , Jianbing Ni , Rongxing Lu

Multimodal large language models (MLLMs) have become integral to a wide range of real-world applications by jointly reasoning over text and visual inputs. However, despite recent advances in safety alignment, MLLMs remain vulnerable to…

Cryptography and Security · Computer Science 2026-03-10 Xinkai Wang , Beibei Li , Zerui Shao , Ao Liu , Guangquan Xu , Shouling Ji

A plethora of jailbreaking attacks have been proposed to obtain harmful responses from safety-tuned LLMs. These methods largely succeed in coercing the target output in their original settings, but their attacks vary substantially in…

Machine Learning · Computer Science 2025-06-12 Valentyn Boreiko , Alexander Panfilov , Vaclav Voracek , Matthias Hein , Jonas Geiping

Reasoning-enhanced large language models (LLMs) explicitly generate intermediate reasoning steps prior to generating final answers, helping the model excel in complex problem-solving. In this paper, we demonstrate that this emerging…

Machine Learning · Computer Science 2025-05-22 Tong Wu , Chong Xiang , Jiachen T. Wang , G. Edward Suh , Prateek Mittal

Large language models (LLMs) have significantly enhanced the performance of numerous applications, from intelligent conversations to text generation. However, their inherent security vulnerabilities have become an increasingly significant…

Computation and Language · Computer Science 2024-08-12 Xiongtao Sun , Deyue Zhang , Dongdong Yang , Quanchen Zou , Hui Li

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

Cryptography and Security · Computer Science 2024-12-03 Erick Galinkin , Martin Sablotny

The rapid development of Multimodal Large Reasoning Models (MLRMs) has demonstrated broad application potential, yet their safety and reliability remain critical concerns that require systematic exploration. To address this gap, we conduct…

Computation and Language · Computer Science 2025-10-14 Xinyue Lou , You Li , Jinan Xu , Xiangyu Shi , Chi Chen , Kaiyu Huang

In deployment and application, large language models (LLMs) typically undergo safety alignment to prevent illegal and unethical outputs. However, the continuous advancement of jailbreak attack techniques, designed to bypass safety…

Cryptography and Security · Computer Science 2025-09-05 Chuhan Zhang , Ye Zhang , Bowen Shi , Yuyou Gan , Tianyu Du , Shouling Ji , Dazhan Deng , Yingcai Wu

Although large language models (LLMs) have achieved remarkable advancements, their security remains a pressing concern. One major threat is jailbreak attacks, where adversarial prompts bypass model safeguards to generate harmful or…

Cryptography and Security · Computer Science 2025-05-21 Tiehan Cui , Yanxu Mao , Peipei Liu , Congying Liu , Datao You

Large Language Models (LLMs) face a significant threat from multi-turn jailbreak attacks, where adversaries progressively steer conversations to elicit harmful outputs. However, the practical effectiveness of existing attacks is undermined…

Cryptography and Security · Computer Science 2026-01-12 Songze Li , Ruishi He , Xiaojun Jia , Jun Wang , Zhihui Fu

The widespread deployment of large language models (LLMs) has raised growing concerns about their misuse risks and associated safety issues. While prior studies have examined the safety of LLMs in general usage, code generation, and…

Cryptography and Security · Computer Science 2026-01-05 Haoran Gu , Handing Wang , Yi Mei , Mengjie Zhang , Yaochu Jin

Batch prompting, which combines a batch of multiple queries sharing the same context in one inference, has emerged as a promising solution to reduce inference costs. However, our study reveals a significant security vulnerability in batch…

Cryptography and Security · Computer Science 2025-06-23 Murong Yue , Ziyu Yao

Large Language Models (LLMs) have revolutionized natural language processing but remain vulnerable to jailbreak attacks, especially multi-turn jailbreaks that distribute malicious intent across benign exchanges and bypass alignment…

Cryptography and Security · Computer Science 2025-10-22 Javad Rafiei Asl , Sidhant Narula , Mohammad Ghasemigol , Eduardo Blanco , Daniel Takabi

The rapid progress of Large Language Models (LLMs) has opened up new opportunities across various domains and applications; yet it also presents challenges related to potential misuse. To mitigate such risks, red teaming has been employed…

Cryptography and Security · Computer Science 2025-06-10 Yifan Jiang , Kriti Aggarwal , Tanmay Laud , Kashif Munir , Jay Pujara , Subhabrata Mukherjee

In recent years, the security vulnerabilities of Multi-modal Large Language Models (MLLMs) have become a serious concern in the Generative Artificial Intelligence (GenAI) research. These highly intelligent models, capable of performing…

Cryptography and Security · Computer Science 2026-01-12 Badhan Chandra Das , Md Tasnim Jawad , Joaquin Molto , M. Hadi Amini , Yanzhao Wu

Large Language Models (LLMs) have performed exceptionally in various text-generative tasks, including question answering, translation, code completion, etc. However, the over-assistance of LLMs has raised the challenge of "jailbreaking",…

Cryptography and Security · Computer Science 2024-09-02 Sibo Yi , Yule Liu , Zhen Sun , Tianshuo Cong , Xinlei He , Jiaxing Song , Ke Xu , Qi Li

Large Reasoning Models (LRMs) have significantly advanced beyond traditional Large Language Models (LLMs) with their exceptional logical reasoning capabilities, yet these improvements introduce heightened safety risks. When subjected to…

Cryptography and Security · Computer Science 2025-06-04 Yang Yao , Xuan Tong , Ruofan Wang , Yixu Wang , Lujundong Li , Liang Liu , Yan Teng , Yingchun Wang