English
Related papers

Related papers: Effective and Efficient Jailbreaks of Black-Box LL…

200 papers

As large language models (LLMs) grow in power and influence, ensuring their safety and preventing harmful output becomes critical. Automated red teaming serves as a tool to detect security vulnerabilities in LLMs without manual labor.…

Artificial Intelligence · Computer Science 2025-06-03 Weiyang Guo , Zesheng Shi , Zhuo Li , Yequan Wang , Xuebo Liu , Wenya Wang , Fangming Liu , Min Zhang , Jing Li

Large language models (LLMs) have seen rapid development in recent years, revolutionizing various applications and significantly enhancing convenience and productivity. However, alongside their impressive capabilities, ethical concerns and…

Computation and Language · Computer Science 2025-02-04 Yu-Ling Hsu , Hsuan Su , Shang-Tse Chen

The widespread applications of large language models (LLMs) have brought about concerns regarding their potential misuse. Although aligned with human preference data before release, LLMs remain vulnerable to various malicious attacks. In…

Cryptography and Security · Computer Science 2025-03-04 Yan Yang , Zeguan Xiao , Xin Lu , Hongru Wang , Xuetao Wei , Hailiang Huang , Guanhua Chen , Yun Chen

As Large Language Models (LLMs) are increasingly used, their security risks have drawn increasing attention. Existing research reveals that LLMs are highly susceptible to jailbreak attacks, with effectiveness varying across language…

Artificial Intelligence · Computer Science 2026-03-25 Xun Huang , Simeng Qin , Xiaoshuang Jia , Ranjie Duan , Huanqian Yan , Zhitao Zeng , Fei Yang , Yang Liu , Xiaojun Jia

Large Language Models (LLMs) have exhibited remarkable capabilities but remain vulnerable to jailbreaking attacks, which can elicit harmful content from the models by manipulating the input prompts. Existing black-box jailbreaking…

Cryptography and Security · Computer Science 2025-08-19 Weiwei Qi , Shuo Shao , Wei Gu , Tianhang Zheng , Puning Zhao , Zhan Qin , Kui Ren

Jailbreaks have been a central focus of research regarding the safety and reliability of large language models (LLMs), yet the mechanisms underlying these attacks remain poorly understood. While previous studies have predominantly relied on…

Cryptography and Security · Computer Science 2025-11-04 Nathalie Kirch , Constantin Weisser , Severin Field , Helen Yannakoudakis , Stephen Casper

Ensuring the safety and alignment of large language models (LLMs) with human values is crucial for generating responses that are beneficial to humanity. While LLMs have the capability to identify and avoid harmful queries, they remain…

Computation and Language · Computer Science 2024-10-22 Yihua Zhou , Xiaochuan Shi

Multimodal large language models (MLLMs) have become integral to a wide range of real-world applications by jointly reasoning over text and visual inputs. However, despite recent advances in safety alignment, MLLMs remain vulnerable to…

Cryptography and Security · Computer Science 2026-03-10 Xinkai Wang , Beibei Li , Zerui Shao , Ao Liu , Guangquan Xu , Shouling Ji

Large language models (LLMs) undergo safety alignment after training and tuning, yet recent work shows that safety can be bypassed through jailbreak attacks. While many jailbreaks and defenses exist, their cross-lingual generalization…

Computation and Language · Computer Science 2025-11-05 Berk Atil , Rebecca J. Passonneau , Fred Morstatter

Large language models (LLMs) have exhibited outstanding performance in engaging with humans and addressing complex questions by leveraging their vast implicit knowledge and robust reasoning capabilities. However, such models are vulnerable…

Computation and Language · Computer Science 2024-10-16 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from LLMs, even after…

Computation and Language · Computer Science 2024-03-01 Nan Xu , Fei Wang , Ben Zhou , Bang Zheng Li , Chaowei Xiao , Muhao Chen

Large Language Models (LLMs) have revolutionized Artificial Intelligence (AI) services due to their exceptional proficiency in understanding and generating human-like text. LLM chatbots, in particular, have seen widespread adoption,…

Cryptography and Security · Computer Science 2024-02-14 Gelei Deng , Yi Liu , Yuekang Li , Kailong Wang , Ying Zhang , Zefeng Li , Haoyu Wang , Tianwei Zhang , Yang Liu

Large language models (LLMs) remain vulnerable to jailbreak attacks that bypass safety alignment and elicit harmful responses. A growing body of work shows that contextual priming, where earlier turns covertly bias later replies,…

Computation and Language · Computer Science 2026-05-05 Mario Rodríguez Béjar , Francisco J. Cortés-Delgado , S. Braghin , Jose L. Hernández-Ramos

Large Language Models (LLMs), especially their compact efficiency-oriented variants, remain susceptible to jailbreak attacks that can elicit harmful outputs despite extensive alignment efforts. Existing adversarial prompt generation…

Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents. Although there are diverse jailbreak attack strategies, there is no unified understanding on why some…

Computation and Language · Computer Science 2024-12-04 Yuping Lin , Pengfei He , Han Xu , Yue Xing , Makoto Yamada , Hui Liu , Jiliang Tang

Large language models (LLMs) have achieved impressive performance across natural language tasks and are increasingly deployed in real-world applications. Despite extensive safety alignment efforts, recent studies show that such alignment is…

Artificial Intelligence · Computer Science 2026-02-02 Yinzhi Zhao , Ming Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

Although large language models (LLMs) demonstrate impressive proficiency in various tasks, they present potential safety risks, such as `jailbreaks', where malicious inputs can coerce LLMs into generating harmful content bypassing safety…

Computation and Language · Computer Science 2025-11-26 Isack Lee , Haebin Seong

Jailbreaking in Large Language Models (LLMs) is a major security concern as it can deceive LLMs to generate harmful text. Yet, there is still insufficient understanding of how jailbreaking works, which makes it hard to develop effective…

Computation and Language · Computer Science 2025-05-22 Lang Gao , Jiahui Geng , Xiangliang Zhang , Preslav Nakov , Xiuying Chen

Jailbreaking is an emerging adversarial attack that bypasses the safety alignment deployed in off-the-shelf large language models (LLMs) and has evolved into multiple categories: human-based, optimization-based, generation-based, and the…

Cryptography and Security · Computer Science 2025-02-06 Xunguang Wang , Daoyuan Wu , Zhenlan Ji , Zongjie Li , Pingchuan Ma , Shuai Wang , Yingjiu Li , Yang Liu , Ning Liu , Juergen Rahmel

Large Reasoning Models (LRMs) improve task performance through extended inference-time reasoning. Although previous studies suggest that longer reasoning should lead to more robust safety behavior, we find evidence to the contrary:…

Artificial Intelligence · Computer Science 2026-05-26 Jianli Zhao , Tingchen Fu , Rylan Schaeffer , Mrinank Sharma , Fazl Barez