中文
相关论文

相关论文: DETAM: Defending LLMs Against Jailbreak Attacks vi…

200 篇论文

Recent advances in large language models (LLMs) have demonstrated remarkable potential in the field of natural language processing. Unfortunately, LLMs face significant security and ethical risks. Although techniques such as safety…

密码学与安全 · 计算机科学 2025-05-27 Qingsong Zou , Jingyu Xiao , Qing Li , Zhi Yan , Yuhang Wang , Li Xu , Wenxuan Wang , Kuofeng Gao , Ruoyu Li , Yong Jiang

The widespread adoption of Large Language Models (LLMs), exemplified by OpenAI's ChatGPT, brings to the forefront the imperative to defend against adversarial threats on these models. These attacks, which manipulate an LLM's output by…

密码学与安全 · 计算机科学 2025-04-04 Amelia Kawasaki , Andrew Davis , Houssam Abbas

Jailbreak attacks to Large audio-language models (LALMs) are studied recently, but they exclusively focused on the attack scenario where the adversary can fully manipulate user prompts (named strong adversary) and limited in effectiveness,…

密码学与安全 · 计算机科学 2026-02-04 Guangke Chen , Fu Song , Zhe Zhao , Xiaojun Jia , Yang Liu , Yanchen Qiao , Weizhe Zhang , Weiping Tu , Yuhong Yang , Bo Du

Large Language Models (LLMs) have increasingly become pivotal in content generation with notable societal impact. These models hold the potential to generate content that could be deemed harmful.Efforts to mitigate this risk include…

计算与语言 · 计算机科学 2024-08-20 Kexin Chen , Yi Liu , Dongxia Wang , Jiaying Chen , Wenhai Wang

Large language models (LLMs) have revolutionized artificial intelligence, but their increasing deployment across critical domains has raised concerns about their abnormal behaviors when faced with malicious attacks. Such vulnerability…

软件工程 · 计算机科学 2025-04-02 Shide Zhou , Tianlin Li , Kailong Wang , Yihao Huang , Ling Shi , Yang Liu , Haoyu Wang

Large Language Models (LLMs) are vulnerable to adversarial attacks that bypass safety guidelines and generate harmful content. Mitigating these vulnerabilities requires defense mechanisms that are both robust and computationally efficient.…

机器学习 · 计算机科学 2025-11-18 Gil Goren , Shahar Katz , Lior Wolf

Large Language Models (LLMs) rapidly reshape modern life, advancing fields from healthcare to education and beyond. However, alongside their remarkable capabilities lies a significant threat: the susceptibility of these models to…

计算与语言 · 计算机科学 2025-05-16 Michael Fire , Yitzhak Elbazis , Adi Wasenstein , Lior Rokach

While Large Language Models (LLMs) have achieved tremendous success in various applications, they are also susceptible to jailbreaking attacks. Several primary defense strategies have been proposed to protect LLMs from producing harmful…

机器学习 · 计算机科学 2024-11-01 Yichuan Mo , Yuji Wang , Zeming Wei , Yisen Wang

While Large Language Models (LLMs) have shown significant advancements in performance, various jailbreak attacks have posed growing safety and ethical risks. Malicious users often exploit adversarial context to deceive LLMs, prompting them…

密码学与安全 · 计算机科学 2025-08-15 Jinhwa Kim , Ian G. Harris

Despite their superb capabilities, Vision-Language Models (VLMs) have been shown to be vulnerable to jailbreak attacks. While recent jailbreaks have achieved notable progress, their effectiveness and efficiency can still be improved. In…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Yunhan Zhao , Xiang Zheng , Xingjun Ma

Speech Language Models (SLMs) enable natural interactions via spoken instructions, which more effectively capture user intent by detecting nuances in speech. The richer speech signal introduces new security risks compared to text-based…

音频与语音处理 · 电气工程与系统科学 2025-10-17 Amirbek Djanibekov , Nurdaulet Mukhituly , Kentaro Inui , Hanan Aldarmaki , Nils Lukas

Large Language Models (LLMs) have achieved remarkable success but remain highly susceptible to jailbreak attacks, in which adversarial prompts coerce models into generating harmful, unethical, or policy-violating outputs. Such attacks pose…

Large Language Models (LLMs) have evolved into Multimodal Large Language Models (MLLMs), significantly enhancing their capabilities by integrating visual information and other types, thus aligning more closely with the nature of human…

密码学与安全 · 计算机科学 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Jing Liu , Hanwang Zhang , Richang Hong

Large Language Models (LLMs) have achieved impressive performance across diverse natural language processing tasks, but their growing power also amplifies potential risks such as jailbreak attacks that circumvent built-in safety mechanisms.…

人工智能 · 计算机科学 2025-10-01 Qinjian Zhao , Jiaqi Wang , Zhiqiang Gao , Zhihao Dou , Belal Abuhaija , Kaizhu Huang

Jailbreaks have been a central focus of research regarding the safety and reliability of large language models (LLMs), yet the mechanisms underlying these attacks remain poorly understood. While previous studies have predominantly relied on…

密码学与安全 · 计算机科学 2025-11-04 Nathalie Kirch , Constantin Weisser , Severin Field , Helen Yannakoudakis , Stephen Casper

Large Language Models (LLMs) remain vulnerable to jailbreak attacks, which attempt to elicit harmful responses from LLMs. The evolving nature and diversity of these attacks pose many challenges for defense systems, including (1) adaptation…

密码学与安全 · 计算机科学 2025-11-04 Guangyu Yang , Jinghong Chen , Jingbiao Mei , Weizhe Lin , Bill Byrne

Recent advancements in Large Language Model (LLM) safety have primarily focused on mitigating attacks crafted in natural language or common ciphers (e.g. Base64), which are likely integrated into newer models' safety training. However, we…

计算与语言 · 计算机科学 2025-10-15 Divij Handa , Zehua Zhang , Amir Saeidi , Shrinidhi Kumbhar , Md Nayem Uddin , Aswin RRV , Chitta Baral

Ensuring safety alignment is a critical requirement for large language models (LLMs), particularly given increasing deployment in real-world applications. Despite considerable advancements, LLMs remain susceptible to jailbreak attacks,…

密码学与安全 · 计算机科学 2025-06-02 Xin Yi , Yue Li , Dongsheng Shi , Linlin Wang , Xiaoling Wang , Liang He

Large Language Models (LLMs) have gained significant traction in various applications, yet their capabilities present risks for both constructive and malicious exploitation. Despite extensive training and fine-tuning efforts aimed at…

机器学习 · 计算机科学 2025-10-15 Zixuan Huang , Kecheng Huang , Lihao Yin , Bowei He , Huiling Zhen , Mingxuan Yuan , Zili Shao

Extensive efforts have been made before the public release of Large language models (LLMs) to align their behaviors with human values. However, even meticulously aligned LLMs remain vulnerable to malicious manipulations such as…

密码学与安全 · 计算机科学 2024-10-01 Zeguan Xiao , Yan Yang , Guanhua Chen , Yun Chen