中文
相关论文

相关论文: POEX: Towards Policy Executable Jailbreak Attacks …

200 篇论文

Despite extensive safety alignment efforts, large language models (LLMs) remain vulnerable to jailbreak attacks that elicit harmful behavior. While existing studies predominantly focus on attack methods that require technical expertise, two…

机器学习 · 计算机科学 2025-08-05 Yik Siu Chan , Narutatsu Ri , Yuxin Xiao , Marzyeh Ghassemi

Large Language Models (LLMs) have evolved into Multimodal Large Language Models (MLLMs), significantly enhancing their capabilities by integrating visual information and other types, thus aligning more closely with the nature of human…

密码学与安全 · 计算机科学 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Jing Liu , Hanwang Zhang , Richang Hong

The World Action Model (WAM) can jointly predict future world states and actions, exhibiting stronger physical manipulation capabilities compared with traditional models. Such powerful physical interaction ability is a double-edged sword:…

机器人学 · 计算机科学 2026-04-08 Hanqing Liu , Songping Wang , Jiahuan Long , Jiacheng Hou , Jialiang Sun , Chao Li , Yang Yang , Wei Peng , Xu Liu , Tingsong Jiang , Wen Yao , Yao Mu

With the growing deployment of LLMs in daily applications like chatbots and content generation, efforts to ensure outputs align with human values and avoid harmful content have intensified. However, increasingly sophisticated jailbreak…

密码学与安全 · 计算机科学 2025-06-10 Cheng Qian , Hainan Zhang , Lei Sha , Zhiming Zheng

As Large Language Models (LLMs) are increasingly being deployed in safety-critical applications, their vulnerability to potential jailbreaks -- malicious prompts that can disable the safety mechanism of LLMs -- has attracted growing…

密码学与安全 · 计算机科学 2024-08-08 Jiahao Zhang , Zilong Wang , Ruofan Wang , Xingjun Ma , Yu-Gang Jiang

This paper proposes a jailbreaking prompt detection method for large language models (LLMs) to defend against jailbreak attacks. Although recent LLMs are equipped with built-in safeguards, it remains possible to craft jailbreaking prompts…

密码学与安全 · 计算机科学 2026-05-12 Zheng Lin , Zhenxing Niu , Haoxuan Ji , Yuzhe Huang , Haichang Gao

Large Language Models (LLMs) are increasingly used to control robotic systems such as drones, but their risks of causing physical threats and harm in real-world applications remain unexplored. Our study addresses the critical gap in…

机器学习 · 计算机科学 2026-02-20 Yung-Chen Tang , Pin-Yu Chen , Tsung-Yi Ho

The integration of Large Language Models (LLMs) like GPT-4o into robotic systems represents a significant advancement in embodied artificial intelligence. These models can process multi-modal prompts, enabling them to generate more…

机器人学 · 计算机科学 2024-09-10 Wenxiao Zhang , Xiangrui Kong , Conan Dewitt , Thomas Braunl , Jin B. Hong

The increasing sophistication of large vision-language models (LVLMs) has been accompanied by advances in safety alignment mechanisms designed to prevent harmful content generation. However, these defenses remain vulnerable to sophisticated…

密码学与安全 · 计算机科学 2026-04-09 Quanchen Zou , Zonghao Ying , Moyang Chen , Wenzhuo Xu , Yisong Xiao , Yakai Li , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

Jailbreak backdoor attacks on LLMs have garnered attention for their effectiveness and stealth. However, existing methods rely on the crafting of poisoned datasets and the time-consuming process of fine-tuning. In this work, we propose…

密码学与安全 · 计算机科学 2025-02-18 Zhuowei Chen , Qiannan Zhang , Shichao Pei

Ensuring the safety and alignment of large language models (LLMs) with human values is crucial for generating responses that are beneficial to humanity. While LLMs have the capability to identify and avoid harmful queries, they remain…

计算与语言 · 计算机科学 2024-10-22 Yihua Zhou , Xiaochuan Shi

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

计算与语言 · 计算机科学 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

In recent years, Large Language Models (LLMs) have gained widespread use, raising concerns about their security. Traditional jailbreak attacks, which often rely on the model internal information or have limitations when exploring the unsafe…

密码学与安全 · 计算机科学 2024-10-04 Zhihao Lin , Wei Ma , Mingyi Zhou , Yanjie Zhao , Haoyu Wang , Yang Liu , Jun Wang , Li Li

Large Language Models (LLMs) are known to be vulnerable to jailbreaking attacks, wherein adversaries exploit carefully engineered prompts to induce harmful or unethical responses. Such threats have raised critical concerns about the safety…

密码学与安全 · 计算机科学 2025-05-22 Taiye Chen , Zeming Wei , Ang Li , Yisen Wang

Large Language Models (LLMs) excel in various domains but pose inherent privacy risks. Existing methods to evaluate privacy leakage in LLMs often use memorized prefixes or simple instructions to extract data, both of which well-alignment…

密码学与安全 · 计算机科学 2025-05-19 Yidan Wang , Yanan Cao , Yubing Ren , Fang Fang , Zheng Lin , Binxing Fang

Research on the safety evaluation of large language models (LLMs) has become extensive, driven by jailbreak studies that elicit unsafe responses. Such response involves information already available to humans, such as the answer to "how to…

密码学与安全 · 计算机科学 2025-12-23 Yu Cui , Yifei Liu , Hang Fu , Sicheng Pan , Haibin Zhang , Cong Zuo , Licheng Wang

As large language models (LLMs) grow more capable, they face growing vulnerability to sophisticated jailbreak attacks. While developers invest heavily in alignment finetuning and safety guardrails, researchers continue publishing novel…

密码学与安全 · 计算机科学 2025-08-14 Boyuan Chen , Minghao Shao , Abdul Basit , Siddharth Garg , Muhammad Shafique

LLM-enabled applications are rapidly reshaping the software ecosystem by using large language models as core reasoning components for complex task execution. This paradigm shift, however, introduces fundamentally new reliability challenges…

密码学与安全 · 计算机科学 2026-02-24 Yedi Zhang , Haoyu Wang , Xianglin Yang , Jin Song Dong , Jun Sun

The availability of Large Language Models (LLMs) has led to a new generation of powerful chatbots that can be developed at relatively low cost. As companies deploy these tools, security challenges need to be addressed to prevent financial…

密码学与安全 · 计算机科学 2026-01-12 Ahmad Alobaid , Martí Jordà Roca , Carlos Castillo , Joan Vendrell

With the development of natural language processing (NLP), large language models (LLMs) are becoming increasingly popular. LLMs are integrating more into everyday life, raising public concerns about their security vulnerabilities.…

计算与语言 · 计算机科学 2024-06-27 Ziqiu Wang , Jun Liu , Shengkai Zhang , Yang Yang