中文
相关论文

相关论文: POEX: Towards Policy Executable Jailbreak Attacks …

200 篇论文

The use of Large Language Models (LLMs) as automatic judges for code evaluation is becoming increasingly prevalent in academic environments. But their reliability can be compromised by students who may employ adversarial prompting…

软件工程 · 计算机科学 2026-02-04 Devanshu Sahoo , Vasudev Majhi , Arjun Neekhra , Yash Sinha , Murari Mandal , Dhruv Kumar

Despite substantial advancements in aligning large language models (LLMs) with human values, current safety mechanisms remain susceptible to jailbreak attacks. We hypothesize that this vulnerability stems from distributional discrepancies…

计算与语言 · 计算机科学 2026-04-27 Jingyu Peng , Maolin Wang , Nan Wang , Jiatong Li , Yuchen Li , Yuyang Ye , Wanyu Wang , Pengyue Jia , Kai Zhang , Xiangyu Zhao

The integration of large language models (LLMs) into robotic control pipelines enables natural language interfaces that translate user prompts into executable commands. However, this digital-to-physical interface introduces a critical and…

机器人学 · 计算机科学 2026-04-07 Mingyang Xie , Jin Wei-Kocsis

Jailbreak attacks reveal critical vulnerabilities in Large Language Models (LLMs) by causing them to generate harmful or unethical content. Evaluating these threats is particularly challenging due to the evolving nature of LLMs and the…

机器学习 · 计算机科学 2025-07-11 Peiyan Zhang , Haibo Jin , Liying Kang , Haohan Wang

The study of large language models (LLMs) is a key area in open-world machine learning. Although LLMs demonstrate remarkable natural language processing capabilities, they also face several challenges, including consistency issues,…

The jailbreak attack can bypass the safety measures of a Large Language Model (LLM), generating harmful content. This misuse of LLM has led to negative societal consequences. Currently, there are two main approaches to address jailbreak…

计算与语言 · 计算机科学 2024-03-25 Zezhong Wang , Fangkai Yang , Lu Wang , Pu Zhao , Hongru Wang , Liang Chen , Qingwei Lin , Kam-Fai Wong

Large Language Models (LLMs) remain susceptible to jailbreak exploits that bypass safety filters and induce harmful or unethical behavior. This work presents a systematic taxonomy of existing jailbreak defenses across prompt-level,…

密码学与安全 · 计算机科学 2025-11-25 Ryan Wong , Hosea David Yu Fei Ng , Dhananjai Sharma , Glenn Jun Jie Ng , Kavishvaran Srinivasan

As the use of large language models (LLMs) continues to expand, ensuring their safety and robustness has become a critical challenge. In particular, jailbreak attacks that bypass built-in safety mechanisms are increasingly recognized as a…

密码学与安全 · 计算机科学 2025-11-19 Hajun Kim , Hyunsik Na , Daeseon Choi

Recent explorations with commercial Large Language Models (LLMs) have shown that non-expert users can jailbreak LLMs by simply manipulating their prompts; resulting in degenerate output behavior, privacy and security breaches, offensive…

计算与语言 · 计算机科学 2024-03-28 Abhinav Rao , Sachin Vashistha , Atharva Naik , Somak Aditya , Monojit Choudhury

Multimodal large language models (MLLMs) have recently gained attention for their generalization and reasoning capabilities in Vision-and-Language Navigation (VLN) tasks, leading to the rise of MLLM-driven navigators. However, MLLMs are…

机器人学 · 计算机科学 2025-05-20 Wenqi Lyu , Zerui Li , Yanyuan Qiao , Qi Wu

While multimodal large language models (MLLMs) have achieved remarkable success in recent advancements, their susceptibility to jailbreak attacks has come to light. In such attacks, adversaries exploit carefully crafted prompts to coerce…

密码学与安全 · 计算机科学 2025-02-04 Ziyi Yin , Yuanpu Cao , Han Liu , Ting Wang , Jinghui Chen , Fenhlong Ma

The evolution of generative models from next-token predictors to autonomous engines of complex systems necessitates rigorous safety hardening. Adversarial jailbreaking, the strategic manipulation of models to elicit harmful output, remains…

机器学习 · 计算机科学 2026-05-11 Montaser Mohammedalamen , Kevin Roice , Reginald McLean , Alyssa Lefaivre Škopac

With the rapid advancement of large language models (LLMs), the safety of LLMs has become a critical concern. Despite significant efforts in safety alignment, current LLMs remain vulnerable to jailbreaking attacks. However, the root causes…

人工智能 · 计算机科学 2026-03-10 Yonghong Deng , Zhen Yang , Ping Jian , Xinyue Zhang , Zhongbin Guo , Chengzhi Li

Integrated Speech and Large Language Models (SLMs) that can follow speech instructions and generate relevant text responses have gained popularity lately. However, the safety and robustness of these models remains largely unclear. In this…

Modern large language model (LLM) developers typically conduct a safety alignment to prevent an LLM from generating unethical or harmful content. Recent studies have discovered that the safety alignment of LLMs can be bypassed by…

密码学与安全 · 计算机科学 2024-06-14 Xuan Chen , Yuzhou Nie , Lu Yan , Yunshu Mao , Wenbo Guo , Xiangyu Zhang

The rapid development of Large Language Models (LLMs) has brought impressive advancements across various tasks. However, despite these achievements, LLMs still pose inherent safety risks, especially in the context of jailbreak attacks. Most…

密码学与安全 · 计算机科学 2025-06-19 Shi Lin , Hongming Yang , Rongchang Li , Xun Wang , Changting Lin , Wenpeng Xing , Meng Han

Large Language Models (LLMS) have increasingly become central to generating content with potential societal impacts. Notably, these models have demonstrated capabilities for generating content that could be deemed harmful. To mitigate these…

密码学与安全 · 计算机科学 2024-05-20 Zihao Xu , Yi Liu , Gelei Deng , Yuekang Li , Stjepan Picek

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

计算与语言 · 计算机科学 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

Large language models (LLMs) have achieved remarkable capabilities but remain vulnerable to adversarial prompts known as jailbreaks, which can bypass safety alignment and elicit harmful outputs. Despite growing efforts in LLM safety…

密码学与安全 · 计算机科学 2025-05-27 Guobin Shen , Dongcheng Zhao , Linghao Feng , Xiang He , Jihang Wang , Sicheng Shen , Haibo Tong , Yiting Dong , Jindong Li , Xiang Zheng , Yi Zeng

The proliferation of Large Language Models (LLMs) has revolutionized natural language processing and significantly impacted code generation tasks, enhancing software development efficiency and productivity. Notably, LLMs like GPT-4 have…

软件工程 · 计算机科学 2025-03-25 Sheng Ouyang , Yihao Qin , Bo Lin , Liqian Chen , Xiaoguang Mao , Shangwen Wang