中文
相关论文

相关论文: Response Attack: Exploiting Contextual Priming to …

200 篇论文

Large Language Models (LLMs) are susceptible to Jailbreaking attacks, which aim to extract harmful information by subtly modifying the attack query. As defense mechanisms evolve, directly obtaining harmful information becomes increasingly…

机器学习 · 计算机科学 2024-10-03 Yixin Cheng , Markos Georgopoulos , Volkan Cevher , Grigorios G. Chrysos

Large language models (LLMs) excel in various tasks but remain vulnerable to jailbreak attacks, where adversaries manipulate prompts to generate harmful outputs. Examining jailbreak prompts helps uncover the shortcomings of LLMs. However,…

计算与语言 · 计算机科学 2024-12-18 Weixiong Zheng , Peijian Zeng , Yiwei Li , Hongyan Wu , Nankai Lin , Junhao Chen , Aimin Yang , Yongmei Zhou

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

Large language models (LLMs) have demonstrated significant utility in a wide range of applications; however, their deployment is plagued by security vulnerabilities, notably jailbreak attacks. These attacks manipulate LLMs to generate…

计算与语言 · 计算机科学 2025-03-12 Wenlong Meng , Fan Zhang , Wendao Yao , Zhenyuan Guo , Yuwei Li , Chengkun Wei , Wenzhi Chen

While Large Language Models (LLMs) have shown significant advancements in performance, various jailbreak attacks have posed growing safety and ethical risks. Malicious users often exploit adversarial context to deceive LLMs, prompting them…

密码学与安全 · 计算机科学 2025-08-15 Jinhwa Kim , Ian G. Harris

Jailbreaking large language models (LLMs) has emerged as a critical security challenge with the widespread deployment of conversational AI systems. Adversarial users exploit these models through carefully crafted prompts to elicit…

密码学与安全 · 计算机科学 2026-02-23 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

Large Language Models face security threats from jailbreak attacks. Existing research has predominantly focused on prompt-level attacks while largely ignoring the underexplored attack surface of user-controlled response prefilling. This…

密码学与安全 · 计算机科学 2025-08-27 Yakai Li , Jiekang Hu , Weiduan Sang , Luping Ma , Dongsheng Nie , Weijuan Zhang , Aimin Yu , Yi Su , Qingjia Huang , Qihang Zhou

Large language models (LLMs) have significantly enhanced the performance of numerous applications, from intelligent conversations to text generation. However, their inherent security vulnerabilities have become an increasingly significant…

计算与语言 · 计算机科学 2024-08-12 Xiongtao Sun , Deyue Zhang , Dongdong Yang , Quanchen Zou , Hui Li

Large Language Models (LLMs) remain susceptible to jailbreak exploits that bypass safety filters and induce harmful or unethical behavior. This work presents a systematic taxonomy of existing jailbreak defenses across prompt-level,…

密码学与安全 · 计算机科学 2025-11-25 Ryan Wong , Hosea David Yu Fei Ng , Dhananjai Sharma , Glenn Jun Jie Ng , Kavishvaran Srinivasan

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

密码学与安全 · 计算机科学 2024-12-03 Erick Galinkin , Martin Sablotny

Large Reasoning Models (LRMs) have demonstrated strong capabilities in generating step-by-step reasoning chains alongside final answers, enabling their deployment in high-stakes domains such as healthcare and education. While prior…

机器学习 · 计算机科学 2026-04-20 Zehao Wang , Lanjun Wang

Large language models (LLMs) remain vulnerable to jailbreak attacks that bypass safety alignment and elicit harmful responses. A growing body of work shows that contextual priming, where earlier turns covertly bias later replies,…

计算与语言 · 计算机科学 2026-05-05 Mario Rodríguez Béjar , Francisco J. Cortés-Delgado , S. Braghin , Jose L. Hernández-Ramos

Large Language Models (LLMs) are known to be vulnerable to jailbreaking attacks, wherein adversaries exploit carefully engineered prompts to induce harmful or unethical responses. Such threats have raised critical concerns about the safety…

密码学与安全 · 计算机科学 2025-05-22 Taiye Chen , Zeming Wei , Ang Li , Yisen Wang

Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling applications across fields beyond healthcare, software engineering, and conversational systems.…

As the integration of the Large Language Models (LLMs) into various applications increases, so does their susceptibility to misuse, raising significant security concerns. Numerous jailbreak attacks have been proposed to assess the security…

密码学与安全 · 计算机科学 2025-05-30 Bijoy Ahmed Saiem , MD Sadik Hossain Shanto , Rakib Ahsan , Md Rafi ur Rashid

Jailbreak attacks represent one of the most sophisticated threats to the security of large language models (LLMs). To deal with such risks, we introduce an innovative framework that can help evaluate the effectiveness of jailbreak attacks…

计算与语言 · 计算机科学 2025-03-19 Dong Shu , Chong Zhang , Mingyu Jin , Zihao Zhou , Lingyao Li , Yongfeng Zhang

Large Language Models (LLMs) are widely deployed in diverse real-world settings, yet remain vulnerable to jailbreaking, where prompt-based attacks bypass safety filters. We present THREAT (Targeted Harmful generation via Reframing and…

密码学与安全 · 计算机科学 2026-05-22 Shahnewaz Karim Sakib , Swati Kar , Anindya Bijoy Das

Jailbreak vulnerabilities in Large Language Models (LLMs) refer to methods that extract malicious content from the model by carefully crafting prompts or suffixes, which has garnered significant attention from the research community.…

密码学与安全 · 计算机科学 2024-09-13 Lijia Lv , Weigang Zhang , Xuehai Tang , Jie Wen , Feng Liu , Jizhong Han , Songlin Hu

Despite explicit alignment efforts for large language models (LLMs), they can still be exploited to trigger unintended behaviors, a phenomenon known as "jailbreaking." Current jailbreak attack methods mainly focus on discrete prompt…

密码学与安全 · 计算机科学 2025-02-18 Guanghao Zhou , Panjia Qiu , Mingyuan Fan , Cen Chen , Mingyuan Chu , Xin Zhang , Jun Zhou

Large Language Models (LLMs) have become increasingly popular for their advanced text generation capabilities across various domains. However, like any software, they face security challenges, including the risk of 'jailbreak' attacks that…

密码学与安全 · 计算机科学 2024-01-31 Jie Li , Yi Liu , Chongyang Liu , Ling Shi , Xiaoning Ren , Yaowen Zheng , Yang Liu , Yinxing Xue
‹ 上一页 1 2 3 10 下一页 ›