中文
相关论文

相关论文: Chain-of-Lure: A Universal Jailbreak Attack Framew…

200 篇论文

Jailbreak attacks on Language Model Models (LLMs) entail crafting prompts aimed at exploiting the models to generate malicious content. Existing jailbreak attacks can successfully deceive the LLMs, however they cannot deceive the human.…

密码学与安全 · 计算机科学 2024-04-18 Zhilong Wang , Yebo Cao , Peng Liu

Extensive efforts have been made before the public release of Large language models (LLMs) to align their behaviors with human values. However, even meticulously aligned LLMs remain vulnerable to malicious manipulations such as…

密码学与安全 · 计算机科学 2024-10-01 Zeguan Xiao , Yan Yang , Guanhua Chen , Yun Chen

As the integration of the Large Language Models (LLMs) into various applications increases, so does their susceptibility to misuse, raising significant security concerns. Numerous jailbreak attacks have been proposed to assess the security…

密码学与安全 · 计算机科学 2025-05-30 Bijoy Ahmed Saiem , MD Sadik Hossain Shanto , Rakib Ahsan , Md Rafi ur Rashid

Safety alignment mechanism are essential for preventing large language models (LLMs) from generating harmful information or unethical content. However, cleverly crafted prompts can bypass these safety measures without accessing the model's…

Recently, Large Language Models (LLMs) have garnered significant attention for their exceptional natural language processing capabilities. However, concerns about their trustworthiness remain unresolved, particularly in addressing…

计算与语言 · 计算机科学 2025-01-29 Yue Huang , Jingyu Tang , Dongping Chen , Bingda Tang , Yao Wan , Lichao Sun , Philip S. Yu , Xiangliang Zhang

Large Language Models (LLMs) aligned with human feedback have recently garnered significant attention. However, it remains vulnerable to jailbreak attacks, where adversaries manipulate prompts to induce harmful outputs. Exploring jailbreak…

密码学与安全 · 计算机科学 2024-12-23 Hongyi Li , Jiawei Ye , Jie Wu , Tianjie Yan , Chu Wang , Zhixin Li

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks. Nevertheless, they still pose notable safety risks due to potential misuse for malicious purposes. Jailbreaking, which seeks to induce models to…

计算与语言 · 计算机科学 2025-09-30 Hua Tang , Lingyong Yan , Yukun Zhao , Shuaiqiang Wang , Jizhou Huang , Dawei Yin

The rapid progress in open-source large language models (LLMs) is significantly advancing AI development. Extensive efforts have been made before model release to align their behavior with human values, with the primary goal of ensuring…

计算与语言 · 计算机科学 2023-10-12 Yangsibo Huang , Samyak Gupta , Mengzhou Xia , Kai Li , Danqi Chen

Despite recent advances, Large Language Models remain vulnerable to jailbreak attacks that bypass alignment safeguards and elicit harmful outputs. While prior research has proposed various attack strategies differing in human readability…

计算与语言 · 计算机科学 2025-10-28 Havva Alizadeh Noughabi , Julien Serbanescu , Fattane Zarrinkalam , Ali Dehghantanha

Large Language Models (LLMs) rapidly reshape modern life, advancing fields from healthcare to education and beyond. However, alongside their remarkable capabilities lies a significant threat: the susceptibility of these models to…

计算与语言 · 计算机科学 2025-05-16 Michael Fire , Yitzhak Elbazis , Adi Wasenstein , Lior Rokach

Large Language Models (LLMs) have revolutionized Artificial Intelligence (AI) services due to their exceptional proficiency in understanding and generating human-like text. LLM chatbots, in particular, have seen widespread adoption,…

密码学与安全 · 计算机科学 2024-02-14 Gelei Deng , Yi Liu , Yuekang Li , Kailong Wang , Ying Zhang , Zefeng Li , Haoyu Wang , Tianwei Zhang , Yang Liu

Large Language Models (LLMs) have performed exceptionally in various text-generative tasks, including question answering, translation, code completion, etc. However, the over-assistance of LLMs has raised the challenge of "jailbreaking",…

密码学与安全 · 计算机科学 2024-09-02 Sibo Yi , Yule Liu , Zhen Sun , Tianshuo Cong , Xinlei He , Jiaxing Song , Ke Xu , Qi Li

Large Language Models (LLMs) have increasingly become pivotal in content generation with notable societal impact. These models hold the potential to generate content that could be deemed harmful.Efforts to mitigate this risk include…

计算与语言 · 计算机科学 2024-08-20 Kexin Chen , Yi Liu , Dongxia Wang , Jiaying Chen , Wenhai Wang

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

密码学与安全 · 计算机科学 2024-12-03 Erick Galinkin , Martin Sablotny

Jailbreaking large language models (LLMs) has emerged as a critical security challenge with the widespread deployment of conversational AI systems. Adversarial users exploit these models through carefully crafted prompts to elicit…

密码学与安全 · 计算机科学 2026-02-23 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

Jailbreaks on large language models (LLMs) have recently received increasing attention. For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with diverse attributes, such as contextual coherence and…

机器学习 · 计算机科学 2024-06-10 Xingang Guo , Fangxu Yu , Huan Zhang , Lianhui Qin , Bin Hu

With the development of natural language processing (NLP), large language models (LLMs) are becoming increasingly popular. LLMs are integrating more into everyday life, raising public concerns about their security vulnerabilities.…

计算与语言 · 计算机科学 2024-06-27 Ziqiu Wang , Jun Liu , Shengkai Zhang , Yang Yang

Large Language Models (LLMs) face prominent security risks from jailbreaking, a practice that manipulates models to bypass built-in security constraints and generate unethical or unsafe content. Among various jailbreak techniques,…

密码学与安全 · 计算机科学 2026-04-14 Yihao Zhang , Kai Wang , Jiangrong Wu , Haolin Wu , Yuxuan Zhou , Zeming Wei , Dongxian Wu , Xun Chen , Jun Sun , Meng Sun

The study of large language models (LLMs) is a key area in open-world machine learning. Although LLMs demonstrate remarkable natural language processing capabilities, they also face several challenges, including consistency issues,…

Extensive work has been devoted to improving the safety mechanism of Large Language Models (LLMs). However, LLMs still tend to generate harmful responses when faced with malicious instructions, a phenomenon referred to as "Jailbreak…

计算与语言 · 计算机科学 2024-02-26 Yanrui Du , Sendong Zhao , Ming Ma , Yuhan Chen , Bing Qin
‹ 上一页 1 2 3 10 下一页 ›