中文
相关论文

相关论文: GRM: Utility-Aware Jailbreak Attacks on Audio LLMs…

200 篇论文

Large Language Models (LLMS) have increasingly become central to generating content with potential societal impacts. Notably, these models have demonstrated capabilities for generating content that could be deemed harmful. To mitigate these…

密码学与安全 · 计算机科学 2024-05-20 Zihao Xu , Yi Liu , Gelei Deng , Yuekang Li , Stjepan Picek

Large Language Models (LLMs) are increasingly popular, powering a wide range of applications. Their widespread use has sparked concerns, especially through jailbreak attacks that bypass safety measures to produce harmful content. In this…

密码学与安全 · 计算机科学 2025-12-25 Zhengchun Shang , Wenlan Wei , Weiheng Bai

Large language models (LLMs) increasingly operate in multi-agent and safety-critical settings, raising open questions about how their vulnerabilities scale when models interact adversarially. This study examines whether larger models can…

机器学习 · 计算机科学 2026-01-05 Samuel Nathanson , Rebecca Williams , Cynthia Matuszek

With the significant advancement of Large Vision-Language Models (VLMs), concerns about their potential misuse and abuse have grown rapidly. Previous studies have highlighted VLMs' vulnerability to jailbreak attacks, where carefully crafted…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Yu Wang , Xiaofei Zhou , Yichen Wang , Geyuan Zhang , Tianxing He

We have uncovered a powerful jailbreak technique that leverages large language models' ability to diverge from prior context, enabling them to bypass safety constraints and generate harmful outputs. By simply instructing the LLM to deviate…

计算与语言 · 计算机科学 2025-05-13 Weiliang Zhao , Daniel Ben-Levi , Wei Hao , Junfeng Yang , Chengzhi Mao

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

计算与语言 · 计算机科学 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Large Language Models (LLMs) remain vulnerable to multi-turn jailbreak attacks. We introduce HarmNet, a modular framework comprising ThoughtNet, a hierarchical semantic network; a feedback-driven Simulator for iterative query refinement;…

密码学与安全 · 计算机科学 2025-10-22 Sidhant Narula , Javad Rafiei Asl , Mohammad Ghasemigol , Eduardo Blanco , Daniel Takabi

Large Language Models (LLMs) have increasingly become pivotal in content generation with notable societal impact. These models hold the potential to generate content that could be deemed harmful.Efforts to mitigate this risk include…

计算与语言 · 计算机科学 2024-08-20 Kexin Chen , Yi Liu , Dongxia Wang , Jiaying Chen , Wenhai Wang

Jailbreak attacks in large language models (LLMs) entail inducing the models to generate content that breaches ethical and legal norm through the use of malicious prompts, posing a substantial threat to LLM security. Current strategies for…

密码学与安全 · 计算机科学 2024-06-07 Lin Lu , Hai Yan , Zenghui Yuan , Jiawen Shi , Wenqi Wei , Pin-Yu Chen , Pan Zhou

Speech Language Models (SLMs) enable natural interactions via spoken instructions, which more effectively capture user intent by detecting nuances in speech. The richer speech signal introduces new security risks compared to text-based…

音频与语音处理 · 电气工程与系统科学 2025-10-17 Amirbek Djanibekov , Nurdaulet Mukhituly , Kentaro Inui , Hanan Aldarmaki , Nils Lukas

Jailbreaking large language models (LLMs) has emerged as a critical security challenge with the widespread deployment of conversational AI systems. Adversarial users exploit these models through carefully crafted prompts to elicit…

密码学与安全 · 计算机科学 2026-02-23 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling applications across fields beyond healthcare, software engineering, and conversational systems.…

While Large Language Models (LLMs) have achieved remarkable progress, they remain vulnerable to jailbreak attacks. Existing methods, primarily relying on discrete input optimization (e.g., GCG), often suffer from high computational costs…

计算与语言 · 计算机科学 2026-01-09 Wenpeng Xing , Mohan Li , Chunqiang Hu , Haitao Xu , Ningyu Zhang , Bo Lin , Meng Han

Large language models (LLMs) undergo safety alignment after training and tuning, yet recent work shows that safety can be bypassed through jailbreak attacks. While many jailbreaks and defenses exist, their cross-lingual generalization…

计算与语言 · 计算机科学 2025-11-05 Berk Atil , Rebecca J. Passonneau , Fred Morstatter

Large Audio-Language Models (LALMs) are increasingly deployed in real-world applications, yet their robustness against malicious audio injection attacks remains underexplored. This study systematically evaluates five leading LALMs across…

计算与语言 · 计算机科学 2025-07-11 Guanyu Hou , Jiaming He , Yinhang Zhou , Ji Guo , Yitong Qiao , Rui Zhang , Wenbo Jiang

The rapid development of Large Language Models (LLMs) has brought impressive advancements across various tasks. However, despite these achievements, LLMs still pose inherent safety risks, especially in the context of jailbreak attacks. Most…

密码学与安全 · 计算机科学 2025-06-19 Shi Lin , Hongming Yang , Rongchang Li , Xun Wang , Changting Lin , Wenpeng Xing , Meng Han

As deep learning advances, Large Language Models (LLMs) and their multimodal counterparts, Multimodal Large Language Models (MLLMs), have shown exceptional performance in many real-world tasks. However, MLLMs face significant security…

密码学与安全 · 计算机科学 2024-10-23 Fenghua Weng , Yue Xu , Chengyan Fu , Wenjie Wang

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks. Nevertheless, they still pose notable safety risks due to potential misuse for malicious purposes. Jailbreaking, which seeks to induce models to…

计算与语言 · 计算机科学 2025-09-30 Hua Tang , Lingyong Yan , Yukun Zhao , Shuaiqiang Wang , Jizhou Huang , Dawei Yin

Despite extensive safety alignment efforts, large language models (LLMs) remain vulnerable to jailbreak attacks that elicit harmful behavior. While existing studies predominantly focus on attack methods that require technical expertise, two…

机器学习 · 计算机科学 2025-08-05 Yik Siu Chan , Narutatsu Ri , Yuxin Xiao , Marzyeh Ghassemi

Large Language Models (LLMs) have gained widespread adoption across various domains, including chatbots and auto-task completion agents. However, these models are susceptible to safety vulnerabilities such as jailbreaking, prompt injection,…

密码学与安全 · 计算机科学 2024-09-10 Divyanshu Kumar , Anurakt Kumar , Sahil Agarwal , Prashanth Harshangi