中文
相关论文

相关论文: Preventing Robotic Jailbreaking via Multimodal Dom…

200 篇论文

Metaphor serves as an implicit approach to convey information, while enabling the generalized comprehension of complex subjects. However, metaphor can potentially be exploited to bypass the safety alignment mechanisms of Large Language…

计算与语言 · 计算机科学 2025-02-25 Yu Yan , Sheng Sun , Junqi Tong , Min Liu , Qi Li

Vision language models (VLMs) extend the reasoning capabilities of large language models (LLMs) to cross-modal settings, yet remain highly vulnerable to multimodal jailbreak attacks. Existing defenses predominantly rely on safety…

人工智能 · 计算机科学 2026-04-14 Mengxuan Wang , Yuxin Chen , Gang Xu , Tao He , Hongjie Jiang , Ming Li

Despite efforts to align large language models (LLMs) with human intentions, widely-used LLMs such as GPT, Llama, and Claude are susceptible to jailbreaking attacks, wherein an adversary fools a targeted LLM into generating objectionable…

机器学习 · 计算机科学 2024-06-17 Alexander Robey , Eric Wong , Hamed Hassani , George J. Pappas

LLMs have made impressive progress, but their growing capabilities also expose them to highly flexible jailbreaking attacks designed to bypass safety alignment. While many existing defenses focus on known types of attacks, it is more…

密码学与安全 · 计算机科学 2025-05-27 Haoyu Wang , Zeyu Qin , Yifei Zhao , Chao Du , Min Lin , Xueqian Wang , Tianyu Pang

Large language models (LLMs) are increasingly utilized in healthcare applications. However, their deployment in clinical practice raises significant safety concerns, including the potential spread of harmful information. This study…

密码学与安全 · 计算机科学 2025-03-05 Hang Zhang , Qian Lou , Yanshan Wang

Jailbreaking large language models (LLMs) has emerged as a critical security challenge with the widespread deployment of conversational AI systems. Adversarial users exploit these models through carefully crafted prompts to elicit…

密码学与安全 · 计算机科学 2026-02-23 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

As Spoken Language Models (SLMs) integrate speech and text modalities, they inherit the safety vulnerabilities of their LLM backbone and an expanded attack surface. SLMs have been previously shown to be susceptible to jailbreaking, where…

机器学习 · 计算机科学 2026-03-20 Aravind Krishnan , Karolina Stańczak , Dietrich Klakow

Large Language Models (LLMs) have achieved remarkable success in various domains but remain vulnerable to adversarial jailbreak attacks. Existing prompt-defense strategies, including parameter-modifying and parameter-free approaches, face…

密码学与安全 · 计算机科学 2025-02-20 Ziyi Ni , Hao Wang , Huacan Wang

Large language models (LLMs) have shown remarkable reasoning capabilities, yet aligning such abilities to small language models (SLMs) remains a challenge due to distributional mismatches and limited model capacity. Existing reasoning…

计算与语言 · 计算机科学 2025-05-28 Yong Wu , Weihang Pan , Ke Li , Chen Binhui , Ping Li , Binbin Lin

Despite their impressive capabilities, Multimodal Large Language Models (MLLMs) exhibit perceptual fragility when confronted with visually complex scenes. This weakness stems from a reliance on finite training datasets, which are…

机器学习 · 计算机科学 2026-03-05 Yicheng Bao , Xuhong Wang , Qiaosheng Zhang , Chaochao Lu , Xia Hu , Xin Tan

Large language models (LLMs) have demonstrated remarkable capabilities, yet they also introduce novel security challenges. For instance, prompt jailbreaking attacks involve adversaries crafting sophisticated prompts to elicit responses from…

人工智能 · 计算机科学 2025-09-30 Zhaoqi Wang , Daqing He , Zijian Zhang , Xin Li , Liehuang Zhu , Meng Li , Jiamou Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they remain vulnerable to adversarial manipulations such as jailbreaking via prompt injection attacks. These attacks bypass safety mechanisms…

机器学习 · 计算机科学 2025-07-08 Xin Wei Chia , Swee Liang Wong , Jonathan Pan

Large Language Models (LLMs) have demonstrated remarkable capabilities in various tasks. However, they remain exposed to jailbreak attacks, eliciting harmful responses. The nested scenario strategy has been increasingly adopted across…

密码学与安全 · 计算机科学 2025-11-18 Ning Xu , Bo Gao , Hui Dou

Large Language Models (LLMs) are widely deployed in diverse real-world settings, yet remain vulnerable to jailbreaking, where prompt-based attacks bypass safety filters. We present THREAT (Targeted Harmful generation via Reframing and…

密码学与安全 · 计算机科学 2026-05-22 Shahnewaz Karim Sakib , Swati Kar , Anindya Bijoy Das

Large Language Models (LLMs) aligned with human feedback have recently garnered significant attention. However, it remains vulnerable to jailbreak attacks, where adversaries manipulate prompts to induce harmful outputs. Exploring jailbreak…

密码学与安全 · 计算机科学 2024-12-23 Hongyi Li , Jiawei Ye , Jie Wu , Tianjie Yan , Chu Wang , Zhixin Li

As large language models (LLMs) are increasingly deployed, ensuring their safe use is paramount. Jailbreaking, adversarial prompts that bypass model alignment to trigger harmful outputs, present significant risks, with existing studies…

密码学与安全 · 计算机科学 2026-01-01 Yuan Xin , Dingfan Chen , Linyi Yang , Michael Backes , Xiao Zhang

Despite rigorous safety alignment, Large Language Models (LLMs) remain vulnerable to jailbreak attacks. Existing black-box methods often rely on heuristic templates or exhaustive trials, lacking mechanistic interpretability and query…

密码学与安全 · 计算机科学 2026-05-19 Ziwei Wang , Jing Chen , Ruichao Liang , Zhi Wang , Yebo Feng , Ju Jia , Ruiying Du , Cong Wu , Yang Liu

While multimodal large language models (MLLMs) have achieved remarkable success in recent advancements, their susceptibility to jailbreak attacks has come to light. In such attacks, adversaries exploit carefully crafted prompts to coerce…

密码学与安全 · 计算机科学 2025-02-04 Ziyi Yin , Yuanpu Cao , Han Liu , Ting Wang , Jinghui Chen , Fenhlong Ma

While large language models (LLMs) exhibit remarkable capabilities across various tasks, they encounter potential security risks such as jailbreak attacks, which exploit vulnerabilities to bypass security measures and generate harmful…

密码学与安全 · 计算机科学 2024-11-28 Xinyuan Wang , Victor Shea-Jay Huang , Renmiao Chen , Hao Wang , Chengwei Pan , Lei Sha , Minlie Huang

Safety alignment mechanism are essential for preventing large language models (LLMs) from generating harmful information or unethical content. However, cleverly crafted prompts can bypass these safety measures without accessing the model's…