中文
相关论文

相关论文: Preventing Robotic Jailbreaking via Multimodal Dom…

200 篇论文

The proliferation of large language models (LLMs) has underscored concerns regarding their security vulnerabilities, notably against jailbreak attacks, where adversaries design jailbreak prompts to circumvent safety mechanisms for potential…

密码学与安全 · 计算机科学 2025-06-10 Yingchaojie Feng , Zhizhang Chen , Zhining Kang , Sijia Wang , Haoyu Tian , Wei Zhang , Minfeng Zhu , Wei Chen

Software vulnerability detection is generally supported by automated static analysis tools, which have recently been reinforced by deep learning (DL) models. However, despite the superior performance of DL-based approaches over rule-based…

软件工程 · 计算机科学 2024-05-03 Yanjing Yang , Xin Zhou , Runfeng Mao , Jinwei Xu , Lanxin Yang , Yu Zhangm , Haifeng Shen , He Zhang

The integration of additional modalities increases the susceptibility of large vision-language models (LVLMs) to safety risks, such as jailbreak attacks, compared to their language-only counterparts. While existing research primarily…

计算与语言 · 计算机科学 2025-06-24 Yilei Jiang , Xinyan Gao , Tianshuo Peng , Yingshui Tan , Xiaoyong Zhu , Bo Zheng , Xiangyu Yue

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

密码学与安全 · 计算机科学 2024-12-03 Erick Galinkin , Martin Sablotny

Jailbreak attacks reveal critical vulnerabilities in Large Language Models (LLMs) by causing them to generate harmful or unethical content. Evaluating these threats is particularly challenging due to the evolving nature of LLMs and the…

机器学习 · 计算机科学 2025-07-11 Peiyan Zhang , Haibo Jin , Liying Kang , Haohan Wang

As large language models (LLMs) become integral to various applications, ensuring both their safety and utility is paramount. Jailbreak attacks, which manipulate LLMs into generating harmful content, pose significant challenges to this…

密码学与安全 · 计算机科学 2025-02-10 Guobin Shen , Dongcheng Zhao , Yiting Dong , Xiang He , Yi Zeng

Large Language Models (LLMs) have revolutionized Artificial Intelligence (AI) services due to their exceptional proficiency in understanding and generating human-like text. LLM chatbots, in particular, have seen widespread adoption,…

密码学与安全 · 计算机科学 2024-02-14 Gelei Deng , Yi Liu , Yuekang Li , Kailong Wang , Ying Zhang , Zefeng Li , Haoyu Wang , Tianwei Zhang , Yang Liu

Large language models (LLMs) have seen rapid development in recent years, revolutionizing various applications and significantly enhancing convenience and productivity. However, alongside their impressive capabilities, ethical concerns and…

计算与语言 · 计算机科学 2025-02-04 Yu-Ling Hsu , Hsuan Su , Shang-Tse Chen

Jailbreaking is an emerging adversarial attack that bypasses the safety alignment deployed in off-the-shelf large language models (LLMs) and has evolved into multiple categories: human-based, optimization-based, generation-based, and the…

密码学与安全 · 计算机科学 2025-02-06 Xunguang Wang , Daoyuan Wu , Zhenlan Ji , Zongjie Li , Pingchuan Ma , Shuai Wang , Yingjiu Li , Yang Liu , Ning Liu , Juergen Rahmel

The vulnerability of Vision Large Language Models (VLLMs) to jailbreak attacks appears as no surprise. However, recent defense mechanisms against these attacks have reached near-saturation performance on benchmark evaluations, often with…

密码学与安全 · 计算机科学 2025-03-07 Yangyang Guo , Fangkai Jiao , Liqiang Nie , Mohan Kankanhalli

Jailbreak vulnerabilities in Large Language Models (LLMs) refer to methods that extract malicious content from the model by carefully crafting prompts or suffixes, which has garnered significant attention from the research community.…

密码学与安全 · 计算机科学 2024-09-13 Lijia Lv , Weigang Zhang , Xuehai Tang , Jie Wen , Feng Liu , Jizhong Han , Songlin Hu

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

计算与语言 · 计算机科学 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Large Language Models (LLMs) serve as the backbone of modern AI systems, yet they remain susceptible to adversarial jailbreak attacks. Consequently, robust detection of such malicious inputs is paramount for ensuring model safety.…

密码学与安全 · 计算机科学 2026-01-13 Jun Leng , Yu Liu , Litian Zhang , Ruihan Hu , Zhuting Fang , Xi Zhang

Recent advances in Vision-Language Models (VLMs) facilitate a new class of embodied AI systems, where these models are integrated into physical platforms, e.g. robots and autonomous vehicles, to interpret visual scenes and execute natural…

密码学与安全 · 计算机科学 2026-05-20 Doguhuan Yeke , Yanming Zhou , Leo Y. Lin , Hongyu Cai , Antonio Bianchi , Z. Berkay Celik

Recent advancements in Large Vision-Language Models (VLMs) have underscored their superiority in various multimodal tasks. However, the adversarial robustness of VLMs has not been fully explored. Existing methods mainly assess robustness…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Ruofan Wang , Xingjun Ma , Hanxu Zhou , Chuanjun Ji , Guangnan Ye , Yu-Gang Jiang

Multi-turn jailbreak attacks have proven effective against text-only large language models (LLMs), where malicious content is gradually introduced to bypass safety alignment. However, effectively extending such attacks to large…

计算机视觉与模式识别 · 计算机科学 2026-05-29 In Chong Choi , Jiacheng Zhang , Feng Liu , Yiliao Song

This paper focuses on jailbreaking attacks against multi-modal large language models (MLLMs), seeking to elicit MLLMs to generate objectionable responses to harmful user queries. A maximum likelihood-based algorithm is proposed to find an…

机器学习 · 计算机科学 2024-02-07 Zhenxing Niu , Haodong Ren , Xinbo Gao , Gang Hua , Rong Jin

Defense in large language models (LLMs) is crucial to counter the numerous attackers exploiting these systems to generate harmful content through manipulated prompts, known as jailbreak attacks. Although many defense strategies have been…

密码学与安全 · 计算机科学 2024-12-11 Bocheng Chen , Hanqing Guo , Qiben Yan

Vision Language Models (VLMs) have advanced perception in autonomous driving (AD), but they remain vulnerable to adversarial threats. These risks range from localized physical patches to imperceptible global perturbations. Existing defense…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Xiaoxu Peng , Dong Zhou , Jianwen Zhang , Guanghui Sun , Anh Tu Ngo , Anupam Chattopadhyay

Open-Vocabulary Multi-Label Recognition (OV-MLR) aims to identify multiple seen and unseen object categories within an image, requiring both precise intra-class localization to pinpoint objects and effective inter-class reasoning to model…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Haijing Liu , Tao Pu , Hefeng Wu , Keze Wang , Liang Lin