English
Related papers

Related papers: Learning to Detect Unknown Jailbreak Attacks in La…

200 papers

Multimodal large language models (MLLMs) are widely used in vision-language reasoning tasks. However, their vulnerability to adversarial prompts remains a serious concern, as safety mechanisms often fail to prevent the generation of harmful…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Zuoou Li , Weitong Zhang , Jingyuan Wang , Shuyuan Zhang , Wenjia Bai , Bernhard Kainz , Mengyun Qiao

Recently, Large Language Models (LLMs) have garnered significant attention for their exceptional natural language processing capabilities. However, concerns about their trustworthiness remain unresolved, particularly in addressing…

Computation and Language · Computer Science 2025-01-29 Yue Huang , Jingyu Tang , Dongping Chen , Bingda Tang , Yao Wan , Lichao Sun , Philip S. Yu , Xiangliang Zhang

Large language models (LLMs) have revolutionized artificial intelligence, but their increasing deployment across critical domains has raised concerns about their abnormal behaviors when faced with malicious attacks. Such vulnerability…

Software Engineering · Computer Science 2025-04-02 Shide Zhou , Tianlin Li , Kailong Wang , Yihao Huang , Ling Shi , Yang Liu , Haoyu Wang

While safety-aligned large language models (LLMs) are increasingly used as the cornerstone for powerful systems such as multi-agent frameworks to solve complex real-world problems, they still suffer from potential adversarial queries, such…

Cryptography and Security · Computer Science 2025-01-03 Miao Yu , Junfeng Fang , Yingjie Zhou , Xing Fan , Kun Wang , Shirui Pan , Qingsong Wen

Large Language Models (LLMs) have increasingly become pivotal in content generation with notable societal impact. These models hold the potential to generate content that could be deemed harmful.Efforts to mitigate this risk include…

Computation and Language · Computer Science 2024-08-20 Kexin Chen , Yi Liu , Dongxia Wang , Jiaying Chen , Wenhai Wang

In recent years, the security vulnerabilities of Multi-modal Large Language Models (MLLMs) have become a serious concern in the Generative Artificial Intelligence (GenAI) research. These highly intelligent models, capable of performing…

Cryptography and Security · Computer Science 2026-01-12 Badhan Chandra Das , Md Tasnim Jawad , Joaquin Molto , M. Hadi Amini , Yanzhao Wu

While multimodal large language models (MLLMs) have achieved remarkable success in recent advancements, their susceptibility to jailbreak attacks has come to light. In such attacks, adversaries exploit carefully crafted prompts to coerce…

Cryptography and Security · Computer Science 2025-02-04 Ziyi Yin , Yuanpu Cao , Han Liu , Ting Wang , Jinghui Chen , Fenhlong Ma

Jailbreaks on large language models (LLMs) have recently received increasing attention. For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with diverse attributes, such as contextual coherence and…

Machine Learning · Computer Science 2024-06-10 Xingang Guo , Fangxu Yu , Huan Zhang , Lianhui Qin , Bin Hu

Multimodal large language models (MLLMs) have revolutionized vision-language understanding but remain vulnerable to multimodal jailbreak attacks, where adversarial inputs are meticulously crafted to elicit harmful or inappropriate…

Computation and Language · Computer Science 2025-02-03 Sejoon Oh , Yiqiao Jin , Megha Sharma , Donghyun Kim , Eric Ma , Gaurav Verma , Srijan Kumar

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

Computation and Language · Computer Science 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha

As large language models (LLMs) become increasingly integrated into real-world applications such as code generation and chatbot assistance, extensive efforts have been made to align LLM behavior with human values, including safety.…

Cryptography and Security · Computer Science 2024-07-29 Zhangchen Xu , Fengqing Jiang , Luyao Niu , Jinyuan Jia , Bill Yuchen Lin , Radha Poovendran

Recent advances in large vision-language models (VLMs) have demonstrated remarkable success across a wide range of visual understanding tasks. However, the robustness of these models against jailbreak attacks remains an open challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiangyu Yin , Jiaxu Liu , Zhen Chen , Jinwei Hu , Yi Dong , Xiaowei Huang , Wenjie Ruan

Multimodal large language models (MLLMs) comprise of both visual and textual modalities to process vision language tasks. However, MLLMs are vulnerable to security-related issues, such as jailbreak attacks that alter the model's input to…

Cryptography and Security · Computer Science 2025-10-27 Xingwei Zhong , Kar Wai Fok , Vrizlynn L. L. Thing

Large language models (LLMs) enhance security through alignment when widely used, but remain susceptible to jailbreak attacks capable of producing inappropriate content. Jailbreak detection methods show promise in mitigating jailbreak…

Cryptography and Security · Computer Science 2026-01-26 Guorui Chen , Yifan Xia , Xiaojun Jia , Zhijiang Li , Philip Torr , Jindong Gu

As software becomes increasingly complex and prone to vulnerabilities, automated vulnerability detection is critically important, yet challenging. Given the significant successes of large language models (LLMs) in various tasks, there is…

Artificial Intelligence · Computer Science 2023-12-25 Zeyu Gao , Hao Wang , Yuchen Zhou , Wenyu Zhu , Chao Zhang

This paper focuses on jailbreaking attacks against large language models (LLMs), eliciting them to generate objectionable content in response to harmful user queries. Unlike previous LLM-jailbreak methods that directly orient to LLMs, our…

Artificial Intelligence · Computer Science 2025-12-02 Haoxuan Ji , Zheng Lin , Zhenxing Niu , Xinbo Gao , Gang Hua

The rapid development of Large Language Models (LLMs) has brought impressive advancements across various tasks. However, despite these achievements, LLMs still pose inherent safety risks, especially in the context of jailbreak attacks. Most…

Cryptography and Security · Computer Science 2025-06-19 Shi Lin , Hongming Yang , Rongchang Li , Xun Wang , Changting Lin , Wenpeng Xing , Meng Han

Large Language Models (LLMs) have achieved remarkable progress, but their deployment has exposed critical vulnerabilities, particularly to jailbreak attacks that circumvent safety alignments. Guardrails--external defense mechanisms that…

Cryptography and Security · Computer Science 2025-10-17 Xunguang Wang , Zhenlan Ji , Wenxuan Wang , Zongjie Li , Daoyuan Wu , Shuai Wang

Large Vision-Language Models (LVLMs) are increasingly equipped with robust safety safeguards to prevent responses to harmful or disallowed prompts. However, these defenses often focus on analyzing explicit textual inputs or relevant visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yihang Chen , Zhao Xu , Youyuan Jiang , Tianle Zheng , Cho-Jui Hsieh

Despite their superb capabilities, Vision-Language Models (VLMs) have been shown to be vulnerable to jailbreak attacks. While recent jailbreaks have achieved notable progress, their effectiveness and efficiency can still be improved. In…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yunhan Zhao , Xiang Zheng , Xingjun Ma