English
Related papers

Related papers: Babel: Jailbreaking Safety Attention via Obfuscati…

200 papers

This paper focuses on jailbreaking attacks against large language models (LLMs), eliciting them to generate objectionable content in response to harmful user queries. Unlike previous LLM-jailbreak methods that directly orient to LLMs, our…

Artificial Intelligence · Computer Science 2025-12-02 Haoxuan Ji , Zheng Lin , Zhenxing Niu , Xinbo Gao , Gang Hua

A fundamental issue in deep learning has been adversarial robustness. As these systems have scaled, such issues have persisted. Currently, large language models (LLMs) with billions of parameters suffer from adversarial attacks just like…

Machine Learning · Computer Science 2025-02-11 Brian Formento , Chuan Sheng Foo , See-Kiong Ng

Backdoor unalignment attacks against Large Language Models (LLMs) enable the stealthy compromise of safety alignment using a hidden trigger while evading normal safety auditing. These attacks pose significant threats to the applications of…

Cryptography and Security · Computer Science 2025-06-23 Biao Yi , Tiansheng Huang , Sishuo Chen , Tong Li , Zheli Liu , Zhixuan Chu , Yiming Li

Large Language Models (LLMs) have gained widespread adoption across various domains, including chatbots and auto-task completion agents. However, these models are susceptible to safety vulnerabilities such as jailbreaking, prompt injection,…

Cryptography and Security · Computer Science 2024-09-10 Divyanshu Kumar , Anurakt Kumar , Sahil Agarwal , Prashanth Harshangi

Large Language Model (LLM) alignment remains vulnerable to jailbreak attacks that elicit unsafe responses, motivating pre-model and post-model guards. Pre-model guards audit the safety of prompts before invoking target models. However,…

Cryptography and Security · Computer Science 2026-05-20 Hongyu Cai , Arjun Arunasalam , Yiming Liang , Antonio Bianchi , Z. Berkay Celik

Multimodal large language models (MLLMs) comprise of both visual and textual modalities to process vision language tasks. However, MLLMs are vulnerable to security-related issues, such as jailbreak attacks that alter the model's input to…

Cryptography and Security · Computer Science 2025-10-27 Xingwei Zhong , Kar Wai Fok , Vrizlynn L. L. Thing

The rapid development of Multimodal Large Reasoning Models (MLRMs) has demonstrated broad application potential, yet their safety and reliability remain critical concerns that require systematic exploration. To address this gap, we conduct…

Computation and Language · Computer Science 2025-10-14 Xinyue Lou , You Li , Jinan Xu , Xiangyu Shi , Chi Chen , Kaiyu Huang

Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling applications across fields beyond healthcare, software engineering, and conversational systems.…

Large Language Models (LLMs) have revolutionized Artificial Intelligence (AI) services due to their exceptional proficiency in understanding and generating human-like text. LLM chatbots, in particular, have seen widespread adoption,…

Cryptography and Security · Computer Science 2024-02-14 Gelei Deng , Yi Liu , Yuekang Li , Kailong Wang , Ying Zhang , Zefeng Li , Haoyu Wang , Tianwei Zhang , Yang Liu

Prior work on jailbreak detection has established the importance of adversarial robustness for LLMs but has largely focused on the model ability to resist adversarial inputs and to output safe content, rather than the effectiveness of…

Cryptography and Security · Computer Science 2025-07-10 Hadrien Mariaccia , Charbel-Raphaël Segerie , Diego Dorn

Large Audio Language Models (LALMs) expand jailbreak risks from token-level prompting to the full speech perception-to-reasoning pipeline, where unsafe behavior can be induced through semantics, acoustic style, signal artifacts, or internal…

Sound · Computer Science 2026-05-29 Bo-Han Feng , Yu-Hsuan Li Liang , Chien-Feng Liu , You-Hsuan Chang , Yun-Nung Chen

With the development of Large Language Models (LLMs), numerous efforts have revealed their vulnerabilities to jailbreak attacks. Although these studies have driven the progress in LLMs' safety alignment, it remains unclear whether LLMs have…

Cryptography and Security · Computer Science 2025-09-16 Yu Yan , Sheng Sun , Zhe Wang , Yijun Lin , Zenghao Duan , zhifei zheng , Min Liu , Zhiyi yin , Jianping Zhang

Jailbreak attacks expose vulnerabilities in safety-aligned LLMs by eliciting harmful outputs through carefully crafted prompts. Existing methods rely on discrete optimization or trained adversarial generators, but are slow,…

Computation and Language · Computer Science 2025-07-08 James Beetham , Souradip Chakraborty , Mengdi Wang , Furong Huang , Amrit Singh Bedi , Mubarak Shah

Ensuring the safety and alignment of large language models (LLMs) with human values is crucial for generating responses that are beneficial to humanity. While LLMs have the capability to identify and avoid harmful queries, they remain…

Computation and Language · Computer Science 2024-10-22 Yihua Zhou , Xiaochuan Shi

Large Language Models (LLMs) rapidly reshape modern life, advancing fields from healthcare to education and beyond. However, alongside their remarkable capabilities lies a significant threat: the susceptibility of these models to…

Computation and Language · Computer Science 2025-05-16 Michael Fire , Yitzhak Elbazis , Adi Wasenstein , Lior Rokach

Ensuring safety alignment is a critical requirement for large language models (LLMs), particularly given increasing deployment in real-world applications. Despite considerable advancements, LLMs remain susceptible to jailbreak attacks,…

Cryptography and Security · Computer Science 2025-06-02 Xin Yi , Yue Li , Dongsheng Shi , Linlin Wang , Xiaoling Wang , Liang He

Recent advances in Multimodal Large Language Models (MLLMs) have significantly enhanced the naturalness and flexibility of human computer interaction by enabling seamless understanding across text, vision, and audio modalities. Among these,…

Computation and Language · Computer Science 2025-05-27 Binhao Ma , Hanqing Guo , Zhengping Jay Luo , Rui Duan

Large Language Models (LLMs) are typically harmless but remain vulnerable to carefully crafted prompts known as ``jailbreaks'', which can bypass protective measures and induce harmful behavior. Recent advancements in LLMs have incorporated…

Cryptography and Security · Computer Science 2024-06-03 Haibo Jin , Andy Zhou , Joe D. Menke , Haohan Wang

Large Language Models (LLMs) demonstrate impressive zero-shot performance across a wide range of natural language processing tasks. Integrating various modality encoders further expands their capabilities, giving rise to Multimodal Large…

Sound · Computer Science 2026-01-13 Hao Cheng , Erjia Xiao , Jing Shao , Yichi Wang , Le Yang , Chao Shen , Philip Torr , Jindong Gu , Renjing Xu

Large language models (LLMs) have gained widespread recognition for their superior comprehension and have been deployed across numerous domains. Building on Chain-of-Thought (CoT) ideology, Large Reasoning models (LRMs) further exhibit…

Computers and Society · Computer Science 2025-09-03 Shiji Zhao , Ranjie Duan , Jiexi Liu , Xiaojun Jia , Fengxiang Wang , Cheng Wei , Ruoxi Cheng , Yong Xie , Chang Liu , Qing Guo , Jialing Tao , Hui Xue , Xingxing Wei