English
Related papers

Related papers: Speech-Audio Compositional Attacks on Multimodal L…

200 papers

System prompts are critical for guiding the behavior of Large Language Models (LLMs), yet they often contain proprietary logic or sensitive information, making them a prime target for extraction attacks. Adversarial queries can successfully…

Cryptography and Security · Computer Science 2026-02-03 Huseein Jawad , Nicolas Brunel

Aligned large language models (LLMs) are vulnerable to jailbreaking attacks, which bypass the safeguards of targeted LLMs and fool them into generating objectionable content. While initial defenses show promise against token-based threat…

Computation and Language · Computer Science 2024-03-01 Jiabao Ji , Bairu Hou , Alexander Robey , George J. Pappas , Hamed Hassani , Yang Zhang , Eric Wong , Shiyu Chang

Guard models are a critical component of LLM safety, but their sensitivity to superficial linguistic variations remains a key vulnerability. We show that even meaning-preserving paraphrases can cause large fluctuations in safety scores,…

Computation and Language · Computer Science 2025-11-17 Cristina Pinneri , Christos Louizos

Hearing is arguably an essential ability of artificial intelligence (AI) agents in the physical world, which refers to the perception and understanding of general auditory information consisting of at least three types of sounds: speech,…

Sound · Computer Science 2024-04-09 Changli Tang , Wenyi Yu , Guangzhi Sun , Xianzhao Chen , Tian Tan , Wei Li , Lu Lu , Zejun Ma , Chao Zhang

This paper presents a real-time modular defense system named Sentra-Guard. The system detects and mitigates jailbreak and prompt injection attacks targeting large language models (LLMs). The framework uses a hybrid architecture with…

Cryptography and Security · Computer Science 2026-05-04 Md. Mehedi Hasan , Sk Tanzir Mehedi , Ziaur Rahman , Rafid Mostafiz , Md. Abir Hossain

Speech Language Models (SLMs) enable natural interactions via spoken instructions, which more effectively capture user intent by detecting nuances in speech. The richer speech signal introduces new security risks compared to text-based…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-17 Amirbek Djanibekov , Nurdaulet Mukhituly , Kentaro Inui , Hanan Aldarmaki , Nils Lukas

Full-duplex multimodal large language models (LLMs) provide a unified framework for addressing diverse speech understanding and generation tasks, enabling more natural and seamless human-machine conversations. Unlike traditional modularised…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-28 Wenyi Yu , Siyin Wang , Xiaoyu Yang , Xianzhao Chen , Xiaohai Tian , Jun Zhang , Guangzhi Sun , Lu Lu , Yuxuan Wang , Chao Zhang

Larger language models (LLMs) have taken the world by storm with their massive multi-tasking capabilities simply by optimizing over a next-word prediction objective. With the emergence of their properties and encoded knowledge, the risk of…

Computation and Language · Computer Science 2023-08-31 Rishabh Bhardwaj , Soujanya Poria

Large Language Models (LLMs) can generate content spanning ideological rhetoric to explicit instructions for violence. However, existing safety evaluations often rely on simplistic binary labels (safe and unsafe), overlooking the nuanced…

Computation and Language · Computer Science 2025-06-03 Vadivel Abishethvarman , Bhavik Chandna , Pratik Jalan , Usman Naseem

Jailbreak attacks expose a persistent gap between the intended safety behavior of aligned large language models and their behavior under adversarial prompting. Existing automated methods are increasingly effective but each commits to a…

Computation and Language · Computer Science 2026-05-21 Abdullah Al Nomaan Nafi , Fnu Suya , Swarup Bhunia , Prabuddha Chakraborty

Large language model (LLM) agents have shown impressive capabilities in human language comprehension and reasoning, yet their potential in cybersecurity remains underexplored. We introduce DefenderBench, a practical, open-source toolkit for…

Computation and Language · Computer Science 2025-10-15 Chiyu Zhang , Marc-Alexandre Cote , Michael Albada , Anush Sankaran , Jack W. Stokes , Tong Wang , Amir Abdi , William Blum , Muhammad Abdul-Mageed

Ensuring the safety and alignment of Large Language Models is a significant challenge with their growing integration into critical applications and societal functions. While prior research has primarily focused on jailbreak attacks, less…

Machine Learning · Computer Science 2026-04-28 Jiawei Chen , Zhengwei Fang , Yu Tian , Jiawei Du , Chao Yu , Zhaoxia Yin , Hang Su

With the growing prevalence of large language models (LLMs), the safety of LLMs has raised significant concerns. However, there is still a lack of definitive standards for evaluating their safety due to the subjective nature of current…

Computation and Language · Computer Science 2025-06-10 Chuxue Cao , Han Zhu , Jiaming Ji , Qichao Sun , Zhenghao Zhu , Yinyu Wu , Juntao Dai , Yaodong Yang , Sirui Han , Yike Guo

Audio Large language models (LLMs) are increasingly deployed in the real world, where they inevitably capture speech from unintended nearby bystanders, raising privacy risks that existing benchmarks and defences did not consider. We…

Sound · Computer Science 2026-04-22 Xiao Zhan , Guangzhi Sun , Jose Such , Phil Woodland

Large Vision-Language Models (LVLMs) unlock powerful multimodal reasoning but also expand the attack surface, particularly through adversarial inputs that conceal harmful goals in benign prompts. We propose SHIELD, a lightweight,…

Computation and Language · Computer Science 2025-10-16 Juan Ren , Mark Dras , Usman Naseem

Large Language Models (LLMs) remain vulnerable to adaptive jailbreaks that easily bypass empirical defenses like GCG. We propose a framework for certifiable robustness that shifts safety guarantees from single-pass inference to the…

Computation and Language · Computer Science 2026-02-03 Zehua Cheng , Jianwei Yang , Wei Dai , Jiahao Sun

Multimodal large language models (MLLMs) are widely used in vision-language reasoning tasks. However, their vulnerability to adversarial prompts remains a serious concern, as safety mechanisms often fail to prevent the generation of harmful…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Zuoou Li , Weitong Zhang , Jingyuan Wang , Shuyuan Zhang , Wenjia Bai , Bernhard Kainz , Mengyun Qiao

Large Language Models (LLMs) demonstrate impressive capabilities across a wide range of tasks, yet their safety mechanisms remain susceptible to adversarial attacks that exploit cognitive biases -- systematic deviations from rational…

Computation and Language · Computer Science 2025-11-18 Xikang Yang , Biyu Zhou , Xuehai Tang , Jizhong Han , Songlin Hu

With the increasingly deep integration of large language models (LLMs) across diverse domains, the effectiveness of their safety mechanisms is encountering severe challenges. Currently, jailbreak attacks based on prompt engineering have…

Cryptography and Security · Computer Science 2025-09-23 Yu-Hang Wu , Yu-Jie Xiong , Hao Zhang , Jia-Chen Zhang , Zheng Zhou

When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails. Indeed, LLMs should never generate content promoting or normalizing harmful, illegal, or unethical behavior that may…

Computation and Language · Computer Science 2024-06-25 Simone Tedeschi , Felix Friedrich , Patrick Schramowski , Kristian Kersting , Roberto Navigli , Huu Nguyen , Bo Li