English
Related papers

Related papers: Speech-Audio Compositional Attacks on Multimodal L…

200 papers

The robustness and security of large language models (LLMs) has become a prominent research area. One notable vulnerability is the ability to bypass LLM safeguards by translating harmful queries into rare or underrepresented languages, a…

Computation and Language · Computer Science 2025-09-16 Hongliang Li , Jinan Xu , Gengping Cui , Changhao Guan , Fengran Mo , Kaiyu Huang

Safety alignment is critical for LLM-powered systems. While recent LLM-powered guardrail approaches such as LlamaGuard achieve high detection accuracy of unsafe inputs written in English (e.g., ``How to create a bomb?''), they struggle with…

Computation and Language · Computer Science 2025-07-18 Wenliang Shan , Michael Fu , Rui Yang , Chakkrit Tantithamthavorn

The emergence of Large Reasoning Models (LRMs) introduces a new paradigm of explicit reasoning, enabling remarkable advances yet posing unique risks such as reasoning manipulation and information leakage. To mitigate these risks, current…

Artificial Intelligence · Computer Science 2026-02-03 Jingnan Zheng , Jingjun Xu , Yanzhen Luo , Chenhang Cui , Gelei Deng , Zhenkai Liang , Xiang Wang , An Zhang , Tat-Seng Chua

In order to enable fluid and natural human-machine speech interaction, existing full-duplex conversational systems often adopt modular architectures with auxiliary components such as voice activity detectors, interrupters, conversation…

Computation and Language · Computer Science 2025-05-26 Wenyi Yu , Siyin Wang , Xiaoyu Yang , Xianzhao Chen , Xiaohai Tian , Jun Zhang , Guangzhi Sun , Lu Lu , Yuxuan Wang , Chao Zhang

Multimodal Large Language Models (MLLMs) are showing strong safety concerns (e.g., generating harmful outputs for users), which motivates the development of safety evaluation benchmarks. However, we observe that existing safety benchmarks…

Cryptography and Security · Computer Science 2024-10-25 Zonghao Ying , Aishan Liu , Siyuan Liang , Lei Huang , Jinyang Guo , Wenbo Zhou , Xianglong Liu , Dacheng Tao

Large Language Models (LLMs) presents significant priority in text understanding and generation. However, LLMs suffer from the risk of generating harmful contents especially while being employed to applications. There are several black-box…

Computation and Language · Computer Science 2023-12-11 Chengyuan Liu , Fubang Zhao , Lizhi Qing , Yangyang Kang , Changlong Sun , Kun Kuang , Fei Wu

Large Audio Language Models (LALMs) have extended the capabilities of Large Language Models (LLMs) by enabling audio-based human interactions. However, recent research has revealed that LALMs remain vulnerable to harmful queries due to…

Computation and Language · Computer Science 2025-05-27 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

While Multimodal Large Language Models (MLLMs) have made remarkable progress in vision-language reasoning, they are also more susceptible to producing harmful content compared to models that focus solely on text. Existing defensive…

Computation and Language · Computer Science 2024-12-30 Yilei Jiang , Yingshui Tan , Xiangyu Yue

Large vision-language models (LVLMs) have achieved remarkable progress in vision-language reasoning tasks, yet ensuring their safety remains a critical challenge. Recent input-side defenses detect unsafe images with CLIP and prepend safety…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xingyu Zhu , Beier Zhu , Junfeng Fang , Shuo Wang , Yin Zhang , Xiang Wang , Xiangnan He

Large Audio Language Models (LALMs) are increasingly capable of reasoning over audio. However, existing benchmarks provide limited coverage of reasoning in polyphonic audio, where multiple sound events co-occur and induce compositional…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Yuanjian Chen , Yang Xiao , Han Yin , Xubo Liu , Jinjie Huang , Ting Dang

Large Language Models (LLMs) have rapidly become integral to numerous applications in critical domains where reliability is paramount. Despite significant advances in safety frameworks and guardrails, current protective measures exhibit…

Cryptography and Security · Computer Science 2025-04-15 Bibek Upadhayay , Vahid Behzadan , Ph. D

Multimodal large language models (MLLMs) have achieved impressive performance across diverse tasks by jointly reasoning over textual and visual inputs. Despite their success, these models remain highly vulnerable to adversarial…

Machine Learning · Computer Science 2025-11-03 Guangzhi Su , Shuchang Huang , Yutong Ke , Zhuohang Liu , Long Qian , Kaizhu Huang

Recent advances in Audio-Language Models (ALMs) have significantly improved multimodal understanding capabilities. However, the introduction of the audio modality also brings new and unique vulnerability vectors. Previous studies have…

Sound · Computer Science 2025-10-31 Weifei Jin , Yuxin Cao , Junjie Su , Minhui Xue , Jie Hao , Ke Xu , Jin Song Dong , Derui Wang

Large Audio Language Models (LALMs) have made significant progress. While increasingly deployed in real-world applications, LALMs face growing safety risks from jailbreak attacks that bypass safety alignment. However, there remains a lack…

Cryptography and Security · Computer Science 2026-03-03 Zifan Peng , Yule Liu , Zhen Sun , Mingchen Li , Zeren Luo , Jingyi Zheng , Wenhan Dong , Xinlei He , Xuechao Wang , Yingjie Xue , Shengmin Xu , Xinyi Huang

The rapid progress of Large Language Models (LLMs) has opened up new opportunities across various domains and applications; yet it also presents challenges related to potential misuse. To mitigate such risks, red teaming has been employed…

Cryptography and Security · Computer Science 2025-06-10 Yifan Jiang , Kriti Aggarwal , Tanmay Laud , Kashif Munir , Jay Pujara , Subhabrata Mukherjee

Large Vision-Language Models (LVLMs) undergo safety alignment to suppress harmful content. However, current defenses predominantly target explicit malicious patterns in the input representation, often overlooking the vulnerabilities…

Cryptography and Security · Computer Science 2026-03-11 Quanchen Zou , Moyang Chen , Zonghao Ying , Wenzhuo Xu , Yisong Xiao , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

Automated red teaming holds substantial promise for uncovering and mitigating the risks associated with the malicious use of large language models (LLMs), yet the field lacks a standardized evaluation framework to rigorously assess new…

Large Language Models (LLMs) remain vulnerable to jailbreak attacks, where adversarially crafted prompts induce policy-violating responses despite safety alignment. Existing defenses typically improve safety through external filtering,…

Cryptography and Security · Computer Science 2026-05-12 Yulong Chen , Qi Zhang , Jiawen Zhang , Yadong Liu , Mu Li , Jie Wen , Yong Xu

Large language models (LLMs) have revolutionized various applications, making robust safety alignment essential to prevent harmful outputs. Current safety alignment techniques, however, harbor inherent vulnerabilities due to their reliance…

Cryptography and Security · Computer Science 2026-04-21 Yuxi Li , Yi Liu , Yuekang Li , Ling Shi , Gelei Deng , Shengquan Chen , Kailong Wang

Embodied agents powered by large language models (LLMs) inherit advanced planning capabilities; however, their direct interaction with the physical world exposes them to safety vulnerabilities. In this work, we identify four key reasoning…

Artificial Intelligence · Computer Science 2025-10-01 Ruolin Chen , Yinqian Sun , Jihang Wang , Mingyang Lv , Qian Zhang , Yi Zeng