中文
相关论文

相关论文: Breaking Audio Large Language Models by Attacking …

200 篇论文

Multimodal large language models (MLLMs) have achieved remarkable progress, yet remain critically vulnerable to adversarial attacks that exploit weaknesses in cross-modal processing. We present a systematic study of multimodal jailbreaks…

密码学与安全 · 计算机科学 2025-10-24 Divyanshu Kumar , Shreyas Jena , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

Large Vision-Language Models (VLMs) have demonstrated remarkable performance across multimodal tasks by integrating vision encoders with large language models (LLMs). However, these models remain vulnerable to adversarial attacks. Among…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Hee-Seon Kim , Minbeom Kim , Changick Kim

Machine learning approaches for speech enhancement are becoming increasingly expressive, enabling ever more powerful modifications of input signals. In this paper, we demonstrate that this expressiveness introduces a vulnerability: advanced…

音频与语音处理 · 电气工程与系统科学 2026-05-01 Rostislav Makarov , Lea Schönherr , Timo Gerkmann

The text generation paradigm for audio tasks has opened new possibilities for unified audio understanding. However, existing models face significant challenges in achieving a comprehensive understanding across diverse audio types, such as…

音频与语音处理 · 电气工程与系统科学 2025-05-28 Ziqian Wang , Xianjun Xia , Xinfa Zhu , Lei Xie

Adversarial attacks refer to a set of methods that perturb the input to a classification model in order to fool the classifier. In this paper we apply different gradient based adversarial attack algorithms on five deep learning models…

机器学习 · 计算机科学 2019-08-16 Vinod Subramanian , Emmanouil Benetos , Ning Xu , SKoT McDonald , Mark Sandler

This paper presents the Interspeech 2026 Audio Encoder Capability Challenge, a benchmark specifically designed to evaluate and advance the performance of pre-trained audio encoders as front-end modules for Large Audio Language Models…

Large Audio Language Models (LALMs) demonstrate impressive performance across diverse tasks, ranging from speech recognition to general audio understanding. However, their scalability is limited by the quadratic complexity of attention and…

音频与语音处理 · 电气工程与系统科学 2025-11-27 Saurabhchand Bhati , Samuel Thomas , Hilde Kuehne , Rogerio Feris , James Glass

As audio-visual multi-modal large language models (MLLMs) are increasingly deployed in safety-critical applications, understanding their vulnerabilities is crucial. To this end, we introduce Multi-Modal Typography, a systematic study…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Tianle Chen , Deepti Ghadiyaram

Developers increasingly construct multimodal large language models (MLLMs) by assembling pretrained components,introducing supply-chain attack surfaces.Existing security research primarily focuses on poisoning backbones such as encoders or…

密码学与安全 · 计算机科学 2026-05-11 Runhe Wang , Li Bai , Haibo Hu , Songze Li

Current research in adversarial robustness of LLMs focuses on discrete input manipulations in the natural language space, which can be directly transferred to closed-source models. However, this approach neglects the steady progression of…

机器学习 · 计算机科学 2025-04-17 Leo Schwinn , David Dobre , Sophie Xhonneux , Gauthier Gidel , Stephan Gunnemann

Universal Adversarial Perturbations are image-agnostic and model-independent noise that when added with any image can mislead the trained Deep Convolutional Neural Networks into the wrong prediction. Since these Universal Adversarial…

密码学与安全 · 计算机科学 2021-11-19 Mehdi Sadi , B. M. S. Bahar Talukder , Kaniz Mishty , Md Tauhidur Rahman

Backdoor attacks manipulate model predictions by inserting innocuous triggers into training and test data. We focus on more realistic and more challenging clean-label attacks where the adversarial training examples are correctly labeled.…

机器学习 · 计算机科学 2023-10-31 Wencong You , Zayd Hammoudeh , Daniel Lowd

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

密码学与安全 · 计算机科学 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

As powerful Large Language Models (LLMs) are now widely used for numerous practical applications, their safety is of critical importance. While alignment techniques have significantly improved overall safety, LLMs remain vulnerable to…

机器学习 · 计算机科学 2024-10-28 Samuel Jacob Chacko , Sajib Biswas , Chashi Mahiul Islam , Fatema Tabassum Liza , Xiuwen Liu

Speech enabled foundation models, either in the form of flexible speech recognition based systems or audio-prompted large language models (LLMs), are becoming increasingly popular. One of the interesting aspects of these models is their…

声音 · 计算机科学 2024-10-14 Vyas Raina , Mark Gales

While Vision-Language Models (VLMs) and Multimodal Large Language Models (MLLMs) have shown strong generalisation in detecting image and video deepfakes, their use for audio deepfake detection remains largely unexplored. In this work, we…

声音 · 计算机科学 2026-01-05 Akanksha Chuchra , Shukesh Reddy , Sudeepta Mishra , Abhijit Das , Abhinav Dhall

Adversarial examples are inputs to machine learning models designed by an adversary to cause an incorrect output. So far, adversarial examples have been studied most extensively in the image domain. In this domain, adversarial examples can…

音频与语音处理 · 电气工程与系统科学 2019-06-10 Yao Qin , Nicholas Carlini , Ian Goodfellow , Garrison Cottrell , Colin Raffel

In a transfer-based attack against Automatic Speech Recognition (ASR) systems, attacks are unable to access the architecture and parameters of the target model. Existing attack methods are mostly investigated in voice assistant scenarios…

声音 · 计算机科学 2023-03-29 Qi Gege , Yuefeng Chen , Xiaofeng Mao , Yao Zhu , Binyuan Hui , Xiaodan Li , Rong Zhang , Hui Xue

The fast advancements in Large Language Models (LLMs) are driving an increasing number of applications. Together with the growing number of users, we also see an increasing number of attackers who try to outsmart these systems. They want…

密码学与安全 · 计算机科学 2024-05-31 Patrick Levi , Christoph P. Neumann

Large language models (LLMs) have achieved remarkable performance across diverse natural language processing tasks, yet their vulnerability to character-level adversarial manipulations presents significant security challenges for real-world…

密码学与安全 · 计算机科学 2025-11-27 Ephraiem Sarabamoun