中文
相关论文

相关论文: SoundBreak: A Systematic Study of Audio-Only Adver…

200 篇论文

Adversarial training is a promising strategy for enhancing model robustness against adversarial attacks. However, its impact on generalization under substantial data distribution shifts in audio classification remains largely unexplored. To…

机器学习 · 计算机科学 2025-07-21 René Heinrich , Lukas Rauch , Bernhard Sick , Christoph Scholz

Large vision-language models (LVLMs) have emerged as a powerful paradigm for multimodal intelligence, but their growing deployment also expands the attack surface of prompt injection. Despite this growing concern, existing attacks still…

密码学与安全 · 计算机科学 2026-05-18 Hao Yang , Zhuo Ma , Yang Liu , Yilong Yang , Guancheng Wang , JianFeng Ma

This paper introduces a novel adversarial algorithm for attacking the state-of-the-art speech-to-text systems, namely DeepSpeech, Kaldi, and Lingvo. Our approach is based on developing an extension for the conventional distortion condition…

声音 · 计算机科学 2021-03-16 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

Audio deepfakes are increasingly in-differentiable from organic speech, often fooling both authentication systems and human listeners. While many techniques use low-level audio features or optimization black-box model training, focusing on…

声音 · 计算机科学 2025-02-21 Kevin Warren , Daniel Olszewski , Seth Layton , Kevin Butler , Carrie Gates , Patrick Traynor

The adversarial attack can force a CNN-based model to produce an incorrect output by craftily manipulating human-imperceptible input. Exploring such perturbations can help us gain a deeper understanding of the vulnerability of neural…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Xiangyu Yin , Wenjie Ruan , Jonathan Fieldsend

Integrated Speech and Large Language Models (SLMs) that can follow speech instructions and generate relevant text responses have gained popularity lately. However, the safety and robustness of these models remains largely unclear. In this…

Large Vision-Language Models (LVLMs) have transformed multi-modal understanding, excelling in tasks like image captioning and visual question answering by integrating visual and textual inputs. However, their robustness against adversarial…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Xiang Fang , Wanlong Fang , Changshuo Wang

Speech contains rich information on the emotions of humans, and Speech Emotion Recognition (SER) has been an important topic in the area of human-computer interaction. The robustness of SER models is crucial, particularly in…

声音 · 计算机科学 2024-02-05 Yi Chang , Zhao Ren , Zixing Zhang , Xin Jing , Kun Qian , Xi Shao , Bin Hu , Tanja Schultz , Björn W. Schuller

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

计算与语言 · 计算机科学 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

Adversarial attacks pose a threat to deep learning models. However, research on adversarial detection methods, especially in the multi-modal domain, is very limited. In this work, we propose an efficient and straightforward detection method…

计算机视觉与模式识别 · 计算机科学 2021-02-15 Pingchuan Ma , Stavros Petridis , Maja Pantic

We consider an echo-assisted communication model wherein block-coded messages, when transmitted across several frames, reach the destination as multiple noisy copies. We address adversarial attacks on such models wherein a subset of the…

信息论 · 计算机科学 2019-04-11 Mohit Goyal , J. Harshan

Deep neural network based speaker recognition systems can easily be deceived by an adversary using minuscule imperceptible perturbations to the input speech samples. These adversarial attacks pose serious security threats to the speaker…

音频与语音处理 · 电气工程与系统科学 2020-11-02 Monisankha Pal , Arindam Jati , Raghuveer Peri , Chin-Cheng Hsu , Wael AbdAlmageed , Shrikanth Narayanan

Recent advancements in large audio-language models (LALMs) have enabled speech-based user interactions, significantly enhancing user experience and accelerating the deployment of LALMs in real-world applications. However, ensuring the…

声音 · 计算机科学 2024-12-12 Mintong Kang , Chejian Xu , Bo Li

State-of-the-art vision-and-language models consist of many parameters and learn from enormous datasets, surpassing the amounts of linguistic data that children are exposed to as they acquire a language. This paper presents our approach to…

计算与语言 · 计算机科学 2025-10-03 Ece Takmaz , Lisa Bylinina , Jakub Dotlacil

The expansion of Multimodal Large Language Models (MLLMs) and their integration into autonomous agentic workflows has introduced a non-stationary attack surface. Empirical observations indicate that adversaries employ progressive,…

密码学与安全 · 计算机科学 2026-05-20 Doohee You

In this work, we demonstrate the existence of universal adversarial audio perturbations that cause mis-transcription of audio signals by automatic speech recognition (ASR) systems. We propose an algorithm to find a single…

机器学习 · 计算机科学 2019-08-16 Paarth Neekhara , Shehzeen Hussain , Prakhar Pandey , Shlomo Dubnov , Julian McAuley , Farinaz Koushanfar

Adversarial attacks are inputs that are similar to original inputs but altered on purpose. Speech-to-text neural networks that are widely used today are prone to misclassify adversarial attacks. In this study, first, we investigate the…

机器学习 · 计算机科学 2021-01-14 Ken Alparslan , Yigit Alparslan , Matthew Burlick

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui

Neural models enjoy widespread use across a variety of tasks and have grown to become crucial components of many industrial systems. Despite their effectiveness and extensive popularity, they are not without their exploitable flaws.…

声音 · 计算机科学 2019-02-26 Krishan Rajaratnam , Jugal Kalita

Computational paralinguistic analysis is increasingly being used in a wide range of cyber applications, including security-sensitive applications such as speaker verification, deceptive speech detection, and medical diagnostics. While…

机器学习 · 计算机科学 2019-01-14 Yuan Gong , Christian Poellabauer