English
Related papers

Related papers: Exploiting Vulnerabilities in Speech Translation S…

200 papers

We demonstrate the existence of universal adversarial perturbations, which can fool a family of audio classification architectures, for both targeted and untargeted attack scenarios. We propose two methods for finding such perturbations.…

Machine Learning · Computer Science 2020-11-18 Sajjad Abdoli , Luiz G. Hafemann , Jerome Rony , Ismail Ben Ayed , Patrick Cardinal , Alessandro L. Koerich

A Machine-Critical Application is a system that is fundamentally necessary to the success of specific and sensitive operations such as search and recovery, rescue, military, and emergency management actions. Recent advances in Machine…

Despite their immense popularity, deep learning-based acoustic systems are inherently vulnerable to adversarial attacks, wherein maliciously crafted audios trigger target systems to misbehave. In this paper, we present SirenAttack, a new…

Cryptography and Security · Computer Science 2019-07-25 Tianyu Du , Shouling Ji , Jinfeng Li , Qinchen Gu , Ting Wang , Raheem Beyah

Previous works have shown that automatic speaker verification (ASV) is seriously vulnerable to malicious spoofing attacks, such as replay, synthetic speech, and recently emerged adversarial attacks. Great efforts have been dedicated to…

Sound · Computer Science 2024-06-06 Haibin Wu , Xu Li , Andy T. Liu , Zhiyong Wu , Helen Meng , Hung-yi Lee

In a pipeline speech translation system, automatic speech recognition (ASR) system will transmit errors in recognition to the downstream machine translation (MT) system. A standard machine translation system is usually trained on parallel…

Computation and Language · Computer Science 2019-10-29 Qiao Cheng , Meiyuan Fang , Yaqian Han , Jin Huang , Yitao Duan

Recently, adversarial machine learning attacks have posed serious security threats against practical audio signal classification systems, including speech recognition, speaker recognition, and music copyright detection. Previous studies…

Sound · Computer Science 2022-07-28 Rui Duan , Zhe Qu , Shangqing Zhao , Leah Ding , Yao Liu , Zhuo Lu

Neural Machine Translation systems are used in diverse applications due to their impressive performance. However, recent studies have shown that these systems are vulnerable to carefully crafted small perturbations to their inputs, known as…

Computation and Language · Computer Science 2024-11-20 Sahar Sadrizadeh , César Descalzo , Ljiljana Dolamic , Pascal Frossard

Multimodal foundation models that integrate audio, vision, and language achieve strong performance on reasoning and generation tasks, yet their robustness to adversarial manipulation remains poorly understood. We study a realistic and…

Sound · Computer Science 2026-01-26 Aafiya Hussain , Gaurav Srivastava , Alvi Ishmam , Zaber Hakim , Chris Thomas

We propose a method to generate audio adversarial examples that can attack a state-of-the-art speech recognition model in the physical world. Previous work assumes that generated adversarial examples are directly fed to the recognition…

Machine Learning · Computer Science 2019-08-20 Hiromu Yakura , Jun Sakuma

Deep neural network based speaker recognition systems can easily be deceived by an adversary using minuscule imperceptible perturbations to the input speech samples. These adversarial attacks pose serious security threats to the speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-02 Monisankha Pal , Arindam Jati , Raghuveer Peri , Chin-Cheng Hsu , Wael AbdAlmageed , Shrikanth Narayanan

Sparse attacks are to optimize the magnitude of adversarial perturbations for fooling deep neural networks (DNNs) involving only a few perturbed pixels (i.e., under the l0 constraint), suitable for interpreting the vulnerability of DNNs.…

Machine Learning · Computer Science 2025-06-24 Fudong Lin , Jiadong Lou , Hao Wang , Brian Jalaian , Xu Yuan

Targeted adversarial attacks are widely used to evaluate the robustness of neural machine translation systems. Unfortunately, this paper first identifies a critical issue in the existing settings of NMT targeted adversarial attacks, where…

Computation and Language · Computer Science 2024-07-09 Junjie Wu , Lemao Liu , Wei Bi , Dit-Yan Yeung

This paper introduces a novel adversarial algorithm for attacking the state-of-the-art speech-to-text systems, namely DeepSpeech, Kaldi, and Lingvo. Our approach is based on developing an extension for the conventional distortion condition…

Sound · Computer Science 2021-03-16 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

Adversarial examples seem to be inevitable. These specifically crafted inputs allow attackers to arbitrarily manipulate machine learning systems. Even worse, they often seem harmless to human observers. In our digital society, this poses a…

Cryptography and Security · Computer Science 2021-06-04 Thorsten Eisenhofer , Lea Schönherr , Joel Frank , Lars Speckemeier , Dorothea Kolossa , Thorsten Holz

The rapid progress in personalized speech generation technology, including personalized text-to-speech (TTS) and voice conversion (VC), poses a challenge in distinguishing between generated and real speech for human listeners, resulting in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Shihao Chen , Liping Chen , Jie Zhang , KongAik Lee , Zhenhua Ling , Lirong Dai

We propose a test-time defense mechanism against adversarial attacks: imperceptible image perturbations that significantly alter the predictions of a model. Unlike existing methods that rely on feature filtering or smoothing, which can lead…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Dong Lao , Yuxiang Zhang , Haniyeh Ehsani Oskouie , Yangchao Wu , Alex Wong , Stefano Soatto

Automatic speech recognition systems based on neural networks are vulnerable to adversarial attacks that alter transcriptions in a malicious way. Recent works in this field have focused on making attacks work in over-the-air scenarios,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-19 Protopopov Alexey

With the advent of deep learning methods, Neural Machine Translation (NMT) systems have become increasingly powerful. However, deep learning based systems are susceptible to adversarial attacks, where imperceptible changes to the input can…

Computation and Language · Computer Science 2023-06-27 Vyas Raina , Mark Gales

Modern text-to-speech (TTS) systems, particularly those built on Large Audio-Language Models (LALMs), generate high-fidelity speech that faithfully reproduces input text and mimics specified speaker identities. While prior misuse studies…

Sound · Computer Science 2025-11-17 Guangke Chen , Yuhui Wang , Shouling Ji , Xiapu Luo , Ting Wang

While neural machine translation (NMT) models achieve success in our daily lives, they show vulnerability to adversarial attacks. Despite being harmful, these attacks also offer benefits for interpreting and enhancing NMT models, thus…

Computation and Language · Computer Science 2024-09-10 Yanni Xue , Haojie Hao , Jiakai Wang , Qiang Sheng , Renshuai Tao , Yu Liang , Pu Feng , Xianglong Liu