English
Related papers

Related papers: Robustifying automatic speech recognition by extra…

200 papers

The application of deep recurrent networks to audio transcription has led to impressive gains in automatic speech recognition (ASR) systems. Many have demonstrated that small adversarial perturbations can fool deep neural networks into…

Machine Learning · Computer Science 2019-08-21 Rohan Taori , Amog Kamsetty , Brenton Chu , Nikita Vemuri

Robust speaker recognition, including in the presence of malicious attacks, is becoming increasingly important and essential, especially due to the proliferation of several smart speakers and personal agents that interact with an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-19 Arindam Jati , Chin-Cheng Hsu , Monisankha Pal , Raghuveer Peri , Wael AbdAlmageed , Shrikanth Narayanan

Automatic speech recognition (ASR) systems based on deep neural networks are weak against adversarial perturbations. We propose mixPGD adversarial training method to improve the robustness of the model for ASR systems. In standard…

Sound · Computer Science 2023-03-13 Aminul Huq , Weiyi Zhang , Xiaolin Hu

Speech models are often trained on sensitive data in order to improve model performance, leading to potential privacy leakage. Our work considers noise masking attacks, introduced by Amid et al. 2022, which attack automatic speech…

Machine Learning · Computer Science 2024-04-03 Matthew Jagielski , Om Thakkar , Lun Wang

Automatic speaker verification (ASV) is one of the core technologies in biometric identification. With the ubiquitous usage of ASV systems in safety-critical applications, more and more malicious attackers attempt to launch adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Haibin Wu , Xu Li , Andy T. Liu , Zhiyong Wu , Helen Meng , Hung-yi Lee

Given the extensive research and real-world applications of automatic speech recognition (ASR), ensuring the robustness of ASR models against minor input perturbations becomes a crucial consideration for maintaining their effectiveness in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-15 Xiaoxue Gao , Zexin Li , Yiming Chen , Cong Liu , Haizhou Li

Whisper is a recent Automatic Speech Recognition (ASR) model displaying impressive robustness to both out-of-distribution inputs and random noise. In this work, we show that this robustness does not carry over to adversarial noise. We show…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-14 Raphael Olivier , Bhiksha Raj

Speech is a common and effective way of communication between humans, and modern consumer devices such as smartphones and home hubs are equipped with deep learning based accurate automatic speech recognition to enable natural interaction…

Computation and Language · Computer Science 2018-01-03 Moustafa Alzantot , Bharathan Balaji , Mani Srivastava

A targeted adversarial attack produces audio samples that can force an Automatic Speech Recognition (ASR) system to output attacker-chosen text. To exploit ASR models in real-world, black-box settings, an adversary can leverage the…

Machine Learning · Computer Science 2022-09-30 Raphael Olivier , Hadi Abdullah , Bhiksha Raj

In light of the widespread application of Automatic Speech Recognition (ASR) systems, their security concerns have received much more attention than ever before, primarily due to the susceptibility of Deep Neural Networks. Previous studies…

Sound · Computer Science 2024-05-16 Weifei Jin , Yuxin Cao , Junjie Su , Qi Shen , Kai Ye , Derui Wang , Jie Hao , Ziyao Liu

Previous works have shown that automatic speaker verification (ASV) is seriously vulnerable to malicious spoofing attacks, such as replay, synthetic speech, and recently emerged adversarial attacks. Great efforts have been dedicated to…

Sound · Computer Science 2024-06-06 Haibin Wu , Xu Li , Andy T. Liu , Zhiyong Wu , Helen Meng , Hung-yi Lee

Adversarial audio attacks can be considered as a small perturbation unperceptive to human ears that is intentionally added to the audio signal and causes a machine learning model to make mistakes. This poses a security concern about the…

Machine Learning · Computer Science 2019-11-26 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

Fooling deep neural networks with adversarial input have exposed a significant vulnerability in the current state-of-the-art systems in multiple domains. Both black-box and white-box approaches have been used to either replicate the model…

Cryptography and Security · Computer Science 2019-07-04 Shreya Khare , Rahul Aralikatte , Senthil Mani

We propose a novel adversarial speaker adaptation (ASA) scheme, in which adversarial learning is applied to regularize the distribution of deep hidden features in a speaker-dependent (SD) deep neural network (DNN) acoustic model to be close…

Machine Learning · Computer Science 2019-04-30 Zhong Meng , Jinyu Li , Yifan Gong

With the development of hardware and algorithms, ASR(Automatic Speech Recognition) systems evolve a lot. As The models get simpler, the difficulty of development and deployment become easier, ASR systems are getting closer to our life. On…

Sound · Computer Science 2022-08-05 Xiao Zhang , Hao Tan , Xuan Huang , Denghui Zhang , Keke Tang , Zhaoquan Gu

Training deep neural networks for automatic speech recognition (ASR) requires large amounts of transcribed speech. This becomes a bottleneck for training robust models for accented speech which typically contains high variability in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-11 Nilaksh Das , Sravan Bodapati , Monica Sunkara , Sundararajan Srinivasan , Duen Horng Chau

Automatic speech recognition (ASR) systems are vulnerable to audio adversarial examples that attempt to deceive ASR systems by adding perturbations to benign speech signals. Although an adversarial example and the original benign wave are…

Cryptography and Security · Computer Science 2021-12-14 Namgyu Park , Sangwoo Ji , Jong Kim

Recent studies have highlighted adversarial examples as a ubiquitous threat to different neural network models and many downstream applications. Nonetheless, as unique data properties have inspired distinct and powerful learning principles,…

Machine Learning · Computer Science 2019-06-06 Zhuolin Yang , Bo Li , Pin-Yu Chen , Dawn Song

In this study, we investigate whether noise-augmented training can concurrently improve adversarial robustness in automatic speech recognition (ASR) systems. We conduct a comparative analysis of the adversarial robustness of four different…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-10 Karla Pizzi , Matías Pizarro , Asja Fischer

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang