English
Related papers

Related papers: Transferable Adversarial Attacks against ASR

200 papers

Automatic speech recognition (ASR) systems are of vital importance nowadays in commonplace tasks such as speech-to-text processing and language translation. This created the need for an ASR system that can operate in realistic crowded…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-29 Sherif Abdulatif , Karim Armanious , Karim Guirguis , Jayasankar T. Sajeev , Bin Yang

The practical deployment of Audio-Visual Speech Recognition (AVSR) systems is fundamentally challenged by significant performance degradation in real-world environments, characterized by unpredictable acoustic noise and visual interference.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-17 Sungnyun Kim

Compared with automatic speech recognition (ASR), the human auditory system is more adept at handling noise-adverse situations, including environmental noise and channel distortion. To mimic this adeptness, auditory models have been widely…

Computation and Language · Computer Science 2016-09-16 Peng Dai , Xue Teng , Frank Rudzicz , Ing Yann Soon

Spoken question answering (SQA) is challenging due to complex reasoning on top of the spoken documents. The recent studies have also shown the catastrophic impact of automatic speech recognition (ASR) errors on SQA. Therefore, this work…

Computation and Language · Computer Science 2019-04-18 Chia-Hsuan Lee , Yun-Nung Chen , Hung-Yi Lee

In recent years, deep learning (DL) models have achieved significant progress in many domains, such as autonomous driving, facial recognition, and speech recognition. However, the vulnerability of deep learning models to adversarial attacks…

Cryptography and Security · Computer Science 2023-04-19 Feng Guo , Zheng Sun , Yuxuan Chen , Lei Ju

Speech-based virtual assistants, such as Amazon Alexa, Google assistant, and Apple Siri, typically convert users' audio signals to text data through automatic speech recognition (ASR) and feed the text to downstream dialog models for…

Computation and Language · Computer Science 2020-06-11 Longshaokan Wang , Maryam Fazel-Zarandi , Aditya Tiwari , Spyros Matsoukas , Lazaros Polymenakos

Automatic speech recognition (ASR) systems have achieved near-human accuracy on curated benchmarks, yet still fail in real-world voice agents under conditions that current evaluations do not systematically cover. Without diagnostic tools…

Artificial Intelligence · Computer Science 2026-03-27 Geeyang Tay , Wentao Ma , Jaewon Lee , Yuzhi Tang , Daniel Lee , Weisu Yin , Dongming Shen , Silin Meng , Yi Zhu , Mu Li , Alex Smola

Recent work has illuminated the vulnerability of speaker recognition systems (SRSs) against adversarial attacks, raising significant security concerns in deploying SRSs. However, they considered only a few settings (e.g., some combinations…

Sound · Computer Science 2022-06-08 Guangke Chen , Zhe Zhao , Fu Song , Sen Chen , Lingling Fan , Yang Liu

Extensive research has revealed that adversarial examples (AE) pose a significant threat to voice-controllable smart devices. Recent studies have proposed black-box adversarial attacks that require only the final transcription from an…

Cryptography and Security · Computer Science 2024-08-06 Peng Cheng , Yuwei Wang , Peng Huang , Zhongjie Ba , Xiaodong Lin , Feng Lin , Li Lu , Kui Ren

Robust speaker recognition, including in the presence of malicious attacks, is becoming increasingly important and essential, especially due to the proliferation of several smart speakers and personal agents that interact with an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-19 Arindam Jati , Chin-Cheng Hsu , Monisankha Pal , Raghuveer Peri , Wael AbdAlmageed , Shrikanth Narayanan

In realistic environments, speech is usually interfered by various noise and reverberation, which dramatically degrades the performance of automatic speech recognition (ASR) systems. To alleviate this issue, the commonest way is to use a…

Sound · Computer Science 2018-05-04 Bin Liu , Shuai Nie , Yaping Zhang , Dengfeng Ke , Shan Liang , Wenju Liu1

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

On-device automatic speech recognition systems face several challenges compared to server-based systems. They have to meet stricter constraints in terms of speed, disk size and memory while maintaining the same accuracy. Often they have to…

Computation and Language · Computer Science 2023-05-18 Markus Nußbaum-Thom , Lyan Verwimp , Youssef Oualil

Although adversarial robustness has been extensively studied in white-box settings, recent advances in black-box attacks (including transfer- and query-based approaches) are primarily benchmarked against weak defenses, leaving a significant…

Machine Learning · Computer Science 2026-02-18 Mohamed Djilani , Salah Ghamizi , Maxime Cordy

Extensive research has shown that Automatic Speech Recognition (ASR) systems are vulnerable to audio adversarial attacks. Current attacks mainly focus on single-source scenarios, ignoring dual-source scenarios where two people are speaking…

Cryptography and Security · Computer Science 2025-04-08 Zheng Fang , Shenyi Zhang , Tao Wang , Bowen Li , Lingchen Zhao , Zhangyi Wang

High-performance spoofing countermeasure systems for automatic speaker verification (ASV) have been proposed in the ASVspoof 2019 challenge. However, the robustness of such systems under adversarial attacks has not been studied yet. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-22 Songxiang Liu , Haibin Wu , Hung-yi Lee , Helen Meng

The black-box adversarial attack has attracted impressive attention for its practical use in the field of deep learning security. Meanwhile, it is very challenging as there is no access to the network architecture or internal weights of the…

Machine Learning · Computer Science 2022-04-26 Yifeng Xiong , Jiadong Lin , Min Zhang , John E. Hopcroft , Kun He

With increasingly more powerful compute capabilities and resources in today's devices, traditionally compute-intensive automatic speech recognition (ASR) has been moving from the cloud to devices to better protect user privacy. However, it…

Machine Learning · Computer Science 2024-05-15 Mingbin Xu , Alex Jin , Sicheng Wang , Mu Su , Tim Ng , Henry Mason , Shiyi Han , Zhihong Lei , Yaqiao Deng , Zhen Huang , Mahesh Krishnamoorthy

In a pipeline speech translation system, automatic speech recognition (ASR) system will transmit errors in recognition to the downstream machine translation (MT) system. A standard machine translation system is usually trained on parallel…

Computation and Language · Computer Science 2019-10-29 Qiao Cheng , Meiyuan Fang , Yaqian Han , Jin Huang , Yitao Duan

Training deep neural networks for automatic speech recognition (ASR) requires large amounts of transcribed speech. This becomes a bottleneck for training robust models for accented speech which typically contains high variability in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-11 Nilaksh Das , Sravan Bodapati , Monica Sunkara , Sundararajan Srinivasan , Duen Horng Chau