English
Related papers

Related papers: DUAP: Dual-task Universal Adversarial Perturbation…

200 papers

In this paper we investigate speech denoising as a defense against adversarial attacks on automatic speech recognition (ASR) systems. Adversarial attacks attempt to force misclassification by adding small perturbations to the original…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-13 Anirudh Sreeram , Nicholas Mehlman , Raghuveer Peri , Dillon Knox , Shrikanth Narayanan

Audio-visual speech recognition (AVSR) combines audio-visual modalities to improve speech recognition, especially in noisy environments. However, most existing methods deploy the unidirectional enhancement or symmetric fusion manner, which…

Multimedia · Computer Science 2025-08-12 Junxiao Xue , Xiaozhen Liu , Xuecheng Wu , Xinyi Yin , Danlei Huang , Fei Yu

Perception module of Autonomous vehicles (AVs) are increasingly susceptible to be attacked, which exploit vulnerabilities in neural networks through adversarial inputs, thereby compromising the AI safety. Some researches focus on creating…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yuanhao Huang , Qinfan Zhang , Jiandong Xing , Mengyue Cheng , Haiyang Yu , Yilong Ren , Xiao Xiong

Form about four decades human beings have been dreaming of an intelligent machine which can master the natural speech. In its simplest form, this machine should consist of two subsystems, namely automatic speech recognition (ASR) and speech…

Sound · Computer Science 2013-05-08 Urmila Shrawankar , V. M. Thakare

Adversarial attacks against deep learning-based object detectors have been studied extensively in the past few years. Most of the attacks proposed have targeted the model's integrity (i.e., caused the model to make incorrect predictions),…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Avishag Shapira , Alon Zolfi , Luca Demetrio , Battista Biggio , Asaf Shabtai

Individuals with cerebral palsy (CP) and amyotrophic lateral sclerosis (ALS) frequently face challenges with articulation, leading to dysarthria and resulting in atypical speech patterns. In healthcare settings, communication breakdowns…

Computation and Language · Computer Science 2024-11-11 Macarious Hui , Jinda Zhang , Aanchan Mohan

Voice authentication systems remain susceptible to two major threats: backdoor triggered attacks and targeted data poisoning attacks. This dual vulnerability is critical because conventional solutions typically address each threat type…

Cryptography and Security · Computer Science 2025-05-07 Alireza Mohammadi , Keshav Sood , Dhananjay Thiruvady , Asef Nazari

As a versatile AI application, voice assistants (VAs) have become increasingly popular, but are vulnerable to security threats. Attackers have proposed various inaudible attacks, but are limited by cost, distance, or LoS. Therefore, we…

Cryptography and Security · Computer Science 2026-03-26 Chao Liu , Zhezheng Zhu , Hao Chen , Kaiwen Guo , Penghao Wang , Xiang-Yang Li

Automatic speaker verification (ASV) plays a critical role in security-sensitive environments. Regrettably, the reliability of ASV has been undermined by the emergence of spoofing attacks, such as replay and synthetic speech, as well as…

Sound · Computer Science 2023-06-27 Haibin Wu , Jiawen Kang , Lingwei Meng , Helen Meng , Hung-yi Lee

As speech translation (ST) systems become increasingly prevalent, understanding their vulnerabilities is crucial for ensuring robust and reliable communication. However, limited work has explored this issue in depth. This paper explores…

Sound · Computer Science 2025-03-06 Chang Liu , Haolin Wu , Xi Yang , Kui Zhang , Cong Wu , Weiming Zhang , Nenghai Yu , Tianwei Zhang , Qing Guo , Jie Zhang

Pre-trained models for automatic speech recognition (ASR) and speech enhancement (SE) have exhibited remarkable capabilities under matched noise and channel conditions. However, these models often suffer from severe performance degradation…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Chien-Chun Wang , Hung-Shin Lee , Hsin-Min Wang , Berlin Chen

Deep neural networks (DNNs) have accomplished impressive success in various applications, including autonomous driving perception tasks, in recent years. On the other hand, current deep neural networks are easily fooled by adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Ibrahim Sobh , Ahmed Hamed , Varun Ravi Kumar , Senthil Yogamani

Multi-speaker automatic speech recognition (ASR) aims to transcribe conversational speech involving multiple speakers, requiring the model to capture not only what was said, but also who said it and sometimes when it was spoken. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Li Li , Ming Cheng , Weixin Zhu , Yannan Wang , Juan Liu , Ming Li

Unsupervised speech recognition (unsupervised ASR) aims to learn the ASR system with non-parallel speech and text corpus only. Wav2vec-U has shown promising results in unsupervised ASR by self-supervised speech representations coupled with…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Guan-Ting Lin , Chan-Jan Hsu , Da-Rong Liu , Hung-Yi Lee , Yu Tsao

The state-of-art models for speech synthesis and voice conversion are capable of generating synthetic speech that is perceptually indistinguishable from bonafide human speech. These methods represent a threat to the automatic speaker…

Machine Learning · Computer Science 2019-07-11 Moustafa Alzantot , Ziqi Wang , Mani B. Srivastava

Deep Learning has advanced Automatic Speaker Verification (ASV) in the past few years. Although it is known that deep learning-based ASV systems are vulnerable to adversarial examples in digital access, there are few studies on adversarial…

Sound · Computer Science 2024-01-04 Jiaqi Li , Li Wang , Liumeng Xue , Lei Wang , Zhizheng Wu

With the development of hardware and algorithms, ASR(Automatic Speech Recognition) systems evolve a lot. As The models get simpler, the difficulty of development and deployment become easier, ASR systems are getting closer to our life. On…

Sound · Computer Science 2022-08-05 Xiao Zhang , Hao Tan , Xuan Huang , Denghui Zhang , Keke Tang , Zhaoquan Gu

In this work, we propose a training algorithm for an audio-visual automatic speech recognition (AV-ASR) system using deep recurrent neural network (RNN).First, we train a deep RNN acoustic model with a Connectionist Temporal Classification…

Computer Vision and Pattern Recognition · Computer Science 2016-11-10 Abhinav Thanda , Shankar M Venkatesan

Detecting adversarial samples that are carefully crafted to fool the model is a critical step to socially-secure applications. However, existing adversarial detection methods require access to sufficient training data, which brings…

Computation and Language · Computer Science 2023-06-29 Songyang Gao , Shihan Dou , Qi Zhang , Xuanjing Huang , Jin Ma , Ying Shan

In this paper, we propose a novel approach for the transcription of speech conversations with natural speaker overlap, from single channel speech recordings. The proposed model is a combination of a speaker diarization system and a hybrid…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-30 Srikanth Raj Chetupalli , Sriram Ganapathy