English
Related papers

Related papers: Audio Adversarial Examples for Robust Hybrid CTC/A…

200 papers

Adversarial machine learning research has recently demonstrated the feasibility to confuse automatic speech recognition (ASR) models by introducing acoustically imperceptible perturbations to audio samples. To help researchers and…

Machine Learning · Computer Science 2018-05-31 Nilaksh Das , Madhuri Shanbhogue , Shang-Tse Chen , Li Chen , Michael E. Kounavis , Duen Horng Chau

This review paper provides a comprehensive analysis of recent advances in automatic speech recognition (ASR) with bidirectional encoder representations from transformers BERT and connectionist temporal classification (CTC) transformers. The…

Computation and Language · Computer Science 2024-10-15 Noussaiba Djeffal , Hamza Kheddar , Djamel Addou , Ahmed Cherif Mazari , Yassine Himeur

Modern automatic speech recognition (ASR) systems need to be robust under acoustic variability arising from environmental, speaker, channel, and recording conditions. Ensuring such robustness to variability is a challenge in modern day…

Computation and Language · Computer Science 2016-12-07 Dmitriy Serdyuk , Kartik Audhkhasi , Philémon Brakel , Bhuvana Ramabhadran , Samuel Thomas , Yoshua Bengio

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

While pre-trained automatic speech recognition (ASR) systems demonstrate impressive performance on matched domains, their performance often degrades when confronted with channel mismatch stemming from unseen recording environments and…

Sound · Computer Science 2025-01-09 Chien-Chun Wang , Li-Wei Chen , Cheng-Kang Chou , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

The attention-based encoder-decoder (AED) speech recognition model has been widely successful in recent years. However, the joint optimization of acoustic model and language model in end-to-end manner has created challenges for text…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Shaoshi Ling , Guoli Ye , Rui Zhao , Yifan Gong

Automated Audio Captioning (AAC) aims to develop systems capable of describing an audio recording using a textual sentence. In contrast, Audio-Text Retrieval (ATR) systems seek to find the best matching audio recording(s) for a given…

Computation and Language · Computer Science 2023-08-30 Etienne Labbé , Thomas Pellegrini , Julien Pinquier

The performance of automatic speech recognition (ASR) has improved tremendously due to the application of deep neural networks (DNNs). Despite this progress, building a new ASR system remains a challenging task, requiring various resources,…

Computation and Language · Computer Science 2015-10-20 Yajie Miao , Mohammad Gowayyed , Florian Metze

Speech emotion recognition (SER) is constantly gaining attention in recent years due to its potential applications in diverse fields and thanks to the possibility offered by deep learning technologies. However, recent studies have shown…

Sound · Computer Science 2024-04-30 Nicolas Facchinetti , Federico Simonetta , Stavros Ntalampiras

Automatic speech recognition (ASR) outcomes serve as input for downstream tasks, substantially impacting the satisfaction level of end-users. Hence, the diagnosis and enhancement of the vulnerabilities present in the ASR model bear…

Computation and Language · Computer Science 2024-01-29 Seonmin Koo , Chanjun Park , Jinsung Kim , Jaehyung Seo , Sugyeong Eo , Hyeonseok Moon , Heuiseok Lim

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

Sound · Computer Science 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

Automatic Speaker Verification (ASV) systems can be used for voice-enabled applications for identity verification. However, recent studies have exposed these systems' vulnerabilities to both over-the-line (OTL) and over-the-air (OTA)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-12 Li Wang , Xiaoyan Lei , Haorui He , Lei Wang , Jie Shi , Zhizheng Wu

Automatic Speech Recognition services (ASRs) inherit deep neural networks' vulnerabilities like crafted adversarial examples. Existing methods often suffer from low efficiency because the target phases are added to the entire audio sample,…

Sound · Computer Science 2022-02-14 Yuantian Miao , Chao Chen , Lei Pan , Jun Zhang , Yang Xiang

End-to-end (E2E) automatic speech recognition (ASR) models have become standard practice for various commercial applications. However, in real-world scenarios, the long-tailed nature of word distribution often leads E2E ASR models to…

Computation and Language · Computer Science 2024-09-11 Yi-Cheng Wang , Li-Ting Pai , Bi-Cheng Yan , Hsin-Wei Wang , Chi-Han Lin , Berlin Chen

In this paper, we present a novel two-pass approach to unify streaming and non-streaming end-to-end (E2E) speech recognition in a single model. Our model adopts the hybrid CTC/attention architecture, in which the conformer layers in the…

Sound · Computer Science 2021-12-30 Binbin Zhang , Di Wu , Zhuoyuan Yao , Xiong Wang , Fan Yu , Chao Yang , Liyong Guo , Yaguang Hu , Lei Xie , Xin Lei

In this paper we introduce various techniques to improve the performance of electroencephalography (EEG) features based continuous speech recognition (CSR) systems. A connectionist temporal classification (CTC) based automatic speech…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-25 Gautam Krishna , Co Tran , Mason Carnahan , Yan Han , Ahmed H Tewfik

Conventional automatic speech recognition (ASR) typically performs multi-level pattern recognition tasks that map the acoustic speech waveform into a hierarchy of speech units. But, it is widely known that information loss in the earlier…

Computation and Language · Computer Science 2017-09-25 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Siamese networks have shown effective results in unsupervised visual representation learning. These models are designed to learn an invariant representation of two augmentations for one input by maximizing their similarity. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-23 Yingying Gao , Junlan Feng , Tianrui Wang , Chao Deng , Shilei Zhang

Automatic Speech Recognition (ASR) plays a crucial role in voice-based applications. For applications requiring real-time feedback like Voice Search, streaming capability becomes vital. While LSTM/RNN and CTC based ASR systems are commonly…

Sound · Computer Science 2023-05-31 Abhinav Goyal , Nikesh Garera

Automatic Cued Speech Recognition (ACSR) provides an intelligent human-machine interface for visual communications, where the Cued Speech (CS) system utilizes lip movements and hand gestures to code spoken language for hearing-impaired…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Lei Liu , Li Liu