English
Related papers

Related papers: Audio-attention discriminative language model for …

200 papers

Modeling the errors of a speech recognizer can help simulate errorful recognized speech data from plain text, which has proven useful for tasks like discriminative language modeling, improving robustness of NLP systems, where limited or…

Artificial Intelligence · Computer Science 2024-08-22 Prashant Serai , Peidong Wang , Eric Fosler-Lussier

We present an end-to-end multichannel speaker-attributed automatic speech recognition (MC-SA-ASR) system that combines a Conformer-based encoder with multi-frame crosschannel attention and a speaker-attributed Transformer-based decoder. To…

Computation and Language · Computer Science 2023-10-17 Can Cui , Imran Ahamad Sheikh , Mostafa Sadeghi , Emmanuel Vincent

Effective spoken dialog systems should facilitate natural interactions with quick and rhythmic timing, mirroring human communication patterns. To reduce response times, previous efforts have focused on minimizing the latency in automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-01 Oswald Zink , Yosuke Higuchi , Carlos Mullov , Alexander Waibel , Tetsunori Kobayashi

Conventional automatic speech recognition systems do not produce punctuation marks which are important for the readability of the speech recognition results. They are also needed for subsequent natural language processing tasks such as…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-08 Jumon Nozaki , Tatsuya Kawahara , Kenkichi Ishizuka , Taiichi Hashimoto

Automatic Speech Recognition (ASR) has undergone a profound transformation over the past decade, driven by advances in deep learning. This survey provides a comprehensive overview of the modern era of ASR, charting its evolution from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-16 Md. Nayeem , Md Shamse Tabrej , Kabbojit Jit Deb , Shaonti Goswami , Md. Azizul Hakim

Automatic speech recognition systems have undoubtedly advanced with the integration of multilingual and multitask models such as Whisper, which have shown a promising ability to understand and process speech across a wide range of…

Computation and Language · Computer Science 2025-04-14 Xabier de Zuazo , Eva Navas , Ibon Saratxaga , Inma Hernáez Rioja

Recent Automatic Speech Recognition systems have been moving towards end-to-end systems that can be trained together. Numerous techniques that have been proposed recently enabled this trend, including feature extraction with CNNs, context…

Computation and Language · Computer Science 2020-12-04 Yushi Guan

In this paper, we demonstrate the efficacy of transfer learning and continuous learning for various automatic speech recognition (ASR) tasks. We start with a pre-trained English ASR model and show that transfer learning can be effectively…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-12 Jocelyn Huang , Oleksii Kuchaiev , Patrick O'Neill , Vitaly Lavrukhin , Jason Li , Adriana Flores , Georg Kucsko , Boris Ginsburg

Measuring performance of an automatic speech recognition (ASR) system without ground-truth could be beneficial in many scenarios, especially with data from unseen domains, where performance can be highly inconsistent. In conventional ASR…

Computation and Language · Computer Science 2019-04-11 Ruizhi Li , Gregory Sell , Hynek Hermansky

Automatic speech recognition (ASR) systems often encounter difficulties in accurately recognizing rare words, leading to errors that can have a negative impact on downstream tasks such as keyword spotting, intent detection, and text…

Artificial Intelligence · Computer Science 2023-10-10 Jiajun He , Zekun Yang , Tomoki Toda

This study addresses robust automatic speech recognition (ASR) by introducing a Conformer-based acoustic model. The proposed model builds on the wide residual bi-directional long short-term memory network (WRBN) with utterance-wise dropout…

Sound · Computer Science 2022-10-21 Yufeng Yang , Peidong Wang , DeLiang Wang

Recent advances in text-to-speech (TTS) led to the development of flexible multi-speaker end-to-end TTS systems. We extend state-of-the-art attention-based automatic speech recognition (ASR) systems with synthetic audio generated by a TTS…

Computation and Language · Computer Science 2020-02-18 Nick Rossenbach , Albert Zeyer , Ralf Schlüter , Hermann Ney

Exploiting cross-lingual resources is an effective way to compensate for data scarcity of low resource languages. Recently, a novel multilingual model fusion technique has been proposed where a model is trained to learn cross-lingual…

Computation and Language · Computer Science 2023-06-16 Muhammad Umar Farooq , Thomas Hain

Recently, Transformer based models have shown competitive automatic speech recognition (ASR) performance. One key factor in the success of these models is the multi-head attention mechanism. However, for trained models, we have previously…

Computation and Language · Computer Science 2021-04-07 Shucong Zhang , Erfan Loweimi , Peter Bell , Steve Renals

Automatic speech recognition (ASR) is a relevant area in multiple settings because it provides a natural communication mechanism between applications and users. ASRs often fail in environments that use language specific to particular…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Rafael Viana-Cámara , Mario Campos-Soberanis , Diego Campos-Sobrino

Segmentation for continuous Automatic Speech Recognition (ASR) has traditionally used silence timeouts or voice activity detectors (VADs), which are both limited to acoustic features. This segmentation is often overly aggressive, given that…

Computation and Language · Computer Science 2022-10-28 Piyush Behre , Naveen Parihar , Sharman Tan , Amy Shah , Eva Sharma , Geoffrey Liu , Shuangyu Chang , Hosam Khalil , Chris Basoglu , Sayan Pathak

One of the central skills that language learners need to practice is speaking the language. Currently, students in school do not get enough speaking opportunities and lack conversational practice. Recent advances in speech technology and…

Computation and Language · Computer Science 2024-06-06 Janick Michot , Manuela Hürlimann , Jan Deriu , Luzia Sauer , Katsiaryna Mlynchyk , Mark Cieliebak

Many of the current state-of-the-art Large Vocabulary Continuous Speech Recognition Systems (LVCSR) are hybrids of neural networks and Hidden Markov Models (HMMs). Most of these systems contain separate components that deal with the…

Computation and Language · Computer Science 2016-03-16 Dzmitry Bahdanau , Jan Chorowski , Dmitriy Serdyuk , Philemon Brakel , Yoshua Bengio

Although attention based end-to-end models have achieved promising performance in speech recognition, the multi-pass forward computation in beam-search increases inference time cost, which limits their practical applications. To address…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Ye Bai , Jiangyan Yi , Jianhua Tao , Zhengkun Tian , Zhengqi Wen , Shuai Zhang

In this paper, we proposed to apply meta learning approach for low-resource automatic speech recognition (ASR). We formulated ASR for different languages as different tasks, and meta-learned the initialization parameters from many…

Sound · Computer Science 2019-10-29 Jui-Yang Hsu , Yuan-Jui Chen , Hung-yi Lee