English
Related papers

Related papers: Continuously Learning New Words in Automatic Speec…

200 papers

In this paper, we demonstrate the efficacy of transfer learning and continuous learning for various automatic speech recognition (ASR) tasks. We start with a pre-trained English ASR model and show that transfer learning can be effectively…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-12 Jocelyn Huang , Oleksii Kuchaiev , Patrick O'Neill , Vitaly Lavrukhin , Jason Li , Adriana Flores , Georg Kucsko , Boris Ginsburg

Automatic speech recognition (ASR) system is becoming a ubiquitous technology. Although its accuracy is closing the gap with that of human level under certain settings, one area that can further improve is to incorporate user-specific…

Computation and Language · Computer Science 2020-05-05 Young Mo Kang , Yingbo Zhou

Recent advancements in supervised automatic speech recognition (ASR) have achieved remarkable performance, largely due to the growing availability of large transcribed speech corpora. However, most languages lack sufficient paired speech…

Computation and Language · Computer Science 2025-01-10 Junrui Ni , Liming Wang , Yang Zhang , Kaizhi Qian , Heting Gao , Mark Hasegawa-Johnson , Chang D. Yoo

In this article, we present an approach for non native automatic speech recognition (ASR). We propose two methods to adapt existing ASR systems to the non-native accents. The first method is based on the modification of acoustic models…

Computation and Language · Computer Science 2007-11-08 Ghazi Bouselmi , Dominique Fohr , Irina Illina , Jean-Paul Haton

Conversational speech normally is embodied with loose syntactic structures at the utterance level but simultaneously exhibits topical coherence relations across consecutive utterances. Prior work has shown that capturing longer context…

Computation and Language · Computer Science 2022-06-02 Bi-Cheng Yan , Hsin-Wei Wang , Shih-Hsuan Chiu , Hsuan-Sheng Chiu , Berlin Chen

Employing pre-trained language models (LM) to extract contextualized word representations has achieved state-of-the-art performance on various NLP tasks. However, applying this technique to noisy transcripts generated by automatic speech…

Computation and Language · Computer Science 2020-11-03 Chao-Wei Huang , Yun-Nung Chen

Automated speaking assessment (ASA) typically involves automatic speech recognition (ASR) and hand-crafted feature extraction from the ASR transcript of a learner's speech. Recently, self-supervised learning (SSL) has shown stellar…

Sound · Computer Science 2025-03-04 Tien-Hong Lo , Fu-An Chao , Tzu-I Wu , Yao-Ting Sung , Berlin Chen

Speaker recognition is a well known and studied task in the speech processing domain. It has many applications, either for security or speaker adaptation of personal devices. In this paper, we present a new paradigm for automatic speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Mathieu Seurin , Florian Strub , Philippe Preux , Olivier Pietquin

Modern topic identification (topic ID) systems for speech use automatic speech recognition (ASR) to produce speech transcripts, and perform supervised classification on such ASR outputs. However, under resource-limited conditions, the…

Computation and Language · Computer Science 2017-07-12 Chunxi Liu , Jan Trmal , Matthew Wiesner , Craig Harman , Sanjeev Khudanpur

While Automatic Speech Recognition (ASR) models have shown significant advances with the introduction of unsupervised or self-supervised training techniques, these improvements are still only limited to a subsection of languages and…

Computation and Language · Computer Science 2023-10-19 Theresa Pekarek Rosin , Stefan Wermter

Spoken language understanding (SLU) tasks are usually solved by first transcribing an utterance with automatic speech recognition (ASR) and then feeding the output to a text-based model. Recent advances in self-supervised representation…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-01 Lasse Borgholt , Jakob Drachmann Havtorn , Mostafa Abdou , Joakim Edin , Lars Maaløe , Anders Søgaard , Christian Igel

Speech-enabled systems typically first convert audio to text through an automatic speech recognition (ASR) model and then feed the text to downstream natural language processing (NLP) modules. The errors of the ASR system can seriously…

Computation and Language · Computer Science 2021-03-26 Tong Cui , Jinghui Xiao , Liangyou Li , Xin Jiang , Qun Liu

Speech applications dealing with conversations require not only recognizing the spoken words, but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate…

Computation and Language · Computer Science 2019-07-12 Laurent El Shafey , Hagen Soltau , Izhak Shafran

We propose a simple method for automatic speech recognition (ASR) by fine-tuning BERT, which is a language model (LM) trained on large-scale unlabeled text data and can generate rich contextual representations. Our assumption is that given…

Sound · Computer Science 2021-02-02 Wen-Chin Huang , Chia-Hua Wu , Shang-Bao Luo , Kuan-Yu Chen , Hsin-Min Wang , Tomoki Toda

Automatic Speech Recognition (ASR) technology has made significant progress in recent years, providing accurate transcription across various domains. However, some challenges remain, especially in noisy environments and specialized jargon.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Aviv Shamsian , Aviv Navon , Neta Glazer , Gill Hetz , Joseph Keshet

Automatic speech recognition (ASR) models are typically trained on large datasets of transcribed speech. As language evolves and new terms come into use, these models can become outdated and stale. In the context of models trained on the…

Computation and Language · Computer Science 2023-12-04 Lillian Zhou , Yuxin Ding , Mingqing Chen , Harry Zhang , Rohit Prabhavalkar , Dhruv Guliani , Giovanni Motta , Rajiv Mathews

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

One common approach for question answering over speech data is to first transcribe speech using automatic speech recognition (ASR) and then employ text-based retrieval-augmented generation (RAG) on the transcriptions. While this cascaded…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-06 Do June Min , Karel Mundnich , Andy Lapastora , Erfan Soltanmohammadi , Srikanth Ronanki , Kyu Han

Attention-based sequence-to-sequence automatic speech recognition (ASR) requires a significant delay to recognize long utterances because the output is generated after receiving entire input sequences. Although several studies recently…

Computation and Language · Computer Science 2020-11-05 Sashi Novitasari , Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Semi-supervised learning in automatic speech recognition (ASR) typically relies on pseudo-labeling, which often suffers from confirmation bias and error accumulation due to noisy supervision. To address this limitation, we propose ReHear, a…

Computation and Language · Computer Science 2026-02-24 Zefang Liu , Chenyang Zhu , Sangwoo Cho , Shi-Xiong Zhang