English
Related papers

Related papers: ASR Error Correction using Large Language Models

200 papers

Acoustic Echo Cancellation (AEC) is essential for accurate recognition of queries spoken to a smart speaker that is playing out audio. Previous work has shown that a neural AEC model operating on log-mel spectral features (denoted "logmel"…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-10 Sankaran Panchapagesan , Arun Narayanan , Turaj Zakizadeh Shabestary , Shuai Shao , Nathan Howard , Alex Park , James Walker , Alexander Gruenstein

The impressive capability and versatility of large language models (LLMs) have aroused increasing attention in automatic speech recognition (ASR), with several pioneering studies attempting to build integrated ASR models by connecting a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-27 Wenyi Yu , Changli Tang , Guangzhi Sun , Xianzhao Chen , Tian Tan , Wei Li , Lu Lu , Zejun Ma , Chao Zhang

End-to-end (E2E) automatic speech recognition (ASR) systems have revolutionized the field by integrating all components into a single neural network, with attention-based encoder-decoder models achieving state-of-the-art performance.…

Computation and Language · Computer Science 2025-07-01 Duygu Altinok

The pervasiveness of intra-utterance code-switching (CS) in spoken content requires that speech recognition (ASR) systems handle mixed language. Designing a CS-ASR system has many challenges, mainly due to data scarcity, grammatical…

Computation and Language · Computer Science 2023-01-12 Amir Hussein , Shammur Absar Chowdhury , Ahmed Abdelali , Najim Dehak , Ahmed Ali , Sanjeev Khudanpur

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

Neural language models (LMs) have been proved to significantly outperform classical n-gram LMs for language modeling due to their superior abilities to model long-range dependencies in text and handle data sparsity problems. And recently,…

Computation and Language · Computer Science 2019-10-28 Hongzhao Huang , Fuchun Peng

ASR Error Detection (AED) models aim to post-process the output of Automatic Speech Recognition (ASR) systems, in order to detect transcription errors. Modern approaches usually use text-based input, comprised solely of the ASR…

Computation and Language · Computer Science 2022-10-27 Zorik Gekhman , Dina Zverinski , Jonathan Mallinson , Genady Beryozkin

Large Language Models (LLMs) have showcased exceptional performance across diverse NLP tasks, and their integration with speech encoder is rapidly emerging as a dominant trend in the Automatic Speech Recognition (ASR) field. Previous works…

Artificial Intelligence · Computer Science 2024-12-05 Zheshu Song , Ziyang Ma , Yifan Yang , Jianheng Zhuo , Xie Chen

Recent studies have shown that using an external Language Model (LM) benefits the end-to-end Automatic Speech Recognition (ASR). However, predicting tokens that appear less frequently in the training set is still quite challenging. The…

Computation and Language · Computer Science 2023-01-03 Yukun Feng , Ming Tu , Rui Xia , Chuanzeng Huang , Yuxuan Wang

It's challenging to customize transducer-based automatic speech recognition (ASR) system with context information which is dynamic and unavailable during model training. In this work, we introduce a light-weight contextual spelling…

Computation and Language · Computer Science 2021-08-29 Xiaoqiang Wang , Yanqing Liu , Sheng Zhao , Jinyu Li

While Automatic Speech Recognition (ASR) systems are widely used in many real-world applications, they often do not generalize well to new domains and need to be finetuned on data from these domains. However, target-domain data usually are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-20 Hsuan Su , Ting-Yao Hu , Hema Swetha Koppula , Raviteja Vemulapalli , Jen-Hao Rick Chang , Karren Yang , Gautam Varma Mantena , Oncel Tuzel

As large language models (LLMs) grow in parameter size and capabilities, such as interaction through prompting, they open up new ways of interfacing with automatic speech recognition (ASR) systems beyond rescoring n-best lists. This work…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Maryam Naderi , Enno Hermann , Alexandre Nanchen , Sevada Hovsepyan , Mathew Magimai. -Doss

Automatic speech recognition systems have undoubtedly advanced with the integration of multilingual and multitask models such as Whisper, which have shown a promising ability to understand and process speech across a wide range of…

Computation and Language · Computer Science 2025-04-14 Xabier de Zuazo , Eva Navas , Ibon Saratxaga , Inma Hernáez Rioja

The integration of Language Models (LMs) has proven to be an effective way to address domain shifts in speech recognition. However, these approaches usually require a significant amount of target domain text data for the training of LMs.…

Computation and Language · Computer Science 2023-06-29 Yuang Li , Yu Wu , Jinyu Li , Shujie Liu

Error correction techniques remain effective to refine outputs from automatic speech recognition (ASR) models. Existing end-to-end error correction methods based on an encoder-decoder architecture process all tokens in the decoding phase,…

Computation and Language · Computer Science 2022-08-10 Jingyuan Yang , Rongjun Li , Wei Peng

Recently, Large Language Models (LLMs) have been widely studied by researchers for their roles in various downstream NLP tasks. As a fundamental task in the NLP field, Chinese Grammatical Error Correction (CGEC) aims to correct all…

Computation and Language · Computer Science 2024-09-20 Yinghui Li , Shang Qin , Haojing Huang , Yangning Li , Libo Qin , Xuming Hu , Wenhao Jiang , Hai-Tao Zheng , Philip S. Yu

Off-the-shelf pre-trained Automatic Speech Recognition (ASR) systems are an increasingly viable service for companies of any size building speech-based products. While these ASR systems are trained on large amounts of data, domain mismatch…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 Anirudh Mani , Shruti Palaskar , Nimshi Venkat Meripo , Sandeep Konam , Florian Metze

This paper investigates discrete and continuous speech representations in Large Language Model (LLM)-based Automatic Speech Recognition (ASR), organizing them by feature continuity and training approach into four categories: supervised and…

Computation and Language · Computer Science 2024-09-04 Yaoxun Xu , Shi-Xiong Zhang , Jianwei Yu , Zhiyong Wu , Dong Yu

Building upon the strength of modern large language models (LLMs), generative error correction (GEC) has emerged as a promising paradigm that can elevate the performance of modern automatic speech recognition (ASR) systems. One…

Computation and Language · Computer Science 2024-07-24 Rithik Sachdev , Zhong-Qiu Wang , Chao-Han Huck Yang

With the strong representational power of large language models (LLMs), generative error correction (GER) for automatic speech recognition (ASR) aims to provide semantic and phonetic refinements to address ASR errors. This work explores how…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-14 Yuka Ko , Sheng Li , Chao-Han Huck Yang , Tatsuya Kawahara