English
Related papers

Related papers: FastEmit: Low-latency Streaming ASR with Sequence-…

200 papers

Word error rate (WER) estimation aims to evaluate the quality of an automatic speech recognition (ASR) system's output without requiring ground-truth labels. This task has gained increasing attention as advanced ASR systems are trained on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-30 Chanho Park , Chengsong Lu , Mingjie Chen , Thomas Hain

Although recent advances in deep learning technology have boosted automatic speech recognition (ASR) performance in the single-talker case, it remains difficult to recognize multi-talker speech in which many voices overlap. One conventional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-20 Takafumi Moriya , Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Takahiro Shinozaki

In this paper, we present TrimTail, a simple but effective emission regularization method to improve the latency of streaming ASR models. The core idea of TrimTail is to apply length penalty (i.e., by trimming trailing frames, see Fig.…

Accented automatic speech recognition (ASR) often degrades due to the limited availability of accented training data. Prior work has explored accent modeling in low-resource settings, but existing approaches typically require minutes to…

Error correction is widely used in automatic speech recognition (ASR) to post-process the generated sentence, and can further reduce the word error rate (WER). Although multiple candidates are generated by an ASR system through beam search,…

Computation and Language · Computer Science 2022-11-30 Yichong Leng , Xu Tan , Rui Wang , Linchen Zhu , Jin Xu , Wenjie Liu , Linquan Liu , Tao Qin , Xiang-Yang Li , Edward Lin , Tie-Yan Liu

This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transcripts into…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-22 Yusuke Kida , Tatsuya Komatsu , Masahito Togami

Automatic speech recognition (ASR) systems, increasingly prevalent in education, healthcare, employment, and mobile technology, face significant challenges in inclusivity, particularly for the 80 million-strong global community of people…

Computation and Language · Computer Science 2024-05-13 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Hope Gerlach-Houck , Caryn Herring , Jia Bin

Non-autoregressive (NAR) modeling has gained more and more attention in speech processing. With recent state-of-the-art attention-based automatic speech recognition (ASR) structure, NAR can realize promising real-time factor (RTF)…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-21 Tianzi Wang , Yuya Fujita , Xuankai Chang , Shinji Watanabe

Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, however, do not share…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-12 Changhan Wang , Juan Pino , Jiatao Gu

Recently, self-supervised pre-training has gained success in automatic speech recognition (ASR). However, considering the difference between speech accents in real scenarios, how to identify accents and use accent features to improve ASR is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-16 Keqi Deng , Songjun Cao , Long Ma

Automatic Speech Recognition (ASR) has seen remarkable progress, with models like OpenAI Whisper and NVIDIA Canary achieving state-of-the-art (SOTA) performance in offline transcription. However, these models are not designed for streaming…

Computation and Language · Computer Science 2026-04-07 Tomer Krichli , Bhiksha Raj , Joseph Keshet

For various speech-related tasks, confidence scores from a speech recogniser are a useful measure to assess the quality of transcriptions. In traditional hidden Markov model-based automatic speech recognition (ASR) systems, confidence…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Qiujia Li , David Qiu , Yu Zhang , Bo Li , Yanzhang He , Philip C. Woodland , Liangliang Cao , Trevor Strohman

We introduce a novel and inexpensive approach for the temporal alignment of speech to highly imperfect transcripts from automatic speech recognition (ASR). Transcripts are generated for extended lecture and presentation videos, which in…

Sound · Computer Science 2007-05-23 Alexander Haubold , John R. Kender

Recent advances in supervised, semi-supervised and self-supervised deep learning algorithms have shown significant improvement in the performance of automatic speech recognition(ASR) systems. The state-of-the-art systems have achieved a…

Computation and Language · Computer Science 2021-10-19 Somnath Roy

Speech applications dealing with conversations require not only recognizing the spoken words, but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate…

Computation and Language · Computer Science 2019-07-12 Laurent El Shafey , Hagen Soltau , Izhak Shafran

In this paper, we investigate the benefit that off-the-shelf word embedding can bring to the sequence-to-sequence (seq-to-seq) automatic speech recognition (ASR). We first introduced the word embedding regularization by maximizing the…

Computation and Language · Computer Science 2020-02-06 Alexander H. Liu , Tzu-Wei Sung , Shun-Po Chuang , Hung-yi Lee , Lin-shan Lee

Recent advances have demonstrated the potential of decoderonly large language models (LLMs) for automatic speech recognition (ASR). However, enabling streaming recognition within this framework remains a challenge. In this work, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-02 Genshun Wan , Wenhui Zhang , Jing-Xuan Zhang , Shifu Xiong , Jianqing Gao , Zhongfu Ye

This paper presents our modeling and architecture approaches for building a highly accurate low-latency language identification system to support multilingual spoken queries for voice assistants. A common approach to solve multilingual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Chander Chandak , Zeynab Raeesy , Ariya Rastrow , Yuzong Liu , Xiangyang Huang , Siyu Wang , Dong Kwon Joo , Roland Maas

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

Computation and Language · Computer Science 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

Speech-to-text errors made by automatic speech recognition (ASR) systems negatively impact downstream models. Error correction models as a post-processing text editing method have been recently developed for refining the ASR outputs.…

Computation and Language · Computer Science 2023-06-22 Ziji Zhang , Zhehui Wang , Rajesh Kamma , Sharanya Eswaran , Narayanan Sadagopan