中文
相关论文

相关论文: Improving Frame-level Classifier for Word Timings …

200 篇论文

Connectionist Temporal Classification (CTC) models are popular for their balance between speed and performance for Automatic Speech Recognition (ASR). However, these CTC models still struggle in other areas, such as personalization towards…

计算与语言 · 计算机科学 2023-07-04 Devang Kulshreshtha , Saket Dingliwal , Brady Houston , Sravan Bodapati

In Automatic Speech Recognition (ASR) systems, a recurring obstacle is the generation of narrowly focused output distributions. This phenomenon emerges as a side effect of Connectionist Temporal Classification (CTC), a robust sequence…

音频与语音处理 · 电气工程与系统科学 2024-03-19 SooHwan Eom , Eunseop Yoon , Hee Suk Yoon , Chanwoo Kim , Mark Hasegawa-Johnson , Chang D. Yoo

Code-Switching (CS) is referred to the phenomenon of alternately using words and phrases from different languages. While today's neural end-to-end (E2E) models deliver state-of-the-art performances on the task of automatic speech…

计算与语言 · 计算机科学 2023-07-04 Enes Yavuz Ugan , Christian Huber , Juan Hussain , Alexander Waibel

This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transcripts into…

音频与语音处理 · 电气工程与系统科学 2021-04-22 Yusuke Kida , Tatsuya Komatsu , Masahito Togami

Recently, the speech community is seeing a significant trend of moving from deep neural network based hybrid modeling to end-to-end (E2E) modeling for automatic speech recognition (ASR). While E2E models achieve the state-of-the-art results…

音频与语音处理 · 电气工程与系统科学 2022-02-04 Jinyu Li

Previous work has shown that neural encoder-decoder speech recognition can be improved with hierarchical multitask learning, where auxiliary tasks are added at intermediate layers of a deep encoder. We explore the effect of hierarchical…

计算与语言 · 计算机科学 2019-03-08 Kalpesh Krishna , Shubham Toshniwal , Karen Livescu

All-neural, end-to-end ASR systems gained rapid interest from the speech recognition community. Such systems convert speech input to text units using a single trainable neural network model. E2E models require large amounts of paired speech…

计算与语言 · 计算机科学 2021-10-08 Rongqing Huang

In automatic speech recognition (ASR) what a user says depends on the particular context she is in. Typically, this context is represented as a set of word n-grams. In this work, we present a novel, all-neural, end-to-end (E2E) ASR sys- tem…

音频与语音处理 · 电气工程与系统科学 2018-08-09 Golan Pundak , Tara N. Sainath , Rohit Prabhavalkar , Anjuli Kannan , Ding Zhao

Learning a set of tasks in sequence remains a challenge for artificial neural networks, which, in such scenarios, tend to suffer from Catastrophic Forgetting (CF). The same applies to End-to-End (E2E) Automatic Speech Recognition (ASR)…

音频与语音处理 · 电气工程与系统科学 2026-01-22 Steven Vander Eeckt , Hugo Van hamme

While deep learning based end-to-end automatic speech recognition (ASR) systems have greatly simplified modeling pipelines, they suffer from the data sparsity issue. In this work, we propose a self-training method with an end-to-end system…

音频与语音处理 · 电气工程与系统科学 2020-07-31 Yang Chen , Weiran Wang , Chao Wang

The external language models (LM) integration remains a challenging task for end-to-end (E2E) automatic speech recognition (ASR) which has no clear division between acoustic and language models. In this work, we propose an internal LM…

音频与语音处理 · 电气工程与系统科学 2020-11-05 Zhong Meng , Sarangarajan Parthasarathy , Eric Sun , Yashesh Gaur , Naoyuki Kanda , Liang Lu , Xie Chen , Rui Zhao , Jinyu Li , Yifan Gong

Graph-based temporal classification (GTC), a generalized form of the connectionist temporal classification loss, was recently proposed to improve automatic speech recognition (ASR) systems using graph-based supervision. For example, GTC was…

声音 · 计算机科学 2022-03-02 Xuankai Chang , Niko Moritz , Takaaki Hori , Shinji Watanabe , Jonathan Le Roux

End-to-end speech recognition models trained using joint Connectionist Temporal Classification (CTC)-Attention loss have gained popularity recently. In these models, a non-autoregressive CTC decoder is often used at inference time due to…

计算与语言 · 计算机科学 2022-11-15 Saket Dingliwal , Monica Sunkara , Sravan Bodapati , Srikanth Ronanki , Jeff Farris , Katrin Kirchhoff

Despite recent advances in end-to-end speech recognition methods, the output tends to be biased to the training data's vocabulary, resulting in inaccurate recognition of proper nouns and other unknown terms. To address this issue, we…

计算与语言 · 计算机科学 2025-06-03 Yu Nakagome , Michael Hentschel

For end-to-end Automatic Speech Recognition (ASR) models, recognizing personal or rare phrases can be hard. A promising way to improve accuracy is through spelling correction (or rewriting) of the ASR lattice, where potentially…

计算与语言 · 计算机科学 2024-09-26 Leonid Velikovich , Christopher Li , Diamantino Caseiro , Shankar Kumar , Pat Rondon , Kandarp Joshi , Xavier Velez

This paper presents a novel algorithm for building an automatic speech recognition (ASR) model with imperfect training data. Imperfectly transcribed speech is a prevalent issue in human-annotated speech corpora, which degrades the…

计算与语言 · 计算机科学 2023-06-05 Dongji Gao , Matthew Wiesner , Hainan Xu , Leibny Paola Garcia , Daniel Povey , Sanjeev Khudanpur

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

计算与语言 · 计算机科学 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

Recently, end-to-end models have been widely used in automatic speech recognition (ASR) systems. Two of the most representative approaches are connectionist temporal classification (CTC) and attention-based encoder-decoder (AED) models.…

计算与语言 · 计算机科学 2023-04-18 Ruchao Fan , Wei Chu , Peng Chang , Abeer Alwan

While Transformers have achieved promising results in end-to-end (E2E) automatic speech recognition (ASR), their autoregressive (AR) structure becomes a bottleneck for speeding up the decoding process. For real-world deployment, ASR systems…

音频与语音处理 · 电气工程与系统科学 2022-01-27 Keqi Deng , Zehui Yang , Shinji Watanabe , Yosuke Higuchi , Gaofeng Cheng , Pengyuan Zhang

Previous studies have confirmed that by augmenting acoustic features with the place/manner of articulatory features, the speech enhancement (SE) process can be guided to consider the broad phonetic properties of the input speech when…

声音 · 计算机科学 2023-06-21 Yen-Ju Lu , Chia-Yu Chang , Cheng Yu , Ching-Feng Liu , Jeih-weih Hung , Shinji Watanabe , Yu Tsao