中文
相关论文

相关论文: An Effective End-to-End Modeling Approach for Misp…

200 篇论文

Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the building of ASR systems…

计算与语言 · 计算机科学 2018-11-02 Ne Luo , Dongwei Jiang , Shuaijiang Zhao , Caixia Gong , Wei Zou , Xiangang Li

Automatic speech recognition (ASR) systems typically rely on an external endpointer (EP) model to identify speech boundaries. In this work, we propose a method to jointly train the ASR and EP tasks in a single end-to-end (E2E) multitask…

声音 · 计算机科学 2023-02-16 Shaan Bijwadia , Shuo-yiin Chang , Bo Li , Tara Sainath , Chao Zhang , Yanzhang He

Mispronunciation detection and diagnosis (MDD) is designed to identify pronunciation errors and provide instructive feedback to guide non-native language learners, which is a core component in computer-assisted pronunciation training (CAPT)…

音频与语音处理 · 电气工程与系统科学 2021-06-02 Bi-Cheng Yan , Berlin Chen

All-neural end-to-end (E2E) automatic speech recognition (ASR) systems that use a single neural network to transduce audio to word sequences have been shown to achieve state-of-the-art results on several tasks. In this work, we examine the…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Arun Narayanan , Rohit Prabhavalkar , Chung-Cheng Chiu , David Rybach , Tara N. Sainath , Trevor Strohman

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

计算与语言 · 计算机科学 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

Confidence measure is a performance index of particular importance for automatic speech recognition (ASR) systems deployed in real-world scenarios. In the present study, utterance-level neural confidence measure (NCM) in end-to-end…

音频与语音处理 · 电气工程与系统科学 2021-09-17 Wei Liu , Tan Lee

End-to-end (E2E) models fold the acoustic, pronunciation and language models of a conventional speech recognition model into one neural network with a much smaller number of parameters than a conventional ASR system, thus making it suitable…

音频与语音处理 · 电气工程与系统科学 2020-05-14 Bo Li , Shuo-yiin Chang , Tara N. Sainath , Ruoming Pang , Yanzhang He , Trevor Strohman , Yonghui Wu

End-to-end (E2E) modeling is advantageous for automatic speech recognition (ASR) especially for Japanese since word-based tokenization of Japanese is not trivial, and E2E modeling is able to model character sequences directly. This paper…

计算与语言 · 计算机科学 2021-06-10 Shigeki Karita , Yotaro Kubo , Michiel Adriaan Unico Bacchiani , Llion Jones

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).…

声音 · 计算机科学 2022-04-04 Xuankai Chang , Takashi Maekaku , Yuya Fujita , Shinji Watanabe

We study the problem of word-level confidence estimation in subword-based end-to-end (E2E) models for automatic speech recognition (ASR). Although prior works have proposed training auxiliary confidence models for ASR systems, they do not…

音频与语音处理 · 电气工程与系统科学 2021-03-12 David Qiu , Qiujia Li , Yanzhang He , Yu Zhang , Bo Li , Liangliang Cao , Rohit Prabhavalkar , Deepti Bhatia , Wei Li , Ke Hu , Tara N. Sainath , Ian McGraw

In this paper, we propose a single multi-task learning framework to perform End-to-End (E2E) speech recognition (ASR) and accent recognition (AR) simultaneously. The proposed framework is not only more compact but can also yield comparable…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Jicheng Zhang , Yizhou Peng , Pham Van Tung , Haihua Xu , Hao Huang , Eng Siong Chng

Recently, self-supervised pretraining has achieved impressive results in end-to-end (E2E) automatic speech recognition (ASR). However, the dominant sequence-to-sequence (S2S) E2E model is still hard to fully utilize the self-supervised…

音频与语音处理 · 电气工程与系统科学 2021-12-15 Keqi Deng , Songjun Cao , Yike Zhang , Long Ma

End-to-end (E2E) spoken language understanding (SLU) systems that generate a semantic parse from speech have become more promising recently. This approach uses a single model that utilizes audio and text representations from pre-trained…

计算与语言 · 计算机科学 2023-07-25 Suyoun Kim , Akshat Shrivastava , Duc Le , Ju Lin , Ozlem Kalinli , Michael L. Seltzer

An on-device DNN-HMM speech recognition system efficiently works with a limited vocabulary in the presence of a variety of predictable noise. In such a case, vocabulary and environment adaptation is highly effective. In this paper, we…

音频与语音处理 · 电气工程与系统科学 2019-06-25 Emiru Tsunoo , Yosuke Kashiwagi , Satoshi Asakawa , Toshiyuki Kumakura

End-to-end (E2E) automatic speech recognition (ASR) with sequence-to-sequence models has gained attention because of its simple model training compared with conventional hidden Markov model based ASR. Recently, several studies report the…

音频与语音处理 · 电气工程与系统科学 2020-02-21 Yuya Fujita , Aswin Shanmugam Subramanian , Motoi Omachi , Shinji Watanabe

Monaural multi-speaker automatic speech recognition (ASR) remains challenging due to data scarcity and the intrinsic difficulty of recognizing and attributing words to individual speakers, particularly in overlapping speech. Recent advances…

计算与语言 · 计算机科学 2026-05-29 Xinlu He , Jacob Whitehill

Conventional automatic speech recognition (ASR) models typically produce outputs as normalized texts lacking punctuation and capitalization, necessitating post-processing models to enhance readability. This approach, however, introduces…

音频与语音处理 · 电气工程与系统科学 2025-12-23 Jian You , Xiangfeng Li , Erwan Zerhouni

Despite the rapid progress of end-to-end (E2E) automatic speech recognition (ASR), it has been shown that incorporating external language models (LMs) into the decoding can further improve the recognition performance of E2E ASR systems. To…

计算与语言 · 计算机科学 2022-04-13 Jinchuan Tian , Jianwei Yu , Chao Weng , Yuexian Zou , Dong Yu

The end-to-end (E2E) automatic speech recognition (ASR) systems are often required to operate in reverberant conditions, where the long-term sub-band envelopes of the speech are temporally smeared. In this paper, we develop a feature…

音频与语音处理 · 电气工程与系统科学 2022-02-21 Rohit Kumar , Anurenjan Purushothaman , Anirudh Sreeram , Sriram Ganapathy

Code-switching (CS) refers to a linguistic phenomenon where a speaker uses different languages in an utterance or between alternating utterances. In this work, we study end-to-end (E2E) approaches to the Mandarin-English code-switching…

计算与语言 · 计算机科学 2019-07-12 Zhiping Zeng , Yerbolat Khassanov , Van Tung Pham , Haihua Xu , Eng Siong Chng , Haizhou Li