中文
相关论文

相关论文: Post-decoder Biasing for End-to-End Speech Recogni…

200 篇论文

End-to-end (E2E) spoken language understanding (SLU) can infer semantics directly from speech signal without cascading an automatic speech recognizer (ASR) with a natural language understanding (NLU) module. However, paired utterance…

计算与语言 · 计算机科学 2021-02-15 Yao Qian , Ximo Bian , Yu Shi , Naoyuki Kanda , Leo Shen , Zhen Xiao , Michael Zeng

End-to-end (E2E) modeling is advantageous for automatic speech recognition (ASR) especially for Japanese since word-based tokenization of Japanese is not trivial, and E2E modeling is able to model character sequences directly. This paper…

计算与语言 · 计算机科学 2021-06-10 Shigeki Karita , Yotaro Kubo , Michiel Adriaan Unico Bacchiani , Llion Jones

Sequence-to-sequence (S2S) modeling is becoming a popular paradigm for automatic speech recognition (ASR) because of its ability to jointly optimize all the conventional ASR components in an end-to-end (E2E) fashion. This report…

音频与语音处理 · 电气工程与系统科学 2019-04-30 Aswin Shanmugam Subramanian , Xiaofei Wang , Shinji Watanabe , Toru Taniguchi , Dung Tran , Yuya Fujita

Multilingual speech recognition has drawn significant attention as an effective way to compensate data scarcity for low-resource languages. End-to-end (e2e) modelling is preferred over conventional hybrid systems, mainly because of no…

计算与语言 · 计算机科学 2022-07-08 Muhammad Umar Farooq , Darshan Adiga Haniya Narayana , Thomas Hain

Monaural multi-speaker automatic speech recognition (ASR) remains challenging due to data scarcity and the intrinsic difficulty of recognizing and attributing words to individual speakers, particularly in overlapping speech. Recent advances…

计算与语言 · 计算机科学 2026-05-29 Xinlu He , Jacob Whitehill

Recently, there has been a strong push to transition from hybrid models to end-to-end (E2E) models for automatic speech recognition. Currently, there are three promising E2E methods: recurrent neural network transducer (RNN-T), RNN…

音频与语音处理 · 电气工程与系统科学 2020-07-31 Jinyu Li , Yu Wu , Yashesh Gaur , Chengyi Wang , Rui Zhao , Shujie Liu

Recently, various studies have been directed towards exploring dense passage retrieval techniques employing pre-trained language models, among which the masked auto-encoder (MAE) pre-training architecture has emerged as the most promising.…

信息检索 · 计算机科学 2023-05-23 Zehan Li , Yanzhao Zhang , Dingkun Long , Pengjun Xie

End-to-end (E2E) models have shown to outperform state-of-the-art conventional models for streaming speech recognition [1] across many dimensions, including quality (as measured by word error rate (WER)) and endpointer latency [2]. However,…

A cascaded speech translation model relies on discrete and non-differentiable transcription, which provides a supervision signal from the source side and helps the transformation between source speech and target text. Such modeling suffers…

计算与语言 · 计算机科学 2020-11-25 Parnia Bahar , Tobias Bieschke , Ralf Schlüter , Hermann Ney

Recently, attention-based encoder-decoder (AED) models have shown high performance for end-to-end automatic speech recognition (ASR) across several tasks. Addressing overconfidence in such models, in this paper we introduce the concept of…

音频与语音处理 · 电气工程与系统科学 2021-12-16 Timo Lohrenz , Patrick Schwarz , Zhengyang Li , Tim Fingscheidt

End-to-end (E2E) systems for automatic speech recognition (ASR), such as RNN Transducer (RNN-T) and Listen-Attend-Spell (LAS) blend the individual components of a traditional hybrid ASR system - acoustic model, language model, pronunciation…

音频与语音处理 · 电气工程与系统科学 2020-08-14 Mahaveer Jain , Gil Keren , Jay Mahadeokar , Geoffrey Zweig , Florian Metze , Yatharth Saraf

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

计算与语言 · 计算机科学 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

Code-Switching (CS) is referred to the phenomenon of alternately using words and phrases from different languages. While today's neural end-to-end (E2E) models deliver state-of-the-art performances on the task of automatic speech…

计算与语言 · 计算机科学 2023-07-04 Enes Yavuz Ugan , Christian Huber , Juan Hussain , Alexander Waibel

Speech recognition applications cover a range of different audio and text distributions, with different speaking styles, background noise, transcription punctuation and character casing. However, many speech recognition systems require…

计算与语言 · 计算机科学 2022-10-25 Sanchit Gandhi , Patrick von Platen , Alexander M. Rush

Code-switching-where multilingual speakers alternately switch between languages during conversations-still poses significant challenges to end-to-end (E2E) automatic speech recognition (ASR) systems due to phenomena of both acoustic and…

音频与语音处理 · 电气工程与系统科学 2024-12-13 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Berlin Chen

End-to-end (E2E) neural models are increasingly attracting attention as a promising modeling approach for mispronunciation detection and diagnosis (MDD). Typically, these models are trained by optimizing a cross-entropy criterion, which…

音频与语音处理 · 电气工程与系统科学 2022-07-12 Bi-Cheng Yan , Shao-Wei Fan Jiang , Fu-An Chao , Berlin Chen

Contextualized end-to-end automatic speech recognition has been an active research area, with recent efforts focusing on the implicit learning of contextual phrases based on the final loss objective. However, these approaches ignore the…

音频与语音处理 · 电气工程与系统科学 2024-09-12 Muhammad Shakeel , Yui Sudo , Yifan Peng , Shinji Watanabe

Machine recognition of an atypical speech like whispered speech, is a challenging task. We introduce whisper-to-natural-speech conversion using sequence-to-sequence approach by proposing enhanced transformer architecture, which uses both…

音频与语音处理 · 电气工程与系统科学 2021-04-06 Abhishek Niranjan , Mukesh Sharma , Sai Bharath Chandra Gutha , M Ali Basha Shaik

This paper proposes a model for transforming speech features using the frequency-directional attention model for End-to-End (E2E) automatic speech recognition. The idea is based on the hypothesis that in the phoneme system of each language,…

音频与语音处理 · 电气工程与系统科学 2022-03-30 Akihiro Dobashi , Chee Siang Leow , Hiromitsu Nishizaki

Recently, the end-to-end approach has been successfully applied to multi-speaker speech separation and recognition in both single-channel and multichannel conditions. However, severe performance degradation is still observed in the…