中文
相关论文

相关论文: An Effective Context-Balanced Adaptation Approach …

200 篇论文

How to leverage dynamic contextual information in end-to-end speech recognition has remained an active research area. Previous solutions to this problem were either designed for specialized use cases that did not generalize well to…

Contextual biasing is an important and challenging task for end-to-end automatic speech recognition (ASR) systems, which aims to achieve better recognition performance by biasing the ASR system to particular context phrases such as person…

计算与语言 · 计算机科学 2022-09-08 Xiaoqiang Wang , Yanqing Liu , Jinyu Li , Veljko Miljanic , Sheng Zhao , Hosam Khalil

Recently, speaker-attributed automatic speech recognition (SA-ASR) has attracted a wide attention, which aims at answering the question ``who spoke what''. Different from modular systems, end-to-end (E2E) SA-ASR minimizes the…

音频与语音处理 · 电气工程与系统科学 2023-05-23 Mohan Shi , Zhihao Du , Qian Chen , Fan Yu , Yangze Li , Shiliang Zhang , Jie Zhang , Li-Rong Dai

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

计算与语言 · 计算机科学 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

The mismatch of speech length and text length poses a challenge in automatic speech recognition (ASR). In previous research, various approaches have been employed to align text with speech, including the utilization of Connectionist…

计算与语言 · 计算机科学 2025-10-14 Peng Fan , Wenping Wang , Fei Deng

Previous studies have confirmed that by augmenting acoustic features with the place/manner of articulatory features, the speech enhancement (SE) process can be guided to consider the broad phonetic properties of the input speech when…

声音 · 计算机科学 2023-06-21 Yen-Ju Lu , Chia-Yu Chang , Cheng Yu , Ching-Feng Liu , Jeih-weih Hung , Shinji Watanabe , Yu Tsao

Recently, the speech community is seeing a significant trend of moving from deep neural network based hybrid modeling to end-to-end (E2E) modeling for automatic speech recognition (ASR). While E2E models achieve the state-of-the-art results…

音频与语音处理 · 电气工程与系统科学 2022-02-04 Jinyu Li

Existing research suggests that automatic speech recognition (ASR) models can benefit from additional contexts (e.g., contact lists, user specified vocabulary). Rare words and named entities can be better recognized with contexts. In this…

音频与语音处理 · 电气工程与系统科学 2024-07-16 Ruizhe Huang , Mahsa Yarmohammadi , Sanjeev Khudanpur , Daniel Povey

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional…

Incorporating longer context has been shown to benefit machine translation, but the inclusion of context in end-to-end speech translation (E2E-ST) remains under-studied. To bridge this gap, we introduce target language context in E2E-ST,…

计算与语言 · 计算机科学 2023-09-28 Amir Hussein , Brian Yan , Antonios Anastasopoulos , Shinji Watanabe , Sanjeev Khudanpur

End-to-end (E2E) automatic speech recognition (ASR) systems often have difficulty recognizing uncommon words, that appear infrequently in the training data. One promising method, to improve the recognition accuracy on such rare words, is to…

End-to-end automatic speech recognition (ASR) and large language models, such as Whisper and GPT-2, have recently been scaled to use vast amounts of training data. Despite the large amount of training data, infrequent content words that…

计算与语言 · 计算机科学 2023-06-06 Guangzhi Sun , Xianrui Zheng , Chao Zhang , Philip C. Woodland

Although end-to-end automatic speech recognition (E2E ASR) has achieved great performance in tasks that have numerous paired data, it is still challenging to make E2E ASR robust against noisy and low-resource conditions. In this study, we…

音频与语音处理 · 电气工程与系统科学 2021-06-08 Emiru Tsunoo , Kentaro Shibata , Chaitanya Narisetty , Yosuke Kashiwagi , Shinji Watanabe

Sequence-to-sequence (S2S) modeling is becoming a popular paradigm for automatic speech recognition (ASR) because of its ability to jointly optimize all the conventional ASR components in an end-to-end (E2E) fashion. This report…

音频与语音处理 · 电气工程与系统科学 2019-04-30 Aswin Shanmugam Subramanian , Xiaofei Wang , Shinji Watanabe , Toru Taniguchi , Dung Tran , Yuya Fujita

One crucial challenge of real-world multilingual speech recognition is the long-tailed distribution problem, where some resource-rich languages like English have abundant training data, but a long tail of low-resource languages have varying…

计算与语言 · 计算机科学 2020-12-04 Genta Indra Winata , Guangsen Wang , Caiming Xiong , Steven Hoi

Recent advances in deep learning and automatic speech recognition (ASR) have enabled the end-to-end (E2E) ASR system and boosted the accuracy to a new level. The E2E systems implicitly model all conventional ASR components, such as the…

Advances in machine learning have made it possible to perform various text and speech processing tasks, such as automatic speech recognition (ASR), in an end-to-end (E2E) manner. E2E approaches utilizing pre-trained models are gaining…

音频与语音处理 · 电气工程与系统科学 2024-06-07 Yukiya Hono , Koh Mitsuda , Tianyu Zhao , Kentaro Mitsui , Toshiaki Wakatsuki , Kei Sawada

Fast contextual adaptation has shown to be effective in improving Automatic Speech Recognition (ASR) of rare words and when combined with an on-device personalized training, it can yield an even better recognition result. However, the…

音频与语音处理 · 电气工程与系统科学 2021-10-08 Tsendsuren Munkhdalai , Khe Chai Sim , Angad Chandorkar , Fan Gao , Mason Chua , Trevor Strohman , Françoise Beaufays

End-to-end (E2E) systems for automatic speech recognition (ASR), such as RNN Transducer (RNN-T) and Listen-Attend-Spell (LAS) blend the individual components of a traditional hybrid ASR system - acoustic model, language model, pronunciation…

音频与语音处理 · 电气工程与系统科学 2020-08-14 Mahaveer Jain , Gil Keren , Jay Mahadeokar , Geoffrey Zweig , Florian Metze , Yatharth Saraf

Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, however, do not share…

音频与语音处理 · 电气工程与系统科学 2020-10-12 Changhan Wang , Juan Pino , Jiatao Gu