中文
相关论文

相关论文: PROCTER: PROnunciation-aware ConTextual adaptER fo…

200 篇论文

Automatic pronunciation error detection (APED) plays an important role in the domain of language learning. As for the previous ASR-based APED methods, the decoded results need to be aligned with the target text so that the errors can be…

音频与语音处理 · 电气工程与系统科学 2021-05-06 Zhan Zhang , Yuehai Wang , Jianyi Yang

For a speech-enhancement algorithm, it is highly desirable to simultaneously improve perceptual quality and recognition rate. Thanks to computational costs and model complexities, it is challenging to train a model that effectively…

机器学习 · 计算机科学 2018-02-19 Rasool Fakoor , Xiaodong He , Ivan Tashev , Shuayb Zarar

Neural transducers have achieved human level performance on standard speech recognition benchmarks. However, their performance significantly degrades in the presence of cross-talk, especially when the primary speaker has a low…

音频与语音处理 · 电气工程与系统科学 2023-03-31 Desh Raj , Junteng Jia , Jay Mahadeokar , Chunyang Wu , Niko Moritz , Xiaohui Zhang , Ozlem Kalinli

We propose CONF-TSASR, a non-autoregressive end-to-end time-frequency domain architecture for single-channel target-speaker automatic speech recognition (TS-ASR). The model consists of a TitaNet based speaker embedding module, a Conformer…

声音 · 计算机科学 2023-08-11 Yang Zhang , Krishna C. Puvvada , Vitaly Lavrukhin , Boris Ginsburg

The network architecture of end-to-end (E2E) automatic speech recognition (ASR) can be classified into several models, including connectionist temporal classification (CTC), recurrent neural network transducer (RNN-T), attention mechanism,…

声音 · 计算机科学 2023-05-31 Yui Sudo , Muhammad Shakeel , Brian Yan , Jiatong Shi , Shinji Watanabe

Confidence estimate is an often requested feature in applications such as medical transcription where errors can impact patient care and the confidence estimate could be used to alert medical professionals to verify potential errors in…

计算与语言 · 计算机科学 2021-10-29 Mingqiu Wang , Hagen Soltau , Laurent El Shafey , Izhak Shafran

Speech recognition, especially name recognition, is widely used in phone services such as company directory dialers, stock quote providers or location finders. It is usually challenging due to pronunciation variations. This paper proposes…

计算与语言 · 计算机科学 2016-06-29 Zhenhao Ge , Aravind Ganapathiraju , Ananth N. Iyer , Scott A. Randal , Felix I. Wyss

End-to-end speech recognition is a promising technology for enabling compact automatic speech recognition (ASR) systems since it can unify the acoustic and language model into a single neural network. However, as a drawback, training of…

计算与语言 · 计算机科学 2022-02-17 Yotaro Kubo , Shigeki Karita , Michiel Bacchiani

Humans are capable of processing speech by making use of multiple sensory modalities. For example, the environment where a conversation takes place generally provides semantic and/or acoustic context that helps us to resolve ambiguities or…

计算与语言 · 计算机科学 2019-02-21 Ozan Caglayan , Ramon Sanabria , Shruti Palaskar , Loïc Barrault , Florian Metze

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

声音 · 计算机科学 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

This work explores constituency parsing on automatically recognized transcripts of conversational speech. The neural parser is based on a sentence encoder that leverages word vectors contextualized with prosodic features, jointly learning…

计算与语言 · 计算机科学 2021-06-16 Trang Tran , Mari Ostendorf

End-to-end (E2E) automatic speech recognition (ASR) with sequence-to-sequence models has gained attention because of its simple model training compared with conventional hidden Markov model based ASR. Recently, several studies report the…

音频与语音处理 · 电气工程与系统科学 2020-02-21 Yuya Fujita , Aswin Shanmugam Subramanian , Motoi Omachi , Shinji Watanabe

In this work, we propose a method to create domain-sensitive speech recognition models that utilize textual domain information by conditioning its generation on a given text prompt. This is accomplished by fine-tuning a pre-trained,…

音频与语音处理 · 电气工程与系统科学 2023-10-09 Feng-Ting Liao , Yung-Chieh Chan , Yi-Chang Chen , Chan-Jan Hsu , Da-shan Shiu

End-to-end model, especially Recurrent Neural Network Transducer (RNN-T), has achieved great success in speech recognition. However, transducer requires a great memory footprint and computing time when processing a long decoding sequence.…

声音 · 计算机科学 2023-07-18 Xiaohui Zhang , Mangui Liang , Zhengkun Tian , Jiangyan Yi , Jianhua Tao

Personalization in multi-turn dialogs has been a long standing challenge for end-to-end automatic speech recognition (E2E ASR) models. Recent work on contextual adapters has tackled rare word recognition using user catalogs. This…

Identifying mistakes (i.e., miscues) made while reading aloud is commonly approached post-hoc by comparing automatic speech recognition (ASR) transcriptions to the target reading text. However, post-hoc methods perform poorly when ASR…

机器学习 · 计算机科学 2025-05-30 Griffin Dietz Smith , Dianna Yee , Jennifer King Chen , Leah Findlater

Contextual biasing is an important and challenging task for end-to-end automatic speech recognition (ASR) systems, which aims to achieve better recognition performance by biasing the ASR system to particular context phrases such as person…

计算与语言 · 计算机科学 2022-09-08 Xiaoqiang Wang , Yanqing Liu , Jinyu Li , Veljko Miljanic , Sheng Zhao , Hosam Khalil

We propose an unsupervised speaker adaptation method inspired by the neural Turing machine for end-to-end (E2E) automatic speech recognition (ASR). The proposed model contains a memory block that holds speaker i-vectors extracted from the…

音频与语音处理 · 电气工程与系统科学 2020-02-17 Leda Sarı , Niko Moritz , Takaaki Hori , Jonathan Le Roux

Neural transducer-based systems such as RNN Transducers (RNN-T) for automatic speech recognition (ASR) blend the individual components of a traditional hybrid ASR systems (acoustic model, language model, punctuation model, inverse text…

Edge-based automatic speech recognition (ASR) technologies are increasingly prevalent in the development of intelligent and personalized assistants. However, resource-constrained ASR models face significant challenges in adaptivity,…

计算与语言 · 计算机科学 2024-12-24 Amir Nassereldine , Dancheng Liu , Chenhui Xu , Ruiyang Qin , Yiyu Shi , Jinjun Xiong