中文
相关论文

相关论文: BLSTM-Based Confidence Estimation for End-to-End S…

200 篇论文

Recently, end-to-end (E2E) automatic speech recognition (ASR) systems have garnered tremendous attention because of their great success and unified modeling paradigms in comparison to conventional hybrid DNN-HMM ASR systems. Despite the…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Tien-Hong Lo , Shi-Yan Weng , Hsiu-Jui Chang , Berlin Chen

Recent studies have shown that using an external Language Model (LM) benefits the end-to-end Automatic Speech Recognition (ASR). However, predicting tokens that appear less frequently in the training set is still quite challenging. The…

计算与语言 · 计算机科学 2023-01-03 Yukun Feng , Ming Tu , Rui Xia , Chuanzeng Huang , Yuxuan Wang

Although end-to-end automatic speech recognition (E2E ASR) has achieved great performance in tasks that have numerous paired data, it is still challenging to make E2E ASR robust against noisy and low-resource conditions. In this study, we…

音频与语音处理 · 电气工程与系统科学 2021-06-08 Emiru Tsunoo , Kentaro Shibata , Chaitanya Narisetty , Yosuke Kashiwagi , Shinji Watanabe

End-to-end (E2E) models have shown to outperform state-of-the-art conventional models for streaming speech recognition [1] across many dimensions, including quality (as measured by word error rate (WER)) and endpointer latency [2]. However,…

Attention-based encoder-decoder model has achieved impressive results for both automatic speech recognition (ASR) and text-to-speech (TTS) tasks. This approach takes advantage of the memorization capacity of neural networks to learn the…

计算与语言 · 计算机科学 2020-03-17 Chengyi Wang , Yu Wu , Yujiao Du , Jinyu Li , Shujie Liu , Liang Lu , Shuo Ren , Guoli Ye , Sheng Zhao , Ming Zhou

End-to-end (E2E) models have gained attention in the research field of automatic speech recognition (ASR). Many E2E models proposed so far assume left-to-right autoregressive generation of an output token sequence except for connectionist…

音频与语音处理 · 电气工程与系统科学 2020-11-17 Yuya Fujita , Shinji Watanabe , Motoi Omachi , Xuankai Chan

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

计算与语言 · 计算机科学 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

State-of-the-art neural network language models (NNLMs) represented by long short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming highly complex. They are prone to overfitting and poor generalization when…

计算与语言 · 计算机科学 2022-08-30 Boyang Xue , Shoukang Hu , Junhao Xu , Mengzhe Geng , Xunying Liu , Helen Meng

In this work, we aim to enhance the system robustness of end-to-end automatic speech recognition (ASR) against adversarially-noisy speech examples. We focus on a rigorous and empirical "closed-model adversarial robustness" setting (e.g.,…

音频与语音处理 · 电气工程与系统科学 2022-02-18 Chao-Han Huck Yang , Zeeshan Ahmed , Yile Gu , Joseph Szurley , Roger Ren , Linda Liu , Andreas Stolcke , Ivan Bulyko

End-to-end (E2E) models fold the acoustic, pronunciation and language models of a conventional speech recognition model into one neural network with a much smaller number of parameters than a conventional ASR system, thus making it suitable…

音频与语音处理 · 电气工程与系统科学 2020-05-14 Bo Li , Shuo-yiin Chang , Tara N. Sainath , Ruoming Pang , Yanzhang He , Trevor Strohman , Yonghui Wu

Confidence scores are very useful for downstream applications of automatic speech recognition (ASR) systems. Recent works have proposed using neural networks to learn word or utterance confidence scores for end-to-end ASR. In those studies,…

音频与语音处理 · 电气工程与系统科学 2021-04-28 David Qiu , Yanzhang He , Qiujia Li , Yu Zhang , Liangliang Cao , Ian McGraw

The speech chain mechanism integrates automatic speech recognition (ASR) and text-to-speech synthesis (TTS) modules into a single cycle during training. In our previous work, we applied a speech chain mechanism as a semi-supervised…

计算与语言 · 计算机科学 2018-11-01 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Despite recent advances in voice separation methods, many challenges remain in realistic scenarios such as noisy recording and the limits of available data. In this work, we propose to explicitly incorporate the phonetic and linguistic…

This work analyzes how attention-based Bidirectional Long Short-Term Memory (BLSTM) models adapt to noise-augmented speech. We identify crucial components for noise adaptation in BLSTM models by freezing model components during fine-tuning.…

音频与语音处理 · 电气工程与系统科学 2021-09-27 Coleman Hooper , Thierry Tambe , Gu-Yeon Wei

Improving the representation of contextual information is key to unlocking the potential of end-to-end (E2E) automatic speech recognition (ASR). In this work, we present a novel and simple approach for training an ASR context mechanism with…

音频与语音处理 · 电气工程与系统科学 2018-10-30 Uri Alon , Golan Pundak , Tara N. Sainath

Neural end-to-end (E2E) models have become a promising technique to realize practical automatic speech recognition (ASR) systems. When realizing such a system, one important issue is the segmentation of audio to deal with streaming input or…

音频与语音处理 · 电气工程与系统科学 2021-07-19 Yuya Fujita , Tianzi Wang , Shinji Watanabe , Motoi Omachi

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).…

声音 · 计算机科学 2022-04-04 Xuankai Chang , Takashi Maekaku , Yuya Fujita , Shinji Watanabe

We study training a single end-to-end (E2E) automatic speech recognition (ASR) model for three languages used in Kazakhstan: Kazakh, Russian, and English. We first describe the development of multilingual E2E ASR based on Transformer…

音频与语音处理 · 电气工程与系统科学 2021-08-04 Saida Mussakhojayeva , Yerbolat Khassanov , Huseyin Atakan Varol

End-to-end (E2E) Automatic Speech Recognition (ASR) models are trained using paired audio-text samples that are expensive to obtain, since high-quality ground-truth data requires human annotators. Voice search applications, such as digital…

计算与语言 · 计算机科学 2025-06-09 Christophe Van Gysel , Maggie Wu , Lyan Verwimp , Caglar Tirkaz , Marco Bertola , Zhihong Lei , Youssef Oualil

Accurate prediction of the user intent to interact with a voice assistant (VA) on a device (e.g. on the phone) is critical for achieving naturalistic, engaging, and privacy-centric interactions with the VA. To this end, we present a novel…

计算与语言 · 计算机科学 2022-10-24 Pranay Dighe , Prateeth Nayak , Oggi Rudovic , Erik Marchi , Xiaochuan Niu , Ahmed Tewfik