English
Related papers

Related papers: An Effective End-to-End Modeling Approach for Misp…

200 papers

Current leading mispronunciation detection and diagnosis (MDD) systems achieve promising performance via end-to-end phoneme recognition. One challenge of such end-to-end solutions is the scarcity of human-annotated phonemes on natural L2…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-13 Mu Yang , Kevin Hirschi , Stephen D. Looney , Okim Kang , John H. L. Hansen

Recently, there has been a growing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments. In this paper, we explore the use of attention-based encoder-decoder model for Mandarin…

Computation and Language · Computer Science 2018-02-14 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

End-to-end (E2E) automatic speech recognition models like Recurrent Neural Networks Transducer (RNN-T) are becoming a popular choice for streaming ASR applications like voice assistants. While E2E models are very effective at learning…

Computation and Language · Computer Science 2022-01-12 Chhavi Choudhury , Ankur Gandhe , Xiaohan Ding , Ivan Bulyko

In automatic speech recognition (ASR) research, discriminative criteria have achieved superior performance in DNN-HMM systems. Given this success, the adoption of discriminative criteria is promising to boost the performance of end-to-end…

Computation and Language · Computer Science 2022-08-24 Jinchuan Tian , Jianwei Yu , Chao Weng , Yuexian Zou , Dong Yu

End-to-end Speech-to-text Translation (E2E-ST), which directly translates source language speech to target language text, is widely useful in practice, but traditional cascaded approaches (ASR+MT) often suffer from error propagation in the…

Computation and Language · Computer Science 2021-02-10 Junkun Chen , Mingbo Ma , Renjie Zheng , Liang Huang

Whispering is an important mode of human speech, but no end-to-end recognition results for it were reported yet, probably due to the scarcity of available whispered speech data. In this paper, we present several approaches for end-to-end…

Computation and Language · Computer Science 2020-11-10 Heng-Jui Chang , Alexander H. Liu , Hung-yi Lee , Lin-shan Lee

End-to-end models have gradually become the preferred option for automatic speech recognition (ASR) applications. During the training of end-to-end ASR, data augmentation is a quite effective technique for regularizing the neural networks.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Jianwei Sun , Zhiyuan Tang , Hengxin Yin , Wei Wang , Xi Zhao , Shuaijiang Zhao , Xiaoning Lei , Wei Zou , Xiangang Li

The Automated Speech Recognition (ASR) community experiences a major turning point with the rise of the fully-neural (End-to-End, E2E) approaches. At the same time, the conventional hybrid model remains the standard choice for the practical…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-24 Valentin Vielzeuf , Grigory Antipov

End-to-end automatic speech recognition (E2E-ASR) has the potential to improve performance, but a specific issue that needs to be addressed is the difficulty it has in handling enharmonic words: named entities (NEs) with the same…

Sound · Computer Science 2023-05-30 Yui Sudo , Kazuya Hata , Kazuhiro Nakadai

Recently, Transformer has gained success in automatic speech recognition (ASR) field. However, it is challenging to deploy a Transformer-based end-to-end (E2E) model for online speech recognition. In this paper, we propose the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-12 Haoran Miao , Gaofeng Cheng , Changfeng Gao , Pengyuan Zhang , Yonghong Yan

Many of the current state-of-the-art Large Vocabulary Continuous Speech Recognition Systems (LVCSR) are hybrids of neural networks and Hidden Markov Models (HMMs). Most of these systems contain separate components that deal with the…

Computation and Language · Computer Science 2016-03-16 Dzmitry Bahdanau , Jan Chorowski , Dmitriy Serdyuk , Philemon Brakel , Yoshua Bengio

Automatic Speech Recognition (ASR) using multiple microphone arrays has achieved great success in the far-field robustness. Taking advantage of all the information that each array shares and contributes is crucial in this task. Motivated by…

Computation and Language · Computer Science 2019-02-20 Xiaofei Wang , Ruizhi Li , Sri Harish Mallid , Takaaki Hori , Shinji Watanabe , Hynek Hermansky

Voice Assistants such as Alexa, Siri, and Google Assistant typically use a two-stage Spoken Language Understanding pipeline; first, an Automatic Speech Recognition (ASR) component to process customer speech and generate text transcriptions,…

Computation and Language · Computer Science 2020-12-17 Subendhu Rongali , Beiye Liu , Liwei Cai , Konstantine Arkoudas , Chengwei Su , Wael Hamza

This paper investigates the impact of word-based RNN language models (RNN-LMs) on the performance of end-to-end automatic speech recognition (ASR). In our prior work, we have proposed a multi-level LM, in which character-based and…

Computation and Language · Computer Science 2018-08-09 Takaaki Hori , Jaejin Cho , Shinji Watanabe

An end-to-end (E2E) speaker-attributed automatic speech recognition (SA-ASR) model was proposed recently to jointly perform speaker counting, speech recognition and speaker identification. The model achieved a low speaker-attributed word…

Sound · Computer Science 2021-01-07 Xuankai Chang , Naoyuki Kanda , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Takuya Yoshioka

Recently, there has been an increasing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments. One approach is the attention-based encoder-decoder framework that learns a mapping…

Computation and Language · Computer Science 2017-02-02 Suyoun Kim , Takaaki Hori , Shinji Watanabe

End-to-end (E2E) models have been explored for large speech corpora and have been found to match or outperform traditional pipeline-based systems in some languages. However, most prior work on end-to-end models use speech corpora exceeding…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-25 Brij Mohan Lal Srivastava , Basil Abraham , Sunayana Sitaram , Rupesh Mehta , Preethi Jyothi

Automatic speech recognition systems have been largely improved in the past few decades and current systems are mainly hybrid-based and end-to-end-based. The recently proposed CTC-CRF framework inherits the data-efficiency of the hybrid…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-09 Huahuan Zheng , Wenjie Peng , Zhijian Ou , Jinsong Zhang

The acoustic-to-word model based on the Connectionist Temporal Classification (CTC) criterion is a natural end-to-end (E2E) system directly targeting word as output unit. Two issues exist in the system: first, the current output of the CTC…

Computation and Language · Computer Science 2019-09-06 Amit Das , Jinyu Li , Guoli Ye , Rui Zhao , Yifan Gong

In this paper we investigate continuous speech recognition using electroencephalography (EEG) features using recently introduced end-to-end transformer based automatic speech recognition (ASR) model. Our results demonstrate that transformer…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-06 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed H Tewfik