中文
相关论文

相关论文: E2E-based Multi-task Learning Approach to Joint Sp…

200 篇论文

End-to-end (E2E) automatic speech recognition (ASR) systems directly map acoustics to words using a unified model. Previous works mostly focus on E2E training a single model which integrates acoustic and language model into a whole.…

计算与语言 · 计算机科学 2018-03-06 Zhehuai Chen , Qi Liu , Hao Li , Kai Yu

Inspite the emerging importance of Speech Emotion Recognition (SER), the state-of-the-art accuracy is quite low and needs improvement to make commercial applications of SER viable. A key underlying reason for the low accuracy is the…

声音 · 计算机科学 2020-03-24 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Julien Epps , Björn W. Schuller

New-age conversational agent systems perform both speech emotion recognition (SER) and automatic speech recognition (ASR) using two separate and often independent approaches for real-world application in noisy environments. In this paper,…

音频与语音处理 · 电气工程与系统科学 2023-05-29 Lokesh Bansal , S. Pavankumar Dubagunta , Malolan Chetlur , Pushpak Jagtap , Aravind Ganapathiraju

Training Automatic Speech Recognition (ASR) models under federated learning (FL) settings has attracted a lot of attention recently. However, the FL scenarios often presented in the literature are artificial and fail to capture the…

In this paper we propose a novel data augmentation method for attention-based end-to-end automatic speech recognition (E2E-ASR), utilizing a large amount of text which is not paired with speech signals. Inspired by the back-translation…

计算与语言 · 计算机科学 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Yu Zhang , Tomoki Toda , Takaaki Hori , Ramon Astudillo , Kazuya Takeda

End-to-end (E2E) automatic speech recognition (ASR) models, by now, have shown competitive performance on several benchmarks. These models are structured to either operate in streaming or non-streaming mode. This work presents cascaded…

音频与语音处理 · 电气工程与系统科学 2020-10-29 Arun Narayanan , Tara N. Sainath , Ruoming Pang , Jiahui Yu , Chung-Cheng Chiu , Rohit Prabhavalkar , Ehsan Variani , Trevor Strohman

India is home to multiple languages, and training automatic speech recognition (ASR) systems for languages is challenging. Over time, each language has adopted words from other languages, such as English, leading to code-mixing. Most Indian…

音频与语音处理 · 电气工程与系统科学 2021-06-04 Mari Ganesh Kumar , Jom Kuriakose , Anand Thyagachandran , Arun Kumar A , Ashish Seth , Lodagala Durga Prasad , Saish Jaiswal , Anusha Prakash , Hema Murthy

With the advances in deep learning, the performance of end-to-end (E2E) single-task models for speech and audio processing has been constantly improving. However, it is still challenging to build a general-purpose model with high…

音频与语音处理 · 电气工程与系统科学 2025-02-21 Xiaoyu Yang , Qiujia Li , Chao Zhang , Phil Woodland

Despite recent advances in voice separation methods, many challenges remain in realistic scenarios such as noisy recording and the limits of available data. In this work, we propose to explicitly incorporate the phonetic and linguistic…

Improving end-to-end speech recognition by incorporating external text data has been a longstanding research topic. There has been a recent focus on training E2E ASR models that get the performance benefits of external text data without…

计算与语言 · 计算机科学 2022-02-15 Bolaji Yusuf , Ankur Gandhe , Alex Sokolov

Automatic speech recognition (ASR) has become increasingly ubiquitous on modern edge devices. Past work developed streaming End-to-End (E2E) all-neural speech recognizers that can run compactly on edge devices. However, E2E ASR models are…

The attention-based encoder-decoder modeling paradigm has achieved promising results on a variety of speech processing tasks like automatic speech recognition (ASR), text-to-speech (TTS) and among others. This paradigm takes advantage of…

音频与语音处理 · 电气工程与系统科学 2021-07-23 Shi-Yan Weng , Berlin Chen

Even with several advancements in multilingual modeling, it is challenging to recognize multiple languages using a single neural model, without knowing the input language and most multilingual models assume the availability of the input…

音频与语音处理 · 电气工程与系统科学 2024-01-23 Aditya Patil , Vikas Joshi , Purvi Agrawal , Rupesh Mehta

Sequence-to-sequence (S2S) modeling is becoming a popular paradigm for automatic speech recognition (ASR) because of its ability to jointly optimize all the conventional ASR components in an end-to-end (E2E) fashion. This report…

音频与语音处理 · 电气工程与系统科学 2019-04-30 Aswin Shanmugam Subramanian , Xiaofei Wang , Shinji Watanabe , Toru Taniguchi , Dung Tran , Yuya Fujita

End-to-end (E2E) approaches to keyword search (KWS) are considerably simpler in terms of training and indexing complexity when compared to approaches which use the output of automatic speech recognition (ASR) systems. This simplification…

音频与语音处理 · 电气工程与系统科学 2024-07-08 Bolaji Yusuf , Murat Saraçlar

The performance of voice-controlled systems is usually influenced by accented speech. To make these systems more robust, the frontend accent recognition (AR) technologies have received increased attention in recent years. As accent is a…

音频与语音处理 · 电气工程与系统科学 2021-05-06 Zhan Zhang , Xi Chen , Yuehai Wang , Jianyi Yang

Although end-to-end (E2E) trainable automatic speech recognition (ASR) has shown great success by jointly learning acoustic and linguistic information, it still suffers from the effect of domain shifts, thus limiting potential applications.…

音频与语音处理 · 电气工程与系统科学 2023-08-28 Keqi Deng , Philip C. Woodland

In recent years, all-neural, end-to-end (E2E) ASR systems gained rapid interest in the speech recognition community. They convert speech input to text units in a single trainable Neural Network model. In ASR, many utterances contain rich…

计算与语言 · 计算机科学 2020-08-11 Rongqing Huang , Ossama Abdel-hamid , Xinwei Li , Gunnar Evermann

We study training a single end-to-end (E2E) automatic speech recognition (ASR) model for three languages used in Kazakhstan: Kazakh, Russian, and English. We first describe the development of multilingual E2E ASR based on Transformer…

音频与语音处理 · 电气工程与系统科学 2021-08-04 Saida Mussakhojayeva , Yerbolat Khassanov , Huseyin Atakan Varol

Attention-based encoder-decoder model has achieved impressive results for both automatic speech recognition (ASR) and text-to-speech (TTS) tasks. This approach takes advantage of the memorization capacity of neural networks to learn the…

计算与语言 · 计算机科学 2020-03-17 Chengyi Wang , Yu Wu , Yujiao Du , Jinyu Li , Shujie Liu , Liang Lu , Shuo Ren , Guoli Ye , Sheng Zhao , Ming Zhou