中文
相关论文

相关论文: Very Deep Self-Attention Networks for End-to-End S…

200 篇论文

This paper proposes a model for transforming speech features using the frequency-directional attention model for End-to-End (E2E) automatic speech recognition. The idea is based on the hypothesis that in the phoneme system of each language,…

音频与语音处理 · 电气工程与系统科学 2022-03-30 Akihiro Dobashi , Chee Siang Leow , Hiromitsu Nishizaki

Advances in machine learning have made it possible to perform various text and speech processing tasks, such as automatic speech recognition (ASR), in an end-to-end (E2E) manner. E2E approaches utilizing pre-trained models are gaining…

音频与语音处理 · 电气工程与系统科学 2024-06-07 Yukiya Hono , Koh Mitsuda , Tianyu Zhao , Kentaro Mitsui , Toshiaki Wakatsuki , Kei Sawada

Transformer architectures are the backbone of the modern AI revolution. However, they are based on simply stacking the same blocks in dozens of layers and processing information sequentially from one block to another. In this paper, we…

计算与语言 · 计算机科学 2024-12-24 Prateek Verma , Mert Pilanci

In this work, we study leveraging extra text data to improve low-resource end-to-end ASR under cross-lingual transfer learning setting. To this end, we extend our prior work [1], and propose a hybrid Transformer-LSTM based architecture.…

音频与语音处理 · 电气工程与系统科学 2020-05-29 Zhiping Zeng , Van Tung Pham , Haihua Xu , Yerbolat Khassanov , Eng Siong Chng , Chongjia Ni , Bin Ma

This paper presents a transfer learning method in speech emotion recognition based on a Time-Delay Neural Network (TDNN) architecture. A major challenge in the current speech-based emotion detection research is data scarcity. The proposed…

音频与语音处理 · 电气工程与系统科学 2020-08-18 Sitong Zhou , Homayoon Beigi

Transformer-based acoustic modeling has achieved great suc-cess for both hybrid and sequence-to-sequence speech recogni-tion. However, it requires access to the full sequence, and thecomputational cost grows quadratically with respect to…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Chunyang Wu , Yongqiang Wang , Yangyang Shi , Ching-Feng Yeh , Frank Zhang

Deep neural networks (DNNs) have been demonstrated to outperform many traditional machine learning algorithms in Automatic Speech Recognition (ASR). In this paper, we show that a large improvement in the accuracy of deep speech models can…

音频与语音处理 · 电气工程与系统科学 2023-05-23 Ahmed Baruwa , Mojeed Abisiga , Ibrahim Gbadegesin , Afeez Fakunle

Automatic recognition systems for child speech are lagging behind those dedicated to adult speech in the race of performance. This phenomenon is due to the high acoustic and linguistic variability present in child speech caused by their…

音频与语音处理 · 电气工程与系统科学 2021-03-05 Lucile Gelin , Morgane Daniel , Julien Pinquier , Thomas Pellegrini

End-to-end models have achieved impressive results on the task of automatic speech recognition (ASR). For low-resource ASR tasks, however, labeled data can hardly satisfy the demand of end-to-end models. Self-supervised acoustic…

计算与语言 · 计算机科学 2021-05-12 Cheng Yi , Shiyu Zhou , Bo Xu

Many of the current state-of-the-art Large Vocabulary Continuous Speech Recognition Systems (LVCSR) are hybrids of neural networks and Hidden Markov Models (HMMs). Most of these systems contain separate components that deal with the…

计算与语言 · 计算机科学 2016-03-16 Dzmitry Bahdanau , Jan Chorowski , Dmitriy Serdyuk , Philemon Brakel , Yoshua Bengio

Automatic speech recognition (ASR) tasks are resolved by end-to-end deep learning models, which benefits us by less preparation of raw data, and easier transformation between languages. We propose a novel end-to-end deep learning model…

音频与语音处理 · 电气工程与系统科学 2018-10-31 Xinpei Zhou , Jiwei Li , Xi Zhou

We present a comprehensive study of deep bidirectional long short-term memory (LSTM) recurrent neural network (RNN) based acoustic models for automatic speech recognition (ASR). We study the effect of size and depth and train models of up…

神经与进化计算 · 计算机科学 2019-08-06 Albert Zeyer , Patrick Doetsch , Paul Voigtlaender , Ralf Schlüter , Hermann Ney

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

声音 · 计算机科学 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

This paper presents our latest investigation on end-to-end automatic speech recognition (ASR) for overlapped speech. We propose to train an end-to-end system conditioned on speaker embeddings and further improved by transfer learning from…

音频与语音处理 · 电气工程与系统科学 2019-08-14 Pavel Denisov , Ngoc Thang Vu

On-device end-to-end speech recognition poses a high requirement on model efficiency. Most prior works improve the efficiency by reducing model sizes. We propose to reduce the complexity of model architectures in addition to model sizes.…

计算与语言 · 计算机科学 2020-11-12 Peidong Wang , DeLiang Wang

End-to-end architectures have been recently proposed for spoken language understanding (SLU) and semantic parsing. Based on a large amount of data, those models learn jointly acoustic and linguistic-sequential features. Such architectures…

计算与语言 · 计算机科学 2020-02-17 Marco Dinarelli , Nikita Kapoor , Bassam Jabaian , Laurent Besacier

As the cornerstone of other important technologies, such as speech recognition and speech synthesis, speech enhancement is a critical area in audio signal processing. In this paper, a new deep learning structure for speech enhancement is…

声音 · 计算机科学 2021-08-30 Yuzi Yan , Wei-Qiang Zhang , Michael T. Johnson

All-neural end-to-end (E2E) automatic speech recognition (ASR) systems that use a single neural network to transduce audio to word sequences have been shown to achieve state-of-the-art results on several tasks. In this work, we examine the…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Arun Narayanan , Rohit Prabhavalkar , Chung-Cheng Chiu , David Rybach , Tara N. Sainath , Trevor Strohman

It is generally believed that direct sequence-to-sequence (seq2seq) speech recognition models are competitive with hybrid models only when a large amount of data, at least a thousand hours, is available for training. In this paper, we show…

音频与语音处理 · 电气工程与系统科学 2020-10-21 Zoltán Tüske , George Saon , Kartik Audhkhasi , Brian Kingsbury

In the area of multi-domain speech recognition, research in the past focused on hybrid acoustic models to build cross-domain and domain-invariant speech recognition systems. In this paper, we empirically examine the difference in behavior…

音频与语音处理 · 电气工程与系统科学 2020-03-10 Thai-Son Nguyen , Sebastian Stüker , Alex Waibel