English
Related papers

Related papers: DFSMN-SAN with Persistent Memory Model for Automat…

200 papers

We introduce a new structure for memory neural networks, called feedforward sequential memory networks (FSMN), which can learn long-term dependency without using recurrent feedback. The proposed FSMN is a standard feedforward neural…

Neural and Evolutionary Computing · Computer Science 2016-01-07 ShiLiang Zhang , Hui Jiang , Si Wei , LiRong Dai

We present a frontend for improving robustness of automatic speech recognition (ASR), that jointly implements three modules within a single model: acoustic echo cancellation, speech enhancement, and speech separation. This is achieved by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Tom O'Malley , Arun Narayanan , Quan Wang , Alex Park , James Walker , Nathan Howard

Neural architecture search (NAS) has attracted much attention and has been explored for automatic speech recognition (ASR). In this work, we focus on streaming ASR scenarios and propose the latency-controlled NAS for acoustic modeling.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Liqiang He , Shulin Feng , Dan Su , Dong Yu

Prior works have investigated the use of articulatory features as complementary representations for automatic speech recognition (ASR), but their use was largely confined to shallow acoustic models. In this work, we revisit articulatory…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-13 Ahmed Adel Attia , Jing Liu , Carol Espy Wilson

Automatic speech recognition (ASR) systems degrade significantly under noisy conditions. Recently, speech enhancement (SE) is introduced as front-end to reduce noise for ASR, but it also suppresses some important speech information, i.e.,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Yuchen Hu , Nana Hou , Chen Chen , Eng Siong Chng

The combination of a deep neural network (DNN) -based speech enhancement (SE) front-end and an automatic speech recognition (ASR) back-end is a widely used approach to implement overlapping speech recognition. However, the SE front-end…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Keisuke Kinoshita , Naoyuki Kamo , Takafumi Moriya

This paper investigates the impact of word-based RNN language models (RNN-LMs) on the performance of end-to-end automatic speech recognition (ASR). In our prior work, we have proposed a multi-level LM, in which character-based and…

Computation and Language · Computer Science 2018-08-09 Takaaki Hori , Jaejin Cho , Shinji Watanabe

We present state-of-the-art automatic speech recognition (ASR) systems employing a standard hybrid DNN/HMM architecture compared to an attention-based encoder-decoder design for the LibriSpeech task. Detailed descriptions of the system…

Computation and Language · Computer Science 2019-10-02 Christoph Lüscher , Eugen Beck , Kazuki Irie , Markus Kitza , Wilfried Michel , Albert Zeyer , Ralf Schlüter , Hermann Ney

The Bidirectional LSTM (BLSTM) RNN based speech synthesis system is among the best parametric Text-to-Speech (TTS) systems in terms of the naturalness of generated speech, especially the naturalness in prosody. However, the model complexity…

Computation and Language · Computer Science 2018-02-27 Mengxiao Bi , Heng Lu , Shiliang Zhang , Ming Lei , Zhijie Yan

End-to-end automatic speech recognition (ASR) commonly transcribes audio signals into sequences of characters while its performance is evaluated by measuring the word-error rate (WER). This suggests that predicting sequences of words…

Computation and Language · Computer Science 2018-12-07 Jan Kremer , Lasse Borgholt , Lars Maaløe

In this paper, various structures and methods of Deep Artificial Neural Networks (DNN) will be evaluated and compared for the purpose of continuous Persian speech recognition. One of the first models of neural networks used in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-06 Arash Dehghani , Seyyed Ali Seyyedsalehi

Recently, pioneer work finds that speech pre-trained models can solve full-stack speech processing tasks, because the model utilizes bottom layers to learn speaker-related information and top layers to encode content-related information.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-17 Chengyi Wang , Yu Wu , Sanyuan Chen , Shujie Liu , Jinyu Li , Yao Qian , Zhenglu Yang

Over the last decade, deep-learning methods have been gradually incorporated into conventional automatic speech recognition (ASR) frameworks to create acoustic, pronunciation, and language models. Although it led to significant improvements…

Sound · Computer Science 2022-05-26 Zohreh Ansari , Farzin Pourhoseini , Fatemeh Hadaeghi

We present a novel deep Recurrent Neural Network (RNN) model for acoustic modelling in Automatic Speech Recognition (ASR). We term our contribution as a TC-DNN-BLSTM-DNN model, the model combines a Deep Neural Network (DNN) with Time…

Machine Learning · Computer Science 2015-04-08 William Chan , Ian Lane

Conventional automatic speech recognition (ASR) typically performs multi-level pattern recognition tasks that map the acoustic speech waveform into a hierarchy of speech units. But, it is widely known that information loss in the earlier…

Computation and Language · Computer Science 2017-09-25 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

In this work, we investigate the use of embeddings for speaker-adaptive training of DNNs (DNN-SAT) focusing on a small amount of adaptation data per speaker. DNN-SAT can be viewed as learning a mapping from each embedding to transformation…

Computation and Language · Computer Science 2019-10-01 Joanna Rownicka , Peter Bell , Steve Renals

Data-driven models achieve successful results in Speech Emotion Recognition (SER). However, these models, which are often based on general acoustic features or end-to-end approaches, show poor performance when the testing set has a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-15 Duowei Tang , Peter Kuppens , Lucca Geurts , Toon van Waterschoot

Recent studies have shown that a hybrid of self-attention networks (SANs) and recurrent neural networks (RNNs) outperforms both individual architectures, while not much is known about why the hybrid models work. With the belief that…

Computation and Language · Computer Science 2019-11-18 Jie Hao , Xing Wang , Shuming Shi , Jinfeng Zhang , Zhaopeng Tu

Accent variability has posed a huge challenge to automatic speech recognition~(ASR) modeling. Although one-hot accent vector based adaptation systems are commonly used, they require prior knowledge about the target accent and cannot handle…

Sound · Computer Science 2022-04-22 Xun Gong , Yizhou Lu , Zhikai Zhou , Yanmin Qian

Self-attention has become an important and widely used neural network component that helped to establish new state-of-the-art results for various applications, such as machine translation and automatic speech recognition (ASR). However, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-08 Niko Moritz , Takaaki Hori , Jonathan Le Roux