English
Related papers

Related papers: Raw Waveform Encoder with Multi-Scale Globally Att…

200 papers

We propose an end-to-end affect recognition approach using a Convolutional Neural Network (CNN) that handles multiple languages, with applications to emotion and personality recognition from speech. We lay the foundation of a universal…

Computation and Language · Computer Science 2019-01-28 Dario Bertero , Onno Kampman , Pascale Fung

End-to-end automatic speech recognition systems represent the state of the art, but they rely on thousands of hours of manually annotated speech for training, as well as heavyweight computation for inference. Of course, this impedes…

Computation and Language · Computer Science 2022-11-22 Raphael Tang , Karun Kumar , Gefei Yang , Akshat Pandey , Yajie Mao , Vladislav Belyaev , Madhuri Emmadi , Craig Murray , Ferhan Ture , Jimmy Lin

Acoustic Echo Cancellation (AEC) plays a key role in speech interaction by suppressing the echo received at microphone introduced by acoustic reverberations from loudspeakers. Since the performance of linear adaptive filter (AF) would…

Sound · Computer Science 2021-06-02 Lu Ma , Song Yang , Yaguang Gong , Zhongqin Wu

Environmental audio tagging is a newly proposed task to predict the presence or absence of a specific audio event in a chunk. Deep neural network (DNN) based methods have been successfully adopted for predicting the audio tags in the…

Sound · Computer Science 2017-02-28 Yong Xu , Qiuqiang Kong , Qiang Huang , Wenwu Wang , Mark D. Plumbley

Speech is one of the most effective ways of communication among humans. Even though audio is the most common way of transmitting speech, very important information can be found in other modalities, such as vision. Vision is particularly…

Computation and Language · Computer Science 2016-11-22 Ramon Sanabria , Florian Metze , Fernando De La Torre

We consider the problem of recognizing speech utterances spoken to a device which is generating a known sound waveform; for example, recognizing queries issued to a digital assistant which is generating responses to previous user inputs.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-03 Nathan Howard , Alex Park , Turaj Zakizadeh Shabestary , Alexander Gruenstein , Rohit Prabhavalkar

Noise-robust automatic speech recognition (ASR) has been commonly addressed by applying speech enhancement (SE) at the waveform level before recognition. However, speech-level enhancement does not always translate into consistent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-09 Da-Hee Yang , Joon-Hyuk Chang

Speech representation and modelling in high-dimensional spaces of acoustic waveforms, or a linear transformation thereof, is investigated with the aim of improving the robustness of automatic speech recognition to additive noise. The…

Computation and Language · Computer Science 2015-03-31 Matthew Ager , Zoran Cvetkovic , Peter Sollich

Although state-of-the-art parallel WaveNet has addressed the issue of real-time waveform generation, there remains problems. Firstly, due to the noisy input signal of the model, there is still a gap between the quality of generated and…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-22 Qiao Tian , Xucheng Wan , Shan Liu

This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones;…

Recently, end-to-end sequence-to-sequence models for speech recognition have gained significant interest in the research community. While previous architecture choices revolve around time-delay neural networks (TDNN) and long short-term…

Computation and Language · Computer Science 2019-05-06 Ngoc-Quan Pham , Thai-Son Nguyen , Jan Niehues , Markus Müller , Sebastian Stüker , Alexander Waibel

Most phoneme recognition state-of-the-art systems rely on a classical neural network classifiers, fed with highly tuned features, such as MFCC or PLP features. Recent advances in ``deep learning'' approaches questioned such systems, but…

Machine Learning · Computer Science 2013-12-10 Dimitri Palaz , Ronan Collobert , Mathew Magimai. -Doss

This study addresses robust automatic speech recognition (ASR) by introducing a Conformer-based acoustic model. The proposed model builds on the wide residual bi-directional long short-term memory network (WRBN) with utterance-wise dropout…

Sound · Computer Science 2022-10-21 Yufeng Yang , Peidong Wang , DeLiang Wang

Transformers have recently dominated the ASR field. Although able to yield good performance, they involve an autoregressive (AR) decoder to generate tokens one by one, which is computationally inefficient. To speed up inference,…

Sound · Computer Science 2023-03-31 Zhifu Gao , Shiliang Zhang , Ian McLoughlin , Zhijie Yan

All-neural end-to-end (E2E) automatic speech recognition (ASR) systems that use a single neural network to transduce audio to word sequences have been shown to achieve state-of-the-art results on several tasks. In this work, we examine the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-28 Arun Narayanan , Rohit Prabhavalkar , Chung-Cheng Chiu , David Rybach , Tara N. Sainath , Trevor Strohman

Deep neural networks can learn complex and abstract representations, that are progressively obtained by combining simpler ones. A recent trend in speech and speaker recognition consists in discovering these representations starting from raw…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-26 Mirco Ravanelli , Yoshua Bengio

Automatic speech recognition (ASR) tasks are resolved by end-to-end deep learning models, which benefits us by less preparation of raw data, and easier transformation between languages. We propose a novel end-to-end deep learning model…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Xinpei Zhou , Jiwei Li , Xi Zhou

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

With the success of neural network based modeling in automatic speech recognition (ASR), many studies investigated acoustic modeling and learning of feature extractors directly based on the raw waveform. Recently, one line of research has…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-06 Peter Vieting , Christoph Lüscher , Wilfried Michel , Ralf Schlüter , Hermann Ney

The requirements for many applications of state-of-the-art speech recognition systems include not only low word error rate (WER) but also low latency. Specifically, for many use-cases, the system must be able to decode utterances in a…