English
Related papers

Related papers: Learning Waveform-Based Acoustic Models using Deep…

200 papers

Convolutional neural networks (CNNs) have had great success in many real-world applications and have also been used to model visual processing in the brain. However, these networks are quite brittle - small changes in the input image can…

Neurons and Cognition · Quantitative Biology 2018-10-30 Brian Hu , Stefan Mihalas

This paper presents a simple end-to-end model for speech recognition, combining a convolutional network based acoustic model and a graph decoding. It is trained to output letters, with transcribed speech, without the need for force…

Machine Learning · Computer Science 2016-09-14 Ronan Collobert , Christian Puhrsch , Gabriel Synnaeve

In speech enhancement, complex neural network has shown promising performance due to their effectiveness in processing complex-valued spectrum. Most of the recent speech enhancement approaches mainly focus on wide-band signal with a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-17 Shubo Lv , Yihui Fu , Mengtao Xing , Jiayao Sun , Lei Xie , Jun Huang , Yannan Wang , Tao Yu

Auditory models are commonly used as feature extractors for automatic speech-recognition systems or as front-ends for robotics, machine-hearing and hearing-aid applications. Although auditory models can capture the biophysical and nonlinear…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Deepak Baby , Arthur Van Den Broucke , Sarah Verhulst

In recent years, neural network approaches have shown superior performance to conventional hand-made features in numerous application areas. In particular, convolutional neural networks (ConvNets) exploit spatially local correlations across…

Sound · Computer Science 2016-07-11 Yoonchang Han , Kyogu Lee

Randomized Neural Networks explore the behavior of neural systems where the majority of connections are fixed, either in a stochastic or a deterministic fashion. Typical examples of such systems consist of multi-layered neural network…

Machine Learning · Computer Science 2021-02-03 Claudio Gallicchio , Simone Scardapane

Although stochastic approximation learning methods have been widely used in the machine learning literature for over 50 years, formal theoretical analyses of specific machine learning algorithms are less common because stochastic…

Machine Learning · Statistics 2017-04-21 Richard M. Golden

We propose an end-to-end joint optimization framework of a multi-channel neural speech extraction and deep acoustic model without mel-filterbank (FBANK) extraction for overlapped speech recognition. First, based on a multi-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-31 Bo Wu , Meng Yu , Lianwu Chen , Chao Weng , Dan Su , Dong Yu

In hybrid hidden Markov model/artificial neural networks (HMM/ANN) automatic speech recognition (ASR) system, the phoneme class conditional probabilities are estimated by first extracting acoustic features from the speech signal based on…

Machine Learning · Computer Science 2013-06-13 Dimitri Palaz , Ronan Collobert , Mathew Magimai. -Doss

Large-scale auto-regressive language models pretrained on massive text have demonstrated their impressive ability to perform new natural language tasks with only a few text examples, without the need for fine-tuning. Recent studies further…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-15 Heting Gao , Junrui Ni , Kaizhi Qian , Yang Zhang , Shiyu Chang , Mark Hasegawa-Johnson

This work proposes a general framework for capturing noise-driven transitions in spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic…

Dynamical Systems · Mathematics 2024-12-16 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

In this paper, we review various end-to-end automatic speech recognition algorithms and their optimization techniques for on-device applications. Conventional speech recognition systems comprise a large number of discrete components such as…

Machine Learning · Computer Science 2021-08-30 Chanwoo Kim , Dhananjaya Gowda , Dongsoo Lee , Jiyeon Kim , Ankur Kumar , Sungsoo Kim , Abhinav Garg , Changwoo Han

In this work, we try to answer two questions: Can deeply learned features with discriminative power benefit an ASR system's robustness to acoustic variability? And how to learn them without requiring framewise labelled sequence training…

Machine Learning · Computer Science 2019-05-17 Jun Wang , Dan Su , Jie Chen , Shulin Feng , Dongpeng Ma , Na Li , Dong Yu

We use a data-driven approach to model a three-dimensional turbulent flow using cutting-edge Deep Learning techniques. The deep learning framework incorporates physical constraints on the flow, such as preserving incompressibility and…

Fluid Dynamics · Physics 2021-12-08 Mohammadreza Momenifar , Enmao Diao , Vahid Tarokh , Andrew D. Bragg

We propose a nonlinear manifold learning technique based on deep convolutional autoencoders that is appropriate for model order reduction of physical systems in complex geometries. Convolutional neural networks have proven to be highly…

Computational Physics · Physics 2021-07-19 John Tencer , Kevin Potter

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

We introduce a new beam search decoder that is fully differentiable, making it possible to optimize at training time through the inference procedure. Our decoder allows us to combine models which operate at different granularities (e.g.…

Computation and Language · Computer Science 2019-02-19 Ronan Collobert , Awni Hannun , Gabriel Synnaeve

In this work, we propose a training algorithm for an audio-visual automatic speech recognition (AV-ASR) system using deep recurrent neural network (RNN).First, we train a deep RNN acoustic model with a Connectionist Temporal Classification…

Computer Vision and Pattern Recognition · Computer Science 2016-11-10 Abhinav Thanda , Shankar M Venkatesan

Machine learning can extract information from neural recordings, e.g., surface EEG, ECoG and {\mu}ECoG, and therefore plays an important role in many research and clinical applications. Deep learning with artificial neural networks has…

This paper proposes a framework for modeling sound change that combines deep learning and iterative learning. Acquisition and transmission of speech is modeled by training generations of Generative Adversarial Networks (GANs) on unannotated…

Computation and Language · Computer Science 2021-09-23 Gašper Beguš