English
Related papers

Related papers: Learning Filterbanks from Raw Speech for Phone Rec…

200 papers

Neural network-based vocoders have recently demonstrated the powerful ability to synthesize high-quality speech. These models usually generate samples by conditioning on spectral features, such as Mel-spectrogram and fundamental frequency,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-13 Yunchao He , Yujun Wang

We investigate sequence machine learning techniques on raw radio signal time-series data. By applying deep recurrent neural networks we learn to discriminate between several application layer traffic types on top of a constant envelope…

Machine Learning · Computer Science 2016-10-04 Timothy J. O'Shea , Seth Hitefield , Johnathan Corgan

Deep learning models are intrinsically sensitive to distribution shifts in the input data. In particular, small, barely perceivable perturbations to the input data can force models to make wrong predictions with high confidence. An common…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Paul Gavrikov , Janis Keuper

Acoustic beamformers have been widely used to enhance audio signals. Currently, the best methods are the deep neural network (DNN)-powered variants of the generalized eigenvalue and minimum-variance distortionless response beamformers and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Yuichiro Koyama , Bhiksha Raj

Convolutional neural networks (CNNs) with dilated filters such as the Wavenet or the Temporal Convolutional Network (TCN) have shown good results in a variety of sequence modelling tasks. However, efficiently modelling long-term…

Machine Learning · Computer Science 2019-11-18 Daniel Stoller , Mi Tian , Sebastian Ewert , Simon Dixon

In the last decade convolutional neural networks have become gargantuan. Pre-trained models, when used as initializers are able to fine-tune ever larger networks on small datasets. Consequently, not all the convolutional features that these…

Machine Learning · Computer Science 2020-05-01 Ragav Venkatesan , Gurumurthy Swaminathan , Xiong Zhou , Anna Luo

Wireless communications at high-frequency bands with large antenna arrays face challenges in beam management, which can potentially be improved by multimodality sensing information from cameras, LiDAR, radar, and GPS. In this paper, we…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Yu Tian , Qiyang Zhao , Zine el abidine Kherroubi , Fouzi Boukhalfa , Kebin Wu , Faouzi Bader

Recently there has been a lot of work on pruning filters from deep convolutional neural networks (CNNs) with the intention of reducing computations.The key idea is to rank the filters based on a certain criterion (say, l1-norm) and retain…

Machine Learning · Computer Science 2018-12-27 Deepak Mittal , Shweta Bhardwaj , Mitesh M. Khapra , Balaraman Ravindran

Deepfake (DF) attacks pose a growing threat as generative models become increasingly advanced. However, our study reveals that existing DF datasets fail to deceive human perception, unlike real DF attacks that influence public discourse. It…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Oguzhan Baser , Ahmet Ege Tanriverdi , Sriram Vishwanath , Sandeep P. Chinchali

Convolutional layers with 1-D filters are often used as frontend to encode audio signals. Unlike fixed time-frequency representations, they can adapt to the local characteristics of input data. However, 1-D filters on raw audio are hard to…

Sound · Computer Science 2024-09-02 Daniel Haider , Felix Perfler , Vincent Lostanlen , Martin Ehler , Peter Balazs

A novel procedure is presented in this paper, for training a deep convolutional and recurrent neural network, taking into account both the available training data set and some information extracted from similar networks trained with other…

Machine Learning · Computer Science 2018-09-13 Dimitrios Kollias , Stefanos Zafeiriou

In recent years, using raw waveforms as input for deep networks has been widely explored for the speaker verification system. For example, RawNet and RawNet2 extracted speaker's feature embeddings from waveforms automatically for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Jin Li , Nan Yan , Lan Wang

A well-trained Convolutional Neural Network can easily be pruned without significant loss of performance. This is because of unnecessary overlap in the features captured by the network's filters. Innovations in network architecture such as…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Aaditya Prakash , James Storer , Dinei Florencio , Cha Zhang

Fully exploiting ad-hoc microphone networks for distant speech recognition is still an open issue. Empirical evidence shows that being able to select the best microphone leads to significant improvements in recognition without any…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-15 Samuele Cornell , Alessio Brutti , Marco Matassoni , Stefano Squartini

We investigated how the application of deep learning, specifically the use of convolutional networks trained with GPUs, can help to build better predictive models in telecommunication business environments, and fill this gap. In particular,…

Machine Learning · Computer Science 2016-07-15 Jaime Zaratiegui , Ana Montoro , Federico Castanedo

Sequence-to-sequence models have shown success in end-to-end speech recognition. However these models have only used shallow acoustic encoder networks. In our work, we successively train very deep convolutional networks to add more…

Computation and Language · Computer Science 2016-10-11 Yu Zhang , William Chan , Navdeep Jaitly

Deep learning approaches for beat and downbeat tracking have brought advancements. However, these approaches continue to rely on hand-crafted, subsampled spectral features as input, restricting the information available to the model. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Christian J. Steinmetz , Joshua D. Reiss

We introduce a new audio processing technique that increases the sampling rate of signals such as speech or music using deep convolutional neural networks. Our model is trained on pairs of low and high-quality audio examples; at test-time,…

Sound · Computer Science 2017-08-03 Volodymyr Kuleshov , S. Zayd Enam , Stefano Ermon

The goal of continuous emotion recognition is to assign an emotion value to every frame in a sequence of acoustic features. We show that incorporating long-term temporal dependencies is critical for continuous emotion recognition tasks. To…

We present an architecture of a recurrent neural network (RNN) with a fully-connected deep neural network (DNN) as its feature extractor. The RNN is equipped with both causal temporal prediction and non-causal look-ahead, via…

Machine Learning · Computer Science 2014-03-07 Jianshu Chen , Li Deng