English
Related papers

Related papers: Instabilities in Convnets for Raw Audio

200 papers

This study investigates the behavior of Causal Convolutional Neural Networks (CNNs) with quasi-linear activation functions when applied to time-series data characterized by multimodal frequency content. We demonstrate that, once trained,…

Machine Learning · Computer Science 2025-10-29 Kiran Bacsa , Wei Liu , Xudong Jian , Huangbin Liang , Eleni Chatzi

The convolutional layers are core building blocks of neural network architectures. In general, a convolutional filter applies to the entire frequency spectrum of the input data. We explore artificially constraining the frequency spectra of…

Machine Learning · Computer Science 2019-11-22 Adam Dziedzic , John Paparrizos , Sanjay Krishnan , Aaron Elmore , Michael Franklin

Deep convolutional neural networks are generally regarded as robust function approximators. So far, this intuition is based on perturbations to external stimuli such as the images to be classified. Here we explore the robustness of…

Machine Learning · Computer Science 2017-03-27 Nicholas Cheney , Martin Schrimpf , Gabriel Kreiman

Deep neural networks can learn complex and abstract representations, that are progressively obtained by combining simpler ones. A recent trend in speech and speaker recognition consists in discovering these representations starting from raw…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-26 Mirco Ravanelli , Yoshua Bengio

When convolutional neural networks are used to tackle learning problems based on music or, more generally, time series data, raw one-dimensional data are commonly pre-processed to obtain spectrogram or mel-spectrogram coefficients, which…

Machine Learning · Computer Science 2018-09-20 Monika Doerfler , Thomas Grill , Roswitha Bammer , Arthur Flexer

In this paper, we propose a novel behavior model for wideband PAs using a real-valued time-delay convolutional neural network (RVTDCNN). The input data of the model are sorted and arranged as the graph composed of the in-phase and…

Signal Processing · Electrical Eng. & Systems 2020-05-21 Xin Hu , Zhijun Liu , Xiaofei Yu , Yulong Zhao , Wenhua Chen , Biao Hu , Xuekun Du , Xiang Li , Mohamed Helaoui , Weidong Wang , Fadhel M. Ghannouchi

Convolutional neural networks (CNNs) with dilated filters such as the Wavenet or the Temporal Convolutional Network (TCN) have shown good results in a variety of sequence modelling tasks. However, efficiently modelling long-term…

Machine Learning · Computer Science 2019-11-18 Daniel Stoller , Mi Tian , Sebastian Ewert , Simon Dixon

This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones;…

Cardiac auscultation is the most practiced non-invasive and cost-effective procedure for the early diagnosis of heart diseases. While machine learning based systems can aid in automatically screening patients, the robustness of these…

Signal Processing · Electrical Eng. & Systems 2020-10-05 Ahmed Imtiaz Humayun , Shabnam Ghaffarzadegan , Md. Istiaq Ansari , Zhe Feng , Taufiq Hasan

Raw waveform acoustic modelling has recently gained interest due to neural networks' ability to learn feature extraction, and the potential for finding better representations for a given scenario than hand-crafted features. SincNet has been…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-01 Joachim Fainberg , Ondřej Klejch , Erfan Loweimi , Peter Bell , Steve Renals

When optimizing convolutional neural networks (CNN) for a specific image-based task, specialists commonly overshoot the number of convolutional layers in their designs. By implication, these CNNs are unnecessarily resource intensive to…

Machine Learning · Computer Science 2022-06-23 Mats L. Richter , Julius Schöning , Anna Wiedenroth , Ulf Krumnack

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

Computation and Language · Computer Science 2018-08-29 Yi Yang

Sound Event Detection and Audio Classification tasks are traditionally addressed through time-frequency representations of audio signals such as spectrograms. However, the emergence of deep neural networks as efficient feature extractors…

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e.…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Sainbayar Sukhbaatar , Joan Bruna , Manohar Paluri , Lubomir Bourdev , Rob Fergus

Audio source separation is often used as preprocessing of various applications, and one of its ultimate goals is to construct a single versatile model capable of dealing with the varieties of audio signals. Since sampling frequency, one of…

Sound · Computer Science 2021-05-11 Koichi Saito , Tomohiko Nakamura , Kohei Yatabe , Yuma Koizumi , Hiroshi Saruwatari

Deep Neural Networks (DNNs) are widely used for their ability to effectively approximate large classes of functions. This flexibility, however, makes the strict enforcement of constraints on DNNs an open problem. Here we present a framework…

Machine Learning · Computer Science 2023-02-10 Eric Marcus , Ray Sheombarsing , Jan-Jakob Sonke , Jonas Teuwen

Recently, deep learning approaches with various network architectures have achieved significant performance improvement over existing iterative reconstruction methods in various imaging problems. However, it is still unclear why these deep…

Machine Learning · Statistics 2018-01-26 Jong Chul Ye , Yoseob Han , Eunju Cha

We propose a learnable content adaptive front end for audio signal processing. Before the modern advent of deep learning, we used fixed representation non-learnable front-ends like spectrogram or mel-spectrogram with/without neural…

Sound · Computer Science 2024-12-24 Prateek Verma , Chris Chafe

Deep learning has dramatically improved the performance of speech recognition systems through learning hierarchies of features optimized for the task at hand. However, true end-to-end learning, where features are learned directly from…

Computation and Language · Computer Science 2016-04-06 Zhenyao Zhu , Jesse H. Engel , Awni Hannun

This paper presents a comparison of several Convolutional Neural Network (CNN) models for extracting target signals in highly noisy measurement conditions. Four CNN architectures were investigated. The first comprises six consecutive…

Signal Processing · Electrical Eng. & Systems 2024-10-11 Andrea Faúndez Quezada , Salvatore La Cavera , Sidahmed A Abayzeed