English
Related papers

Related papers: Over-Parameterization and Generalization in Audio …

200 papers

Music genre recognition based on visual representation has been successfully explored over the last years. Recently, there has been increasing interest in attempting convolutional neural networks (CNNs) to achieve the task. However, most of…

Sound · Computer Science 2019-01-28 Caifeng Liu , Lin Feng , Guochao Liu , Huibing Wang , Shenglan Liu

It is frequently observed that overparameterized neural networks generalize well. Regarding such phenomena, existing theoretical work mainly devotes to linear settings or fully-connected neural networks. This paper studies the learning…

Machine Learning · Statistics 2023-08-17 Tian-Yi Zhou , Xiaoming Huo

This paper proposes a 1D residual convolutional neural network (CNN) architecture for music genre classification and compares it with other recent 1D CNN architectures. The 1D CNNs learn a representation and a discriminant directly from the…

Sound · Computer Science 2021-05-18 Safaa Allamy , Alessandro Lameiras Koerich

Convolutional neural networks (CNNs) have been successfully applied on both discriminative and generative modeling for music-related tasks. For a particular task, the trained CNN contains information representing the decision making or the…

Sound · Computer Science 2017-06-30 S. Geng , G. Ren , M. Ogihara

Convolutional Neural Networks are widely used in various machine learning domains. In image processing, the features can be obtained by applying 2D convolution to all spatial dimensions of the input. However, in the audio case, frequency…

Sound · Computer Science 2021-03-26 Simyung Chang , Hyoungwoo Park , Janghoon Cho , Hyunsin Park , Sungrack Yun , Kyuwoong Hwang

In the last few years, deep learning has led to very good performance on a variety of problems, such as visual recognition, speech recognition and natural language processing. Among different types of deep neural networks, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-10-20 Jiuxiang Gu , Zhenhua Wang , Jason Kuen , Lianyang Ma , Amir Shahroudy , Bing Shuai , Ting Liu , Xingxing Wang , Li Wang , Gang Wang , Jianfei Cai , Tsuhan Chen

Recent studies have shown that deep neural networks (DNNs) perform significantly better than shallow networks and Gaussian mixture models (GMMs) on large vocabulary speech recognition tasks. In this paper, we argue that the improved…

Machine Learning · Computer Science 2018-12-06 Dong Yu , Michael L. Seltzer , Jinyu Li , Jui-Ting Huang , Frank Seide

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

We report applications of Convolutional Neural Networks (CNN) to multi-classification classification of a large medical data set. We discuss in detail how changes in the CNN model and the data pre-processing impact the classification…

Machine Learning · Computer Science 2020-12-29 YuanZheng Hu , Marina Sokolova

Convolutional neural networks (CNNs) have achieved impressive results on imbalanced image data, but they still have difficulty generalizing to minority classes and their decisions are difficult to interpret. These problems are related…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Damien Dablain , Kristen N. Jacobson , Colin Bellinger , Mark Roberts , Nitesh Chawla

Convolutional neural networks (CNN) are now being widely used for classifying and detecting pulmonary abnormalities in chest radiographs. Two complementary generalization properties of CNNs, translation invariance and equivariance, are…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Edward Verenich , Tobias Martin , Alvaro Velasquez , Nazar Khan , Faraz Hussain

Generalization is essential for deep learning. In contrast to previous works claiming that Deep Neural Networks (DNNs) have an implicit regularization implemented by the stochastic gradient descent, we demonstrate explicitly Bayesian…

Machine Learning · Computer Science 2019-10-23 Xinjie Lan , Kenneth E. Barner

Image classification is a fundamental task in computer vision with diverse applications, ranging from autonomous systems to medical imaging. The CIFAR-10 dataset is a widely used benchmark to evaluate the performance of classification…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xiaoran Yang , Shuhan Yu , Wenxi Xu

Using deep neural networks (DNNs) for encoding of microphone array (MA) signals to the Ambisonics spatial audio format can surpass certain limitations of established conventional methods, but existing DNN-based methods need to be trained…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Mikko Heikkinen , Archontis Politis , Konstantinos Drossos , Tuomas Virtanen

Object detection systems based on the deep convolutional neural network (CNN) have recently made ground- breaking advances on several object detection benchmarks. While the features learned by these high-capacity neural networks are…

Computer Vision and Pattern Recognition · Computer Science 2016-01-15 Yuting Zhang , Kihyuk Sohn , Ruben Villegas , Gang Pan , Honglak Lee

Convolutional Neural Networks (CNNs) have become the state-of-the-art in supervised learning vision tasks. Their convolutional filters are of paramount importance for they allow to learn patterns while disregarding their locations in input…

Machine Learning · Computer Science 2017-10-26 Jean-Charles Vialatte , Vincent Gripon , Grégoire Mercier

Convolutional Neural Network (CNN) recognition rates drop in the presence of noise. We demonstrate a novel method of counteracting this drop in recognition rate by adjusting the biases of the neurons in the convolutional layers according to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 James R. Geraci , Parichay Kapoor

In this article we present an account of the state-of-the-art in acoustic scene classification (ASC), the task of classifying environments from the sounds they produce. Starting from a historical review of previous research in this area, we…

Sound · Computer Science 2015-04-08 Daniele Barchiesi , Dimitrios Giannoulis , Dan Stowell , Mark D. Plumbley

Complex visual scenes that are composed of multiple objects, each with attributes, such as object name, location, pose, color, etc., are challenging to describe in order to train neural networks. Usually,deep learning networks are trained…

Neural and Evolutionary Computing · Computer Science 2023-03-27 E. Paxon Frady , Spencer Kent , Quinn Tran , Pentti Kanerva , Bruno A. Olshausen , Friedrich T. Sommer

Domain mismatch is a noteworthy issue in acoustic event detection tasks, as the target domain data is difficult to access in most real applications. In this study, we propose a novel CNN-based discriminative training framework as a domain…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-29 Tiantian Tang , Xinyuan Zhou , Yanhua Long , Yijie Li , Jiaen Liang