English
Related papers

Related papers: Bayes Complexity of Learners vs Overfitting

200 papers

Recent years have witnessed a hot wave of deep neural networks in various domains; however, it is not yet well understood theoretically. A theoretical characterization of deep neural networks should point out their approximation ability and…

Machine Learning · Computer Science 2022-10-28 Gao Zhang , Jin-Hui Wu , Shao-Qun Zhang

PAC-Bayes is a useful framework for deriving generalization bounds which was introduced by McAllester ('98). This framework has the flexibility of deriving distribution- and algorithm-dependent bounds, which are often tighter than…

Machine Learning · Computer Science 2021-09-06 Roi Livni , Shay Moran

This paper studies the novel concept of weight correlation in deep neural networks and discusses its impact on the networks' generalisation ability. For fully-connected layers, the weight correlation is defined as the average cosine…

Machine Learning · Computer Science 2020-10-20 Gaojie Jin , Xinping Yi , Liang Zhang , Lijun Zhang , Sven Schewe , Xiaowei Huang

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk

Deep neural networks generalize well on unseen data though the number of parameters often far exceeds the number of training examples. Recently proposed complexity measures have provided insights to understanding the generalizability in…

Machine Learning · Computer Science 2020-05-12 Jingling Li , Yanchao Sun , Jiahao Su , Taiji Suzuki , Furong Huang

Understanding the origins of complexity is a fundamental challenge with implications for biological and technological systems. Network theory emerges as a powerful tool to model complex systems. Networks are an intuitive framework to…

Disordered Systems and Neural Networks · Physics 2024-10-22 Blai Vidiella , Salva Duran-Nebreda , Sergi Valverde

A fundamental question in theoretical machine learning is generalization. Over the past decades, the PAC-Bayesian approach has been established as a flexible framework to address the generalization capabilities of machine learning…

Machine Learning · Computer Science 2024-03-28 Fredrik Hellström , Giuseppe Durisi , Benjamin Guedj , Maxim Raginsky

Recent research in neural networks and machine learning suggests that using many more parameters than strictly required by the initial complexity of a regression problem can result in more accurate or faster-converging models -- contrary to…

Machine Learning · Computer Science 2023-05-18 Arthur Castello B. de Oliveira , Milad Siami , Eduardo D. Sontag

Normalizing flows have emerged as an important family of deep neural networks for modelling complex probability distributions. In this note, we revisit their coupling and autoregressive transformation layers as probabilistic graphical…

Machine Learning · Computer Science 2020-06-05 Antoine Wehenkel , Gilles Louppe

One of the central questions in the theory of deep learning is to understand how neural networks learn hierarchical features. The ability of deep networks to extract salient features is crucial to both their outstanding generalization…

Machine Learning · Computer Science 2025-04-03 Eshaan Nichani , Alex Damian , Jason D. Lee

An important issue in neural network research is how to choose the number of nodes and layers such as to solve a classification problem. We provide new intuitions based on earlier results by An et al. (2015) by deriving an upper bound on…

Machine Learning · Statistics 2018-02-13 Marjolein Troost , Katja Seeliger , Marcel van Gerven

Deep nets generalize well despite having more parameters than the number of training samples. Recent works try to give an explanation using PAC-Bayes and Margin-based analyses, but do not as yet result in sample complexity bounds better…

Machine Learning · Computer Science 2018-11-28 Sanjeev Arora , Rong Ge , Behnam Neyshabur , Yi Zhang

One of the defining properties of deep learning is that models are chosen to have many more parameters than available training data. In light of this capacity for overfitting, it is remarkable that simple algorithms like SGD reliably return…

Machine Learning · Computer Science 2017-10-20 Gintare Karolina Dziugaite , Daniel M. Roy

Neural networks outperform kernel methods, sometimes by orders of magnitude, e.g. on staircase functions. This advantage stems from the ability of neural networks to learn features, adapting their hidden representations to better capture…

Machine Learning · Computer Science 2025-07-29 Niclas Alexander Göring , Charles London , Abdurrahman Hadi Erturk , Chris Mingard , Yoonsoo Nam , Ard A. Louis

In many contexts, simpler models are preferable to more complex models and the control of this model complexity is the goal for many methods in machine learning such as regularization, hyperparameter tuning and architecture design. In deep…

Machine Learning · Computer Science 2022-12-27 Benoit Dherin , Michael Munn , Mihaela Rosca , David G. T. Barrett

We make three related contributions motivated by the challenge of training stochastic neural networks, particularly in a PAC-Bayesian setting: (1) we show how averaging over an ensemble of stochastic neural networks enables a new class of…

Machine Learning · Computer Science 2021-12-16 Felix Biggs , Benjamin Guedj

A new class of functions is presented. The structure of the algorithm, particularly the selection criteria (branching), is used to define the fundamental property of the new class. The most interesting property of the new functions is that…

Computational Complexity · Computer Science 2020-02-25 Rade Vuckovac

Domain generalization is challenging due to the domain shift and the uncertainty caused by the inaccessibility of target domain data. In this paper, we address both challenges with a probabilistic framework based on variational Bayesian…

Machine Learning · Computer Science 2021-07-16 Zehao Xiao , Jiayi Shen , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

Overfitting is one of the fundamental challenges when training convolutional neural networks and is usually identified by a diverging training and test loss. The underlying dynamics of how the flow of activations induce overfitting is…

Machine Learning · Computer Science 2021-04-14 Karim Huesmann , Luis Garcia Rodriguez , Lars Linsen , Benjamin Risse

I aim to show that models, classification or generating functions, invariances and datasets are algorithmically equivalent concepts once properly defined, and provide some concrete examples of them. I then show that a) neural networks (NNs)…

Machine Learning · Computer Science 2016-12-19 Giulio Ruffini