English
Related papers

Related papers: Understanding the Generalization Ability of Deep L…

200 papers

In this work, we present a variety of novel information-theoretic generalization bounds for learning algorithms, from the supersample setting of Steinke & Zakynthinou (2020)-the setting of the "conditional mutual information" framework. Our…

Machine Learning · Statistics 2023-06-16 Ziqiao Wang , Yongyi Mao

Machine learning has made tremendous progress in recent years, with models matching or even surpassing humans on a series of specialized tasks. One key element behind the progress of machine learning in recent years has been the ability to…

Machine Learning · Computer Science 2020-06-30 Giorgi Nadiradze , Ilia Markov , Bapi Chatterjee , Vyacheslav Kungurtsev , Dan Alistarh

We present a non-asymptotic theory of generalization in deep learning where the empirical neural tangent kernel partitions the output space. In directions corresponding to signal, error dissipates rapidly; in the vast orthogonal dimensions…

Machine Learning · Computer Science 2026-05-05 Elon Litman , Gabe Guo

An interesting observation in artificial neural networks is their favorable generalization error despite typically being extremely overparameterized. It is well known that the classical statistical learning methods often result in vacuous…

Machine Learning · Computer Science 2021-10-12 Sattar Vakili , Michael Bromberg , Jezabel Garcia , Da-shan Shiu , Alberto Bernacchia

The Renyi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies or…

Quantum Physics · Physics 2014-01-28 Martin Müller-Lennert , Frédéric Dupuis , Oleg Szehr , Serge Fehr , Marco Tomamichel

Information theory provides principled ways to analyze different inference and learning problems such as hypothesis testing, clustering, dimensionality reduction, classification, among others. However, the use of information theoretic…

Machine Learning · Computer Science 2014-09-03 Luis G. Sanchez Giraldo , Murali Rao , Jose C. Principe

Existing generalization theories of supervised learning typically take a holistic approach and provide bounds for the expected generalization over the whole data distribution, which implicitly assumes that the model generalizes similarly…

Machine Learning · Computer Science 2024-01-08 Firas Laakom , Yuheng Bu , Moncef Gabbouj

Recently, generalization bounds of the non-convex empirical risk minimization paradigm using Stochastic Gradient Langevin Dynamics (SGLD) have been extensively studied. Several theoretical frameworks have been presented to study this…

Machine Learning · Computer Science 2021-12-17 Bingzhe Wu , Zhicong Liang , Yatao Bian , ChaoChao Chen , Junzhou Huang , Yuan Yao

Exponential generalization bounds with near-tight rates have recently been established for uniformly stable learning algorithms. The notion of uniform stability, however, is stringent in the sense that it is invariant to the data-generating…

Machine Learning · Statistics 2022-06-09 Xiao-Tong Yuan , Ping Li

This research paper delves into the innovative integration of Shannon entropy and rough set theory, presenting a novel approach to generalize the evaluation approach in machine learning. The conventional application of entropy, primarily…

Machine Learning · Computer Science 2024-04-22 Olga Cherednichenko , Dmytro Chernyshov , Dmytro Sytnikov , Polina Sytnikova

Training deep neural networks with stochastic gradient descent (SGD) can often achieve zero training loss on real-world tasks although the optimization landscape is known to be highly non-convex. To understand the success of SGD for…

Machine Learning · Statistics 2020-06-15 Yiping Lu , Chao Ma , Yulong Lu , Jianfeng Lu , Lexing Ying

Information-theoretic generalization bounds analyze stochastic optimization by relating expected generalization error to the mutual information between learned parameters and training data. Virtual perturbation analyses of SGD add auxiliary…

Machine Learning · Computer Science 2026-05-04 Mohammad Partohaghighi

The asymptotically precise estimation of the generalization of kernel methods has recently received attention due to the parallels between neural networks and their associated kernels. However, prior works derive such estimates for training…

Machine Learning · Computer Science 2024-03-19 Maksim Velikanov , Maxim Panov , Dmitry Yarotsky

This dissertation studies a fundamental open challenge in deep learning theory: why do deep networks generalize well even while being overparameterized, unregularized and fitting the training data to zero error? In the first part of the…

Machine Learning · Computer Science 2021-10-19 Vaishnavh Nagarajan

It is by now well-established that modern over-parameterized models seem to elude the bias-variance tradeoff and generalize well despite overfitting noise. Many recent works attempt to analyze this phenomenon in the relatively tractable…

Machine Learning · Computer Science 2024-02-21 Daniel Barzilai , Ohad Shamir

The traditional approach of statistical physics to supervised learning routinely assumes unrealistic generative models for the data: usually inputs are independent random variables, uncorrelated with their labels. Only recently, statistical…

Statistical Mechanics · Physics 2020-10-21 Mauro Pastore , Pietro Rotondo , Vittorio Erba , Marco Gherardi

Deep learning has transformed computer vision, natural language processing, and speech recognition\cite{badrinarayanan2017segnet, dong2016image, ren2017faster, ji20133d}. However, two critical questions remain obscure: (1) why do deep…

Machine Learning · Statistics 2018-10-03 Jingwei Zhang , Tongliang Liu , Dacheng Tao

Algorithm unfolding or unrolling is the technique of constructing a deep neural network (DNN) from an iterative algorithm. Unrolled DNNs often provide better interpretability and superior empirical performance over standard DNNs in signal…

Machine Learning · Statistics 2024-02-21 Carter Lyons , Raghu G. Raj , Margaret Cheney

This work advances the theoretical understanding of quantum learning by establishing a new family of upper bounds on the expected generalization error of quantum learning algorithms, leveraging the framework introduced by Caro et al. (2024)…

Quantum Physics · Physics 2026-04-20 Naqueeb Ahmad Warsi , Ayanava Dasgupta , Masahito Hayashi

Recent research has used margin theory to analyze the generalization performance for deep neural networks (DNNs). The existed results are almost based on the spectrally-normalized minimum margin. However, optimizing the minimum margin…

Machine Learning · Computer Science 2024-07-10 Shen-Huan Lyu , Lu Wang , Zhi-Hua Zhou