English
Related papers

Related papers: Fantastic Generalization Measures are Nowhere to b…

200 papers

Random feature methods have been successful in various machine learning tasks, are easy to compute, and come with theoretical accuracy bounds. They serve as an alternative approach to standard neural networks since they can represent…

Machine Learning · Statistics 2026-01-21 Abolfazl Hashemi , Hayden Schaeffer , Robert Shi , Ufuk Topcu , Giang Tran , Rachel Ward

In this work, we introduce novel information-theoretic generalization bounds using the conditional $f$-information framework, an extension of the traditional conditional mutual information (MI) framework. We provide a generic approach to…

Machine Learning · Statistics 2024-10-31 Ziqiao Wang , Yongyi Mao

We present a general approach, based on exponential inequalities, to derive bounds on the generalization error of randomized learning algorithms. Using this approach, we provide bounds on the average generalization error as well as bounds…

Machine Learning · Computer Science 2023-03-10 Fredrik Hellström , Giuseppe Durisi

While deep learning is successful in a number of applications, it is not yet well understood theoretically. A satisfactory theoretical characterization of deep learning however, is beginning to emerge. It covers the following questions: 1)…

Machine Learning · Computer Science 2019-08-27 Tomaso Poggio , Andrzej Banburski , Qianli Liao

In this paper, we present the Bennett-type generalization bounds of the learning process for i.i.d. samples, and then show that the generalization bounds have a faster rate of convergence than the traditional results. In particular, we…

Machine Learning · Statistics 2013-09-27 Chao Zhang

PAC-Bayesian is an analysis framework where the training error can be expressed as the weighted average of the hypotheses in the posterior distribution whilst incorporating the prior knowledge. In addition to being a pure generalization…

Machine Learning · Computer Science 2022-02-07 Wei Huang , Chunrui Liu , Yilan Chen , Tianyu Liu , Richard Yi Da Xu

Score-based generative models (SGMs) have emerged as one of the most popular classes of generative models. A substantial body of work now exists on the analysis of SGMs, focusing either on discretization aspects or on their statistical…

Machine Learning · Statistics 2026-02-10 Benjamin Dupuis , Dario Shariatian , Maxime Haddouche , Alain Durmus , Umut Simsekli

We are motivated by the problem of providing strong generalization guarantees in the context of meta-learning. Existing generalization bounds are either challenging to evaluate or provide vacuous guarantees in even relatively simple…

Machine Learning · Computer Science 2021-10-27 Alec Farid , Anirudha Majumdar

Bounding and predicting the generalization gap of overparameterized neural networks remains a central open problem in theoretical machine learning. There is a recent and growing body of literature that proposes the framework of fractals to…

Machine Learning · Computer Science 2024-11-04 Charlie B. Tan , Inés García-Redondo , Qiquan Wang , Michael M. Bronstein , Anthea Monod

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

In this paper, we study the dynamics of temporal difference learning with neural network-based value function approximation over a general state space, namely, \emph{Neural TD learning}. We consider two practically used algorithms,…

Machine Learning · Computer Science 2021-08-09 Semih Cayci , Siddhartha Satpathi , Niao He , R. Srikant

This paper discovers that the neural network with lower decision boundary (DB) variability has better generalizability. Two new notions, algorithm DB variability and $(\epsilon, \eta)$-data DB variability, are proposed to measure the…

Machine Learning · Computer Science 2023-12-27 Shiye Lei , Fengxiang He , Yancheng Yuan , Dacheng Tao

This paper proves that robustness implies generalization via data-dependent generalization bounds. As a result, robustness and generalization are shown to be connected closely in a data-dependent manner. Our bounds improve previous bounds…

Machine Learning · Computer Science 2022-08-04 Kenji Kawaguchi , Zhun Deng , Kyle Luh , Jiaoyang Huang

Modern language models can contain billions of parameters, raising the question of whether they can generalize beyond the training data or simply parrot their training corpora. We provide the first non-vacuous generalization bounds for…

Machine Learning · Statistics 2024-07-18 Sanae Lotfi , Marc Finzi , Yilun Kuang , Tim G. J. Rudner , Micah Goldblum , Andrew Gordon Wilson

An interesting observation in artificial neural networks is their favorable generalization error despite typically being extremely overparameterized. It is well known that the classical statistical learning methods often result in vacuous…

Machine Learning · Computer Science 2021-10-12 Sattar Vakili , Michael Bromberg , Jezabel Garcia , Da-shan Shiu , Alberto Bernacchia

In this work, we revisit the problem of uniformity testing of discrete probability distributions. A fundamental problem in distribution testing, testing uniformity over a known domain has been addressed over a significant line of works, and…

Data Structures and Algorithms · Computer Science 2017-08-17 Tuğkan Batu , Clément L. Canonne

We propose semi-random features for nonlinear function approximation. The flexibility of semi-random feature lies between the fully adjustable units in deep learning and the random features used in kernel methods. For one hidden layer…

Machine Learning · Computer Science 2017-11-22 Kenji Kawaguchi , Bo Xie , Vikas Verma , Le Song

The ultimate goal of a supervised learning algorithm is to produce models constructed on the training data that can generalize well to new examples. In classification, functional margin maximization -- correctly classifying as many training…

Machine Learning · Computer Science 2020-01-29 Nikolaos Nikolaou , Henry Reeve , Gavin Brown

Often in language and other areas of cognition, whether two components of an object are identical or not determine whether it is well formed. We call such constraints identity effects. When developing a system to learn well-formedness from…

Computation and Language · Computer Science 2020-05-12 Simone Brugiapaglia , Matthew Liu , Paul Tupper

Deep neural networks (DNNs) generalize remarkably well without explicit regularization even in the strongly over-parametrized regime where classical learning theory would instead predict that they would severely overfit. While many…

Machine Learning · Statistics 2019-04-23 Guillermo Valle-Pérez , Chico Q. Camargo , Ard A. Louis