English
Related papers

Related papers: On Random Subset Generalization Error Bounds and t…

200 papers

Generalization error (also known as the out-of-sample error) measures how well the hypothesis learned from training data generalizes to previously unseen data. Proving tight generalization error bounds is a central question in statistical…

Machine Learning · Computer Science 2020-03-03 Jian Li , Xuanyuan Luo , Mingda Qiao

In statistical learning theory, generalization error is used to quantify the degree to which a supervised machine learning algorithm may overfit to training data. Recent work [Xu and Raginsky (2017)] has established a bound on the…

Machine Learning · Computer Science 2018-01-16 Ankit Pensia , Varun Jog , Po-Ling Loh

Generalization error bounds for deep neural networks trained by stochastic gradient descent (SGD) are derived by combining a dynamical control of an appropriate parameter norm and the Rademacher complexity estimate based on parameter norms.…

Machine Learning · Computer Science 2023-05-30 Mingze Wang , Chao Ma

We present a general approach, based on exponential inequalities, to derive bounds on the generalization error of randomized learning algorithms. Using this approach, we provide bounds on the average generalization error as well as bounds…

Machine Learning · Computer Science 2023-03-10 Fredrik Hellström , Giuseppe Durisi

The information-theoretic framework of Russo and J. Zou (2016) and Xu and Raginsky (2017) provides bounds on the generalization error of a learning algorithm in terms of the mutual information between the algorithm's output and the training…

Machine Learning · Statistics 2020-10-26 Mahdi Haghifam , Jeffrey Negrea , Ashish Khisti , Daniel M. Roy , Gintare Karolina Dziugaite

We study the Out-of-Distribution (OOD) generalization in machine learning and propose a general framework that establishes information-theoretic generalization bounds. Our framework interpolates freely between Integral Probability Metric…

Information Theory · Computer Science 2024-12-16 Wenliang Liu , Guanding Yu , Lele Wang , Renjie Liao

Recent years have seen advances in generalization bounds for noisy stochastic algorithms, especially stochastic gradient Langevin dynamics (SGLD) based on stability (Mou et al., 2018; Li et al., 2020) and information theoretic approaches…

Machine Learning · Computer Science 2022-11-02 Arindam Banerjee , Tiancong Chen , Xinyan Li , Yingxue Zhou

Algorithm-dependent generalization error bounds are central to statistical learning theory. A learning algorithm may use a large hypothesis space, but the limited number of iterations controls its model capacity and generalization error.…

Machine Learning · Computer Science 2017-07-20 Wenlong Mou , Liwei Wang , Xiyu Zhai , Kai Zheng

Proving algorithm-dependent generalization error bounds for gradient-type optimization methods has attracted significant attention recently in learning theory. However, most existing trajectory-based analyses require either restrictive…

Machine Learning · Computer Science 2022-10-12 Xuanyuan Luo , Luo Bei , Jian Li

Stochastic iterative algorithms, including stochastic gradient descent (SGD) and stochastic gradient Langevin dynamics (SGLD), are widely utilized for optimization and sampling in large-scale and high-dimensional problems in machine…

Machine Learning · Statistics 2025-01-22 Xiaoyu Wang , Mikolaj J. Kasprzak , Jeffrey Negrea , Solesne Bourguin , Jonathan H. Huggins

An information-theoretic upper bound on the generalization error of supervised learning algorithms is derived. The bound is constructed in terms of the mutual information between each individual training sample and the output of the…

Machine Learning · Computer Science 2020-08-06 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

Machine learning models trained by different optimization algorithms under different data distributions can exhibit distinct generalization behaviors. In this paper, we analyze the generalization of models trained by noisy iterative…

Machine Learning · Statistics 2022-12-29 Hao Wang , Rui Gao , Flavio P. Calmon

Many machine learning tasks can be formulated as Regularized Empirical Risk Minimization (R-ERM), and solved by optimization algorithms such as gradient descent (GD), stochastic gradient descent (SGD), and stochastic variance reduction…

Machine Learning · Statistics 2016-09-28 Qi Meng , Yue Wang , Wei Chen , Taifeng Wang , Zhi-Ming Ma , Tie-Yan Liu

Recently, generalization bounds of the non-convex empirical risk minimization paradigm using Stochastic Gradient Langevin Dynamics (SGLD) have been extensively studied. Several theoretical frameworks have been presented to study this…

Machine Learning · Computer Science 2021-12-17 Bingzhe Wu , Zhicong Liang , Yatao Bian , ChaoChao Chen , Junzhou Huang , Yuan Yao

In this work, we improve upon the stepwise analysis of noisy iterative learning algorithms initiated by Pensia, Jog, and Loh (2018) and recently extended by Bu, Zou, and Veeravalli (2019). Our main contributions are significantly improved…

Machine Learning · Statistics 2020-01-28 Jeffrey Negrea , Mahdi Haghifam , Gintare Karolina Dziugaite , Ashish Khisti , Daniel M. Roy

Generalization error bounds are essential to understanding machine learning algorithms. This paper presents novel expected generalization error upper bounds based on the average joint distribution between the output hypothesis and each…

Information Theory · Computer Science 2022-02-25 Gholamali Aminian , Yuheng Bu , Gregory Wornell , Miguel Rodrigues

This work presents several expected generalization error bounds based on the Wasserstein distance. More specifically, it introduces full-dataset, single-letter, and random-subset bounds, and their analogues in the randomized subsample…

Machine Learning · Statistics 2022-03-29 Borja Rodríguez-Gálvez , Germán Bassi , Ragnar Thobaben , Mikael Skoglund

We consider the problem of sampling from a target distribution, which is \emph {not necessarily logconcave}, in the context of empirical risk minimization and stochastic optimization as presented in Raginsky et al. (2017). Non-asymptotic…

Statistics Theory · Mathematics 2021-02-03 Ngoc Huy Chau , Éric Moulines , Miklos Rásonyi , Sotirios Sabanis , Ying Zhang

We establish generalization error bounds for stochastic gradient Langevin dynamics (SGLD) with constant learning rate under the assumptions of dissipativity and smoothness, a setting that has received increased attention in the…

Machine Learning · Statistics 2021-11-29 Tyler Farghly , Patrick Rebeschini

This work discusses how to derive upper bounds for the expected generalisation error of supervised learning algorithms by means of the chaining technique. By developing a general theoretical framework, we establish a duality between…

Machine Learning · Statistics 2022-07-01 Eugenio Clerico , Amitis Shidani , George Deligiannidis , Arnaud Doucet
‹ Prev 1 2 3 10 Next ›