English
Related papers

Related papers: The Generalization Error of Supervised Machine Lea…

200 papers

Generalization is at the core of machine learning models. However, the definition of generalization is not entirely clear. We employ set theory to introduce the concepts of algorithms, hypotheses, and dataset generalization. We analyze the…

Machine Learning · Computer Science 2023-11-14 Shiqi Liu

Uncertainty estimation (UE) techniques -- such as the Gaussian process (GP), Bayesian neural networks (BNN), Monte Carlo dropout (MCDropout) -- aim to improve the interpretability of machine learning models by assigning an estimated…

Machine Learning · Computer Science 2021-12-10 Yehao Liu , Matteo Pagliardini , Tatjana Chavdarova , Sebastian U. Stich

Although machine learning approaches have been widely used in the field of finance, to very successful degrees, these approaches remain bespoke to specific investigations and opaque in terms of explainability, comparability, and…

Trading and Market Microstructure · Quantitative Finance 2022-06-22 Artur Sokolovsky , Luca Arnaboldi

(Gradient) Expectation Maximization (EM) is a widely used algorithm for estimating the maximum likelihood of mixture models or incomplete data problems. A major challenge facing this popular technique is how to effectively preserve the…

Machine Learning · Computer Science 2022-01-19 Di Wang , Jiahao Ding , Lijie Hu , Zejun Xie , Miao Pan , Jinhui Xu

Generative classifiers are constructed on the basis of a joint probability distribution and are typically learned using closed-form procedures that rely on data statistics and maximize scores related to data fitting. However, these scores…

Machine Learning · Computer Science 2025-03-31 Aritz Pérez , Carlos Echegoyen , Guzmán Santafé

We develop Bayesian machine learning methods for mixed data sampling (MIDAS) regressions. This involves handling frequency mismatches and specifying functional relationships between many predictors and the dependent variable. We use…

Econometrics · Economics 2024-09-11 Niko Hauzenberger , Massimiliano Marcellino , Michael Pfarrhofer , Anna Stelzer

Using information-theoretic principles, we consider the generalization error (gen-error) of iterative semi-supervised learning (SSL) algorithms that iteratively generate pseudo-labels for a large amount of unlabelled data to progressively…

Machine Learning · Computer Science 2022-09-20 Haiyun He , Hanshu Yan , Vincent Y. F. Tan

Symbolic regression (SR) with genetic programming (GP) aims to discover interpretable mathematical expressions directly from data. Despite its strong empirical success, the theoretical understanding of why GP-based SR generalizes beyond the…

Machine Learning · Computer Science 2026-04-21 Masahiro Nomura , Ryoki Hamano , Isao Ono

Many learning algorithms can be represented as Markov processes, and understanding their generalization error is a central topic in learning theory. For specific continuous-time noisy algorithms, a prominent analysis technique relies on…

Machine Learning · Statistics 2026-03-06 Benjamin Dupuis , Maxime Haddouche , George Deligiannidis , Umut Simsekli

In this paper I propose a generative model of supervised learning that unifies two approaches to supervised learning, using a concept of a correct loss function. Addressing two measurability problems, which have been ignored in statistical…

Statistics Theory · Mathematics 2025-04-29 Hông Vân Lê

Characterizing precisely the asymptotic generalization error of neural networks using parameters that can be estimated efficiently is a crucial problem in machine learning, which relies heavily on heuristics and practitioners' intuition to…

Machine Learning · Computer Science 2026-05-22 David Perera , Victor Moura , Lais Isabelle Alves dos Santos , Michel F. C. Haddad , Flavio Figueiredo

Recent progress has shown that the generalization error of the Gibbs algorithm can be exactly characterized using the symmetrized KL information between the learned hypothesis and the entire training dataset. However, evaluating such a…

Information Theory · Computer Science 2024-10-17 Youheng Zhu , Yuheng Bu

We study the generalization properties of stochastic gradient methods for learning with convex loss functions and linearly parameterized functions. We show that, in the absence of penalizations or constraints, the stability and…

Machine Learning · Computer Science 2016-05-27 Junhong Lin , Raffaello Camoriano , Lorenzo Rosasco

This undergraduate thesis focuses on calculating maximum likelihood estimates of parameters in the generalized Gamma distribution using the SeLF algorithm. As an extension of the Gamma distribution, the generalized Gamma distribution can…

Methodology · Statistics 2026-01-01 Yufei Cai

Despite the superior empirical success of deep meta-learning, theoretical understanding of overparameterized meta-learning is still limited. This paper studies the generalization of a widely used meta-learning approach, Model-Agnostic…

Machine Learning · Computer Science 2022-06-22 Yu Huang , Yingbin Liang , Longbo Huang

Experimental studies are a cornerstone of Machine Learning (ML) research. A common and often implicit assumption is that the study's results will generalize beyond the study itself, e.g., to new data. That is, repeating the same study under…

Machine Learning · Computer Science 2025-12-05 Federico Matteucci , Vadim Arzamasov , Jose Cribeiro-Ramallo , Marco Heyden , Konstantin Ntounas , Klemens Böhm

We derive a differential equation that governs the evolution of the generalization gap when a deep network is trained by gradient descent. This differential equation is controlled by two quantities, a contraction factor that brings together…

Machine Learning · Computer Science 2025-10-14 Rubing Yang , Pratik Chaudhari

As deep neural networks are highly expressive, it is important to find solutions with small generalization gap (the difference between the performance on the training data and unseen data). Focusing on the stochastic nature of training, we…

Machine Learning · Computer Science 2023-10-31 Rie Johnson , Tong Zhang

Inductive Conformal Prediction (ICP) provides a practical and effective approach for equipping deep learning models with uncertainty estimates in the form of set-valued predictions which are guaranteed to contain the ground truth with high…

Machine Learning · Computer Science 2023-12-11 Apoorva Sharma , Sushant Veer , Asher Hancock , Heng Yang , Marco Pavone , Anirudha Majumdar

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk