English
Related papers

Related papers: Small Sample Inference for Generalization Error in…

200 papers

Recent studies show that transformer-based architectures emulate gradient descent during a forward pass, contributing to in-context learning capabilities - an ability where the model adapts to new tasks based on a sequence of prompt…

Statistics Theory · Mathematics 2024-05-13 Karthik Duraisamy

Nonparametric estimation using uniform-width binning is a standard approach for evaluating the calibration performance of machine learning models. However, existing theoretical analyses of the bias induced by binning are limited to binary…

Machine Learning · Computer Science 2025-07-14 Masahiro Fujisawa , Futoshi Futami

In the context of few-shot learning, one cannot measure the generalization ability of a trained classifier using validation sets, due to the small number of labeled samples. In this paper, we are interested in finding alternatives to answer…

Machine Learning · Computer Science 2020-07-09 Myriam Bontonou , Louis Béthune , Vincent Gripon

This paper provides conditions under which subsampling and the bootstrap can be used to construct estimators of the quantiles of the distribution of a root that behave well uniformly over a large class of distributions $\mathbf{P}$. These…

Statistics Theory · Mathematics 2013-02-19 Joseph P. Romano , Azeem M. Shaikh

Weighting procedures are used in observational causal inference to adjust for covariate imbalance within the sample. Common practice for inference is to estimate robust standard errors from a weighted regression of outcome on treatment.…

Methodology · Statistics 2025-07-29 Erin Hartman , Chad Hazlett , Arisa Sadeghpour

We develop a methodology for constructing confidence sets for parameters of statistical models via a reduction to sequential prediction. Our key observation is that for any generalized linear model (GLM), one can construct an associated…

Statistics Theory · Mathematics 2025-04-24 Eugenio Clerico , Hamish Flynn , Wojciech Kotłowski , Gergely Neu

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

In statistical exercises where there are several candidate models, the traditional approach is to select one model using some data driven criterion and use that model for estimation, testing and other purposes, ignoring the variability of…

Statistics Theory · Mathematics 2008-12-18 Snigdhansu Chatterjee , Nitai D. Mukhopadhyay

Algorithm unfolding or unrolling is the technique of constructing a deep neural network (DNN) from an iterative algorithm. Unrolled DNNs often provide better interpretability and superior empirical performance over standard DNNs in signal…

Machine Learning · Statistics 2024-02-21 Carter Lyons , Raghu G. Raj , Margaret Cheney

We consider the problem of calculating learning curves (i.e., average generalization performance) of Gaussian processes used for regression. On the basis of a simple expression for the generalization error, in terms of the eigenvalue…

Disordered Systems and Neural Networks · Physics 2007-05-23 Peter Sollich , Anason Halees

Empirical evidence shows that ensembles, such as bagging, boosting, random and rotation forests, generally perform better in terms of their generalization error than individual classifiers. To explain this performance, Schapire et al.…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez , J. Brian Gray

Several new methods have been proposed for performing valid inference after model selection. An older method is sampling splitting: use part of the data for model selection and part for inference. In this paper we revisit sample splitting…

Statistics Theory · Mathematics 2018-04-04 Alessandro Rinaldo , Larry Wasserman , Max G'Sell , Jing Lei

Proper losses such as cross-entropy incentivize classifiers to produce class probabilities that are well-calibrated on the training data. Due to the generalization gap, these classifiers tend to become overconfident on the test data,…

Machine Learning · Computer Science 2025-08-27 Viacheslav Komisarenko , Meelis Kull

We study the problem of transfer learning and fine-tuning in linear models for both regression and binary classification. In particular, we consider the use of stochastic gradient descent (SGD) on a linear model initialized with pretrained…

Machine Learning · Computer Science 2025-02-25 Reza Ghane , Danil Akhtiamov , Babak Hassibi

Few-shot learning has attracted intensive research attention in recent years. Many methods have been proposed to generalize a model learned from provided base classes to novel classes, but no previous work studies how to select base…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Linjun Zhou , Peng Cui , Xu Jia , Shiqiang Yang , Qi Tian

While standard statistical inference techniques and machine learning generalization bounds assume that tests are run on data selected independently of the hypotheses, practical data analysis and machine learning are usually iterative and…

Signal Processing · Electrical Eng. & Systems 2019-10-09 Lorenzo De Stefani , Eli Upfal

A general approach to selective inference is considered for hypothesis testing of the null hypothesis represented as an arbitrary shaped region in the parameter space of multivariate normal model. This approach is useful for hierarchical…

Statistics Theory · Mathematics 2018-03-28 Yoshikazu Terada , Hidetoshi Shimodaira

This study focuses on finite-sample inference on the non-linear Bures-Wasserstein manifold and introduces a generalized bootstrap procedure for estimating Bures-Wasserstein barycenters. We provide non-asymptotic statistical guarantees for…

Statistics Theory · Mathematics 2024-11-26 Alexey Kroshnin , Vladimir Spokoiny , Alexandra Suvorikova

We focus on the construction of confidence corridors for multivariate nonparametric generalized quantile regression functions. This construction is based on asymptotic results for the maximal deviation between a suitable nonparametric…

Statistics Theory · Mathematics 2015-02-03 Shih-Kang Chao , Katharina Proksch , Holger Dette , Wolfgang Härdle

Random forests perform bootstrap-aggregation by sampling the training samples with replacement. This enables the evaluation of out-of-bag error which serves as a internal cross-validation mechanism. Our motivation lies in using the…

Machine Learning · Statistics 2017-07-20 Kiran Bangalore Ravi , Jean Serra