English
Related papers

Related papers: Concentration Inequalities for Cross-validation in…

200 papers

We prove a strong concentration result about the natural collision estimator, which counts the number of collisions that occur within an iid sample. This estimator is at the heart of algorithms used for uniformity testing and entropy…

Information Theory · Computer Science 2020-06-26 Maciej Skorski

We study the problem of compression for the purpose of similarity identification, where similarity is measured by the mean square Euclidean distance between vectors. While the asymptotical fundamental limits of the problem - the minimal…

Information Theory · Computer Science 2014-05-13 Fabian Steiner , Steffen Dempfle , Amir Ingber , Tsachy Weissman

Diffusion models have demonstrated state-of-the-art performance across vision, language, and scientific domains. Despite their empirical success, prior theoretical analyses of the sample complexity suffer from poor scaling with input data…

Machine Learning · Computer Science 2026-04-14 Mudit Gaur , Prashant Trivedi , Sasidhar Kunapuli , Amrit Singh Bedi , Vaneet Aggarwal

The lasso and related sparsity inducing algorithms have been the target of substantial theoretical and applied research. Correspondingly, many results are known about their behavior for a fixed or optimally chosen tuning parameter specified…

Statistics Theory · Mathematics 2016-06-23 Darren Homrighausen , Daniel J. McDonald

This study's first purpose is to provide quantitative evidence that would incentivize researchers to instead use the more robust method of nested cross-validation. The second purpose is to present methods and MATLAB codes for doing power…

Machine Learning · Computer Science 2024-03-19 Hamzeh Ghasemzadeh , Robert E. Hillman , Daryush D. Mehta

This paper develops a general concentration inequality for the suprema of empirical processes with dependent data. The concentration inequality is obtained by combining generic chaining with a coupling-based strategy. Our framework…

Econometrics · Economics 2026-02-23 Chiara Amorino , Christian Brownlees , Ankita Ghosh

A general framework is that the estimators of a distribution are obtained by minimizing a function (the estimating function) and they are assessed through another function (the assessment function). The estimating and assessment functions…

Statistics Theory · Mathematics 2022-01-14 Daniel Commenges , Cécile Proust-Lima , Cécilia Samieri , Benoit Liquet

We conduct a non asymptotic study of the Cross Validation (CV) estimate of the generalization risk for learning algorithms dedicated to extreme regions of the covariates space. In this Extreme Value Analysis context, the risk function…

Statistics Theory · Mathematics 2024-09-12 Anass Aghbalou , Patrice Bertail , François Portier , Anne Sabourin

Score-based diffusion models, while achieving minimax optimality for sampling, are often hampered by slow sampling speeds due to the high computational burden of score function evaluations. Despite the recent remarkable empirical advances…

Machine Learning · Computer Science 2025-02-27 Gen Li , Changxiao Cai

When selecting a classification algorithm to be applied to a particular problem, one has to simultaneously select the best algorithm for that dataset \emph{and} the best set of hyperparameters for the chosen model. The usual approach is to…

Machine Learning · Computer Science 2018-09-26 Jacques Wainer , Gavin Cawley

While techniques have been developed for chance constrained stochastic optimal control using sample disturbance data that provide a probabilistic confidence bound for chance constraint satisfaction, far less is known about how to use sample…

Systems and Control · Electrical Eng. & Systems 2023-03-31 Shawn Priore , Meeko Oishi

Visual perception entails solving a wide set of tasks, e.g., object detection, depth estimation, etc. The predictions made for multiple tasks from the same image are not independent, and therefore, are expected to be consistent. We propose…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Amir Zamir , Alexander Sax , Teresa Yeo , Oğuzhan Kar , Nikhil Cheerla , Rohan Suri , Zhangjie Cao , Jitendra Malik , Leonidas Guibas

This paper presents a theory of error in cross-validation testing of algorithms for predicting real-valued attributes. The theory justifies the claim that predicting real-valued attributes requires balancing the conflicting demands of…

Machine Learning · Computer Science 2007-05-23 Peter D. Turney

Cross-validation is a standard tool for obtaining a honest assessment of the performance of a prediction model. The commonly used version repeatedly splits data, trains the prediction model on the training set, evaluates the model…

Machine Learning · Statistics 2025-10-10 Tianyu Pan , Vincent Z. Yu , Viswanath Devanarayan , Lu Tian

We derive the asymptotic risk function of regularized empirical risk minimization (ERM) estimators tuned by $n$-fold cross-validation (CV). The out-of-sample prediction loss of such estimators converges in distribution to the squared-error…

Statistics Theory · Mathematics 2026-03-24 Karun Adusumilli , Maximilian Kasy , Ashia Wilson

Despite ongoing theoretical research on cross-validation (CV), many theoretical questions remain widely open. This motivates our investigation into how properties of algorithm-distribution pairs can affect the choice for the number of folds…

Statistics Theory · Mathematics 2026-01-09 Ido Nachum , Rüdiger Urbanke , Thomas Weinberger

Sample complexity bounds are a common performance metric in the Reinforcement Learning literature. In the discounted cost, infinite horizon setting, all of the known bounds have a factor that is a polynomial in $1/(1-\gamma)$, where $\gamma…

Machine Learning · Computer Science 2020-07-09 Adithya M. Devraj , Sean P. Meyn

The paper focuses on general properties of parametric minimum contrast estimators. The quality of estimation is measured in terms of the rate function related to the contrast, thus allowing to derive exponential risk bounds invariant with…

Statistics Theory · Mathematics 2009-01-07 Yuri Golubev , Vladimir Spokoiny

This paper derives the rate of convergence and asymptotic distribution for a class of Kolmogorov-Smirnov style test statistics for conditional moment inequality models for parameters on the boundary of the identified set under general…

Applications · Statistics 2011-12-06 Timothy B. Armstrong

Convex sample approximations of chance-constrained optimization problems are considered, in which chance constraints are replaced by sets of sampled constraints. We propose a randomized sample selection strategy that allows tight bounds to…

Optimization and Control · Mathematics 2018-05-22 Mark Cannon