English
Related papers

Related papers: Don't Waste Your Time: Early Stopping Cross-Valida…

200 papers

This study extensively compares conventional machine learning methods and deep learning for condition monitoring tasks using an AutoML toolbox. The experiments reveal consistent high accuracy in random K-fold cross-validation scenarios…

Machine Learning · Computer Science 2023-08-29 Payman Goodarzi , Andreas Schütze , Tizian Schneider

Bayesian Deep Ensembles (BDEs) represent a powerful approach for uncertainty quantification in deep learning, combining the robustness of Deep Ensembles (DEs) with flexible multi-chain MCMC. While DEs are affordable in most deep learning…

Machine Learning · Computer Science 2026-04-21 Emanuel Sommer , Rickmer Schulte , Sarah Deubner , Julius Kobialka , David Rügamer

Early stopping is a simple and widely used method to prevent over-training neural networks. We develop theoretical results to reveal the relationship between the optimal early stopping time and model dimension as well as sample size of the…

Machine Learning · Computer Science 2022-02-25 Ruoqi Shen , Liyao Gao , Yi-An Ma

Machine learning classifiers often produce probabilistic predictions that are critical for accurate and interpretable decision-making in various domains. The quality of these predictions is generally evaluated with proper losses, such as…

Machine Learning · Computer Science 2025-06-26 Eugène Berta , David Holzmüller , Michael I. Jordan , Francis Bach

This paper presents a simple, effective, and cost-efficient strategy to improve LLM performance by scaling test-time compute. Our strategy builds upon the repeated-sampling-then-voting framework, with a novel twist: incorporating multiple…

Artificial Intelligence · Computer Science 2025-11-11 Jianhao Chen , Zishuo Xun , Bocheng Zhou , Han Qi , Hangfan Zhang , Qiaosheng Zhang , Yang Chen , Wei Hu , Yuzhong Qu , Wanli Ouyang , Shuyue Hu

In this paper, we propose a single-agent Monte Carlo based reinforced feature selection (MCRFS) method, as well as two efficiency improvement strategies, i.e., early stopping (ES) strategy and reward-level interactive (RI) strategy. Feature…

Machine Learning · Computer Science 2021-10-13 Kunpeng Liu , Pengfei Wang , Dongjie Wang , Wan Du , Dapeng Oliver Wu , Yanjie Fu

It is not an exaggeration to say that the recent progress in artificial intelligence technology depends on large-scale and high-quality data. Simultaneously, a prevalent issue exists everywhere: the budget for data labeling is constrained.…

Machine Learning · Computer Science 2023-08-22 Yujin Hwang , Won Jo , Juyoung Hong , Yukyung Choi

Systems that are based on recursive Bayesian updates for classification limit the cost of evidence collection through certain stopping/termination criteria and accordingly enforce decision making. Conventionally, two termination criteria…

Machine Learning · Computer Science 2021-04-27 Aziz Kocanaogullari , Murat Akcakaya , Deniz Erdogmus

Estimating out-of-sample risk for models trained on large high-dimensional datasets is an expensive but essential part of the machine learning process, enabling practitioners to optimally tune hyperparameters. Cross-validation (CV) serves…

Statistics Theory · Mathematics 2025-04-28 Parth Nobel , Daniel LeJeune , Emmanuel J. Candès

In many real-world applications, we are interested in approximating black-box, costly functions as accurately as possible with the smallest number of function evaluations. A complex computer code is an example of such a function. In this…

Computation · Statistics 2022-03-22 Hossein Mohammadi , Peter Challenor , Daniel Williamson , Marc Goodfellow

In causal machine learning, the fitting and evaluation of nuisance models are often performed on separate partitions, or folds, of the observed data. This technique, called cross-fitting, eliminates bias introduced by the use of black-box…

Methodology · Statistics 2026-05-12 Salvador V. Balkus , Hasan Laith , Nima S. Hejazi

Automated Machine Learning (AutoML) automatically builds machine learning (ML) models on data. The de facto standard for evaluating new AutoML frameworks for tabular data is the AutoML Benchmark (AMLB). AMLB proposed to evaluate AutoML…

Machine Learning · Computer Science 2025-04-16 Israel Campero Jurado , Pieter Gijsbers , Joaquin Vanschoren

Current evaluations of Continual Learning (CL) methods typically assume that there is no constraint on training time and computation. This is an unrealistic assumption for any real-world setting, which motivates us to propose: a practical…

Sample selection is a prevalent method in learning with noisy labels, where small-loss data are typically considered as correctly labeled data. However, this method may not effectively identify clean hard examples with large losses, which…

Machine Learning · Computer Science 2023-08-29 Suqin Yuan , Lei Feng , Tongliang Liu

In recent decades, multilevel regression and poststratification (MRP) has surged in popularity for population inference. However, the validity of the estimates can depend on details of the model, and there is currently little research on…

Methodology · Statistics 2022-09-07 Swen Kuh , Lauren Kennedy , Qixuan Chen , Andrew Gelman

Classical optimization algorithms--hill climbing, simulated annealing, population-based methods--generate candidate solutions via random perturbations. We replace the random proposal generator with an LLM agent that reasons about evaluation…

Artificial Intelligence · Computer Science 2026-03-31 Yitao Li

This work examines the convergence of stochastic gradient-based optimization algorithms that use early stopping based on a validation function. The form of early stopping we consider is that optimization terminates when the norm of the…

Optimization and Control · Mathematics 2020-07-23 Thomas Flynn , Kwang Min Yu , Abid Malik , Nicolas D'Imperio , Shinjae Yoo

Increasingly high-dimensional data sets require that estimation methods do not only satisfy statistical guarantees but also remain computationally feasible. In this context, we consider $ L^{2} $-boosting via orthogonal matching pursuit in…

Statistics Theory · Mathematics 2022-10-17 Bernhard Stankewitz

\noindent Hyper-parameter selection is a central practical problem in modern machine learning, governing regularization strength, model capacity, and robustness choices. Cross-validation is often computationally prohibitive at scale, while…

Machine Learning · Statistics 2025-12-24 Hedibert Lopes , Nick Polson , Vadim Sokolov

VQ (Vendor Qualification) and IOQ (Installation and Operation Qualification) audits are implemented in warehouses to ensure all equipment being turned over in the fulfillment network meets the quality standards. Audit checks are likely to…

Machine Learning · Computer Science 2022-09-30 Farouq Halawa , Majid Abdul , Raashid Mohammed