English
Related papers

Related papers: Iterative Approximate Cross-Validation

200 papers

Risk measures are important key figures to measure the adequacy of the reserves of a company. The most common risk measures in practice are Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR). Recently, quantum-based algorithms are…

Quantum Physics · Physics 2025-01-29 Christian Laudagé , Ivica Turkalj

Many varieties of cross validation would be statistically appealing for the estimation of smoothing and other penalized regression hyperparameters, were it not for the high cost of evaluating such criteria. Here it is shown how to…

Methodology · Statistics 2025-11-06 Simon N. Wood

We consider the problem of evaluating risk for a system that is modeled by a complex stochastic simulation with many possible input parameter values. Two sources of computational burden can be identified: the effort associated with…

Methodology · Statistics 2024-03-29 Armin Khayyer , Alexander Vinel , Joseph J. Kennedy

Cross validation (CV) and the bootstrap are ubiquitous model-agnostic tools for assessing the error or variability of machine learning and statistical estimators. However, these methods require repeatedly re-fitting the model with different…

Statistics Theory · Mathematics 2019-07-30 Ryan Giordano , Michael I. Jordan , Tamara Broderick

We propose a method for designing policies for convex stochastic control problems characterized by random linear dynamics and convex stage cost. We consider policies that employ quadratic approximate value functions as a substitute for the…

Optimization and Control · Mathematics 2023-11-10 Alan Yang , Stephen Boyd

Two key tasks in high-dimensional regularized regression are tuning the regularization strength for accurate predictions and estimating the out-of-sample risk. It is known that the standard approach -- $k$-fold cross-validation -- is…

Statistics Theory · Mathematics 2025-10-24 Kevin Luo , Yufan Li , Pragya Sur

Mutation validation (MV) is a recently proposed approach for model selection, garnering significant interest due to its unique characteristics and potential benefits compared to the widely used cross-validation (CV) method. In this study,…

Machine Learning · Computer Science 2024-07-25 Jinyang Yu , Sami Hamdan , Leonard Sasse , Abigail Morrison , Kaustubh R. Patil

Bayesian variable selection methods are powerful techniques for fitting and inferring on sparse high-dimensional linear regression models. However, many are computationally intensive or require restrictive prior distributions on model…

Methodology · Statistics 2023-10-10 Alexander C. McLain , Anja Zgodic , Howard Bondell

The covariance matrix plays a fundamental role in many modern exploratory and inferential statistical procedures, including dimensionality reduction, hypothesis testing, and regression. In low-dimensional regimes, where the number of…

Methodology · Statistics 2024-11-12 Philippe Boileau , Nima S. Hejazi , Mark J. van der Laan , Sandrine Dudoit

Recent advances in quantum computing have significantly accelerated research into quantum-assisted information retrieval and recommender systems, particularly in solving feature selection problems by formulating them as Quadratic…

Quantum Physics · Physics 2025-07-22 Jiayang Niu , Qihan Zou , Jie Li , Ke Deng , Mark Sanderson , Yongli Ren

The choice of the parameter value for regularized inverse problems is critical to the results and remains a topic of interest. This article explores a criterion for selecting a good parameter value by maximizing the probability of the data,…

Numerical Analysis · Mathematics 2020-02-11 Toby Sanders , Rodrigo B. Platte , Robert D. Skeel

Computer models play a crucial role in numerous scientific and engineering domains. To ensure the accuracy of simulations, it is essential to properly calibrate the input parameters of these models through statistical inference. While…

Applications · Statistics 2024-03-07 Dongkyu Derek Cho , Won Chang , Jaewoo Park

Many decision problems cannot be solved exactly and use several estimation algorithms that assign scores to the different available options. The estimation errors can have various correlations, from low (e.g. between two very different…

Machine Learning · Computer Science 2023-09-06 Theo Delemazure , François Durand , Fabien Mathieu

Invex programs are a special kind of non-convex problems which attain global minima at every stationary point. While classical first-order gradient descent methods can solve them, they converge very slowly. In this paper, we propose new…

Optimization and Control · Mathematics 2023-07-11 Adarsh Barik , Suvrit Sra , Jean Honorio

A popular approach for addressing uncertainty in variational inequality problems is by solving the expected residual minimization (ERM) problem. This avenue necessitates distributional information associated with the uncertainty and…

Optimization and Control · Mathematics 2015-12-14 Yue Xie , Uday V. Shanbhag

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

With the increasing size of today's data sets, finding the right parameter configuration in model selection via cross-validation can be an extremely time-consuming task. In this paper we propose an improved cross-validation procedure which…

Machine Learning · Computer Science 2016-02-05 Tammo Krueger , Danny Panknin , Mikio Braun

Autoregressive pre-trained models combined with decoding methods have achieved impressive performance on complex reasoning tasks. While mainstream decoding strategies such as beam search can generate plausible candidate sets, they often…

Machine Learning · Computer Science 2025-09-08 Yuzhu Chen , Yingjie Wang , Shunyu Liu , Yongcheng Jing , Dacheng Tao

The expectation-maximization (EM) algorithm is a powerful computational technique for finding the maximum likelihood estimates for parametric models when the data are not fully observed. The EM is best suited for situations where the…

Computation · Statistics 2018-05-14 Chanseok Park

Verifying multi-step reasoning in large language models is difficult due to imprecise error localization and high token costs. Existing methods either assess entire reasoning chains, suffering attention dilution, or rely on expensive…

Artificial Intelligence · Computer Science 2025-10-06 Yulong Zhang , Li Wang , Wei Du , Peilin Li , Yuqin Dai Zhiyuan Zhao , Lingyong Fang , Ziniu Liu , Ru Zhang , Huijia Zhu , Gongshen Liu