English
Related papers

Related papers: Holdout cross-validation for large non-Gaussian co…

200 papers

The future predictive performance of a Bayesian model can be estimated using Bayesian cross-validation. In this article, we consider Gaussian latent variable models where the integration over the latent values is approximated using the…

Computation · Statistics 2016-08-09 Aki Vehtari , Tommi Mononen , Ville Tolvanen , Tuomas Sivula , Ole Winther

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

Machine Learning · Statistics 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

We introduce a novel covariance estimator for portfolio selection that adapts to the non-stationary or persistent heteroskedastic environments of financial time series by employing exponentially weighted averages and nonlinearly shrinking…

Machine Learning · Statistics 2023-01-23 Vincent Tan , Stefan Zohren

It is common for researchers to holdout data from a study pool to be used for external validation as well as for future research, and the same desire is true to those using machine learning modeling research. For this discussion, the…

Machine Learning · Computer Science 2022-05-10 Michele Bennett , Mehdi Nekouei , Armand Prieditis Rajesh Mehta , Ewa Kleczyk , Karin Hayes

The objective of this paper is to develop statistical methodology for planning and evaluating three-armed non-inferiority trials for general retention of effect hypotheses, where the endpoint of interest may follow any (regular) parametric…

Methodology · Statistics 2009-12-22 M. Mielke , A. Munk

Using a semi-parametric approach based on the fourth-order Edgeworth expansion for the unknown signal distribution, we derive an explicit expression for the likelihood detection statistic in the presence of non-normally distributed…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-19 Lionel Martellini , Tania Regimbau

We present an optimal transport framework for performing regression when both the covariate and the response are probability distributions on a compact Euclidean subset $\Omega\subset\mathbb{R}^d$, where $d>1$. Extending beyond compactly…

Statistics Theory · Mathematics 2024-03-05 Laya Ghodrati , Victor M. Panaretos

We introduce a new framework for efficient sampling from complex probability distributions, using a combination of optimal transport maps and the Metropolis-Hastings rule. The core idea is to use continuous transportation to transform…

Computation · Statistics 2019-06-11 Matthew Parno , Youssef Marzouk

Cross-validation (CV) methods are popular for selecting the tuning parameter in the high-dimensional variable selection problem. We show the mis-alignment of the CV is one possible reason of its over-selection behavior. To fix this issue,…

Methodology · Statistics 2018-01-17 Yang Feng , Yi Yu

In this article, we derive concentration inequalities for the cross-validation estimate of the generalization error for subagged estimators, both for classification and regressor. General loss functions and class of predictors with both…

Machine Learning · Statistics 2010-11-24 Matthieu CORNEC

Testing for white noise is a classical yet important problem in statistics, especially for diagnostic checks in time series modeling and linear regression. For high-dimensional time series in the sense that the dimension $p$ is large in…

Statistics Theory · Mathematics 2018-11-26 Zeng Li , Clifford Lam , Jianfeng Yao , Qiwei Yao

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…

Hybrid quantum-classical optimization algorithms represent one of the most promising application for near-term quantum computers. In these algorithms the goal is to optimize an observable quantity with respect to some classical parameters,…

Quantum Physics · Physics 2021-01-27 Leonardo Banchi , Gavin E. Crooks

Cross-validation plays a fundamental role in Machine Learning, enabling robust evaluation of model performance and preventing overestimation on training and validation data. However, one of its drawbacks is the potential to create data…

Machine Learning · Computer Science 2025-08-28 Afonso Martini Spezia , Thomas Fontanari , Mariana Recamonde-Mendoza

Stochastic iterative methods are useful in a variety of large-scale numerical linear algebraic, machine learning, and statistical problems, in part due to their low-memory footprint. They are frequently used in a variety of applications,…

Numerical Analysis · Mathematics 2025-11-27 Toby Anderson , Max Collins , Jamie Haddock , Jackie Lok , Elizaveta Rebrova

High-dimensional Kronecker-structured estimation faces a conflict between non-convex scaling ambiguities and statistical robustness. The arbitrary factor scaling distorts gradient magnitudes, rendering standard fixed-threshold robust…

Methodology · Statistics 2025-12-23 Xiaoyu Zhang , Zhiyun Fan , Wenyang Zhang , Di Wang

We consider the problem of detecting (testing) Gaussian stochastic sequences (signals) with imprecisely known means and covariance matrices. The alternative is independent identically distributed zero-mean Gaussian random variables with…

Information Theory · Computer Science 2023-02-28 Marat V. Burnashev

Trajectory Reconstruction (TR) is vital for accurately mapping movement patterns and validating analyses, especially in fields like robotics, biomechanics, and environmental tracking, where data might be missing or affected by outliers.…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Arslan Majal , Aamir Hussain Chughtai

This paper uses techniques from Random Matrix Theory to find the ideal training-testing data split for a simple linear regression with m data points, each an independent n-dimensional multivariate Gaussian. It defines "ideal" as satisfying…

Machine Learning · Statistics 2022-07-26 Alexander Dubbs

We consider the problem of mean-variance portfolio optimization for a generic covariance matrix subject to the budget constraint and the constraint for the expected return, with the application of the replica method borrowed from the…

Portfolio Management · Quantitative Finance 2017-01-04 Istvan Varga-Haszonits , Fabio Caccioli , Imre Kondor