English
Related papers

Related papers: Fast and Robust: Computationally Efficient Covaria…

200 papers

We propose an extreme dimension reduction method extending the Extreme-PLS approach to the case where the covariate lies in a possibly infinite-dimensional Hilbert space. The ideas are partly borrowed from both Partial Least-Squares and…

Statistics Theory · Mathematics 2026-01-01 Stéphane Girard , Cambyse Pakzad

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

Machine Learning · Statistics 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

Recently attention has been drawn to practical problems with the use of unbounded Pareto distributions, for instance when there are natural upper bounds that truncate the probability tail. Aban, Meerschaert and Panorska (2006) derived the…

Statistics Theory · Mathematics 2014-12-24 Jan Beirlant , Isabel Fraga Alves , Ivette Gomes , Mark M. Meerschaert

We consider the problem of robustly predicting as well as the best linear combination of $d$ given functions in least squares regression, and variants of this problem including constraints on the parameters of the linear combination. For…

Statistics Theory · Mathematics 2012-02-24 Jean-Yves Audibert , Olivier Catoni

We introduce a novel covariance estimator for portfolio selection that adapts to the non-stationary or persistent heteroskedastic environments of financial time series by employing exponentially weighted averages and nonlinearly shrinking…

Machine Learning · Statistics 2023-01-23 Vincent Tan , Stefan Zohren

As in standard linear regression, in truncated linear regression, we are given access to observations $(A_i, y_i)_i$ whose dependent variable equals $y_i= A_i^{\rm T} \cdot x^* + \eta_i$, where $x^*$ is some fixed unknown vector of interest…

Machine Learning · Computer Science 2020-07-30 Constantinos Daskalakis , Dhruv Rohatgi , Manolis Zampetakis

This paper considers the regularized estimation of covariance matrices (CM) of high-dimensional (compound) Gaussian data for minimum variance distortionless response (MVDR) beamforming. Linear shrinkage is applied to improve the accuracy…

Signal Processing · Electrical Eng. & Systems 2021-04-06 Lei Xie , Zishu He , Jun Tong , Jun Li , Jiangtao Xi

We investigate high-dimensional sparse regression when both the noise and the design matrix exhibit heavy-tailed behavior. Standard algorithms typically fail in this regime, as heavy-tailed covariates distort the empirical risk geometry. We…

Methodology · Statistics 2026-01-12 Kaiyuan Zhou , Xiaoyu Zhang , Wenyang Zhang , Di Wang

We construct a novel estimator for the diffusion coefficient of the limiting homogenized equation, when observing the slow dynamics of a multiscale model, in the case when the slow dynamics are of bounded variation. Previous research…

Statistics Theory · Mathematics 2018-07-04 Theodoros Manikas , Anastasia Papavasiliou

We consider an on-line least squares regression problem with optimal solution $\theta^*$ and Hessian matrix H, and study a time-average stochastic gradient descent estimator of $\theta^*$. For $k\ge2$, we provide an unbiased estimator of…

Machine Learning · Statistics 2025-11-18 Nabil Kahalé

A weighted Gaussian approximation to tail product-limit process for Pareto-like distributions of randomly right-truncated data is provided and a new consistent and asymptotically normal estimator of the extreme value index is derived. A…

Statistics Theory · Mathematics 2015-07-07 Souad Benchaira , Djamel Meraghni , Abdelhakim Necir

We consider the high-dimensional linear regression model and assume that a fraction of the measurements are altered by an adversary with complete knowledge of the data and the underlying distribution. We are interested in a scenario where…

Statistics Theory · Mathematics 2023-12-11 Stanislav Minsker , Mohamed Ndaoud , Lang Wang

Economically responsible mitigation of multivariate extreme risks-such as extreme rainfall over large areas, large simultaneous variations in many stock prices, or widespread breakdowns in transportation systems-requires assessing the…

Machine Learning · Statistics 2026-01-13 Stéphane Lhaut , Holger Rootzén , Johan Segers

The estimation of conditional quantiles at extreme tails is of great interest in numerous applications. Various methods that integrate regression analysis with an extrapolation strategy derived from extreme value theory have been proposed…

Methodology · Statistics 2024-11-22 Yiwei Tang , Judy Huixia Wang , Deyuan Li

Cross-validation is one of the most widely used methods for model selection and evaluation; its efficiency for large covariance matrix estimation appears robust in practice, but little is known about the theoretical behavior of its error.…

Statistical Finance · Quantitative Finance 2025-09-18 Lamia Lamrani , Benoît Collins , Jean-Philippe Bouchaud

We study polynomial time algorithms for estimating the mean of a heavy-tailed multivariate random vector. We assume only that the random vector $X$ has finite mean and covariance. In this setting, the radius of confidence intervals achieved…

Statistics Theory · Mathematics 2019-06-05 Samuel B. Hopkins

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

This paper investigates pooling strategies for tail index and extreme quantile estimation from heavy-tailed data. To fully exploit the information contained in several samples, we present general weighted pooled Hill estimators of the tail…

Statistics Theory · Mathematics 2021-11-08 Abdelaati Daouia , Simone A. Padoan , Gilles Stupfler

We address the problem of robust sparse estimation of the precision matrix for heavy-tailed distributions in high-dimensional settings. In such high-dimensional contexts, we observe that the covariance matrix can be approximated by a…

Methodology · Statistics 2025-03-06 Zhengke Lu , Long Feng

We derive a novel variational expectation maximization approach based on truncated posterior distributions. Truncated distributions are proportional to exact posteriors within subsets of a discrete state space and equal zero otherwise. The…

Machine Learning · Statistics 2019-07-12 Jörg Lücke