English
Related papers

Related papers: Challenging the empirical mean and empirical varia…

200 papers

We consider random-design linear prediction and related questions on the lower tail of random matrices. It is known that, under boundedness constraints, the minimax risk is of order $d/n$ in dimension $d$ with $n$ samples. Here, we study…

Statistics Theory · Mathematics 2022-08-31 Jaouad Mourtada

We revisit empirical Bayes discrimination detection, focusing on uncertainty arising from both partial identification and sampling variability. While prior work has mostly focused on partial identification, we find that some empirical…

Econometrics · Economics 2025-08-19 Jiaying Gu , Nikolaos Ignatiadis , Azeem M. Shaikh

Modern statistical analyses often encounter datasets with massive sizes and heavy-tailed distributions. For datasets with massive sizes, traditional estimation methods can hardly be used to estimate the extreme value index directly. To…

Methodology · Statistics 2022-07-26 Yongxin Li , Liujun Chen , Deyuan Li , Hansheng Wang

In many statistical problems, stochastic signals can be represented as a sequence of noisy wavelet coefficients. In this paper, we develop general empirical Bayes methods for the estimation of true signal. Our estimators approximate certain…

Statistics Theory · Mathematics 2007-06-13 Cun-Hui Zhang

Tail dependence models for distributions attracted to a max-stable law are fitted using observations above a high threshold. To cope with spatial, high-dimensional data, a rank-based M-estimator is proposed relying on bivariate margins…

Methodology · Statistics 2015-01-12 John Einmahl , Anna Kiriliouk , Andrea Krajina , Johan Segers

Aggregated predictors are obtained by making a set of basic predictors vote according to some weights, that is, to some probability distribution. Randomized predictors are obtained by sampling in a set of basic predictors, according to some…

Machine Learning · Statistics 2025-03-03 Pierre Alquier

We propose an estimator for the mean of random variables in separable real Banach spaces using the empirical characteristic function. Assuming that the covariance operator of the random variable is bounded in a precise sense, we show that…

Statistics Theory · Mathematics 2020-11-04 Sohail Bahmani

A fundamental problem in analysis of complex systems is getting a reliable estimate of entropy of their probability distributions over the state space. This is difficult because unsampled states can contribute substantially to the entropy,…

Data Analysis, Statistics and Probability · Physics 2023-07-19 Damián G. Hernández , Ahmed Roman , Ilya Nemenman

Estimating a high-dimensional sparse covariance matrix from a limited number of samples is a fundamental problem in contemporary data analysis. Most proposals to date, however, are not robust to outliers or heavy tails. Towards bridging…

Statistics Theory · Mathematics 2020-08-04 John Goes , Gilad Lerman , Boaz Nadler

In this paper, we investigate the extreme-value methodology, to propose an improved estimator of the conditional tail expectation ($CTE$) for a loss distribution with a finite mean but infinite variance. The present work introduces a new…

Statistics Theory · Mathematics 2020-02-11 Mohamed Laidi , Abdelaziz Rassoul , Hamid Ould Rouis

This paper is focused on dimension-free PAC-Bayesian bounds, under weak polynomial moment assumptions, allowing for heavy tailed sample distributions. It covers the estimation of the mean of a vector or a matrix, with applications to least…

Statistics Theory · Mathematics 2018-01-03 Olivier Catoni , Ilaria Giulini

We study the fundamental task of outlier-robust mean estimation for heavy-tailed distributions in the presence of sparsity. Specifically, given a small number of corrupted samples from a high-dimensional heavy-tailed distribution whose mean…

Data Structures and Algorithms · Computer Science 2022-11-30 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Ankit Pensia

An important part of the legacy of Evarist Gin\'e is his fundamental contributions to our understanding of $U$-statistics and $U$-processes. In this paper we discuss the estimation of the mean of multivariate functions in case of possibly…

Statistics Theory · Mathematics 2015-04-20 Emilien Joly , Gábor Lugosi

The term moderate deviations is often used in the literature to mean a class of large deviation principles that, in some sense, fills the gap between a convergence in probability of some random variables to a constant and a weak convergence…

Probability · Mathematics 2024-11-20 Rita Giuliano , Claudio Macci , Barbara Pacchiarotti

We make use of the empirical process theory to approximate the adapted Hill estimator, for censored data, in terms of Gaussian processes. Then, we derive its asymptotic normality, only under the usual second-order condition of regular…

Statistics Theory · Mathematics 2015-07-07 Brahim Brahimi , Djamel Meraghni , Abdelhakim Necir

Consider a random sample in the max-domain of attraction of a multivariate extreme value distribution such that the dependence structure of the attractor belongs to a parametric model. A new estimator for the unknown parameter is defined as…

Statistics Theory · Mathematics 2012-10-05 John H. J. Einmahl , Andrea Krajina , Johan Segers

Generalized linear mixed models are powerful tools for analyzing clustered data, where the unknown parameters are classically (and most commonly) estimated by the maximum likelihood and restricted maximum likelihood procedures. However,…

Statistics Theory · Mathematics 2023-03-23 Andrea M. Bratsberg , Magne Thoresen , Abhik Ghosh

In this paper, we study the problem of distributed mean estimation with 1-bit communication constraints. We propose a mean estimator that is based on (randomized and sequentially-chosen) interval queries, whose 1-bit outcome indicates…

Machine Learning · Statistics 2026-04-07 Ivan Lau , Jonathan Scarlett

The non-asymptotic tail bounds of random variables play crucial roles in probability, statistics, and machine learning. Despite much success in developing upper bounds on tail probability in literature, the lower bounds on tail…

Probability · Mathematics 2020-09-08 Anru R. Zhang , Yuchen Zhou

Consider the Gaussian sequence model under the additional assumption that a fixed fraction of the means is known. We study the problem of variance estimation from a frequentist Bayesian perspective. The maximum likelihood estimator (MLE)…

Statistics Theory · Mathematics 2019-12-19 Gianluca Finocchio , Johannes Schmidt-Hieber