English
Related papers

Related papers: Statistical Barriers to Affine-equivariant Estimat…

200 papers

Motivated by the construction of tractable robust estimators via convex relaxations, we present conditions on the sample size which guarantee an augmented notion of Restricted Eigenvalue-type condition for Gaussian designs. Such a notion is…

Statistics Theory · Mathematics 2018-12-04 Philip Thompson , Arnak S. Dalalyan

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adaptive trials.…

Machine Learning · Statistics 2021-02-16 Vitor Hadad , David A. Hirshberg , Ruohan Zhan , Stefan Wager , Susan Athey

Despite the renewed interest in the Newey and Powell (1987) concept of expectiles in fields such as econometrics, risk management, and extreme value theory, expectile regression---or, more generally, M-quantile regression---unfortunately…

Statistics Theory · Mathematics 2019-05-31 Abdelaati Daouia , Davy Paindaveine

Tukey's halfspace median ($\HM$), servicing as the {multivariate} counterpart of the univariate median, has been introduced and extensively studied in the literature. It is supposed and expected to preserve robustness property (the most…

Statistics Theory · Mathematics 2017-09-13 Xiaohui Liu , Yijun Zuo , Qihua Wang

Robust estimation of location is a fundamental problem in statistics, particularly in scenarios where data contamination by outliers or model misspecification is a concern. In univariate settings, methods such as the sample median and…

Statistics Theory · Mathematics 2025-05-07 Alejandro Cholaquidis , Ricardo Fraiman , Leonardo Moreno , Gonzalo Perera

Statistical inference for discrete time observations of an affine stochastic delay differential equation is considered. The main focus is on maximum pseudo-likelihood estimators, which are easy to calculate in practice. A more general class…

Statistics Theory · Mathematics 2013-03-21 Uwe Küchler , Michael Sørensen

Classical estimators, the cornerstones of statistical inference, face insurmountable challenges when applied to important emerging classes of Archimedean copulas. These models exhibit pathological properties, including numerically unstable…

Machine Learning · Statistics 2026-02-03 Agnideep Aich

We provide a new computationally-efficient class of estimators for risk minimization. We show that these estimators are robust for general statistical models: in the classical Huber epsilon-contamination model and in heavy-tailed settings.…

Machine Learning · Statistics 2018-04-23 Adarsh Prasad , Arun Sai Suggala , Sivaraman Balakrishnan , Pradeep Ravikumar

The problem of robust mean estimation in high dimensions is studied, in which a certain fraction (less than half) of the datapoints can be arbitrarily corrupted. Motivated by compressive sensing, the robust mean estimation problem is…

Applications · Statistics 2022-12-08 Aditya Deshmukh , Jing Liu , Venugopal V. Veeravalli

This paper illustrates the use of selected robust estimators of covariance or correlation in the identification of anomalous laboratory results in inter-laboratory data. It is shown that robust estimators can substantially reduce the impact…

Applications · Statistics 2019-05-29 Stephen L R Ellison

Stochastic estimators are fundamental to large-scale optimization, where population quantities must be inferred from noisy oracle observations. Although influential methods such as momentum, SPIDER, STORM, and PAGE have been highly…

Machine Learning · Computer Science 2026-05-18 Zhankun Luo , Antesh Upadhyay , M. Berk Sahin , Sang Bin Moon , Anuran Makur , Abolfazl Hashemi

This paper addresses the problem of estimating, in the presence of random censoring as well as competing risks, the extreme value index of the (sub)-distribution function associated to one particular cause, in the heavy-tail case.…

Statistics Theory · Mathematics 2017-01-20 Julien Worms , Rym Worms

The problem of estimating the coefficient of bivariate tail dependence is considered here from the robustness point of view; it combines two apparently contradictory theories of robust statistics and extreme value statistics. The usual…

Applications · Statistics 2014-07-08 Abhik Ghosh

A robust estimator is proposed for the parameters that characterize the linear regression problem. It is based on the notion of shrinkages, often used in Finance and previously studied for outlier detection in multivariate data. A thorough…

Methodology · Statistics 2020-02-07 Elisa Cabana , Rosa E. Lillo , Henry Laniado

Assume that $(X_t)_{t\in\Z}$ is a real valued time series admitting a common marginal density $f$ with respect to Lebesgue's measure. Donoho {\it et al.} (1996) propose a near-minimax method based on thresholding wavelets to estimate $f$ on…

Statistics Theory · Mathematics 2011-03-17 Irène Gannaz , Olivier Wintenberger

U-statistics are a fundamental class of estimators that generalize the sample mean and underpin much of nonparametric statistics. Although extensively studied in both statistics and probability, key challenges remain: their high…

Statistics Theory · Mathematics 2026-02-19 Cesare Miglioli , Jordan Awan

The advancement of generalized deepfake disruption is constrained by the interruption imbalance, a fundamental bottleneck inherent to the generation of universal perturbations. We reveal that conventional static gradient normalization…

Machine Learning · Computer Science 2026-05-04 Hongrui Zheng , Liejun Wang , Zhiqing Guo

We introduce a novel covariance estimator for portfolio selection that adapts to the non-stationary or persistent heteroskedastic environments of financial time series by employing exponentially weighted averages and nonlinearly shrinking…

Machine Learning · Statistics 2023-01-23 Vincent Tan , Stefan Zohren

In this paper, we consider matrix completion with absolute deviation loss and obtain an estimator of the median matrix. Despite several appealing properties of median, the non-smooth absolute deviation loss leads to computational challenge…

Machine Learning · Statistics 2020-06-19 Weidong Liu , Xiaojun Mao , Raymond K. W. Wong