English
Related papers

Related papers: Statistical Barriers to Affine-equivariant Estimat…

200 papers

The problem of nonlinear functional of parameters, such as differential entropy, has received much attention in information theory and statistics. In many situations, prior information about the parameters is available in the form of order…

Statistics Theory · Mathematics 2026-03-10 Somnath Mandal , Lakshmi Kanta Patra

Aggregating estimators using exponential weights depending on their risk appears optimal in expectation but not in probability. We use here a slight overpenalization to obtain oracle inequality in probability for such an explicit…

Statistics Theory · Mathematics 2018-02-01 Lucie Montuelle , Erwan Le Pennec

We analyze a posteriori error bounds for stabilized finite element discretizations of second-order steady-state mean field games. We prove the local equivalence between the $H^1$-norm of the error and the dual norm of the residual. We then…

Numerical Analysis · Mathematics 2025-12-02 Yohance A. P. Osborne , Iain Smears , Harry Wells

Contemporary data assimilation often involves millions of prediction variables. The classical Kalman filter is no longer computationally feasible in such a high dimensional context. This problem can often be resolved by exploiting the…

Statistics Theory · Mathematics 2016-06-30 Andrew J. Majda , Xin T. Tong

Mean-variance portfolio decisions that combine prediction and optimisation have been shown to have poor empirical performance. Here, we consider the performance of various shrinkage methods by their efficient frontiers under different…

Portfolio Management · Quantitative Finance 2022-05-03 Andrew Paskaramoorthy , Tim Gebbie , Terence van Zyl

High-dimensional covariance estimation is notoriously sensitive to outliers. While statistically optimal estimators exist for general heavy-tailed distributions, they often rely on computationally expensive techniques like semidefinite…

Machine Learning · Statistics 2026-01-06 Even He

In the usual statistical inference problem, we estimate an unknown parameter of a statistical model using the information in the random sample. A priori information about the parameter is also known in several real-life situations. One such…

Statistics Theory · Mathematics 2024-11-11 Lakshmi Kanta Patra , Constantinos Petropoulos , Shrajal Bajpai , Naresh Garg

Mean estimation is a fundamental task in statistics and a focus within differentially private statistical estimation. While univariate methods based on the Gaussian mechanism are widely used in practice, more advanced techniques such as the…

Machine Learning · Computer Science 2025-02-27 Gavin Brown , Lydia Zakynthinou

We consider robust location-scale estimators under contamination. We show that commonly used robust estimators such as the median and the Huber estimator are inconsistent under asymmetric contamination, while the Tukey estimator is…

Statistics Theory · Mathematics 2025-02-14 Jens Klooster , Bent Nielsen

We study prior distributions for Poisson parameter estimation under $L^1$ loss. Specifically, we construct a new family of prior distributions whose optimal Bayesian estimators (the conditional medians) can be any prescribed increasing…

Statistics Theory · Mathematics 2025-05-28 Leighton P. Barnes , Alex Dytso , H. Vincent Poor

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

Let $X$ be a random variable with unknown mean and finite variance. We present a new estimator of the mean of $X$ that is robust with respect to the possible presence of outliers in the sample, provides tight sub-Gaussian deviation…

Statistics Theory · Mathematics 2022-01-03 Stanislav Minsker , Mohamed Ndaoud

Missing outcome data is one of the principal threats to the validity of treatment effect estimates from randomized trials. The outcome distributions of participants with missing and observed data are often different, which increases the…

Methodology · Statistics 2017-04-06 Iván Díaz , Mark J. van der Laan

We study the convergence rate of the median estimator for affine matrix scrambled digital nets applied to integrands over the unit hypercube $[0, 1]^s$. By taking the median of $(2r-1)$ independent randomized quasi-Monte Carlo (RQMC)…

Numerical Analysis · Mathematics 2025-05-06 Yang Liu

This paper develops and analyzes three families of estimators that continuously interpolate between classical quantiles and the sample mean. The construction begins with a smoothed version of the $L_{1}$ loss, indexed by a location…

Methodology · Statistics 2025-12-23 Saïd Maanan , Azzouz Dermoune , Ahmed El Ghini

Recent studies found that many channels are affected by additive noise that is impulsive in nature and is best explained by heavy-tailed symmetric alpha-stable distributions. Dealing with impulsive noise environments comes with an added…

Information Theory · Computer Science 2016-10-07 Jihad Fahs , Ibrahim Abou-Faycal

We consider the problem of aggregating a general collection of affine estimators for fixed design regression. Relevant examples include some commonly used statistical estimators such as least squares, ridge and robust least squares…

Statistics Theory · Mathematics 2013-11-13 Dong Dai , Philippe Rigollet , Lucy Xia , Tong Zhang

In statistical analysis, measuring a score of predictive performance is an important task. In many scientific fields, appropriate scores were tailored to tackle the problems at hand. A proper score is a popular tool to obtain statistically…

Statistics Theory · Mathematics 2013-05-14 Takafumi Kanamori , Hironori Fujisawa

Datasets are often reused to perform multiple statistical analyses in an adaptive way, in which each analysis may depend on the outcomes of previous analyses on the same dataset. Standard statistical guarantees do not account for these…

Machine Learning · Computer Science 2017-06-19 Vitaly Feldman , Thomas Steinke

High-dimensional data subject to heavy-tailed phenomena and heterogeneity are commonly encountered in various scientific fields and bring new challenges to the classical statistical methods. In this paper, we combine the asymmetric square…

Statistics Theory · Mathematics 2019-10-02 Jun Zhao , Guan'ao Yan , Yi Zhang