English
Related papers

Related papers: Robust Modifications of U-statistics and Applicati…

200 papers

We study the accuracy of estimating the covariance and the precision matrix of a $D$-variate sub-Gaussian distribution along a prescribed subspace or direction using the finite sample covariance. Our results show that the estimation…

Statistics Theory · Mathematics 2021-01-14 Zeljko Kereta , Timo Klock

Robust mean estimation is the problem of estimating the mean $\mu \in \mathbb{R}^d$ of a $d$-dimensional distribution $D$ from a list of independent samples, an $\epsilon$-fraction of which have been arbitrarily corrupted by a malicious…

Computational Complexity · Computer Science 2019-06-05 Samuel B. Hopkins , Jerry Li

Let $X$ be a mean zero Gaussian random vector in a separable Hilbert space ${\mathbb H}$ with covariance operator $\Sigma:={\mathbb E}(X\otimes X).$ Let $\Sigma=\sum_{r\geq 1}\mu_r P_r$ be the spectral decomposition of $\Sigma$ with…

Statistics Theory · Mathematics 2016-01-08 Vladimir Koltchinskii , Karim Lounici

We investigate how to improve efficiency using regression adjustments with covariates in covariate-adaptive randomizations (CARs) with imperfect subject compliance. Our regression-adjusted estimators, which are based on the doubly robust…

Econometrics · Economics 2023-06-19 Liang Jiang , Oliver B. Linton , Haihan Tang , Yichong Zhang

We propose an empirically stable and asymptotically efficient covariate-balancing approach to the problem of estimating survival causal effects in data with conditionally-independent censoring. This addresses a challenge often encountered…

Empirical regression discontinuity (RD) studies often include covariates in their specifications to increase the precision of their estimates. In this paper, we propose a novel class of estimators that use such covariate information more…

Econometrics · Economics 2025-04-28 Claudia Noack , Tomasz Olma , Christoph Rothe

The assumption of separability is a simplifying and very popular assumption in the analysis of spatio-temporal or hypersurface data structures. It is often made in situations where the covariance structure cannot be easily estimated, for…

Methodology · Statistics 2019-01-03 Pramita Bagchi , Holger Dette

In statistics and machine learning, people are often interested in the eigenvectors (or singular vectors) of certain matrices (e.g. covariance matrices, data matrices, etc). However, those matrices are usually perturbed by noises or…

Statistics Theory · Mathematics 2017-06-05 Jianqing Fan , Weichen Wang , Yiqiao Zhong

We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that achieve exact coverage asymptotically. We develop a…

Machine Learning · Statistics 2018-07-03 John Duchi , Peter Glynn , Hongseok Namkoong

This paper focuses on investigating Stein's invariant shrinkage estimators for large sample covariance matrices and precision matrices in high-dimensional settings. We consider models that have nearly arbitrary population covariance…

Statistics Theory · Mathematics 2024-04-24 Xiucai Ding , Yun Li , Fan Yang

Algorithmic stability is a central concept in statistics and learning theory that measures how sensitive an algorithm's output is to small changes in the training data. Stability plays a crucial role in understanding generalization,…

Statistics Theory · Mathematics 2026-01-21 Abhinav Chakraborty , Yuetian Luo , Rina Foygel Barber

We introduce a novel covariance estimator for portfolio selection that adapts to the non-stationary or persistent heteroskedastic environments of financial time series by employing exponentially weighted averages and nonlinearly shrinking…

Machine Learning · Statistics 2023-01-23 Vincent Tan , Stefan Zohren

This paper provides some extended results on estimating parameter matrix of several regression models when the covariate or response possesses weaker moment condition. We study the $M$-estimator of Fan et al. (Ann Stat 49(3):1239--1266,…

Statistics Theory · Mathematics 2022-09-08 Kangqiang Li , Songqiao Tang , Lixin Zhang

We study the problem of robustly estimating the mean of a $d$-dimensional distribution given $N$ examples, where most coordinates of every example may be missing and $\varepsilon N$ examples may be arbitrarily corrupted. Assuming each…

Data Structures and Algorithms · Computer Science 2021-05-04 Lunjia Hu , Omer Reingold

In this paper we propose statistical inference tools for the covariance operators of functional time series in the two sample and change point problem. In contrast to most of the literature the focus of our approach is not testing the null…

Statistics Theory · Mathematics 2020-06-15 Holger Dette , Kevin Kokot

Many stochastic optimization problems include chance constraints that enforce constraint satisfaction with a specific probability; however, solving an optimization problem with chance constraints assumes that the solver has access to the…

Optimization and Control · Mathematics 2021-09-21 Joshua Comden , Ahmed S. Zamzam , Andrey Bernstein

We discuss a class of difference-based estimators for the autocovariance in nonparametric regression when the signal is discontinuous (change-point regression), possibly highly fluctuating, and the errors form a stationary $m$-dependent…

Methodology · Statistics 2016-08-09 Inder Tecuapetla-Gómez , Axel Munk

This paper deals with the problem of estimating the covariance matrix of a series of independent multivariate observations, in the case where the dimension of each observation is of the same order as the number of observations. Although…

Information Theory · Computer Science 2015-06-03 Jianfeng Yao , Abla Kammoun , Jamal Najim

A covariance matrix estimator using two bits per entry was recently developed by Dirksen, Maly and Rauhut [Annals of Statistics, 50(6), pp. 3538-3562]. The estimator achieves near minimax rate for general sub-Gaussian distributions, but…

Machine Learning · Statistics 2024-11-12 Junren Chen , Michael K. Ng

We consider the problem of robustly testing the norm of a high-dimensional sparse signal vector under two different observation models. In the first model, we are given $n$ i.i.d. samples from the distribution…

Information Theory · Computer Science 2022-11-08 Anand Jerry George , Clément L. Canonne