English
Related papers

Related papers: Consistent Covariance estimation for stratum imbal…

200 papers

Statistical inference and information processing of high-dimensional data often require efficient and accurate estimation of their second-order statistics. With rapidly changing data, limited processing power and storage at the acquisition…

Information Theory · Computer Science 2015-03-23 Yuxin Chen , Yuejie Chi , Andrea Goldsmith

Despite decades of research and recent progress in adaptive control and reinforcement learning, there remains a fundamental lack of understanding in designing controllers that provide robustness to inherent non-asymptotic uncertainties…

Machine Learning · Computer Science 2021-08-13 Benjamin Gravell , Tyler Summers

This paper studies the impact of bootstrap procedure on the eigenvalue distributions of the sample covariance matrix under a high-dimensional factor structure. We provide asymptotic distributions for the top eigenvalues of bootstrapped…

Statistics Theory · Mathematics 2023-11-21 Long Yu , Peng Zhao , Wang Zhou

Covariate-adaptive randomization is widely used in clinical trials to balance prognostic factors, and regression adjustments are often adopted to further enhance the estimation and inference efficiency. In practice, the covariates may…

Methodology · Statistics 2025-08-15 Wanjia Fu , Yingying Ma , Hanzhong Liu

Time-to-event outcomes are commonly used as primary endpoints in randomized clinical trials. Despite this, relatively little work incorporates baseline covariate information while also accounting for stratified randomization, a common form…

Methodology · Statistics 2026-05-01 Raphael C. Kim , Brian Gilbert , Ramin Zabih , Michele Santacatterina , Ivan Diaz

Subsampling methods have been recently proposed to speed up least squares estimation in large scale settings. However, these algorithms are typically not robust to outliers or corruptions in the observed covariates. The concept of influence…

Machine Learning · Statistics 2014-06-20 Brian McWilliams , Gabriel Krummenacher , Mario Lucic , Joachim M. Buhmann

This paper considers the problem of estimating a high-dimensional (HD) covariance matrix when the sample size is smaller, or not much larger, than the dimensionality of the data, which could potentially be very large. We develop a…

Methodology · Statistics 2019-05-22 Esa Ollila , Elias Raninen

We consider penalized extremum estimation of a high-dimensional, possibly nonlinear model that is sparse in the sense that most of its parameters are zero but some are not. We use the SCAD penalty function, which provides model selection…

Econometrics · Economics 2024-02-23 Joel L. Horowitz , Ahnaf Rafi

The problem of estimating a spiked covariance matrix in high dimensions under Frobenius loss, and the parallel problem of estimating the noise in spiked PCA is investigated. We propose an estimator of the noise parameter by minimizing an…

Statistics Theory · Mathematics 2014-08-28 Didier Chételat , Martin T. Wells

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

Methodology · Statistics 2025-12-30 Shaoxin Wang , Ziyun Ma

We consider the problem of minimizing the composition of a smooth (nonconvex) function and a smooth vector mapping, where the inner mapping is in the form of an expectation over some random variable or a finite sum. We propose a stochastic…

Optimization and Control · Mathematics 2019-06-26 Junyu Zhang , Lin Xiao

This article considers the sequential Monte Carlo (SMC) approximation of ratios of normalizing constants associated to posterior distributions which in principle rely on continuum models. Therefore, the Monte Carlo estimation error and the…

Computation · Statistics 2016-03-04 Pierre Del Moral , Ajay Jasra , Kody Law , Yan Zhou

This paper investigates estimation and inference for average treatment effects in completely randomized experiments when researchers observe potentially many covariates. Within Neyman's (1923) design-based framework, allowing the number of…

Econometrics · Economics 2025-11-20 Harold D Chiang , Yukitoshi Matsushita , Taisuke Otsu

High dimensional error covariance matrices and their inverses are used to weight the contribution of observation and background information in data assimilation procedures. As observation error covariance matrices are often obtained by…

Optimization and Control · Mathematics 2019-10-02 Jemima M. Tabeart , Sarah L. Dance , Amos S. Lawless , Nancy K. Nichols , Joanne A. Waller

This paper delves into the realm of stochastic optimization for compositional minimax optimization - a pivotal challenge across various machine learning domains, including deep AUC and reinforcement learning policy evaluation. Despite its…

Machine Learning · Computer Science 2023-12-13 Jin Liu , Xiaokang Pan , Junwen Duan , Hongdong Li , Youqi Li , Zhe Qu

This paper develops valid bootstrap inference methods for the dynamic short panel threshold regression. We show that the standard nonparametric bootstrap is inconsistent for the first-differenced generalized method of moments (GMM)…

Econometrics · Economics 2025-11-18 Woosik Gong , Myung Hwan Seo

Adaptive Monte Carlo methods are very efficient techniques designed to tune simulation estimators on-line. In this work, we present an alternative to stochastic approximation to tune the optimal change of measure in the context of…

Probability · Mathematics 2009-10-23 Benjamin Jourdain , Jérôme Lelong

Covariance matrix estimation is an important problem in multivariate data analysis, both from theoretical as well as applied points of view. Many simple and popular covariance matrix estimators are known to be severely affected by model…

Methodology · Statistics 2025-11-21 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

Weighting methods are widely used to adjust for covariates in observational studies, sample surveys, and regression settings. In this paper, we study a class of recently proposed weighting methods which find the weights of minimum…

Methodology · Statistics 2019-10-29 Yixin Wang , José R. Zubizarreta

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…