English
Related papers

Related papers: Heteroskedasticity-robust inference in linear regr…

200 papers

In this paper we study covariance estimation with missing data. We consider missing data mechanisms that can be independent of the data, or have a time varying dependency. Additionally, observed variables may have arbitrary (non uniform)…

Statistics Theory · Mathematics 2021-06-17 Eduardo Pavez , Antonio Ortega

In this paper, we develop a systematic theory for high dimensional analysis of variance in multivariate linear regression, where the dimension and the number of coefficients can both grow with the sample size. We propose a new \emph{U}~type…

Methodology · Statistics 2023-01-12 Zhipeng Lou , Xianyang Zhang , Wei Biao Wu

Utilizing covariate information has been a powerful approach to improve the efficiency and accuracy for causal inference, which support massive amount of randomized experiments run on data-driven enterprises. However, state-of-art…

Methodology · Statistics 2023-11-06 Yuhang Wu , Jinghai He , Zeyu Zheng

Regression adjustment is broadly applied in randomized trials under the premise that it usually improves the precision of a treatment effect estimator. However, previous work has shown that this is not always true. To further understand…

Methodology · Statistics 2022-10-11 Katarzyna Reluga , Ting Ye , Qingyuan Zhao

In the early 1980s Halbert White inaugurated a "model-robust'' form of statistical inference based on the "sandwich estimator'' of standard error. This estimator is known to be "heteroskedasticity-consistent", but it is less well-known to…

Many data-science applications involve detecting a shared signal between two high-dimensional variables. Using random matrix theory methods, we determine when such signal can be detected and reconstructed from sample correlations, despite…

Disordered Systems and Neural Networks · Physics 2026-04-07 Arabind Swain , Sean Alexander Ridout , Ilya Nemenman

We study high-dimensional linear models with error-in-variables. Such models are motivated by various applications in econometrics, finance and genetics. These models are challenging because of the need to account for measurement errors to…

Statistics Theory · Mathematics 2017-03-03 Alexandre Belloni , Victor Chernozhukov , Abhishek Kaul

A key challenge in building effective regression models for large and diverse populations is accounting for patient heterogeneity. An example of such heterogeneity is in health system risk modeling efforts where different combinations of…

Methodology · Statistics 2022-12-26 Jared D. Huling , Menggang Yu

Real-world large-scale datasets are heteroskedastic and imbalanced -- labels have varying levels of uncertainty and label distributions are long-tailed. Heteroskedasticity and imbalance challenge deep learning algorithms due to the…

Machine Learning · Computer Science 2021-03-19 Kaidi Cao , Yining Chen , Junwei Lu , Nikos Arechiga , Adrien Gaidon , Tengyu Ma

We propose a new lack-of-fit test for quantile regression models that is suitable even with high-dimensional covariates. The test is based on the cumulative sum of residuals with respect to unidimensional linear projections of the…

This paper develops permutation versions of identification-robust tests in linear instrumental variables (IV) regression. Unlike the existing randomization and rank-based tests in which independence between the instruments and the error…

Econometrics · Economics 2024-07-24 Purevdorj Tuvaandorj

Understanding covariate-varying interdependencies among features is of great interest in various applications. Motivated by microbiome studies where microbial abundances and interactions vary with environmental factors, we develop a…

Methodology · Statistics 2026-03-16 Shuangjie Zhang , Michael L. Patnode , Juhee Lee

Covariate-adaptive randomization is widely employed to balance baseline covariates in interventional studies such as clinical trials and experiments in development economics. Recent years have witnessed substantial progress in inference…

Methodology · Statistics 2024-05-30 Jiahui Xin , Hanzhong Liu , Wei Ma

Despite its prevalence in statistical datasets, heteroscedasticity (non-constant sample variances) has been largely ignored in the high-dimensional statistics literature. Recently, studies have shown that the Lasso can accommodate…

Statistics Theory · Mathematics 2014-10-31 James Sharpnack , Mladen Kolar

Many multivariate statistical methods rely heavily on the sample covariance matrix. It is well known though that the sample covariance matrix is highly non-robust. One popular alternative approach for "robustifying" the multivariate method…

Methodology · Statistics 2015-12-21 Klaus Nordhausen , David E. Tyler

It is common to conduct causal inference in matched observational studies by proceeding as though treatment assignments within matched sets are assigned uniformly at random and using this distribution as the basis for inference. This…

Methodology · Statistics 2023-11-14 Samuel D. Pimentel , Yaxuan Huang

Multivariate linear regression is a fundamental statistical task, but classical estimators such as ordinary least squares are highly sensitive to outliers. These may occur as casewise outliers that affect entire observations, or as outlying…

Methodology · Statistics 2026-05-11 Fabio Centofanti , Mia Hubert , Peter J. Rousseeuw

In many practical applications, regression models are employed to uncover relationships between predictors and a response variable, yet the common assumption of constant error variance is frequently violated. This issue is further…

Methodology · Statistics 2025-02-05 Masanari Kimura

Deep heteroscedastic regression models the mean and covariance of the target distribution through neural networks. The challenge arises from heteroscedasticity, which implies that the covariance is sample dependent and is often unknown.…

Machine Learning · Computer Science 2025-02-18 Megh Shukla , Aziz Shameem , Mathieu Salzmann , Alexandre Alahi

We investigate popular resampling methods for estimating the uncertainty of statistical models, such as subsampling, bootstrap and the jackknife, and their performance in high-dimensional supervised regression tasks. We provide a tight…