English
Related papers

Related papers: Endogeneity in high dimensions

200 papers

Gaussian mixture models (GMMs) are fundamental tools in statistical and data sciences. We study the moments of multivariate Gaussians and GMMs. The $d$-th moment of an $n$-dimensional random variable is a symmetric $d$-way tensor of size…

Machine Learning · Statistics 2022-03-23 João M. Pereira , Joe Kileel , Tamara G. Kolda

We consider non-parametric estimation and inference of conditional moment models in high dimensions. We show that even when the dimension $D$ of the conditioning variable is larger than the sample size $n$, estimation and inference is…

Machine Learning · Computer Science 2019-06-19 Khashayar Khosravi , Greg Lewis , Vasilis Syrgkanis

We consider statistical inference in high-dimensional regression problems under affine constraints on the parameter space. The theoretical study of this is motivated by the study of genetic determinants of diseases, such as diabetes, using…

In this work we address the problem of approximating high-dimensional data with a low-dimensional representation. We make the following contributions. We propose an inverse regression method which exchanges the roles of input and response,…

Machine Learning · Computer Science 2015-09-04 Antoine Deleforge , Florence Forbes , Radu Horaud

In this work, we consider causal inference in various high-dimensional treatment settings, including for single multi-valued treatments and vector treatments with binary or continuous components, when the number of treatments can be…

Statistics Theory · Mathematics 2026-02-26 Patrick Kramer , Edward H. Kennedy , Isaac M. Opper

Although understanding and characterizing causal effects have become essential in observational studies, it is challenging when the confounders are high-dimensional. In this article, we develop a general framework $\textit{CausalEGM}$ for…

Machine Learning · Statistics 2023-03-20 Qiao Liu , Zhongren Chen , Wing Hung Wong

Understanding how well a deep generative model captures a distribution of high-dimensional data remains an important open challenge. It is especially difficult for certain model classes, such as Generative Adversarial Networks and Diffusion…

Machine Learning · Computer Science 2023-08-08 Suman Ravuri , Mélanie Rey , Shakir Mohamed , Marc Deisenroth

We propose a semi-partitioned Generalized Method of Moments (GMM) framework for analyzing longitudinal data with time-dependent covariates, within a marginal modeling paradigm. This approach addresses limitations of both aggregated and…

Methodology · Statistics 2026-03-04 Niloofar Ramezani , Jeffrey R. Wilson

Nonparametric feature selection in high-dimensional data is an important and challenging problem in statistics and machine learning fields. Most of the existing methods for feature selection focus on parametric or additive models which may…

Methodology · Statistics 2021-03-31 Hang Yu , Yuanjia Wang , Donglin Zeng

A class of simultaneous equation models arise in the many domains where observed binary outcomes are themselves a consequence of the existing choices of of one of the agents in the model. These models are gaining increasing interest in the…

Econometrics · Economics 2025-12-30 Shakeeb Khan , Elie Tamer , Qingsong Yao

Many popular estimation methods in panel data rely on the assumption that the covariates of interest are strictly exogenous. However, this assumption is empirically restrictive in a wide range of settings. In this paper I argue that…

Econometrics · Economics 2025-12-22 Stephane Bonhomme

Penalized likelihood approaches are widely used for high-dimensional regression. Although many methods have been proposed and the associated theory is now well-developed, the relative efficacy of different approaches in finite-sample…

Methodology · Statistics 2020-01-29 Fan Wang , Sach Mukherjee , Sylvia Richardson , Steven M. Hill

We consider estimation and inference in panel data models with additive unobserved individual specific heterogeneity in a high dimensional setting. The setting allows the number of time varying regressors to be larger than the sample size.…

Methodology · Statistics 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen , Damian Kozbur

With the availability of high dimensional genetic biomarkers, it is of interest to identify heterogeneous effects of these predictors on patients' survival, along with proper statistical inference. Censored quantile regression has emerged…

Methodology · Statistics 2021-07-26 Zhe Fei , Qi Zheng , Hyokyoung G. Hong , Yi Li

Big data analytics has opened new avenues in economic research, but the challenge of analyzing datasets with tens of millions of observations is substantial. Conventional econometric methods based on extreme estimators require large amounts…

Econometrics · Economics 2023-11-02 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

This paper addresses the challenge of integrating sequentially arriving data within the quantile regression framework, where the number of features is allowed to grow with the number of observations, the horizon is unknown, and memory is…

Statistics Theory · Mathematics 2025-10-21 Yinan Shen , Dong Xia , Wen-Xin Zhou

In observational studies, the causal effect of a treatment may be confounded with variables that are related to both the treatment and the outcome of interest. In order to identify a causal effect, such studies often rely on the…

Methodology · Statistics 2017-10-17 Emma Persson , Jenny Häggström , Ingeborg Waernbaum , Xavier de Luna

The low-degree polynomial framework has emerged as a powerful tool for providing evidence of statistical-computational gaps in high-dimensional inference. For detection problems, the standard approach bounds the low-degree advantage through…

Statistics Theory · Mathematics 2026-04-21 Zhangsong Li

This paper considers (partial) identification of a variety of counterfactual parameters in binary response models with possibly endogenous regressors. Our framework allows for nonseparable index functions with multi-dimensional latent…

Econometrics · Economics 2022-07-26 Jiaying Gu , Thomas M. Russell

Accurate and automated detection of anomalous samples in a natural image dataset can be accomplished with a probabilistic model for end-to-end modeling of images. Such images have heterogeneous complexity, however, and a probabilistic model…

Machine Learning · Computer Science 2018-09-05 Takashi Matsubara , Kenta Hama , Ryosuke Tachibana , Kuniaki Uehara