English
Related papers

Related papers: Endogeneity in high dimensions

200 papers

Despite significant research on the optimization aspects of federated learning, the exploration of generalization error, especially in the realm of heterogeneous federated learning, remains an area that has been insufficiently investigated,…

Machine Learning · Statistics 2025-09-17 Saptarshi Chakraborty , Peter L. Bartlett

With the evolution of single-cell RNA sequencing techniques into a standard approach in genomics, it has become possible to conduct cohort-level causal inferences based on single-cell-level measurements. However, the individual gene…

Methodology · Statistics 2025-04-23 Jin-Hong Du , Zhenghao Zeng , Edward H. Kennedy , Larry Wasserman , Kathryn Roeder

Econometric identification generally relies on orthogonality conditions, which usually state that the random error term is uncorrelated with the explanatory variables. In convex regression, the orthogonality conditions for identification…

Methodology · Statistics 2025-06-27 Sheng Dai , Timo Kuosmanen , Xun Zhou

Since Pearson [Philosophical Transactions of the Royal Society of London. A, 185 (1894), pp. 71-110] first applied the method of moments (MM) for modeling data as a mixture of one-dimensional Gaussians, moment-based estimation methods have…

Machine Learning · Computer Science 2025-07-29 Liu Zhang , Oscar Mickelin , Sheng Xu , Amit Singer

We develop a methodology for conducting inference on extreme quantiles of unobserved individual heterogeneity (e.g., heterogeneous coefficients, treatment effects) in panel data and meta-analysis settings. Inference is challenging in such…

Econometrics · Economics 2026-02-04 Vladislav Morozov

We develop a continuous-time penalized regression framework for the estimation of time-varying coefficients and variable selection when both the response and covariates are It\^o semimartingales with jumps. The coefficient paths are…

Econometrics · Economics 2026-04-28 Aleksey Kolokolov , Shifan Yu

This article considers a novel and widely applicable approach to modeling high-dimensional dependent data when a large number of explanatory variables are available and the signal-to-noise ratio is low. We postulate that a $p$-dimensional…

Methodology · Statistics 2024-12-09 Zhaoxing Gao , Ruey S. Tsay

We study generalization properties of random features (RF) regression in high dimensions optimized by stochastic gradient descent (SGD) in under-/over-parameterized regime. In this work, we derive precise non-asymptotic error bounds of RF…

Machine Learning · Statistics 2022-10-18 Fanghui Liu , Johan A. K. Suykens , Volkan Cevher

Large-scale data are often characterized by some degree of inhomogeneity as data are either recorded in different time regimes or taken from multiple sources. We look at regression models and the effect of randomly changing coefficients,…

Methodology · Statistics 2016-08-11 Nicolai Meinshausen , Peter Bühlmann

Quantile regression has become a valuable tool to analyze heterogeneous covaraite-response associations that are often encountered in practice. The development of quantile regression methodology for high-dimensional covariates primarily…

Methodology · Statistics 2015-07-06 Qi Zheng , Limin Peng , Xuming He

We consider a generalized method of moments framework in which a part of the data vector is missing for some units in a completely unrestricted, potentially endogenous way. In this setup, the parameters of interest are usually only…

Econometrics · Economics 2026-01-07 Grigory Franguridi , Hyungsik Roger Moon

Estimation in generalized linear models (GLM) is complicated by the presence of constraints. One can handle constraints by maximizing a penalized log-likelihood. Penalties such as the lasso are effective in high dimensions, but often lead…

Machine Learning · Statistics 2017-11-07 Jason Xu , Eric C. Chi , Kenneth Lange

This paper considers the maximum generalized empirical likelihood (GEL) estimation and inference on parameters identified by high dimensional moment restrictions with weakly dependent data when the dimensions of the moment restrictions and…

Statistics Theory · Mathematics 2015-01-28 Jinyuan Chang , Song Xi Chen , Xiaohong Chen

We study the estimation of causal effects on group-level parameters identified from microdata (e.g., child penalties). We demonstrate that standard one-step methods (such as pooled OLS and IV regressions) are generally inconsistent due to…

General Economics · Economics 2026-01-13 Dmitry Arkhangelsky , Kazuharu Yanagimoto , Tom Zohar

Nowadays, several data analysis problems require for complexity reduction, mainly meaning that they target at removing the non-influential covariates from the model and at delivering a sparse model. When categorical covariates are present,…

Statistics Theory · Mathematics 2022-12-21 Lea Kaufmann , Maria Kateri

Recent advances in generative modeling have led to an increased interest in the study of statistical divergences as means of model comparison. Commonly used evaluation methods, such as the Frechet Inception Distance (FID), correlate well…

Machine Learning · Statistics 2018-10-30 Mehdi S. M. Sajjadi , Olivier Bachem , Mario Lucic , Olivier Bousquet , Sylvain Gelly

When solving inverse problems in geophysical imaging, deep generative models (DGMs) may be used to enforce the solution to display highly structured spatial patterns which are supported by independent information (e.g. the geological…

Geophysics · Physics 2021-04-28 Jorge Lopez-Alvis , Eric Laloy , Frédéric Nguyen , Thomas Hermans

We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining…

Machine Learning · Computer Science 2023-05-22 Sitan Chen , Sinho Chewi , Holden Lee , Yuanzhi Li , Jianfeng Lu , Adil Salim

Missing data are frequently encountered in high-dimensional problems, but they are usually difficult to deal with using standard algorithms, such as the expectation-maximization (EM) algorithm and its variants. To tackle this difficulty,…

Methodology · Statistics 2018-02-08 Faming Liang , Bochao Jia , Jingnan Xue , Qizhai Li , Ye Luo

This study introduces a novel model that effectively captures asymmetric structures in multivariate contingency tables with ordinal categories. Leveraging the principle of maximum entropy, our approach employs f-divergence to provide a…

Methodology · Statistics 2025-12-22 Hisaya Okahara , Kouji Tahata