English
Related papers

Related papers: De-Biased Machine Learning of Global and Local Par…

200 papers

In this paper, we extend the Riesz representation framework to causal inference under sample selection, where both treatment assignment and outcome observability are non-random. Formulating the problem in terms of a Riesz representer…

In a variety of applications, including nonparametric instrumental variable (NPIV) analysis, proximal causal inference under unmeasured confounding, and missing-not-at-random data with shadow variables, we are interested in inference on a…

Many causal and structural effects depend on regressions. Examples include policy effects, average derivatives, regression decompositions, average treatment effects, causal mediation, and parameters of economic structural models. The…

Statistics Theory · Mathematics 2022-10-25 Victor Chernozhukov , Whitney K Newey , Rahul Singh

We present machine learning estimators for causal and predictive parameters under covariate shift, where covariate distributions differ between training and target populations. One such parameter is the average effect of a policy that…

Methodology · Statistics 2025-09-23 Victor Chernozhukov , Michael Newey , Whitney K Newey , Rahul Singh , Vasilis Syrgkanis

We consider the problem of recovering of continuous multi-dimensional functions from the noisy observations over the regular grid. Our focus is at the adaptive estimation in the case when the function can be well recovered using a linear…

Statistics Theory · Mathematics 2009-03-06 Anatoli Iouditski , Arkadii S. Nemirovski

The Riesz representer is a central object in semiparametric statistics and debiased/doubly-robust estimation. Two literatures in econometrics have highlighted the role for directly estimating Riesz representers: the automatic debiased…

Econometrics · Economics 2026-03-24 David Bruns-Smith

We study frequentist asymptotic properties of Bayesian procedures for high-dimensional Gaussian sparse regression when unknown nuisance parameters are involved. Nuisance parameters can be finite-, high-, or infinite-dimensional. A mixture…

Statistics Theory · Mathematics 2021-02-18 Seonghyun Jeong , Subhashis Ghosal

A powerful concept behind much of the recent progress in machine learning is the extraction of common features across data from heterogeneous sources or tasks. Intuitively, using all of one's data to learn a common representation function…

Machine Learning · Statistics 2024-10-15 Thomas T. C. K. Zhang , Leonardo F. Toso , James Anderson , Nikolai Matni

Estimating causal effects of continuous treatments is a common problem in practice, for example, in studying average dose-response functions. Classical analyses typically assume that all confounders are fully observed, whereas in real-world…

Statistics Theory · Mathematics 2026-04-14 Shuyuan Chen , Peng Zhang , Yifan Cui

Doubly robust estimators are widely used for estimating average treatment effects and other linear summaries of regression functions. While consistency requires only one of two nuisance functions to be estimated consistently, asymptotic…

Methodology · Statistics 2025-07-01 Lars van der Laan , Alex Luedtke , Marco Carone

We consider the estimation of treatment effects in settings when multiple treatments are assigned over time and treatments can have a causal effect on future outcomes or the state of the treated unit. We propose an extension of the…

Econometrics · Economics 2021-06-18 Greg Lewis , Vasilis Syrgkanis

We investigate a semiparametric regression model where one gets noisy non linear non invertible functions of the observations. We focus on the application to bearings-only tracking. We first investigate the least squares estimator and prove…

Statistics Theory · Mathematics 2008-12-17 Elisabeth Gassiat , Benoit Landelle

We propose double/debiased machine learning approaches to infer (at the parametric rate) the parametric component of a logistic partially linear model with the binary response following a conditional logistic model of a low dimensional…

Methodology · Statistics 2020-10-01 Molei Liu , Yi Zhang , Doudou Zhou

We propose nonparametric methods for functional linear regression which are designed for sparse longitudinal data, where both the predictor and response are functions of a covariate such as time. Predictor and response processes have smooth…

Statistics Theory · Mathematics 2016-08-16 Fang Yao , Hans-Georg Müller , Jane-Ling Wang

Modern statistical applications often involve minimizing an objective function that may be nonsmooth and/or nonconvex. This paper focuses on a broad Bregman-surrogate algorithm framework including the local linear approximation, mirror…

Optimization and Control · Mathematics 2021-12-20 Yiyuan She , Zhifeng Wang , Jiuwu Jin

Nonlinearity and endogeneity are prevalent challenges in causal analysis using observational data. This paper proposes an inference procedure for a nonlinear and endogenous marginal effect function, defined as the derivative of the…

Econometrics · Economics 2024-06-19 Qingliang Fan , Zijian Guo , Ziwei Mei , Cun-Hui Zhang

We consider inference from non-random samples in data-rich settings where high-dimensional auxiliary information is available both in the sample and the target population, with survey inference being a special case. We propose a regularized…

Methodology · Statistics 2021-04-13 Yutao Liu , Andrew Gelman , Qixuan Chen

In this paper, we apply doubly robust approach to estimate, when some covariates are given, the conditional average treatment effect under parametric, semiparametric and nonparametric structure of the nuisance propensity score and outcome…

Statistics Theory · Mathematics 2020-09-15 Chuyun Ye , Keli Guo , Lixing Zhu

We propose a roughness regularization approach in making nonparametric inference for generalized functional linear models. In a reproducing kernel Hilbert space framework, we construct asymptotically valid confidence intervals for…

Statistics Theory · Mathematics 2015-07-31 Zuofeng Shang , Guang Cheng

Nonparametric extension of tensor regression is proposed. Nonlinearity in a high-dimensional tensor space is broken into simple local functions by incorporating low-rank tensor decomposition. Compared to naive nonparametric approaches, our…

Machine Learning · Statistics 2016-03-09 Masaaki Imaizumi , Kohei Hayashi