English
Related papers

Related papers: A Note on Debiased/Double Machine Learning Logisti…

200 papers

Due to concerns about parametric model misspecification, there is interest in using machine learning to adjust for confounding when evaluating the causal effect of an exposure on an outcome. Unfortunately, exposure effect estimators that…

Methodology · Statistics 2025-01-08 Oliver Dukes , Stijn Vansteelandt , David Whitney

Sparse linear models are one of several core tools for interpretable machine learning, a field of emerging importance as predictive models permeate decision-making in many domains. Unfortunately, sparse linear models are far less flexible…

Machine Learning · Statistics 2024-01-03 Ryan Thompson , Amir Dezfouli , Robert Kohn

Estimation and inference of treatment effects under unconfounded treatment assignments often suffer from bias and the `curse of dimensionality' due to the nonparametric estimation of nuisance parameters for high-dimensional confounders.…

Methodology · Statistics 2025-07-08 Zeqi Wu , Meilin Wang , Wei Huang , Zheng Zhang

In this paper, we propose a triple (or double-debiased) Lasso estimator for inference on a low-dimensional parameter in high-dimensional linear regression models. The estimator is based on a moment function that satisfies not only first-…

Econometrics · Economics 2026-03-23 Denis Chetverikov , Jesper R. -V. Sørensen , Aleh Tsyvinski

We consider estimating a low-dimensional parameter in an estimating equation involving high-dimensional nuisances that depend on the parameter. A central example is the efficient estimating equation for the (local) quantile treatment effect…

Machine Learning · Statistics 2022-08-18 Nathan Kallus , Xiaojie Mao , Masatoshi Uehara

The consistency of doubly robust estimators relies on consistent estimation of at least one of two nuisance regression parameters. In moderate to large dimensions, the use of flexible data-adaptive regression estimators may aid in achieving…

Machine Learning · Statistics 2019-01-30 Iván Díaz

We propose a semiparametric Bayesian methodology for estimating the average treatment effect (ATE) within the potential outcomes framework using observational data with high-dimensional nuisance parameters. Our method introduces a Bayesian…

Methodology · Statistics 2025-11-21 Gözde Sert , Abhishek Chakrabortty , Anirban Bhattacharya

Many machine learning applications use latent variable models to explain structure in data, whereby visible variables (= coordinates of the given datapoint) are explained as a probabilistic function of some hidden variables. Finding…

Machine Learning · Computer Science 2016-12-30 Sanjeev Arora , Rong Ge , Tengyu Ma , Andrej Risteski

We establish a general statistical optimality theory for estimation problems where the target parameter is a linear functional of an unknown nuisance component that must be estimated from data. This formulation covers many causal and…

Machine Learning · Statistics 2026-01-06 Jikai Jin , Vasilis Syrgkanis

Doubly robust estimators have gained widespread popularity in various fields due to their ability to provide unbiased estimates under model misspecification. However, the asymptotic theory for doubly robust estimators with continuous-time…

Statistics Theory · Mathematics 2024-04-23 Andrew Ying

Structure-agnostic causal inference studies how well one can estimate a treatment effect given black-box machine learning estimates of nuisance functions (like the impact of confounders on treatment and outcomes). Here, we find that the…

Machine Learning · Statistics 2025-11-10 Jikai Jin , Lester Mackey , Vasilis Syrgkanis

Double machine learning provides $\sqrt{n}$-consistent estimates of parameters of interest even when high-dimensional or nonparametric nuisance parameters are estimated at an $n^{-1/4}$ rate. The key is to employ Neyman-orthogonal moment…

Machine Learning · Computer Science 2018-08-03 Lester Mackey , Vasilis Syrgkanis , Ilias Zadik

Bias is a common problem inherent in recommender systems, which is entangled with users' preferences and poses a great challenge to unbiased learning. For debiasing tasks, the doubly robust (DR) method and its variants show superior…

Information Retrieval · Computer Science 2023-03-03 Haoxuan Li , Yan Lyu , Chunyuan Zheng , Peng Wu

Reliability analysis aims at estimating the failure probability of an engineering system. It often requires multiple runs of a limit-state function, which usually relies on computationally intensive simulations. Traditionally, these…

Computation · Statistics 2024-01-22 Anderson V. Pires , Maliki Moustapha , Stefano Marelli , Bruno Sudret

We propose two semiparametric versions of the debiased Lasso procedure for the model $Y_i = X_i\beta_0 + g_0(Z_i) + \epsilon_i$, where $\beta_0$ is high dimensional but sparse (exactly or approximately). Both versions are shown to have the…

Statistics Theory · Mathematics 2017-08-09 Ying Zhu , Zhuqing Yu , Guang Cheng

In empirical studies with time-to-event outcomes, investigators often leverage observational data to conduct causal inference on the effect of exposure when randomized controlled trial data is unavailable. Model misspecification and lack of…

Methodology · Statistics 2023-05-05 Shenbo Xu , Bang Zheng , Bowen Su , Stan Finkelstein , Roy Welsch , Kenney Ng , Ioanna Tzoulaki , Zach Shahn

We consider the problem of dynamic pricing of a product in the presence of feature-dependent price sensitivity. Developing practical algorithms that can estimate price elasticities robustly, especially when information about no purchases…

Machine Learning · Statistics 2022-12-21 Ravi Kumar , Shahin Boluki , Karl Isler , Jonas Rauch , Darius Walczak

Statistical inferences for high-dimensional regression models have been extensively studied for their wide applications ranging from genomics, neuroscience, to economics. However, in practice, there are often potential unmeasured…

Methodology · Statistics 2023-09-12 Jing Ouyang , Kean Ming Tan , Gongjun Xu

Causal effect estimation under networked interference is an important but challenging problem. Available parametric methods are limited in their model space, while previous semiparametric methods, e.g., leveraging neural networks to fit…

Machine Learning · Computer Science 2025-02-27 Weilin Chen , Ruichu Cai , Zeqin Yang , Jie Qiao , Yuguang Yan , Zijian Li , Zhifeng Hao

Sparse linear regression methods such as Lasso require a tuning parameter that depends on the noise variance, which is typically unknown and difficult to estimate in practice. In the presence of heavy-tailed noise or adversarial outliers,…

Statistics Theory · Mathematics 2025-06-17 Takeyuki Sasai , Hironori Fujisawa