English
Related papers

Related papers: Regularizing Double Machine Learning in Partially …

200 papers

Panel data methods are widely used in empirical analysis to address unobserved heterogeneity, but causal inference remains challenging when treatments are endogenous and confounding variables high-dimensional and potentially nonlinear.…

Econometrics · Economics 2026-03-24 Anna Baiardi , Paul S. Clarke , Andrea A. Naghi , Annalivia Polselli

Consider semiparametric estimation where a doubly robust estimating function for a low-dimensional parameter is available, depending on two working models. With high-dimensional data, we develop regularized calibrated estimation as a…

Methodology · Statistics 2020-09-28 Satyajit Ghosh , Zhiqiang Tan

Traditionally, spline or kernel approaches in combination with parametric estimation are used to infer the linear coefficient (fixed effects) in a partially linear mixed-effects model for repeated measurements. Using machine learning…

Methodology · Statistics 2023-04-03 Corinne Emmenegger , Peter Bühlmann

Estimating causal effect using machine learning (ML) algorithms can help to relax functional form assumptions if used within appropriate frameworks. However, most of these frameworks assume settings with cross-sectional data, whereas…

Econometrics · Economics 2024-09-04 Jonathan Fuhr , Dominik Papies

This paper studies the high-dimensional mixed linear regression (MLR) where the output variable comes from one of the two linear regression models with an unknown mixing proportion and an unknown covariance structure of the random…

Methodology · Statistics 2020-11-10 Linjun Zhang , Rong Ma , T. Tony Cai , Hongzhe Li

Double/debiased machine learning (DML) provides a general framework for inference with high-dimensional or otherwise complex nuisance parameters by combining Neyman-orthogonal scores with cross-fitting, thereby circumventing classical…

Statistics Theory · Mathematics 2026-04-21 Ziming Lin , Fang Han

This paper studies the properties of debiased machine learning (DML) estimators under a novel asymptotic framework, offering insights for improving the performance of these estimators in applications. DML is an estimation method suited to…

Econometrics · Economics 2024-11-05 Amilcar Velez

Adaptive causal representation learning from observational data is presented, integrated with an efficient sample splitting technique within the semiparametric estimating equation framework. The support points sample splitting (SPSS), a…

Machine Learning · Statistics 2024-11-25 Lynda Aouar , Han Yu

We study inference on a low-dimensional functional $\beta$ in the presence of infinite-dimensional nuisance parameters. Classical inferential methods are typically based on Wald intervals, whose large-sample validity rests on asymptotic…

Methodology · Statistics 2026-02-24 Mengchu Zheng , Matteo Bonvini , Zijian Guo

Differential machine learning (DML) is a recently proposed technique that uses samplewise state derivatives to regularize least square fits to learn conditional expectations of functionals of stochastic processes as functions of state…

Computational Finance · Quantitative Finance 2023-02-21 Arun Kumar Polala , Bernhard Hientzsch

In real data analysis with structural equation modeling, data are unlikely to be exactly normally distributed. If we ignore the non-normality reality, the parameter estimates, standard error estimates, and model fit statistics from normal…

Methodology · Statistics 2021-06-21 Han Du , Peter M. Bentler

We introduce the package ddml for Double/Debiased Machine Learning (DDML) in Stata. Estimators of causal parameters for five different econometric models are supported, allowing for flexible estimation of causal effects of endogenous…

Econometrics · Economics 2024-01-09 Achim Ahrens , Christian B. Hansen , Mark E. Schaffer , Thomas Wiemann

This paper is the first study to apply deep mutual learning (DML) to end-to-end ASR models. In DML, multiple models are trained simultaneously and collaboratively by mimicking each other throughout the training process, which helps to…

Computation and Language · Computer Science 2021-02-17 Ryo Masumura , Mana Ihori , Akihiko Takashima , Tomohiro Tanaka , Takanori Ashihara

This paper studies quantile regression with an endogenous regressor and measurement error in the dependent variable. Standard quantile regression estimators ignoring these two elements can induce substantial bias. We adopt a…

Econometrics · Economics 2026-05-21 Xuanjing Su

A novel estimation approach for a general class of semi-parametric multivariate time series models is introduced where the conditional mean is modeled through parametric functions. The focus of the estimation is the conditional mean…

Methodology · Statistics 2025-07-21 Mirko Armillotta

This paper investigates double/debiased machine learning (DML) under multiway clustered sampling environments. We propose a novel multiway cross fitting algorithm and a multiway DML estimator based on this algorithm. We also develop a…

Econometrics · Economics 2020-03-05 Harold D. Chiang , Kengo Kato , Yukun Ma , Yuya Sasaki

Double machine learning is a statistical method for leveraging complex black-box models to construct approximately unbiased treatment effect estimates given observational data with high-dimensional covariates, under the assumption of a…

Machine Learning · Statistics 2022-06-03 Nitai Fingerhut , Matteo Sesia , Yaniv Romano

We consider the estimation of the average treatment effect in the treated as a function of baseline covariates, where there is a valid (conditional) instrument. We describe two doubly robust (DR) estimators: a locally efficient g-estimator,…

Methodology · Statistics 2019-06-11 Karla DiazOrdaz , Rhian Daniel , Noemi Kreif

High-dimensional prediction is a challenging problem setting for traditional statistical models. Although regularization improves model performance in high dimensions, it does not sufficiently leverage knowledge on feature importances held…

Machine Learning · Computer Science 2019-12-10 Shouvik Mani , Mehdi Maasoumy , Sina Pakazad , Henrik Ohlsson

Recent works have shown that most deep learning models are often poorly calibrated, i.e., they may produce overconfident predictions that are wrong. It is therefore desirable to have models that produce predictive uncertainty estimates that…

Machine Learning · Computer Science 2020-03-02 Saiteja Utpala , Piyush Rai