English
Related papers

Related papers: Perturbed Double Machine Learning: Nonstandard Inf…

200 papers

Recent advances in causal inference have seen the development of methods which make use of the predictive power of machine learning algorithms. In this paper, we develop novel double machine learning (DML) procedures for panel data in which…

Econometrics · Economics 2025-01-03 Paul S. Clarke , Annalivia Polselli

There is substantial interest in the use of machine learning (ML)-based techniques throughout the electronic computer-aided design (CAD) flow, particularly methods based on deep learning. However, while deep learning methods have achieved…

Machine Learning · Computer Science 2024-03-04 Chester Holtz , Yucheng Wang , Chung-Kuan Cheng , Bill Lin

Machine learning methods, particularly the double machine learning (DML) estimator (Chernozhukov et al., 2018), are increasingly popular for the estimation of the average treatment effect (ATE). However, datasets often exhibit unbalanced…

Econometrics · Economics 2024-06-12 Daniele Ballinari

Double Machine Learning is often justified by nuisance-rate conditions, yet finite-sample reliability also depends on the conditioning of the orthogonal-score Jacobian. This conditioning is typically assumed rather than tracked. When…

Methodology · Statistics 2026-01-08 Gabriel Saco

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

We develop a unified framework for automatic debiased machine learning (autoDML) for inference on a broad class of statistical parameters. The framework applies to any smooth functional of a nonparametric M-estimand, defined as the…

Methodology · Statistics 2026-03-23 Lars van der Laan , Aurelien Bibaut , Nathan Kallus , Alex Luedtke

Modern Natural Language Processing (NLP) models are known to be sensitive to input perturbations and their performance can decrease when applied to real-world, noisy data. However, it is still unclear why models are less robust to some…

Computation and Language · Computer Science 2022-03-21 Yunxiang Zhang , Liangming Pan , Samson Tan , Min-Yen Kan

This paper deals with the parametric inference for integrated signals embedded in an additive Gaussian noise and observed at deterministic discrete instants which are not necessarily equidistant. The unknown parameter is multidimensional…

Statistics Theory · Mathematics 2019-03-18 Dominique Dehay , Khalil El Waled , Vincent Monsan

Estimation and inference of treatment effects under unconfounded treatment assignments often suffer from bias and the `curse of dimensionality' due to the nonparametric estimation of nuisance parameters for high-dimensional confounders.…

Methodology · Statistics 2025-07-08 Zeqi Wu , Meilin Wang , Wei Huang , Zheng Zhang

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Deep neural networks have achieved tremendous success due to their representation power and adaptation to low-dimensional structures. Their potential for estimating structured regression functions has been recently established in the…

Statistics Theory · Mathematics 2023-02-14 Sohom Bhattacharya , Jianqing Fan , Debarghya Mukherjee

We consider the problem of constructing bounds on the average treatment effect (ATE) when unmeasured confounders exist but have bounded influence. Specifically, we assume that omitted confounders could not change the odds of treatment for…

Methodology · Statistics 2022-07-25 Jacob Dorn , Kevin Guo , Nathan Kallus

One way to quantify exposure to air pollution and its constituents in epidemiologic studies is to use an individual's nearest monitor. This strategy results in potential inaccuracy in the actual personal exposure, introducing bias in…

Errors in measurements are key to weighting the value of data, but are often neglected in Machine Learning (ML). We show how Convolutional Neural Networks (CNNs) are able to learn about the context and patterns of signal and noise, leading…

Machine Learning · Computer Science 2021-08-11 Natália V. N. Rodrigues , L. Raul Abramo , Nina S. Hirata

In this paper, we propose a triple (or double-debiased) Lasso estimator for inference on a low-dimensional parameter in high-dimensional linear regression models. The estimator is based on a moment function that satisfies not only first-…

Econometrics · Economics 2026-03-23 Denis Chetverikov , Jesper R. -V. Sørensen , Aleh Tsyvinski

Debiased machine learning estimators for smooth functionals in nonparametric models can exhibit substantial variability and instability, often leading practitioners to instead rely on parametric or semiparametric working models. Such…

Methodology · Statistics 2026-03-20 Lars van der Laan , Marco Carone , Alex Luedtke , Mark van der Laan

Deep neural networks (DNNs) have achieved remarkable empirical success, yet their training dynamics remain understood mainly from optimization rather than statistical principles. Here we develop a statistical framework for DNN training in…

Machine Learning · Statistics 2026-05-28 Minhao Yao , Ruoyu Wang , Xihong Lin , Lin Liu , Zhonghua Liu

This paper proposes an introspective deep metric learning (IDML) framework for uncertainty-aware comparisons of images. Conventional deep metric learning methods focus on learning a discriminative embedding to describe the semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Chengkun Wang , Wenzhao Zheng , Zheng Zhu , Jie Zhou , Jiwen Lu

We study statistical inference for small-noise-perturbed multiscale dynamical systems. We prove consistency, asymptotic normality, and convergence of all scaled moments of an appropriately-constructed maximum likelihood estimator (MLE) for…

Probability · Mathematics 2016-06-16 Siragan Gailus , Konstantinos Spiliopoulos

We study the properties of the score confidence set for the local average treatment effect in non and semiparametric instrumental variable models. This confidence set is constructed by inverting a score test based on an estimate of the…

Statistics Theory · Mathematics 2025-06-13 Ezequiel Smucler , Ludovico Lanni , David Masip