English
Related papers

Related papers: An Introduction to Double/Debiased Machine Learnin…

200 papers

Deep Metric Learning (DML) is arguably one of the most influential lines of research for learning visual similarities with many proposed approaches every year. Although the field benefits from the rapid progress, the divergence in training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Karsten Roth , Timo Milbich , Samarth Sinha , Prateek Gupta , Björn Ommer , Joseph Paul Cohen

Bias is a common problem inherent in recommender systems, which is entangled with users' preferences and poses a great challenge to unbiased learning. For debiasing tasks, the doubly robust (DR) method and its variants show superior…

Information Retrieval · Computer Science 2023-03-03 Haoxuan Li , Yan Lyu , Chunyuan Zheng , Peng Wu

Traditional multimodal methods often assume static modality quality, which limits their adaptability in dynamic real-world scenarios. Thus, dynamical multimodal methods are proposed to assess modality quality and adjust their contribution…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Shicai Wei , Kaijie Zhang , Luyi Chen , Tao He , Guiduo Duan

In multi-task learning, labels are often missing irregularly across samples, which can be fully labeled, partially labeled or unlabeled. The irregular label presence often appears in scientific studies due to experimental limitations. It…

Machine Learning · Computer Science 2025-08-07 Mingqian Li , Qiao Han , Ruifeng Li , Yao Yang , Hongyang Chen

In this work, we study distance metric learning (DML) for high dimensional data. A typical approach for DML with high dimensional data is to perform the dimensionality reduction first before learning the distance metric. The main…

Machine Learning · Computer Science 2015-09-16 Qi Qian , Rong Jin , Lijun Zhang , Shenghuo Zhu

In this article we study a class of parameters with the so-called `mixed bias property'. For parameters with this property, the bias of the semiparametric efficient one step estimator is equal to the mean of the product of the estimation…

Statistics Theory · Mathematics 2019-05-07 Andrea Rotnitzky , Ezequiel Smucler , James M. Robins

We propose plug-in (PI) and double machine learning (DML) estimators of average treatment effect (ATE), average treatment effect on the treated (ATET) and local average treatment effect (LATE) in the multivariate sample selection model with…

Econometrics · Economics 2025-11-18 Sofiia Dolgikh , Bodan Potanin

Decision-Focused Learning (DFL) is an emerging learning paradigm that tackles the task of training a machine learning (ML) model to predict missing parameters of an incomplete optimization problem, where the missing parameters are…

Machine Learning · Computer Science 2025-06-23 Yehya Farhat

We investigate unsupervised anomaly detection for high-dimensional data and introduce a deep metric learning (DML) based framework. In particular, we learn a distance metric through a deep neural network. Through this metric, we project the…

Machine Learning · Computer Science 2020-05-13 Selim F. Yilmaz , Suleyman S. Kozat

Conventional machine learning (ML) relies heavily on manual design from machine learning experts to decide learning tasks, data, models, optimization algorithms, and evaluation metrics, which is labor-intensive, time-consuming, and cannot…

Machine Learning · Computer Science 2022-01-11 Wenwu Zhu , Xin Wang , Pengtao Xie

Supervised machine learning models often associate irrelevant nuisance factors with the prediction target, which hurts generalization. We propose a framework for training robust neural networks that induces invariance to nuisances through…

Machine Learning · Computer Science 2019-12-03 Ayush Jaiswal , Rob Brekelmans , Daniel Moyer , Greg Ver Steeg , Wael AbdAlmageed , Premkumar Natarajan

Double descent is a surprising phenomenon in machine learning, in which as the number of model parameters grows relative to the number of data, test error drops as models grow ever larger into the highly overparameterized (data…

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

We introduce the package ddml for Double/Debiased Machine Learning (DDML) in Stata. Estimators of causal parameters for five different econometric models are supported, allowing for flexible estimation of causal effects of endogenous…

Econometrics · Economics 2024-01-09 Achim Ahrens , Christian B. Hansen , Mark E. Schaffer , Thomas Wiemann

Machine learning methods, particularly the double machine learning (DML) estimator (Chernozhukov et al., 2018), are increasingly popular for the estimation of the average treatment effect (ATE). However, datasets often exhibit unbalanced…

Econometrics · Economics 2024-06-12 Daniele Ballinari

In this paper, we introduce and prove asymptotic normality for a new nonparametric estimator of continuous treatment effects. Specifically, we estimate the average dose-response function - the expected value of an outcome of interest at a…

Econometrics · Economics 2021-04-22 Sylvia Klosin

Recent works demonstrated the existence of a double-descent phenomenon for the generalization error of neural networks, where highly overparameterized models escape overfitting and achieve good test performance, at odds with the standard…

Machine Learning · Computer Science 2024-04-02 Elizaveta Demyanenko , Christoph Feinauer , Enrico M. Malatesta , Luca Saglietti

In recent years, machine learning (ML) has been proposed to devise data-driven parametrisations of unresolved processes in dynamical numerical models. In most cases, the ML training leverages high-resolution simulations to provide a dense,…

Computational Physics · Physics 2020-12-09 Julien Brajard , Alberto Carrassi , Marc Bocquet , Laurent Bertino

Estimating causal treatment effects in observational settings is frequently compromised by selection bias arising from unobserved confounders. While traditional econometric methods struggle when these confounders are orthogonal to…

Artificial Intelligence · Computer Science 2026-01-06 Ahmed Dawoud , Osama El-Shamy

Causal Impact (CI) of customer actions are broadly used across the industry to inform both short- and long-term investment decisions of various types. In this paper, we apply the double machine learning (DML) methodology to estimate the CI…

Machine Learning · Computer Science 2024-09-05 Sushant More , Priya Kotwal , Sujith Chappidi , Dinesh Mandalapu , Chris Khawand