English
Related papers

Related papers: Estimating Average Treatment Effects via Orthogona…

200 papers

Dropout, a simple and effective way to train deep neural networks, has led to a number of impressive empirical successes and spawned many recent theoretical investigations. However, the gap between dropout's training and inference phases,…

Machine Learning · Computer Science 2017-02-17 Xuezhe Ma , Yingkai Gao , Zhiting Hu , Yaoliang Yu , Yuntian Deng , Eduard Hovy

Convolution Neural Networks, known as ConvNets exceptionally perform well in many complex machine learning tasks. The architecture of ConvNets demands the huge and rich amount of data and involves with a vast number of parameters that leads…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pushparaja Murugan , Shanmugasundaram Durairaj

Treatment effect heterogeneity is central to policy evaluation, social science, and precision medicine, where interventions can affect individuals differently. In observational studies, covariates, treatment, and outcomes are often only…

Methodology · Statistics 2026-02-24 Shuozhi Zuo , Yixin Wang , Fan Yang

Deep learning systems are known to exhibit implicit regularization (alt. implicit bias), favoring simple solutions instead of merely minimizing the loss function. In some cases, we can analytically derive the implicit regularization --…

Machine Learning · Statistics 2026-05-08 Joseph H. Rudoler , Kevin Tan , Giles Hooker , Konrad P. Kording

Orthogonality regularization has been developed to prevent deep CNNs from training instability and feature redundancy. Among existing proposals, kernel orthogonality regularization enforces orthogonality by minimizing the residual between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Changhao Wu , Shenan Zhang , Fangsong Long , Ziliang Yin , Tuo Leng

We introduce a novel end-to-end approach for learning to cluster in the absence of labeled examples. Our clustering objective is based on optimizing normalized cuts, a criterion which measures both intra-cluster similarity as well as…

Machine Learning · Computer Science 2019-10-18 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

The Average Treatment Effect (ATE) is a global measure of the effectiveness of an experimental treatment intervention. Classical methods of its estimation either ignore relevant covariates or do not fully exploit them. Moreover, past work…

Methodology · Statistics 2013-11-05 Emil Pitkin , Richard Berk , Lawrence Brown , Andreas Buja , Ed George , Kai Zhang , Linda Zhao

Average treatment effect estimation is the most central problem in causal inference with application to numerous disciplines. While many estimation strategies have been proposed in the literature, the statistical optimality of these methods…

Machine Learning · Statistics 2025-06-10 Jikai Jin , Vasilis Syrgkanis

Factorial experiments are ubiquitous in the social and biomedical sciences, but when units fail to comply with each assigned factors, identification and estimation of the average treatment effects become impossible without strong…

Methodology · Statistics 2025-08-06 Matthew Blackwell , Nicole E. Pashley

Treatment effect estimation is essential for informed decision-making in many fields such as healthcare, economics, and public policy. While flexible machine learning models have been widely applied for estimating heterogeneous treatment…

Machine Learning · Computer Science 2025-09-29 Pascal Memmesheimer , Vincent Heuveline , Jürgen Hesser

Suppose we have a binary treatment used to influence an outcome. Given data from an observational or controlled study, we wish to determine whether or not there exists some subset of observed covariates in which the treatment is more…

Methodology · Statistics 2016-03-22 Alexander R. Luedtke , Mark J. van der Laan

Deep neural networks (DNNs) have become increasingly important due to their excellent empirical performance on a wide range of problems. However, regularization is generally achieved by indirect means, largely due to the complex set of…

Machine Learning · Computer Science 2018-07-02 Amal Rannen Triki , Maxim Berman , Matthew B. Blaschko

Uncertainty quantification of causal effects is crucial for safety-critical applications such as personalized medicine. A powerful approach for this is conformal prediction, which has several practical benefits due to model-agnostic…

Machine Learning · Computer Science 2026-02-04 Maresa Schröder , Dennis Frauen , Jonas Schweisthal , Konstantin Heß , Valentyn Melnychuk , Stefan Feuerriegel

The estimand framework provides guidance on handling intercurrent events, such as treatment discontinuation, in the analysis of clinical trial responses. Under ICH E9(R1), the treatment policy (TP) strategy incorporates post-discontinuation…

Methodology · Statistics 2026-04-07 Myeongjong Kang , Sangyoon Yi

In this paper we present a data-adaptive estimation procedure for estimation of average treatment effects in a time-to-event setting based on generalized random forests. In these kinds of settings, the definition of causal effect parameters…

Methodology · Statistics 2021-04-28 Helene C. W. Rytgaard , Claus T. Ekstrøm , Lars V. Kessing , Thomas A. Gerds

Algorithm unfolding or unrolling is the technique of constructing a deep neural network (DNN) from an iterative algorithm. Unrolled DNNs often provide better interpretability and superior empirical performance over standard DNNs in signal…

Machine Learning · Statistics 2024-02-21 Carter Lyons , Raghu G. Raj , Margaret Cheney

Unsupervised and self-supervised learning approaches have become a crucial tool to learn representations for downstream prediction tasks. While these approaches are widely used in practice and achieve impressive empirical gains, their…

Machine Learning · Computer Science 2020-10-23 Siddhant Garg , Yingyu Liang

In this paper, we consider estimation of average treatment effect on the treated (ATT), an interpretable and relevant causal estimand to policy makers when treatment assignment is endogenous. By considering shadow variables that are…

Methodology · Statistics 2026-04-21 Trinetri Ghosh , Jiawei Shan , Menggang Yu , Jiwei Zhao

Reliable estimation of treatment effects from observational data is important in many disciplines such as medicine. However, estimation is challenging when unconfoundedness as a standard assumption in the causal inference literature is…

Machine Learning · Computer Science 2024-10-15 Jonas Schweisthal , Dennis Frauen , Maresa Schröder , Konstantin Hess , Niki Kilbertus , Stefan Feuerriegel

Researchers are frequently interested in understanding the causal effect of treatment interventions. However, in some cases, the treatment of interest--readily available in a randomized controlled trial (RCT)--is either not directly…

Methodology · Statistics 2025-09-29 Lan Wen , Aaron L Sarvet