English
Related papers

Related papers: Targeted Regularization for Causal Effect Estimati…

200 papers

Sequential Bayesian inference over predictive functions is a natural framework for continual learning from streams of data. However, applying it to neural networks has proved challenging in practice. Addressing the drawbacks of existing…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Freddie Bickford Smith , Qixuan Feng , Yee Whye Teh , Yarin Gal

Randomized experiments are widely used to estimate the causal effects of a proposed treatment in many areas of science, from medicine and healthcare to the physical and biological sciences, from the social sciences to engineering, to public…

Methodology · Statistics 2022-11-30 Christina Lee Yu , Edoardo M Airoldi , Christian Borgs , Jennifer T Chayes

Adversarial robustness has become an important research topic given empirical demonstrations on the lack of robustness of deep neural networks. Unfortunately, recent theoretical results suggest that adversarial training induces a strict…

Machine Learning · Computer Science 2020-03-25 Matt Olfat , Anil Aswani

The rapid growth in complexity and size of modern deep neural networks (DNNs) has increased challenges related to computational costs and memory usage, spurring a growing interest in efficient model compression techniques. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Sarthak Ketanbhai Modi , Zi Pong Lim , Shourya Kuchhal , Yushi Cao , Yupeng Cheng , Yon Shin Teo , Shang-Wei Lin , Zhiming Li

Unraveling the reasons behind the remarkable success and exceptional generalization capabilities of deep neural networks presents a formidable challenge. Recent insights from random matrix theory, specifically those concerning the spectral…

Machine Learning · Statistics 2023-04-10 Xuanzhe Xiao , Zeng Li , Chuanlong Xie , Fengwei Zhou

The purpose of this work is to improve the efficiency in estimating the average causal effect (ACE) on the survival scale where right-censoring exists and high-dimensional covariate information is available. We propose new estimators using…

Methodology · Statistics 2021-06-29 Ran Dai , Cheng Zheng , Mei-Jie Zhang

Modern deep neural network (DNN) trainings utilize various training techniques, e.g., nonlinear activation functions, batch normalization, skip-connections, etc. Despite their effectiveness, it is still mysterious how they help accelerate…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Junjie Yang , Yi Zhou

Despite apparent human-level performances of deep neural networks (DNN), they behave fundamentally differently from humans. They easily change predictions when small corruptions such as blur and noise are applied on the input (lack of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Sanghyuk Chun , Seong Joon Oh , Sangdoo Yun , Dongyoon Han , Junsuk Choe , Youngjoon Yoo

Causal reasoning is often challenging with spatial data, particularly when handling high-dimensional inputs. To address this, we propose a neural network (NN) based framework integrated with an approximate Gaussian process to manage spatial…

Machine Learning · Computer Science 2024-12-06 Ziyang Jiang , Zach Calhoun , Yiling Liu , Lei Duan , David Carlson

Causal effect estimation is important for many tasks in the natural and social sciences. We design algorithms for the continuous partial identification problem: bounding the effects of multivariate, continuous treatments when unmeasured…

Machine Learning · Statistics 2023-05-18 Kirtan Padh , Jakob Zeitler , David Watson , Matt Kusner , Ricardo Silva , Niki Kilbertus

In contrast to problems of interference in (exogenous) treatments, models of interference in unit-specific (endogenous) outcomes do not usually produce a reduced-form representation where outcomes depend on other units' treatment status…

Econometrics · Economics 2025-06-17 Konrad Menzel

Individual treatment effects are not point-identified from data. The Probability of Necessity and Sufficiency (PNS) circumvents this limitation by characterizing individual-level causality through intersection bounds derived from combined…

Machine Learning · Statistics 2026-05-11 Gandharv Patil , Keyi Tang , Raquel Aoki , Leo Guelman

We propose a novel approach for inferring the individualized causal effects of a treatment (intervention) from observational data. Our approach conceptualizes causal inference as a multitask learning problem; we model a subject's potential…

Machine Learning · Computer Science 2017-06-20 Ahmed M. Alaa , Michael Weisz , Mihaela van der Schaar

Federated or multi-site studies have distinct advantages over single-site studies, including increased generalizability, the ability to study underrepresented populations, and the opportunity to study rare exposures and outcomes. However,…

Machine Learning · Statistics 2023-09-25 Larry Han , Zhu Shen , Jose Zubizarreta

Randomized Controlled Trials are one of the pillars of science; nevertheless, they rely on hand-crafted hypotheses and expensive analysis. Such constraints prevent causal effect estimation at scale, potentially anchoring on popular yet…

Machine Learning · Computer Science 2026-01-07 Tommaso Mencattini , Riccardo Cadei , Francesco Locatello

Causal inference requires evaluating models on balanced distributions between treatment and control groups, while training data often exhibits imbalance due to historical decision-making policies. Most conventional statistical methods…

Machine Learning · Statistics 2025-11-21 Akira Tanimoto

Individual treatment effect (ITE) estimation requires adjusting for the covariate shift between populations with different treatments, and deep representation learning has shown great promise in learning a balanced representation of…

Machine Learning · Computer Science 2023-12-19 Amirreza Kazemi , Martin Ester

Regularizing neural networks is important for anticipating model behavior in regions of the data space that are not well represented. In this work, we propose a regularization technique for enforcing a level of smoothness in the mapping…

Machine Learning · Computer Science 2025-03-05 Ali Hasan , Haoming Yang , Yuting Ng , Vahid Tarokh

In this work we approach attractor neural networks from a machine learning perspective: we look for optimal network parameters by applying a gradient descent over a regularized loss function. Within this framework, the optimal…

Machine Learning · Computer Science 2024-02-21 Elena Agliari , Francesco Alemanno , Miriam Aquaro , Alberto Fachechi

We present a general framework for Bayesian inference of causal effects that delivers provably robust inferences founded on design-based randomization of treatments. The framework involves fixing the observed potential outcomes and forming…

Methodology · Statistics 2025-11-04 Easton Huch , Fred Feinberg , Walter Dempsey