English
Related papers

Related papers: Targeted Regularization for Causal Effect Estimati…

200 papers

Causal inference is a critical research area with multi-disciplinary origins and applications, ranging from statistics, computer science, economics, psychology to public health. In many scientific research, randomized experiments provide a…

Methodology · Statistics 2022-07-26 Jingying Zeng

Some form of nonperturbative regularization is necessary if effective field theory treatments of the NN interaction are to yield finite answers. We discuss various regularization schemes used in the literature. Two of these methods involve…

Nuclear Theory · Physics 2009-04-17 D. R. Phillips , S. R. Beane , T. D. Cohen

Bootstrapping is behind much of the successes of Deep Reinforcement Learning. However, learning the value function via bootstrapping often leads to unstable training due to fast-changing target values. Target Networks are employed to…

This paper develops methods for uncertainty quantification in causal inference settings with random network interference. We study the large-sample distributional properties of the classical difference-in-means Hajek treatment effect…

Methodology · Statistics 2025-11-11 Matias D. Cattaneo , Yihan He , Ruiqi Rae Yu

In this paper, the solution to the empirical risk minimization problem with $f$-divergence regularization (ERM-$f$DR) is presented and conditions under which the solution also serves as the solution to the minimization of the expected…

Machine Learning · Statistics 2026-01-21 Francisco Daunas , Iñaki Esnaola , Samir M. Perlaza , H. Vincent Poor

In this paper, we introduce a unified estimator to analyze various treatment effects in causal inference, including but not limited to the average treatment effect (ATE) and the quantile treatment effect (QTE). The proposed estimator is…

Methodology · Statistics 2025-03-31 Kuan-Hsun Wu , Li-Pang Chen

We investigate how to exploit structural similarities of an individual's potential outcomes (POs) under different treatments to obtain better estimates of conditional average treatment effects in finite samples. Especially when it is…

Machine Learning · Statistics 2021-10-26 Alicia Curth , Mihaela van der Schaar

The removal of multiplicative Gamma noise is a critical research area in the application of synthetic aperture radar (SAR) imaging, where neural networks serve as a potent tool. However, real-world data often diverges from theoretical…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yi Ran , Zhichang Guo , Jia Li , Yao Li , Martin Burger , Boying Wu

Overfitting is one of the most common problems when training deep neural networks on comparatively small datasets. Here, we demonstrate that neural network activation sparsity is a reliable indicator for overfitting which we utilize to…

Machine Learning · Computer Science 2020-02-24 Karim Huesmann , Soeren Klemm , Lars Linsen , Benjamin Risse

Analyzing data from multiple sources offers valuable opportunities to improve the estimation efficiency of causal estimands. However, this analysis also poses many challenges due to population heterogeneity and data privacy constraints.…

Methodology · Statistics 2025-10-23 Rong Zhao , Jason Falvey , Xu Shi , Vernon M. Chinchilli , Chixiang Chen

Recent advancements in artificial intelligence, particularly deep neural networks, have pushed the boundaries of what is achievable in complex tasks. Traditional methods for training neural networks in classification problems often rely on…

Machine Learning · Computer Science 2024-09-10 Jaouad Dabounou

Parameter-space regularization in neural network optimization is a fundamental tool for improving generalization. However, standard parameter-space regularization methods make it challenging to encode explicit preferences about desired…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Sanyam Kapoor , Shikai Qiu , Andrew Gordon Wilson

We identify the average dose-response function (ADRF) for a continuously valued error-contaminated treatment by a weighted conditional expectation. We then estimate the weights nonparametrically by maximising a local generalised empirical…

Statistics Theory · Mathematics 2022-11-30 Wei Huang , Zheng Zhang

Matching is a widely used causal inference design that aims to approximate a randomized experiment using observational data by forming matched sets of treated and control units based on similarities in their covariates. Ideally, treated…

Methodology · Statistics 2026-04-06 Jianan Zhu , Jeffrey Zhang , Zijian Guo , Siyu Heng

Estimating the conditional average treatment effects (CATE) is very important in causal inference and has a wide range of applications across many fields. In the estimation process of CATE, the unconfoundedness assumption is typically…

Machine Learning · Computer Science 2024-12-16 Pengfei Shi , Wei Zhong , Xinyu Zhang , Ningtao Wang , Xing Fu , Weiqiang Wang , Yin Jin

Deep predictive models of neuronal activity have recently enabled several new discoveries about the selectivity and invariance of neurons in the visual cortex. These models learn a shared set of nonlinear basis functions, which are linearly…

Neurons and Cognition · Quantitative Biology 2024-06-19 Polina Turishcheva , Max Burg , Fabian H. Sinz , Alexander Ecker

A decision maker typically (i) incorporates training data to learn about the relative effectiveness of treatments, and (ii) chooses an implementation mechanism that implies an ``optimal'' predicted outcome distribution according to some…

Econometrics · Economics 2025-05-29 Anders Bredahl Kock , David Preinerstorfer

Feed-forward neural networks can be understood as a combination of an intermediate representation and a linear hypothesis. While most previous works aim to diversify the representations, we explore the complementary direction by performing…

Machine Learning · Computer Science 2019-10-24 Han Zhao , Yao-Hung Hubert Tsai , Ruslan Salakhutdinov , Geoffrey J. Gordon

Inspired by the adaptation phenomenon of neuronal firing, we propose the regularity normalization (RN) as an unsupervised attention mechanism (UAM) which computes the statistical regularity in the implicit space of neural networks under the…

Machine Learning · Computer Science 2021-12-30 Baihan Lin

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $\epsilon$-adversarially…

Machine Learning · Computer Science 2020-11-17 Yuxin Wen , Shuai Li , Kui Jia