English
Related papers

Related papers: Doubly Robust Proxy Causal Learning with Neural Me…

200 papers

Reduced-order models, also known as proxy model or surrogate model, are approximate models that are less computational expensive as opposed to fully descriptive models. With the integration of machine learning, these models have garnered…

Machine Learning · Computer Science 2024-10-15 Jungang Chen , Eduardo Gildin , John Killough

Proxy variables are commonly used in causal inference when unmeasured confounding exists. While most existing proximal methods assume a unidirectional causal relationship between two primary variables, many social and biological systems…

Methodology · Statistics 2025-07-21 Jiaqi Min , Xueyue Zhang , Shanshan Luo

Recommender systems often suffer from selection bias as users tend to rate their preferred items. The datasets collected under such conditions exhibit entries missing not at random and thus are not randomized-controlled trials representing…

Information Retrieval · Computer Science 2024-03-05 Wonbin Kweon , Hwanjo Yu

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

This review systematizes the emerging literature for causal inference using deep neural networks under the potential outcomes framework. It provides an intuitive introduction on how deep learning can be used to estimate/predict…

Machine Learning · Computer Science 2023-11-30 Bernard Koch , Tim Sainburg , Pablo Geraldo , Song Jiang , Yizhou Sun , Jacob Gates Foster

Representation learning, i.e. the generation of representations useful for downstream applications, is a task of fundamental importance that underlies much of the success of deep neural networks (DNNs). Recently, robustness to adversarial…

Machine Learning · Computer Science 2022-09-16 Christian Cianfarani , Arjun Nitin Bhagoji , Vikash Sehwag , Ben Y. Zhao , Prateek Mittal , Haitao Zheng

The goal of few-shot learning is to generalize and achieve high performance on new unseen learning tasks, where each task has only a limited number of examples available. Gradient-based meta-learning attempts to address this challenging…

Machine Learning · Computer Science 2024-06-13 Christian Raymond , Qi Chen , Bing Xue , Mengjie Zhang

Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn new tasks and overcome forgetting the knowledge obtained from the…

Machine Learning · Computer Science 2022-02-08 Yujiang He

Popular debiased estimation methods for causal inference -- such as augmented inverse propensity weighting and targeted maximum likelihood estimation -- enjoy desirable asymptotic properties like statistical efficiency and double robustness…

Machine Learning · Statistics 2025-09-16 Tiffany Tianhui Cai , Yuri Fonseca , Kaiwen Hou , Hongseok Namkoong

The research described herewith is to re-visit the classical doubly robust estimation of average treatment effect by conducting a systematic study on the comparisons, in the sense of asymptotic efficiency, among all possible combinations of…

Statistics Theory · Mathematics 2020-06-01 Keli Guo , Chuyun Ye , Jun Fan , Lixing Zhu

Hybrid modeling integrates machine learning with scientific knowledge to enhance interpretability, generalization, and adherence to natural laws. Nevertheless, equifinality and regularization biases pose challenges in hybrid modeling to…

Machine Learning · Computer Science 2024-04-05 Kai-Hendrik Cohrs , Gherardo Varando , Nuno Carvalhais , Markus Reichstein , Gustau Camps-Valls

The mainstream researche in deep metric learning can be divided into two genres: proxy-based and pair-based methods. Proxy-based methods have attracted extensive attention due to the lower training complexity and fast network convergence.…

Information Retrieval · Computer Science 2023-04-19 Xinyue Li , Jian Wang , Wei Song , Yanling Du , Zhixiang Liu

Many physical AI tasks are governed by implicit equilibrium: an agent actuates a subset of degrees of freedom (boundary DoFs), while the remaining free DoFs settle by minimizing a total potential energy. Even seemingly basic tasks such as…

Robotics · Computer Science 2026-05-06 Dezhong Tong , Jiawen Wang , Hengyi Zhou , Yinglong Shen , Xiaonan Huang , M. Khalid Jawed

This paper provides clear and practical guidance on the specification of imputation models when multiple imputation is used in conjunction with doubly robust estimation methods for causal inference. Through theoretical arguments and…

Methodology · Statistics 2025-12-19 Lucy D'Agostino McGowan

We study optimal covariate balance for causal inferences from observational data when rich covariates and complex relationships necessitate flexible modeling with neural networks. Standard approaches such as propensity weighting and…

Machine Learning · Statistics 2018-02-16 Nathan Kallus

We propose a doubly robust estimator for the average treatment effect in high dimensional low sample size observational studies, where contamination and model misspecification pose serious inferential challenges. The estimator combines…

Methodology · Statistics 2025-11-04 Byeonghee Lee , Sangwook Kang , Ju-Hyun Park , Saebom Jeon , Joonsung Kang

Inferring the heterogeneous treatment effect is a fundamental problem in the sciences and commercial applications. In this paper, we focus on estimating Conditional Average Treatment Effect (CATE), that is, the difference in the conditional…

Methodology · Statistics 2021-03-23 Haomiao Meng , Xingye Qiao

Predictive coding has emerged as an influential normative model of neural computation, with numerous extensions and applications. As such, much effort has been put into mapping PC faithfully onto the cortex, but there are issues that remain…

Neurons and Cognition · Quantitative Biology 2023-03-07 Siavash Golkar , Tiberiu Tesileanu , Yanis Bahroun , Anirvan M. Sengupta , Dmitri B. Chklovskii

Although the optimization objectives for learning neural networks are highly non-convex, gradient-based methods have been wildly successful at learning neural networks in practice. This juxtaposition has led to a number of recent studies on…

Machine Learning · Computer Science 2022-09-14 Spencer Frei , Quanquan Gu

A common issue in learning decision-making policies in data-rich settings is spurious correlations in the offline dataset, which can be caused by hidden confounders. Instrumental variable (IV) regression, which utilises a key unconfounded…

Machine Learning · Computer Science 2025-06-25 Daqian Shao , Ashkan Soleymani , Francesco Quinzan , Marta Kwiatkowska