English
Related papers

Related papers: Transfer Learning for Causal Effect Estimation

200 papers

We propose a novel framework that unifies and extends existing methods of transfer learning (TL) for regression. To bridge a pretrained source model to the model on a target task, we introduce a density-ratio reweighting function, which is…

Machine Learning · Statistics 2020-12-18 Shunya Minami , Song Liu , Stephen Wu , Kenji Fukumizu , Ryo Yoshida

Decision-making tasks often unfold on graphs with spatial-temporal dynamics. Black-box reinforcement learning often overlooks how local changes spread through network structure, limiting sample efficiency and interpretability. We present…

Artificial Intelligence · Computer Science 2026-01-07 Hadi Partovi Aria , Zhe Xu

Many methods have been proposed to estimate treatment effects with observational data. Often, the choice of the method considers the application's characteristics, such as type of treatment and outcome, confounding effect, and the…

Machine Learning · Computer Science 2022-05-20 Raquel Aoki , Martin Ester

Causal machine learning (CML) has experienced increasing popularity in healthcare. Beyond the inherent capabilities of adding domain knowledge into learning systems, CML provides a complete toolset for investigating how a system would react…

Machine Learning · Computer Science 2022-06-01 Pedro Sanchez , Jeremy P. Voisey , Tian Xia , Hannah I. Watson , Alison Q. ONeil , Sotirios A. Tsaftaris

Many practical decision-making problems in economics and healthcare seek to estimate the average treatment effect (ATE) from observational data. The Double/Debiased Machine Learning (DML) is one of the prevalent methods to estimate ATE in…

Econometrics · Economics 2022-12-07 Yiyan Huang , Cheuk Hang Leung , Xing Yan , Qi Wu , Shumin Ma , Zhiri Yuan , Dongdong Wang , Zhixiang Huang

Modern NLP applications have enjoyed a great boost utilizing neural networks models. Such deep neural models, however, are not applicable to most human languages due to the lack of annotated training data for various NLP tasks.…

Computation and Language · Computer Science 2019-06-06 Xilun Chen , Ahmed Hassan Awadallah , Hany Hassan , Wei Wang , Claire Cardie

We study transfer learning for estimating piecewise-constant signals when source data, which may be relevant but disparate, are available in addition to the target data. We first investigate transfer learning estimators that respectively…

Methodology · Statistics 2024-07-30 Fan Wang , Yi Yu

Principal component analysis (PCA) can be significantly limited when there is too few examples of the target data of interest. We propose a transfer learning approach to PCA (TL-PCA) where knowledge from a related source task is used in…

Machine Learning · Computer Science 2024-10-15 Sharon Hendy , Yehuda Dar

Treatment effect estimation, which refers to the estimation of causal effects and aims to measure the strength of the causal relationship, is of great importance in many fields but is a challenging problem in practice. As present,…

Machine Learning · Computer Science 2021-07-20 Zhenyu Guo , Shuai Zheng , Zhizhe Liu , Kun Yan , Zhenfeng Zhu

Causal representation learning (CRL) enhances machine learning models' robustness and generalizability by learning structural causal models associated with data-generating processes. We focus on a family of CRL methods that uses contrastive…

Machine Learning · Statistics 2025-03-17 Xiusi Li , Sékou-Oumar Kaba , Siamak Ravanbakhsh

This paper focuses on an important type of black-box attacks, i.e., transfer-based adversarial attacks, where the adversary generates adversarial examples by a substitute (source) model and utilize them to attack an unseen target model,…

Machine Learning · Computer Science 2023-07-04 Ruijie Yang , Yuanfang Guo , Junfu Wang , Jiantao Zhou , Yunhong Wang

Causal representation learning (CRL) aims at recovering latent causal variables from high-dimensional observations to solve causal downstream tasks, such as predicting the effect of new interventions or more robust classification. A…

Machine Learning · Computer Science 2025-03-06 Dingling Yao , Dario Rancati , Riccardo Cadei , Marco Fumero , Francesco Locatello

Causal inference is the process of estimating the effect or impact of a treatment on an outcome with other covariates as potential confounders (and mediators) that may need to be controlled. The vast majority of existing methods and systems…

Computation and Language · Computer Science 2022-05-05 Arun S. Maiya

Data scarcity is a tremendous challenge in causal effect estimation. In this paper, we propose to exploit additional data sources to facilitate estimating causal effects in the target population. Specifically, we leverage additional source…

Machine Learning · Computer Science 2021-06-01 Thanh Vinh Vo , Pengfei Wei , Trong Nghia Hoang , Tze-Yun Leong

Generalizing causal knowledge across diverse environments is challenging, especially when estimates from large-scale datasets must be applied to smaller or systematically different contexts, where external validity is critical. Model-based…

Machine Learning · Statistics 2025-12-19 Seyda Betul Aydin , Holger Brandt

Statistical machine learning algorithms have achieved state-of-the-art results on benchmark datasets, outperforming humans in many tasks. However, the out-of-distribution data and confounder, which have an unpredictable causal relationship,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Changjie Lu

Randomized trials and observational studies, more often than not, run over a certain period of time. The treatment effect evolves during this period which provides crucial insights into the treatment response and the long-term effects. Many…

Methodology · Statistics 2020-04-13 Shu Li , Peter Bühlmann

Multi-Task Learning (MTL) is a powerful learning paradigm to improve generalization performance via knowledge sharing. However, existing studies find that MTL could sometimes hurt generalization, especially when two tasks are less…

Machine Learning · Computer Science 2022-11-28 Ziniu Hu , Zhe Zhao , Xinyang Yi , Tiansheng Yao , Lichan Hong , Yizhou Sun , Ed H. Chi

Causal inference, estimating causal effects from observational data, is a fundamental tool in many disciplines. Of particular importance across a variety of domains is the continuous treatment setting, where the variable of intervention has…

Machine Learning · Computer Science 2026-05-15 Christopher Stith , Medha Barath , Vahid Balazadeh , Jesse C. Cresswell , Rahul G. Krishnan

In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we…

Machine Learning · Statistics 2022-04-19 Ye Tian , Yang Feng