English
Related papers

Related papers: Transfer Learning of CATE with Kernel Ridge Regres…

200 papers

Kernel ridge regression (KRR) is a foundational tool in machine learning, with recent work emphasizing its connections to neural networks. However, existing theory primarily addresses the i.i.d. setting, while real-world data often exhibits…

Machine Learning · Statistics 2025-10-20 Dechen Zhang , Zhenmei Shi , Yi Zhang , Yingyu Liang , Difan Zou

Under covariate shift, training (source) data and testing (target) data differ in input space distribution, but share the same conditional label distribution. This poses a challenging machine learning task. Robust Bias-Aware (RBA)…

Machine Learning · Computer Science 2018-01-01 Anqi Liu , Rizal Fathony , Brian D. Ziebart

We propose a new causal inference framework to learn causal effects from multiple, decentralized data sources in a federated setting. We introduce an adaptive transfer algorithm that learns the similarities among the data sources by…

Machine Learning · Computer Science 2023-01-03 Thanh Vinh Vo , Arnab Bhattacharyya , Young Lee , Tze-Yun Leong

Reliable estimation of treatment effects from observational data is important in many disciplines such as medicine. However, estimation is challenging when unconfoundedness as a standard assumption in the causal inference literature is…

Machine Learning · Computer Science 2024-10-15 Jonas Schweisthal , Dennis Frauen , Maresa Schröder , Konstantin Hess , Niki Kilbertus , Stefan Feuerriegel

Transfer learning is a valuable tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet,…

Machine Learning · Computer Science 2023-06-13 Daniel Jakubovitz , David Uliel , Miguel Rodrigues , Raja Giryes

We study linear regression under covariate shift, where the marginal distribution over the input covariates differs in the source and the target domains, while the conditional distribution of the output given the input covariates is similar…

Machine Learning · Computer Science 2022-08-04 Jingfeng Wu , Difan Zou , Vladimir Braverman , Quanquan Gu , Sham M. Kakade

In the absence of unobserved confounders, matching and weighting methods are widely used to estimate causal quantities including the Average Treatment Effect on the Treated (ATT). Unfortunately, these methods do not necessarily achieve…

Methodology · Statistics 2016-05-03 Chad Hazlett

Randomized controlled trials (RCTs) often exhibit limited inferential efficiency in estimating treatment effects due to small sample sizes. In recent years, the combination of external controls has gained increasing attention as a means of…

Methodology · Statistics 2025-10-06 Qinwei Yang , Jingyi Li , Peng Wu

In modern machine learning applications, frequent encounters of covariate shift and label scarcity have posed challenges to robust model training and evaluation. Numerous transfer learning methods have been developed to robustly adapt the…

Methodology · Statistics 2022-11-22 Linshanshan Wang , Xuan Wang , Katherine P. Liao , Tianxi Cai

This paper introduces kernel continual learning, a simple but effective variant of continual learning that leverages the non-parametric nature of kernel methods to tackle catastrophic forgetting. We deploy an episodic memory unit that…

Machine Learning · Computer Science 2021-07-16 Mohammad Mahdi Derakhshani , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

This study proposes an end-to-end algorithm for policy learning in causal inference. We observe data consisting of covariates, treatment assignments, and outcomes, where only the outcome corresponding to the assigned treatment is observed.…

Econometrics · Economics 2025-12-30 Masahiro Kato

Randomized controlled trials are the standard method for estimating causal effects, ensuring sufficient statistical power and confidence through adequate sample sizes. However, achieving such sample sizes is often challenging. This study…

Methodology · Statistics 2025-03-28 Keisuke Hanada , Masahiro Kojima

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

Deep learning models deployed in real-world applications (e.g., medicine) face challenges because source models do not generalize well to domain-shifted target data. Many successful domain adaptation (DA) approaches require full access to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Mainak Biswas , Ambedkar Dukkipati , Devarajan Sridharan

Conditional Average Treatment Effects (CATE) estimation is one of the main challenges in causal inference with observational data. In addition to Machine Learning based-models, nonparametric estimators called meta-learners have been…

Machine Learning · Statistics 2023-06-06 Naoufal Acharki , Ramiro Lugo , Antoine Bertoncello , Josselin Garnier

In many social, behavioral, and biomedical sciences, treatment effect estimation is a crucial step in understanding the impact of an intervention, policy, or treatment. In recent years, an increasing emphasis has been placed on…

Methodology · Statistics 2024-10-10 Xinhai Zhang , Xingye Qiao

Randomized controlled trials (RCTs) are the gold standard for estimating heterogeneous treatment effects, yet they are often underpowered for detecting effect heterogeneity. Large observational studies (OS) can supplement RCTs for…

Machine Learning · Computer Science 2026-04-07 Amir Asiaee , Samhita Pal

We regularly consider answering counterfactual questions in practice, such as "Would people with diabetes take a turn for the better had they choose another medication?". Observational studies are growing in significance in answering such…

Machine Learning · Computer Science 2022-08-16 Guanglin Zhou , Lina Yao , Xiwei Xu , Chen Wang , Liming Zhu

There are numerous advantages of deep neural network surrogate modeling for response time-history prediction. However, due to the high cost of refined numerical simulations and actual experiments, the lack of data has become an unavoidable…

Machine Learning · Computer Science 2023-06-16 Yongjia Xu , Xinzheng Lu , Yifan Fei , Yuli Huang

Transfer learning is a very important tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet,…

Machine Learning · Computer Science 2020-01-24 Daniel Jakubovitz , Miguel R. D. Rodrigues , Raja Giryes