English
Related papers

Related papers: Transfer Learning of CATE with Kernel Ridge Regres…

200 papers

We study a fundamental transfer learning process from source to target linear regression tasks, including overparameterized settings where there are more learned parameters than data samples. The target task learning is addressed by using…

Machine Learning · Computer Science 2024-06-03 Yehuda Dar , Daniel LeJeune , Richard G. Baraniuk

The large amount of online data and vast array of computing resources enable current researchers in both industry and academia to employ the power of deep learning with neural networks. While deep models trained with massive amounts of data…

Machine Learning · Computer Science 2020-06-15 Shuai Tang , Virginia R. de Sa

For treatment effects - one of the core issues in modern econometric analysis - prediction and estimation are two sides of the same coin. As it turns out, machine learning methods are the tool for generalized prediction models. Combined…

Econometrics · Economics 2021-04-27 Daniel Jacob

Decision-making across various fields, such as medicine, heavily relies on conditional average treatment effects (CATEs). Practitioners commonly make decisions by checking whether the estimated CATE is positive, even though the…

Machine Learning · Computer Science 2025-05-23 Dennis Frauen , Valentyn Melnychuk , Jonas Schweisthal , Mihaela van der Schaar , Stefan Feuerriegel

The ability of a human being to extrapolate previously gained knowledge to other domains inspired a new family of methods in machine learning called transfer learning. Transfer learning is often based on the assumption that objects in both…

Machine Learning · Statistics 2016-10-21 Ievgen Redko , Younès Bennani

This article proposes a meta-learning method for estimating the conditional average treatment effect (CATE) from a few observational data. The proposed method learns how to estimate CATEs from multiple tasks and uses the knowledge for…

Machine Learning · Statistics 2023-05-22 Tomoharu Iwata , Yoichi Chikahara

Robust estimation of heterogeneous treatment effects is a fundamental challenge for optimal decision-making in domains ranging from personalized medicine to educational policy. In recent years, predictive machine learning has emerged as a…

Machine Learning · Statistics 2025-06-23 Maximilian Schuessler , Erik Sverdrup , Robert Tibshirani

Machine learning models used in medical applications often face challenges due to the covariate shift, which occurs when there are discrepancies between the distributions of training and target data. This can lead to decreased predictive…

Machine Learning · Computer Science 2024-12-24 Mingyang Cai , Thomas Klausch , Mark A. van de Wiel

Within the field of causal inference, we consider the problem of estimating heterogeneous treatment effects from data. We propose and validate a novel approach for learning feature representations to aid the estimation of the conditional…

Machine Learning · Statistics 2022-06-23 Michael C. Burkhart , Gabriel Ruiz

Inferring the heterogeneous treatment effect is a fundamental problem in the sciences and commercial applications. In this paper, we focus on estimating Conditional Average Treatment Effect (CATE), that is, the difference in the conditional…

Methodology · Statistics 2021-03-23 Haomiao Meng , Xingye Qiao

We study the risk (i.e. generalization error) of Kernel Ridge Regression (KRR) for a kernel $K$ with ridge $\lambda>0$ and i.i.d. observations. For this, we introduce two objects: the Signal Capture Threshold (SCT) and the Kernel Alignment…

Machine Learning · Statistics 2020-06-18 Arthur Jacot , Berfin Şimşek , Francesco Spadaro , Clément Hongler , Franck Gabriel

Randomized trials are typically designed to detect average treatment effects but often lack the statistical power to uncover individual-level treatment effect heterogeneity, limiting their value for personalized decision-making. To address…

Machine Learning · Statistics 2026-03-19 Rickard Karlsson , Piersilvio De Bartolomeis , Issa J. Dahabreh , Jesse H. Krijthe

Kernel matching is a widely used technique for estimating treatment effects, particularly valuable in observational studies where randomized controlled trials are not feasible. While kernel-matching approaches have demonstrated practical…

Methodology · Statistics 2025-12-11 Chong Ding , Zheng Li , Hon Keung Tony Ng , Wei Gao

Transfer learning refers to the process of adapting a model trained on a source task to a target task. While kernel methods are conceptually and computationally simple machine learning models that are competitive on a variety of tasks, it…

Machine Learning · Computer Science 2022-11-02 Adityanarayanan Radhakrishnan , Max Ruiz Luyten , Neha Prasad , Caroline Uhler

In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer…

Machine Learning · Statistics 2021-09-03 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

We propose to analyse the conditional distributional treatment effect (CoDiTE), which, in contrast to the more common conditional average treatment effect (CATE), is designed to encode a treatment's distributional aspects beyond the mean.…

Machine Learning · Statistics 2021-06-11 Junhyung Park , Uri Shalit , Bernhard Schölkopf , Krikamol Muandet

Accurately estimating personalized treatment effects within a study site (e.g., a hospital) has been challenging due to limited sample size. Furthermore, privacy considerations and lack of resources prevent a site from leveraging…

Machine Learning · Statistics 2022-06-17 Xiaoqing Tan , Chung-Chou H. Chang , Ling Zhou , Lu Tang

We address the consistency of a kernel ridge regression estimate of the conditional mean embedding (CME), which is an embedding of the conditional distribution of $Y$ given $X$ into a target reproducing kernel Hilbert space $\mathcal{H}_Y$.…

Machine Learning · Statistics 2023-12-13 Zhu Li , Dimitri Meunier , Mattes Mollenhauer , Arthur Gretton

Estimating heterogeneous treatment effects is critical in domains such as personalized medicine, resource allocation, and policy evaluation. A central challenge lies in identifying subpopulations that respond differently to interventions,…

Machine Learning · Statistics 2025-09-18 Zilong Wang , Turgay Ayer , Shihao Yang

Machine learning (ML) estimates of conditional average treatment effects (CATE) can guide policy decisions, either by allowing targeting of individuals with beneficial CATE estimates, or as inputs to decision trees that optimise overall…

Econometrics · Economics 2023-10-04 Julia Hatamyar , Noemi Kreif