English
Related papers

Related papers: Generalized Kernel Ridge Regression for Causal Inf…

200 papers

We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all non-negative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the multiple…

Statistics Theory · Mathematics 2024-10-10 Georgios Gavrilopoulos , Guillaume Lecué , Zong Shang

Imputing missing potential outcomes using an estimated regression function is a natural idea for estimating causal effects. In the literature, estimators that combine imputation and regression adjustments are believed to be comparable to…

Statistics Theory · Mathematics 2023-01-20 Zhexiao Lin , Fang Han

Recent theoretical studies illustrated that kernel ridgeless regression can guarantee good generalization ability without an explicit regularization. In this paper, we investigate the statistical properties of ridgeless regression with…

Machine Learning · Computer Science 2023-08-30 Jian Li , Yong Liu , Yingying Zhang

Analyses of randomised trials are often based on regression models which adjust for baseline covariates, in addition to randomised group. Based on such models, one can obtain estimates of the marginal mean outcome for the population under…

Methodology · Statistics 2017-07-17 Jonathan W. Bartlett

This paper carries out a large dimensional analysis of a variation of kernel ridge regression that we call \emph{centered kernel ridge regression} (CKRR), also known in the literature as kernel ridge regression with offset. This modified…

Machine Learning · Statistics 2020-04-22 Khalil Elkhalil , Abla Kammoun , Xiangliang Zhang , Mohamed-Slim Alouini , Tareq Al-Naffouri

A common challenge in nonparametric inference is its high computational complexity when data volume is large. In this paper, we develop computationally efficient nonparametric testing by employing a random projection strategy. In the…

Statistics Theory · Mathematics 2018-02-20 Meimei Liu , Zuofeng Shang , Guang Cheng

A nonparametric kernel density estimator for directional-linear data is introduced. The proposal is based on a product kernel accounting for the different nature of both (directional and linear) components of the random vector. Expressions…

This paper conducts a comprehensive study of the learning curves of kernel ridge regression (KRR) under minimal assumptions. Our contributions are three-fold: 1) we analyze the role of key properties of the kernel, such as its spectral…

Machine Learning · Computer Science 2024-10-24 Tin Sum Cheng , Aurelien Lucchi , Anastasis Kratsios , David Belius

Additive models play an important role in semiparametric statistics. This paper gives learning rates for regularized kernel based methods for additive models. These learning rates compare favourably in particular in high dimensions to…

Machine Learning · Statistics 2014-05-15 Andreas Christmann , Ding-Xuan Zhou

Randomization, as a key technique in clinical trials, can eliminate sources of bias and produce comparable treatment groups. In randomized experiments, the treatment effect is a parameter of general interest. Researchers have explored the…

Methodology · Statistics 2023-12-05 Fuyi Tu , Wei Ma , Hanzhong Liu

Randomized Controlled Trials (RCTs) are often considered the gold standard for estimating causal effect, but they may lack external validity when the population eligible to the RCT is substantially different from the target population.…

Methodology · Statistics 2023-01-11 Bénédicte Colnet , Julie Josse , Erwan Scornet , Gaël Varoquaux

This paper studies inference in randomized controlled trials with covariate-adaptive randomization when there are multiple treatments. More specifically, we study inference about the average effect of one or more treatments relative to…

Econometrics · Economics 2019-01-21 Federico A. Bugni , Ivan A. Canay , Azeem M. Shaikh

Quasi-experimental evaluations are central for generating real-world causal evidence and complementing insights from randomized trials. The regression discontinuity design (RDD) is a quasi-experimental design that can be used to estimate…

Machine Learning · Statistics 2026-04-07 Maximilian Schuessler , Erik Sverdrup , Robert Tibshirani , Stefan Wager

The analysis of randomized trials is often complicated by the occurrence of intercurrent events and missing values. Even though there are different strategies to address missing values it is still common to require missing values…

Methodology · Statistics 2025-11-11 A. Ruiz de Villa , Ll. Badiella

In many empirical settings, directly observing a treatment variable may be infeasible although an error-prone surrogate measurement of the latter will often be available. Causal inference based solely on the surrogate measurement is…

Methodology · Statistics 2024-09-26 Ying Zhou , Eric Tchetgen Tchetgen

Given additional distributional information in the form of moment restrictions, kernel density and distribution function estimators with implied generalised empirical likelihood probabilities as weights achieve a reduction in variance due…

Methodology · Statistics 2019-10-08 Vitaliy Oryshchenko , Richard J. Smith

Distributional treatment effects can be invisible to means: a treatment may preserve average outcomes while changing tails, modes, dispersion, or rare-event probabilities. Kernel tests can detect discrepancies between interventional outcome…

Machine Learning · Statistics 2026-05-11 Houssam Zenati , Arthur Gretton

Continual learning is motivated by the need to adapt to real-world dynamics in tasks and data distribution while mitigating catastrophic forgetting. Despite significant advances in continual learning techniques, the theoretical…

Methodology · Statistics 2025-08-22 Yihan Zhao , Wenqing Su , Ying Yang

This paper presents a weighted optimization framework that unifies the binary,multi-valued, continuous, as well as mixture of discrete and continuous treatment, under the unconfounded treatment assignment. With a general loss function, the…

Econometrics · Economics 2018-08-20 Chunrong Ai , Oliver Linton , Kaiji Motegi , Zheng Zhang

Estimating treatment effects from observational data is challenging due to two main reasons: (a) hidden confounding, and (b) covariate mismatch (control and treatment groups not having identical distributions). Long lines of works exist…

Machine Learning · Computer Science 2025-04-30 Praharsh Nanavati , Ranjitha Prasad , Karthikeyan Shanmugam