English
Related papers

Related papers: Kernel Instrumental Variable Regression

200 papers

This article considers inference in linear instrumental variables models with many regressors, all of which could be endogenous. We propose the STIV estimator. Identification robust confidence sets are derived by solving linear programs. We…

Statistics Theory · Mathematics 2021-08-09 Eric Gautier , Christiern Rose

Multidimensional function data arise from many fields nowadays. The covariance function plays an important role in the analysis of such increasingly common data. In this paper, we propose a novel nonparametric covariance function estimation…

Methodology · Statistics 2021-09-14 Jiayi Wang , Raymond K. W. Wong , Xiaoke Zhang

Kernel logistic regression (KLR) is a powerful classification method widely applied across diverse domains. In many real-world scenarios, indefinite kernels capture more domain-specific structural information than positive definite kernels.…

Machine Learning · Statistics 2025-10-31 Shaoxin Wang , Hanjing Yao

We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the…

Methodology · Statistics 2022-07-19 Peijun Sang , Bing Li

Kernel ridge regression, KRR, is a generalization of linear ridge regression that is non-linear in the data, but linear in the model parameters. Here, we introduce an equivalent formulation of the objective function of KRR, which opens up…

Machine Learning · Statistics 2025-03-10 Oskar Allerbo

Functional linear and single-index models are core regression methods in functional data analysis and are widely used for performing regression in a wide range of applications when the covariates are random functions coupled with scalar…

Statistics Theory · Mathematics 2024-03-28 Krishnakumar Balasubramanian , Hans-Georg Müller , Bharath K. Sriperumbudur

Stochastic approximation (SA) is a powerful and scalable computational method for iteratively estimating the solution of optimization problems in the presence of randomness, particularly well-suited for large-scale and streaming data…

Statistics Theory · Mathematics 2023-10-03 Meimei Liu , Zuofeng Shang , Yun Yang

The main purpose is to estimate the regression function of a real random variable with functional explanatory variable by using a recursive nonparametric kernel approach. The mean square error and the almost sure convergence of a family of…

Statistics Theory · Mathematics 2013-08-07 Aboubacar Amiri , Christophe Crambes , Baba Thiam

One of the fundamental challenges in causal inference is to estimate the causal effect of a treatment on its outcome of interest from observational data. However, causal effect estimation often suffers from the impacts of confounding bias…

Machine Learning · Computer Science 2023-06-23 Debo Cheng , Ziqi Xu , Jiuyong Li , Lin Liu , Thuc Duy Le , Jixue Liu

We study the covariate shift problem in the context of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We focus on two natural families of covariate shift problems defined using the likelihood ratios between the…

Statistics Theory · Mathematics 2023-06-07 Cong Ma , Reese Pathak , Martin J. Wainwright

The support vector machine (SVM) is a popular machine learning classification method which produces a nonlinear decision boundary in a feature space by constructing linear boundaries in a transformed Hilbert space. It is well known that…

Quantum Physics · Physics 2017-10-31 Rupak Chatterjee , Ting Yu

Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational…

Machine Learning · Statistics 2018-02-26 Jiaxin Shi , Shengyang Sun , Jun Zhu

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

Individualized treatment rules (ITRs) are considered a promising recipe to deliver better policy interventions. One key ingredient in optimal ITR estimation problems is to estimate the average treatment effect conditional on a subject's…

Methodology · Statistics 2021-03-16 Hongming Pu , Bo Zhang

The advent of the big data era brought new opportunities and challenges to draw treatment effect in data fusion, that is, a mixed dataset collected from multiple sources (each source with an independent treatment assignment mechanism). Due…

Artificial Intelligence · Computer Science 2022-12-08 Anpeng Wu , Kun Kuang , Ruoxuan Xiong , Minqing Zhu , Yuxuan Liu , Bo Li , Furui Liu , Zhihua Wang , Fei Wu

Instrumental variable methods are fundamental to causal inference when treatment assignment is confounded by unobserved variables. In this article, we develop a general nonparametric causal framework for identification and learning with…

Methodology · Statistics 2026-02-10 Shuyuan Chen , Peng Zhang , Yifan Cui

We provide a new flexible framework for inference with the instrumental variable model. Rather than using linear specifications, functions characterizing the effects of instruments and other explanatory variables are estimated using machine…

Machine Learning · Statistics 2021-02-03 Robert E. McCulloch , Rodney A. Sparapani , Brent R. Logan , Purushottam W. Laud

Two-stage least squares (TSLS) estimators and variants thereof are widely used to infer the effect of an exposure on an outcome using instrumental variables (IVs). They belong to a wider class of two-stage IV estimators, which are based on…

Methodology · Statistics 2015-10-08 Stijn Vansteelandt , Vanessa Didelez

In recent years, transfer learning has garnered significant attention. Its ability to leverage knowledge from related studies to improve generalization performance in a target study has made it highly appealing. This paper focuses on…

Machine Learning · Statistics 2025-10-30 Chao Wang , Caixing Wang , Xin He , Xingdong Feng

Instrumental variables (IV) regression is a popular method for the estimation of the endogenous treatment effects. Conventional IV methods require all the instruments are relevant and valid. However, this is impractical especially in…

Econometrics · Economics 2020-06-29 Qingliang Fan , Yaqian Wu