English
Related papers

Related papers: Semiparametrically Efficient Inference for Kernel …

200 papers

We develop and analyze a principled approach to kernel ridge regression under covariate shift. The goal is to learn a regression function with small mean squared error over a target distribution, based on unlabeled data from there and…

Methodology · Statistics 2025-07-25 Kaizheng Wang

Functional bilevel methods estimate a lower-level function and plug it into a hypergradient, but this plug-in gradient can retain first-order bias when the lower-level problem is learned nonparametrically. To remove this bias, we develop a…

Machine Learning · Statistics 2026-05-21 Fares El Khoury , Houssam Zenati , Nathan Kallus , Michael Arbel , Aurélien Bibaut

We consider regression models with parametric (linear or nonlinear) regression function and allow responses to be ``missing at random.'' We assume that the errors have mean zero and are independent of the covariates. In order to estimate…

Statistics Theory · Mathematics 2009-08-24 Ursula U. Müller

In many environmental applications involving spatially-referenced data, limitations on the number and locations of observations motivate the need for practical and efficient models for spatial interpolation, or kriging. A key component of…

Methodology · Statistics 2015-09-15 Mark D. Risser , Catherine A. Calder

An inference procedure is proposed to provide consistent estimators of parameters in a modal regression model with a covariate prone to measurement error. A score-based diagnostic tool exploiting parametric bootstrap is developed to assess…

Methodology · Statistics 2024-07-02 Qingyang Liu , Xianzheng Huang

Triangular systems with nonadditively separable unobserved heterogeneity provide a theoretically appealing framework for the modelling of complex structural relationships. However, they are not commonly used in practice due to the need for…

Econometrics · Economics 2019-10-08 Victor Chernozhukov , Iván Fernández-Val , Whitney Newey , Sami Stouli , Francis Vella

Reliable state estimation hinges on accurate specification of sensor noise covariances, which weigh heterogeneous measurements. In practice, these covariances are difficult to identify due to environmental variability, front-end…

Robotics · Computer Science 2025-12-18 Haoying Li , Yifan Peng , Xinghan Li , Junfeng Wu

Consider a Gaussian nonparametric regression problem having both an unknown mean function and unknown variance function. This article presents a class of difference-based kernel estimators for the variance function. Optimal convergence…

Statistics Theory · Mathematics 2009-09-29 Lawrence D. Brown , M. Levine

In this paper we present a nonparametric method for extending functional regression methodology to the situation where more than one functional covariate is used to predict a functional response. Borrowing the idea from Kadri et al.…

Machine Learning · Statistics 2013-01-16 Hachem Kadri , Philippe Preux , Emmanuel Duflos , Stéphane Canu

In this paper we propose a semiparametric spatial autoregressive model that combines a linear covariate component with a nonparametrically estimated spatial term, allowing flexible dependence modeling without restrictive covariance…

Methodology · Statistics 2026-04-30 Rodrigo García Arancibia , Pamela Llop , Mariel Lovatto

A spectral mixture (SM) kernel is a flexible kernel used to model any stationary covariance function. Although it is useful in modeling data, the learning of the SM kernel is generally difficult because optimizing a large number of…

Machine Learning · Statistics 2020-06-15 Yohan Jung , Kyungwoo Song , Jinkyoo Park

We revisit the classical problem of comparing regression functions, a fundamental question in statistical inference with broad relevance to modern applications such as data integration, transfer learning, and causal inference. Existing…

Methodology · Statistics 2025-10-29 Jian Yan , Zhuoxi Li , Yang Ning , Yong Chen

In this paper we study the kernel multiple ridge regression framework, which we refer to as multi-task regression, using penalization techniques. The theoretical analysis of this problem shows that the key element appearing for an optimal…

Statistics Theory · Mathematics 2012-10-25 Matthieu Solnon , Sylvain Arlot , Francis Bach

Kernel-based methods have been recently introduced for linear system identification as an alternative to parametric prediction error methods. Adopting the Bayesian perspective, the impulse response is modeled as a non-stationary Gaussian…

Optimization and Control · Mathematics 2017-03-16 Mattia Zorzi , Alessandro Chiuso

We study the problem of estimating the effect function for a continuous treatment, which maps each treatment value to a population-averaged outcome. A central challenge in this setting is confounding: treatment assignment often depends on…

Methodology · Statistics 2026-05-29 Seok-Jin Kim , Kaizheng Wang

I propose kernel ridge regression estimators for nonparametric dose response curves and semiparametric treatment effects in the setting where an analyst has access to a selected sample rather than a random sample; only for select…

Econometrics · Economics 2022-08-24 Rahul Singh

We propose a kernel mixture of polynomials prior for Bayesian nonparametric regression. The regression function is modeled by local averages of polynomials with kernel mixture weights. We obtain the minimax-optimal rate of contraction of…

Statistics Theory · Mathematics 2018-09-17 Fangzheng Xie , Yanxun Xu

Kernel regression is a popular non-parametric fitting technique. It aims at learning a function which estimates the targets for test inputs as precise as possible. Generally, the function value for a test input is estimated by a weighted…

Machine Learning · Computer Science 2017-12-27 Rongqing Huang , Shiliang Sun

We consider two nonparametric approaches to ensure that linear instrumental variables estimators satisfy the rich-covariates condition emphasized by Blandhol et al. (2025), even when the instrument is not unconditionally randomly assigned…

Econometrics · Economics 2025-07-24 Ludgero Glorias , Federico Martellosio , J. M. C. Santos Silva

In this paper we propose an automatic selection of the bandwidth of the semi-recursive kernel estimators of a regression function defined by the stochastic approximation algorithm. We showed that, using the selected bandwidth and some…

Statistics Theory · Mathematics 2016-07-05 Yousri Slaoui