English
Related papers

Related papers: Minimax Prediction for Functional Linear Regressio…

200 papers

As with classic statistics, functional regression models are invaluable in the analysis of functional data. While there are now extensive tools with accompanying theory available for linear models, there is still a great deal of work to be…

Statistics Theory · Mathematics 2018-06-25 Matthew Reimherr , Bharath Sriperumbudur , Bahaeddine Taoufik

We propose inferential tools for functional linear quantile regression where the conditional quantile of a scalar response is assumed to be a linear functional of a functional covariate. In contrast to conventional approaches, we employ…

Statistics Theory · Mathematics 2022-02-25 Peijun Sang , Zuofeng Shang , Pang Du

An extension of reproducing kernel Hilbert space (RKHS) theory provides a new framework for modeling functional regression models with functional responses. The approach only presumes a general nonlinear regression structure as opposed to…

Statistics Theory · Mathematics 2008-12-17 Heng Lian

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

We propose a novel Bayesian methodology for inference in functional linear and logistic regression models based on the theory of reproducing kernel Hilbert spaces (RKHS's). We introduce general models that build upon the RKHS generated by…

Methodology · Statistics 2025-09-09 José R. Berrendero , Antonio Coín , Antonio Cuevas

We propose new reproducing kernel-based tests for model checking in conditional moment restriction models. By regressing estimated residuals on kernel functions via kernel ridge regression (KRR), we obtain a coefficient function in a…

Econometrics · Economics 2025-05-05 Yuhao Li

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly…

Machine Learning · Statistics 2022-02-17 Junhyunng Park , Krikamol Muandet

The functional linear model extends the notion of linear regression to the case where the response and covariates are iid elements of an infinite dimensional Hilbert space. The unknown to be estimated is a Hilbert-Schmidt operator, whose…

Statistics Theory · Mathematics 2016-12-22 Tung Pham , Victor Panaretos

We prove rates of convergence in the statistical sense for kernel-based least squares regression using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is directly related…

Statistics Theory · Mathematics 2010-09-30 Gilles Blanchard , Nicole Kraemer

Estimation of the mean and covariance functions is a fundamental problem in functional data analysis, particularly for discretely observed functional data. In this work, we study a regularization-based framework for estimating the mean and…

Statistics Theory · Mathematics 2026-03-20 Naveen Gupta , Bharath K Sriperumbudur

Function-on-function linear regression is important for understanding the relationship between the response and the predictor that are both functions. In this article, we propose a reproducing kernel Hilbert space approach to…

Statistics Theory · Mathematics 2021-09-29 Holger Dette , Jiajun Tang

We consider the sampling problem for functional PCA (fPCA), where the simplest example is the case of taking time samples of the underlying functional components. More generally, we model the sampling operation as a continuous linear map…

Statistics Theory · Mathematics 2013-02-14 Arash A. Amini , Martin J. Wainwright

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

In this paper, we consider the nonparametric least square regression in a Reproducing Kernel Hilbert Space (RKHS). We propose a new randomized algorithm that has optimal generalization error bounds with respect to the square loss, closing a…

Machine Learning · Computer Science 2019-05-28 Kwang-Sung Jun , Ashok Cutkosky , Francesco Orabona

In this work, we develop and study an empirical projection operator scheme for solving nonparametric regression problems. This scheme is based on an approximate projection of the regression function over a suitable reproducing kernel…

Statistics Theory · Mathematics 2020-02-04 Bilel Bousselmi , Jean-François Dupuy , Abderrazek Karoui

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

This paper considers the partially functional linear model (PFLM) where all predictive features consist of a functional covariate and a high dimensional scalar vector. Over an infinite dimensional reproducing kernel Hilbert space, the…

Statistics Theory · Mathematics 2021-10-19 Shaogao Lv , Xin He , Junhui Wang

In this paper, we present a unified approach to function approximation in reproducing kernel Hilbert spaces (RKHS) that establishes a previously unrecognized optimality property for several well-known function approximation techniques, such…

Statistics Theory · Mathematics 2013-01-08 Richard J. Barton

This paper studies convergence rates for some value function approximations that arise in a collection of reproducing kernel Hilbert spaces (RKHS) $H(\Omega)$. By casting an optimal control problem in a specific class of native spaces,…

Systems and Control · Electrical Eng. & Systems 2023-11-20 Ali Bouland , Shengyuan Niu , Sai Tej Paruchuri , Andrew Kurdila , John Burns , Eugenio Schuster

In this paper we investigate the problem of estimating the regression function in models with correlated observations. The data is obtained from several experimental units each of them forms a time series. We propose a new estimator based…

Statistics Theory · Mathematics 2019-06-13 Djihad Benelmadani , Karim Benhenni , Sana Louhichi