English
Related papers

Related papers: Optimal Rates for Functional Linear Regression wit…

200 papers

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

This paper studies a class of exponential family models whose canonical parameters are specified as linear functionals of an unknown infinite-dimensional slope function. The optimal minimax rates of convergence for slope function estimation…

Statistics Theory · Mathematics 2011-12-25 Winston Wei Dou , David Pollard , Harrison H. Zhou

The main purpose is to estimate the regression function of a real random variable with functional explanatory variable by using a recursive nonparametric kernel approach. The mean square error and the almost sure convergence of a family of…

Statistics Theory · Mathematics 2013-08-07 Aboubacar Amiri , Christophe Crambes , Baba Thiam

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti

The paper introduces a new efficient nonlinear one-class classifier formulated as the Rayleigh quotient criterion optimisation. The method, operating in a reproducing kernel Hilbert space, minimises the scatter of target distribution along…

Machine Learning · Computer Science 2019-02-12 Shervin Rahimzadeh Arashloo , Josef Kittler

We establish linear convergence rates for a certain class of extrapolated fixed point algorithms which are based on dynamic string-averaging methods in a real Hilbert space. This applies, in particular, to the extrapolated simultaneous and…

Optimization and Control · Mathematics 2018-05-11 Christian Bargetz , Victor I. Kolobov , Simeon Reich , Rafał Zalas

We study theoretical properties of a broad class of regularized algorithms with vector-valued output. These spectral algorithms include kernel ridge regression, kernel principal component regression, various implementations of gradient…

Machine Learning · Statistics 2024-05-24 Dimitri Meunier , Zikai Shen , Mattes Mollenhauer , Arthur Gretton , Zhu Li

The regularity of refinable functions has been investigated deeply in the past 25 years using Fourier analysis, wavelet analysis, restricted and joint spectral radii techniques. However the shift-invariance of the underlying regular setting…

Numerical Analysis · Mathematics 2018-07-31 Maria Charina , Costanza Conti , Lucia Romani , Joachim Stöckler , Alberto Viscardi

Kernel-based methods in Numerical Analysis have the advantage of yielding optimal recovery processes in the "native" Hilbert space $\calh$ in which they are reproducing. Continuous kernels on compact domains have an expansion into…

Numerical Analysis · Mathematics 2018-10-09 Gabriele Santin , Robert Schaback

Functional regression is very crucial in functional data analysis and a linear relationship between scalar response and functional predictor is often assumed. However, the linear assumption may not hold in practice, which makes the methods…

Methodology · Statistics 2023-01-18 Rou Zhong , Dongxue Wang , Jingxiao Zhang

Regularized empirical risk minimization using kernels and their corresponding reproducing kernel Hilbert spaces (RKHSs) plays an important role in machine learning. However, the actually used kernel often depends on one or on a few…

Machine Learning · Statistics 2017-09-25 Andreas Christmann , Daohong Xiang , Ding-Xuan Zhou

Forward regression is a statistical model selection and estimation procedure which inductively selects covariates that add predictive power into a working statistical regression model. Once a model is selected, unknown regression parameters…

Machine Learning · Statistics 2018-04-12 Damian Kozbur

Estimation of the mean and covariance parameters for functional data is a critical task, with local linear smoothing being a popular choice. In recent years, many scientific domains are producing multivariate functional data for which $p$,…

Statistics Theory · Mathematics 2024-09-24 Alexander Petersen

In this paper, we apply a new kind of smoothness concept, i.e. H\"older stability estimates for the determination of convergence rates of Tikhonov regularization for linear and non-linear inverse problems in Hilbert spaces. For linear…

Numerical Analysis · Mathematics 2020-11-05 Gaurav Mittal , Ankik Kumar Giri

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola

A linear multiple regression model in function spaces is formulated, under temporal correlated errors. This formulation involves kernel regressors. A generalized least-squared regression parameter estimator is derived. Its asymptotic…

Statistics Theory · Mathematics 2018-08-07 M. D. Ruiz-Medina , D. Miranda , R. M. Espejo

This paper derives error bounds for regression in continuous time over subsets of certain types of Riemannian manifolds.The regression problem is typically driven by a nonlinear evolution law taking values on the manifold, and it is cast as…

Dynamical Systems · Mathematics 2022-09-09 Nathan Powell , Jia Guo , Sai Tej Parachuri , John Burns , Boone Estes , Andrew Kurdila

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

In this paper, we study the Tikhonov regularization scheme in Hilbert scales for the nonlinear statistical inverse problem with a general noise. The regularizing norm in this scheme is stronger than the norm in Hilbert space. We focus on…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi

We study estimation and prediction in linear models where the response and the regressor variable both take values in some Hilbert space. Our main objective is to obtain consistency of a principal components based estimator for the…

Statistics Theory · Mathematics 2014-04-17 Siegfried Hörmann , Łukasz Kidziński