English
Related papers

Related papers: Kernel-based estimation for partially functional l…

200 papers

Projected kernel calibration is a newly proposed frequentist calibration method, which is asymptotic normal and semi-parametric. Its loss function is usually referred to as the PK loss function. In this work, we prove the uniform…

Methodology · Statistics 2022-08-10 Yan Wang

We propose and study kernel conjugate gradient methods (KCGM) with random projections for least-squares regression over a separable Hilbert space. Considering two types of random projections generated by randomized sketches and Nystr\"{o}m…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Volkan Cevher

Recently, deep learning has been widely applied in functional data analysis (FDA) with notable empirical success. However, the infinite dimensionality of functional data necessitates an effective dimension reduction approach for functional…

Machine Learning · Statistics 2025-05-13 Zhongjie Shi , Jun Fan , Linhao Song , Ding-Xuan Zhou , Johan A. K. Suykens

We propose a novel procedure for estimating and conducting inference on average marginal effects in partially linear instrumental regressions using Reproducing Kernel Hilbert Space methods. Our procedure relies on a single regularization…

Econometrics · Economics 2026-04-14 Lucas Girard , Elia Lapenta

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Reduced modeling in high-dimensional reproducing kernel Hilbert spaces offers the opportunity to approximate efficiently non-linear dynamics. In this work, we devise an algorithm based on low rank constraint optimization and kernel-based…

Machine Learning · Computer Science 2020-02-23 Patrick Heas , Cedric Herzet , Benoit Combes

In this paper, we consider a partial deconvolution kernel estimator for nonparametric regression when some covariates are measured with error while others are observed without error. We focus on a general and realistic setting in which the…

Statistics Theory · Mathematics 2026-01-29 Baba Thiam

We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the…

Methodology · Statistics 2022-07-19 Peijun Sang , Bing Li

We propose new optimal estimators for the Lipschitz frontier of a set of points. They are defined as kernel estimators being sufficiently regular, covering all the points and whose associated support is of smallest surface. The estimators…

Methodology · Statistics 2011-03-31 Stéphane Girard , Anatoli Iouditski , Alexander Nazin

We study a non linear regression model with functional data as inputs and scalar response. We propose a pointwise estimate of the regression function that maps a Hilbert space onto the real line by a local linear method. We provide the…

Statistics Theory · Mathematics 2013-02-20 Alain Berlinet , Abdallah Elamine , André Mas

In the last decade, a considerable research effort has been devoted to developing adaptive algorithms based on kernel functions. One of the main features of these algorithms is that they form a family of universal approximation techniques,…

Signal Processing · Electrical Eng. & Systems 2018-08-21 A. Flores , R. C. de Lamare

Kernel methods are powerful and flexible approach to solve many problems in machine learning. Due to the pairwise evaluations in kernel methods, the complexity of kernel computation grows as the data size increases; thus the applicability…

Machine Learning · Computer Science 2017-11-28 Bharath Bhushan Damodaran , Nicolas Courty , Philippe-Henri Gosselin

Multidimensional function data arise from many fields nowadays. The covariance function plays an important role in the analysis of such increasingly common data. In this paper, we propose a novel nonparametric covariance function estimation…

Methodology · Statistics 2021-09-14 Jiayi Wang , Raymond K. W. Wong , Xiaoke Zhang

We prove rates of convergence in the statistical sense for kernel-based least squares regression using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is directly related…

Statistics Theory · Mathematics 2010-09-30 Gilles Blanchard , Nicole Kraemer

We propose new estimates for the frontier of a set of points. They are defined as kernel estimates covering all the points and whose associated support is of smallest surface. The estimates are written as linear combinatio- ns of kernel…

Methodology · Statistics 2011-03-31 Guillaume Bouchard , Stéphane Girard , Anatoli Iouditski , Alexander Nazin

Kernel ridge regression (KRR) is widely used for nonparametric regression over reproducing kernel Hilbert spaces. It offers powerful modeling capabilities at the cost of significant computational costs, which typically require $O(n^3)$…

Methodology · Statistics 2024-03-18 Xiaowu Dai , Huiying Zhong

The Koopman operator provides a linear framework to study nonlinear dynamical systems. Its spectra offer valuable insights into system dynamics, but the operator can exhibit both discrete and continuous spectra, complicating direct…

Dynamical Systems · Mathematics 2025-05-02 Jonghyeon Lee , Boumediene Hamzi , Boya Hou , Houman Owhadi , Gabriele Santin , Umesh Vaidya

Partial Least-Squares (PLS) Regression is a widely used tool in chemometrics for performing multivariate regression. PLS is a bi-linear method that has a limited capacity of modelling non-linear relations between the predictor variables and…

This paper addresses the problem of learning the impulse responses characterizing forward models by means of a regularized kernel-based Prediction Error Method (PEM). The common approach to accomplish that is to approximate the system with…

Optimization and Control · Mathematics 2024-09-20 Giulio Fattore , Marco Peruzzo , Giacomo Sartori , Mattia Zorzi

We consider models for multivariate point processes where the intensity is given nonparametrically in terms of functions in a reproducing kernel Hilbert space. The likelihood function involves a time integral and is consequently not given…

Computation · Statistics 2014-02-14 Niels Richard Hansen
‹ Prev 1 3 4 5 6 7 10 Next ›