English
Related papers

Related papers: Nonlinear functional models for functional respons…

200 papers

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

Statistics Theory · Mathematics 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

We propose new reproducing kernel-based tests for model checking in conditional moment restriction models. By regressing estimated residuals on kernel functions via kernel ridge regression (KRR), we obtain a coefficient function in a…

Econometrics · Economics 2025-05-05 Yuhao Li

Multidimensional function data arise from many fields nowadays. The covariance function plays an important role in the analysis of such increasingly common data. In this paper, we propose a novel nonparametric covariance function estimation…

Methodology · Statistics 2021-09-14 Jiayi Wang , Raymond K. W. Wong , Xiaoke Zhang

In this work, we develop and study an empirical projection operator scheme for solving nonparametric regression problems. This scheme is based on an approximate projection of the regression function over a suitable reproducing kernel…

Statistics Theory · Mathematics 2020-02-04 Bilel Bousselmi , Jean-François Dupuy , Abderrazek Karoui

A framework for estimation and hypothesis testing of functional restrictions against general alternatives is proposed. The parameter space is a reproducing kernel Hilbert space (RKHS). The null hypothesis does not necessarily define a…

Methodology · Statistics 2018-08-21 Alessio Sancetta

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

In statistical learning, identifying underlying structures of true target functions based on observed data plays a crucial role to facilitate subsequent modeling and analysis. Unlike most of those existing methods that focus on some…

Machine Learning · Statistics 2021-05-04 Xin He , Yeheng Ge , Xingdong Feng

In this paper, we introduce a new distribution regression model for probability distributions. This model is based on a Reproducing Kernel Hilbert Space (RKHS) regression framework, where universal kernels are built using Wasserstein…

Statistics Theory · Mathematics 2019-10-07 Thi Thien Trang Bui , J-M Loubes , Laurent Risser , Patricia Balaresque

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

Reproducing kernel Hilbert spaces (RKHSs) are key elements of many non-parametric tools successfully used in signal processing, statistics, and machine learning. In this work, we aim to address three issues of the classical RKHS based…

Signal Processing · Electrical Eng. & Systems 2019-05-09 Maria Peifer , Luiz. F. O. Chamon , Santiago Paternain , Alejandro Ribeiro

In this article, we consider convergence rates in functional linear regression with functional responses, where the linear coefficient lies in a reproducing kernel Hilbert space (RKHS). Without assuming that the reproducing kernel and the…

Methodology · Statistics 2012-11-20 Heng Lian

Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…

Methodology · Statistics 2013-05-07 Robert Hable

This paper extends a conventional, general framework for online adaptive estimation problems for systems governed by unknown nonlinear ordinary differential equations. The central feature of the theory introduced in this paper represents…

Systems and Control · Computer Science 2017-07-11 Parag Bobade , Suprotim Majumdar , Savio Pereira , Andrew J. Kurdila , John B. Ferris

Functional linear and single-index models are core regression methods in functional data analysis and are widely used for performing regression in a wide range of applications when the covariates are random functions coupled with scalar…

Statistics Theory · Mathematics 2024-03-28 Krishnakumar Balasubramanian , Hans-Georg Müller , Bharath K. Sriperumbudur

This paper proposes a method for constructing one-step prediction tubes for nonlinear systems using reproducing kernel Hilbert spaces. We approximate a bounded reproducing kernel Hilbert space (RKHS) hypothesis set by a finite-dimensional…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Jannis Lübsen , Annika Eichler

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Machine Learning · Statistics 2021-12-22 Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda , Fuyuta Komura , Takeshi Katsura , Yoshinobu Kawahara

This paper presents new results on Functional Analysis of Variance for fixed effect models with correlated Hilbert-valued Gaussian error components. The geometry of the Reproducing Kernel Hilbert Space (RKHS) of the error term is considered…

Statistics Theory · Mathematics 2015-09-04 M. D. Ruiz-Medina

Functional regression is very crucial in functional data analysis and a linear relationship between scalar response and functional predictor is often assumed. However, the linear assumption may not hold in practice, which makes the methods…

Methodology · Statistics 2023-01-18 Rou Zhong , Dongxue Wang , Jingxiao Zhang

Reproducing kernel Hilbert spaces (RKHSs) play an important role in many statistics and machine learning applications ranging from support vector machines to Gaussian processes and kernel embeddings of distributions. Operators acting on…

Functional Analysis · Mathematics 2021-04-06 Mattes Mollenhauer , Ingmar Schuster , Stefan Klus , Christof Schütte

We develop methodology for testing hypotheses regarding the slope function in functional linear regression for time series via a reproducing kernel Hilbert space approach. In contrast to most of the literature, which considers tests for the…

Statistics Theory · Mathematics 2022-02-17 Holger Dette , Jiajun Tang