English
Related papers

Related papers: Nonlinear Multivariate Function-on-function Regres…

200 papers

Traditional machine learning models, particularly neural networks, are rooted in finite-dimensional parameter spaces and nonlinear function approximations. This report explores an alternative formulation where learning tasks are expressed…

Machine Learning · Computer Science 2025-07-30 Andrew Kiruluta , Andreas Lemos , Priscilla Burity

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of…

Machine Learning · Statistics 2024-02-20 Jiading Liu , Lei Shi

We propose an approach to multivariate nonparametric regression that generalizes reduced rank regression for linear models. An additive model is estimated for each dimension of a $q$-dimensional response, with a shared $p$-dimensional…

Machine Learning · Statistics 2013-01-10 Rina Foygel , Michael Horrell , Mathias Drton , John Lafferty

In this work, we consider a multivariate regression model with one-sided errors. We assume for the regression function to lie in a general H\"{o}lder class and estimate it via a nonparametric local polynomial approach that consists of…

Statistics Theory · Mathematics 2021-02-11 Leonie Selk , Charles Tillier , Orlando Marigliano

We study the estimation and prediction of functional autoregressive~(FAR) processes, a statistical tool for modeling functional time series data. Due to the infinite-dimensional nature of FAR processes, the existing literature addresses its…

Methodology · Statistics 2020-12-01 Daren Wang , Zifeng Zhao , Rebecca Willett , Chun Yip Yau

The function-on-function linear regression model in which the response and predictors consist of random curves has become a general framework to investigate the relationship between the functional response and functional predictors.…

Methodology · Statistics 2021-11-03 Ufuk Beyaztas , Han Lin Shang

We propose a flexible regression framework to model the conditional distribution of multilevel generalized multivariate functional data of potentially mixed type, e.g. binary and continuous data. We make pointwise parametric distributional…

Methodology · Statistics 2024-07-31 Alexander Volkmann , Nikolaus Umlauf , Sonja Greven

In this paper, we introduce a new distribution regression model for probability distributions. This model is based on a Reproducing Kernel Hilbert Space (RKHS) regression framework, where universal kernels are built using Wasserstein…

Statistics Theory · Mathematics 2019-10-07 Thi Thien Trang Bui , J-M Loubes , Laurent Risser , Patricia Balaresque

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

Numerical Analysis · Mathematics 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

We introduce a new class of non-linear function-on-function regression models for functional data using neural networks. We propose a framework using a hidden layer consisting of continuous neurons, called a continuous hidden layer, for…

Methodology · Statistics 2023-10-10 Aniruddha Rajendra Rao , Matthew Reimherr

Motivated by the inherent heterogeneity observed in many functional or imaging datasets, this paper focuses on subgroup learning in functional or image responses. While change-plane analysis has demonstrated empirical success in practice,…

Methodology · Statistics 2025-03-04 Xin Guan , Yiyuan Li , Xu Liu , Jinhong You

Motivated by the growing interest in representation learning approaches that uncover the latent structure of high-dimensional data, this work proposes new algorithms for reconstruction-based manifold learning within Reproducing-Kernel…

Machine Learning · Computer Science 2026-05-07 Enrique Feito-Casares , Francisco M. Melgarejo-Meseguer , José-Luis Rojo-Álvarez

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

The regression of a functional response on a set of scalar predictors can be a challenging task, especially if there is a large number of predictors, or the relationship between those predictors and the response is nonlinear. In this work,…

Machine Learning · Statistics 2023-08-24 Sidi Wu , Cédric Beaulac , Jiguo Cao

In this paper, we study the estimation and inference of change points under a functional linear regression model with changes in the slope function. We present a novel Functional Regression Binary Segmentation (FRBS) algorithm which is…

Methodology · Statistics 2026-02-02 Shivam Kumar , Haotian Xu , Haeran Cho , Daren Wang

Random objects are complex non-Euclidean data taking value in general metric space, possibly devoid of any underlying vector space structure. Such data are getting increasingly abundant with the rapid advancement in technology. Examples…

Methodology · Statistics 2023-10-13 Satarupa Bhattacharjee , Bing Li , Lingzhou Xue

Estimation of the mean and covariance functions is a fundamental problem in functional data analysis, particularly for discretely observed functional data. In this work, we study a regularization-based framework for estimating the mean and…

Statistics Theory · Mathematics 2026-03-20 Naveen Gupta , Bharath K Sriperumbudur

In this paper, an adaptive non-parametric method is proposed to estimate the scalar-valued nonlinear function that appears in uncertain systems governed by ordinary differential equations (ODEs). By employing an infinite-dimensional…

Optimization and Control · Mathematics 2021-03-15 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti

The aim of this paper is to model an ordinal response variable in terms of vector-valued functional data included on a vector-valued RKHS. In particular, we focus on the vector-valued RKHS obtained when a geometrical object (body) is…

Applications · Statistics 2018-07-13 Sonia Barahona , Pablo Centella , Ximo Gual-Arnau , Maria Victoria Ibáñez , Amelia Simó