English
Related papers

Related papers: Optimal Penalized Function-on-Function Regression …

200 papers

Hypothesis testing procedures are developed to assess linear operator constraints in function-on-scalar regression when incomplete functional responses are observed. The approach enables statistical inferences about the shape and other…

Methodology · Statistics 2022-12-06 Yeonjoo Park , Kyunghee Han , Douglas G. Simpson

Modern multivariate machine learning and statistical methodologies estimate parameters of interest while leveraging prior knowledge of the association between outcome variables. The methods that do allow for estimation of relationships do…

Methodology · Statistics 2021-06-10 Ben Sherwood , Bradley S. Price

We develop a modeling framework for dynamic function-on-scalars regression, in which a time series of functional data is regressed on a time series of scalar predictors. The regression coefficient function for each predictor is allowed to…

Methodology · Statistics 2018-10-25 Daniel R. Kowal

We consider multi-agent stochastic optimization problems over reproducing kernel Hilbert spaces (RKHS). In this setting, a network of interconnected agents aims to learn decision functions, i.e., nonlinear statistical models, that are…

Optimization and Control · Mathematics 2018-07-04 Alec Koppel , Santiago Paternain , Cedric Richard , Alejandro Ribeiro

We consider a one-dimensional diffusion process $(X_t)$ which is observed at $n+1$ discrete times with regular sampling interval $\Delta$. Assuming that $(X_t)$ is strictly stationary, we propose nonparametric estimators of the drift and…

Statistics Theory · Mathematics 2009-09-29 Fabienne Comte , Valentine Genon-Catalot , Yves Rozenholc

Simplicial-simplicial regression refers to the regression setting where both the responses and predictor variables lie within the simplex space, i.e. they are compositional. For this setting, constrained least squares, where the regression…

Methodology · Statistics 2024-12-24 Michail Tsagris

We propose a new reconstruction operator that aims to recover the missing parts of a function given the observed parts. This new operator belongs to a new, very large class of functional operators which includes the classical regression…

Statistics Theory · Mathematics 2019-05-14 Alois Kneip , Dominik Liebl

We describe a method to perform functional operations on probability distributions of random variables. The method uses reproducing kernel Hilbert space representations of probability distributions, and it is applicable to all operations…

Machine Learning · Statistics 2016-09-14 Bernhard Schölkopf , Krikamol Muandet , Kenji Fukumizu , Jonas Peters

In functional data analysis, functional linear regression has attracted significant attention recently. Herein, we consider the case where both the response and covariates are functions. There are two available approaches for addressing…

Methodology · Statistics 2021-09-28 Mauro Bernardi , Antonio Canale , Marco Stefanucci

In this paper, we present a unified approach to function approximation in reproducing kernel Hilbert spaces (RKHS) that establishes a previously unrecognized optimality property for several well-known function approximation techniques, such…

Statistics Theory · Mathematics 2013-01-08 Richard J. Barton

This paper proposes distributed estimation procedures for three scalar-on-function regression models: the functional linear model (FLM), the functional non-parametric model (FNPM), and the functional partial linear model (FPLM). The…

Computation · Statistics 2026-01-08 Peilun He , Han Lin Shang , Nan Zou

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

We consider the estimation of a regression function with random design and heteroscedastic noise in a nonparametric setting. More precisely, we address the problem of characterizing the optimal penalty when the regression function is…

Statistics Theory · Mathematics 2015-06-29 Adrien Saumard

The problem of fitting experimental data to a given model function $f(t; p_1,p_2,\dots,p_N)$ is conventionally solved numerically by methods such as that of Levenberg-Marquardt, which are based on approximating the Chi-squared measure of…

Optimization and Control · Mathematics 2017-03-14 Alberto Herrera-Gomez , R. Michael Porter

We introduce a spatial function-on-function regression model to capture spatial dependencies in functional data by integrating spatial autoregressive techniques with functional principal component analysis. The proposed model addresses a…

Estimation of the mean and covariance functions is a fundamental problem in functional data analysis, particularly for discretely observed functional data. In this work, we study a regularization-based framework for estimating the mean and…

Statistics Theory · Mathematics 2026-03-20 Naveen Gupta , Bharath K Sriperumbudur

We delve into the estimation of the functional coefficients and inference for varying coefficient model. Applying Laguerre series, we develop an estimator for the vector of functional coefficients that attains asymptotically optimal…

Statistics Theory · Mathematics 2026-05-04 Rida Benhaddou , Khalid Chokri , Jackson Pinschenat

We consider nonparametric regression with functional covariates, that is, they are elements of an infinite-dimensional Hilbert space. A locally polynomial estimator is constructed, where an orthonormal basis and various tuning parameters…

Statistics Theory · Mathematics 2025-04-09 Moritz Jirak , Alois Kneip , Alexander Meister , Mario Pahl

In this paper we analyze a greedy procedure to approximate a linear functional defined in a Reproducing Kernel Hilbert Space by nodal values. This procedure computes a quadrature rule which can be applied to general functionals, including…

Numerical Analysis · Mathematics 2021-05-19 Gabriele Santin , Toni Karvonen , Bernard Haasdonk

We study hypothesis testing for penalized estimators in settings where the full marginal distribution of a multivariate response is difficult to specify, such as longitudinal data with correlated measurements or high-dimensional…

Methodology · Statistics 2026-04-08 Jing Zhou , Zhe Zhang