English
Related papers

Related papers: Kernel partial least squares regression for functi…

200 papers

We propose an efficient online dictionary learning algorithm for kernel-based sparse representations. In this framework, input signals are nonlinearly mapped to a high-dimensional feature space and represented sparsely using a virtual…

Machine Learning · Computer Science 2025-07-03 Ghasem Alipoor , Karl Skretting

In many environmental applications involving spatially-referenced data, limitations on the number and locations of observations motivate the need for practical and efficient models for spatial interpolation, or kriging. A key component of…

Methodology · Statistics 2015-09-15 Mark D. Risser , Catherine A. Calder

Envelope methods improve the estimation efficiency in multivariate linear regression by identifying and separating the material and immaterial parts of the responses or the predictors and estimating the regression coefficients using only…

Methodology · Statistics 2025-09-10 Tate Jacobson

We propose a novel method to model nonlinear regression problems by adapting the principle of penalization to Partial Least Squares (PLS). Starting with a generalized additive model, we expand the additive component of each variable in…

Statistics Theory · Mathematics 2010-08-13 Nicole Kraemer , Anne-Laure Boulesteix , Gerhard Tutz

We discuss how to define a kernel for Signal Temporal Logic (STL) formulae. Such a kernel allows us to embed the space of formulae into a Hilbert space, and opens up the use of kernel-based machine learning algorithms in the context of STL.…

Machine Learning · Computer Science 2020-09-14 Luca Bortolussi , Giuseppe Maria Gallo , Laura Nenzi

This paper develops a novel spatial quantile function-on-scalar regression model, which studies the conditional spatial distribution of a high-dimensional functional response given scalar predictors. With the strength of both quantile…

Methodology · Statistics 2020-12-22 Zhengwu Zhang , Xiao Wang , Linglong Kong , Hongtu Zhu

This article investigates nonparametric estimation of variance functions for functional data when the mean function is unknown. We obtain asymptotic results for the kernel estimator based on squared residuals. Similar to the finite…

Methodology · Statistics 2008-12-16 Heng Lian

Kernel analog forecasting (KAF), alternatively known as kernel principal component regression, is a kernel method used for nonparametric statistical forecasting of dynamically generated time series data. This paper synthesizes descriptions…

Statistics Theory · Mathematics 2020-06-24 Romeo Alexander , Dimitrios Giannakis

Functional linear regression is an important topic in functional data analysis. It is commonly assumed that samples of the functional predictor are independent realizations of an underlying stochastic process, and are observed over a grid…

Methodology · Statistics 2020-09-15 Cheng Chen , Shaojun Guo , Xinghao Qiao

Stochastic configuration networks (SCNs), as a class of randomized learner models, are featured by its way of random parameters assignment in the light of a supervisory mechanism, resulting in the universal approximation property at…

Machine Learning · Computer Science 2024-12-17 Yongxuan Chen , Dianhui Wang

In quantum and quantum-inspired machine learning, the very first step is to embed the data in quantum space known as Hilbert space. Developing quantum kernel function (QKF), which defines the distances among the samples in the Hilbert…

Quantum Physics · Physics 2022-08-15 Wei-Ming Li , Shi-Ju Ran

Classical functional linear regression models the relationship between a scalar response and a functional covariate, where the coefficient function is assumed to be identical for all subjects. In this paper, the classical model is extended…

Methodology · Statistics 2022-11-29 Yifan Sun , Ziyi Liu , Wu Wang

In this paper, we propose a Network-Weighted Functional Regression (NWFR) model, an extension of Spatially Weighted Functional Regression (SWFR) to functional data defined on network-structured settings. To asses predictive uncertainity, we…

Methodology · Statistics 2025-06-02 Elvira Romano , Antonio Irpino , Claire Miller

This paper introduces an efficient multi-linear nonparametric (kernel-based) approximation framework for data regression and imputation, and its application to dynamic magnetic-resonance imaging (dMRI). Data features are assumed to reside…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Duc Thien Nguyen , Konstantinos Slavakis

The Koopman operator provides a linear framework to study nonlinear dynamical systems. Its spectra offer valuable insights into system dynamics, but the operator can exhibit both discrete and continuous spectra, complicating direct…

Dynamical Systems · Mathematics 2025-05-02 Jonghyeon Lee , Boumediene Hamzi , Boya Hou , Houman Owhadi , Gabriele Santin , Umesh Vaidya

We study regression models for the situation where both dependent and independent variables are square-integrable stochastic processes. Questions concerning the definition and existence of the corresponding functional linear regression…

Statistics Theory · Mathematics 2011-02-28 Guozhong He , Hans-Georg Müller , Jane-Ling Wang , Wenjing Yang

Most machine learning algorithms, such as classification or regression, treat the individual data point as the object of interest. Here we consider extending machine learning algorithms to operate on groups of data points. We suggest…

Machine Learning · Computer Science 2021-01-15 Danica J. Sutherland , Liang Xiong , Barnabás Póczos , Jeff Schneider

A fast and flexible $k$NN procedure is developed for dealing with a semiparametric functional regression model involving both partial-linear and single-index components. Rates of uniform consistency are presented. Simulated experiments…

Methodology · Statistics 2024-01-29 Silvia Novo , Germán Aneiros , Philippe Vieu

We propose non-stationary spectral kernels for Gaussian process regression. We propose to model the spectral density of a non-stationary kernel function as a mixture of input-dependent Gaussian process frequency density surfaces. We solve…

Machine Learning · Statistics 2019-09-25 Sami Remes , Markus Heinonen , Samuel Kaski

We present a machine learning approach for model-independent new physics searches. The corresponding algorithm is powered by recent large-scale implementations of kernel methods, nonparametric learning algorithms that can approximate any…

High Energy Physics - Phenomenology · Physics 2022-10-17 Marco Letizia , Gianvito Losapio , Marco Rando , Gaia Grosso , Andrea Wulzer , Maurizio Pierini , Marco Zanetti , Lorenzo Rosasco