English
Related papers

Related papers: Sparse multiresolution representations with adapti…

200 papers

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

Statistics Theory · Mathematics 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Machine Learning · Statistics 2021-12-22 Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda , Fuyuta Komura , Takeshi Katsura , Yoshinobu Kawahara

Reproducing Kernel Hilbert spaces (RKHS) have been a very successful tool in various areas of machine learning. Recently, Barron spaces have been used to prove bounds on the generalisation error for neural networks. Unfortunately, Barron…

Functional Analysis · Mathematics 2023-03-14 Len Spek , Tjeerd Jan Heeringa , Felix Schwenninger , Christoph Brune

We develop a mathematical framework to address a broad class of metric and preference learning problems within a Hilbert space. We obtain a novel representer theorem for the simultaneous task of metric and preference learning. Our key…

Machine Learning · Computer Science 2025-10-28 Peyman Morteza

We develop a stochastic approximation framework for learning nonlinear operators between infinite-dimensional spaces utilizing general Mercer operator-valued kernels. Our framework encompasses two key classes: (i) compact kernels, which…

Machine Learning · Statistics 2026-01-13 Jia-Qi Yang , Lei Shi

A model for the prediction of functional time series is introduced, where observations are assumed to be continuous random functions. We model the dependence of the data with a nonstandard autoregressive structure, motivated in terms of the…

Methodology · Statistics 2018-07-03 Beatriz Bueno-Larraz , Johannes Klepsch

Estimating the dissipativity of nonlinear systems from empirical data is useful for the analysis and control of nonlinear systems, especially when an accurate model is unavailable. Based on a Koopman operator model of the nonlinear system…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Xiuzhen Ye , Wentao Tang

This paper extends a conventional, general framework for online adaptive estimation problems for systems governed by unknown nonlinear ordinary differential equations. The central feature of the theory introduced in this paper represents…

Systems and Control · Computer Science 2017-07-11 Parag Bobade , Suprotim Majumdar , Savio Pereira , Andrew J. Kurdila , John B. Ferris

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of…

Machine Learning · Statistics 2024-02-20 Jiading Liu , Lei Shi

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

The empirical success of deep convolutional networks on tasks involving high-dimensional data such as images or audio suggests that they can efficiently approximate certain functions that are well-suited for such tasks. In this paper, we…

Machine Learning · Statistics 2022-03-22 Alberto Bietti

We propose a novel Bayesian methodology for inference in functional linear and logistic regression models based on the theory of reproducing kernel Hilbert spaces (RKHS's). We introduce general models that build upon the RKHS generated by…

Methodology · Statistics 2025-09-09 José R. Berrendero , Antonio Coín , Antonio Cuevas

This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate…

Statistics Theory · Mathematics 2026-01-30 Markus Holzleitner , Sergiy Pereverzyev , Sergei V. Pereverzyev , Vaibhav Silmana , S. Sivananthan

Kernel embeddings have emerged as a powerful tool for representing probability measures in a variety of statistical inference problems. By mapping probability measures into a reproducing kernel Hilbert space (RKHS), kernel embeddings enable…

Machine Learning · Statistics 2024-10-31 Dino Sejdinovic

Motivated by applications to the study of stochastic processes, we introduce a new analysis of positive definite kernels $K$, their reproducing kernel Hilbert spaces (RKHS), and an associated family of feature spaces that may be chosen in…

Functional Analysis · Mathematics 2017-07-27 Palle Jorgensen , Feng Tian

In this paper, we consider the nonparametric least square regression in a Reproducing Kernel Hilbert Space (RKHS). We propose a new randomized algorithm that has optimal generalization error bounds with respect to the square loss, closing a…

Machine Learning · Computer Science 2019-05-28 Kwang-Sung Jun , Ashok Cutkosky , Francesco Orabona

We present a new framework for online Least Squares algorithms for nonlinear modeling in RKH spaces (RKHS). Instead of implicitly mapping the data to a RKHS (e.g., kernel trick), we map the data to a finite dimensional Euclidean space,…

Machine Learning · Computer Science 2016-06-14 Pantelis Bouboulis , Spyridon Pougkakiotis , Sergios Theodoridis

A framework for estimation and hypothesis testing of functional restrictions against general alternatives is proposed. The parameter space is a reproducing kernel Hilbert space (RKHS). The null hypothesis does not necessarily define a…

Methodology · Statistics 2018-08-21 Alessio Sancetta

Hyperspectral measurements from long range sensors can give a detailed picture of the items, materials, and chemicals in a scene but analysis can be difficult, slow, and expensive due to high spatial and spectral resolutions of…

Machine Learning · Computer Science 2023-10-10 Michael G. Rawson , Timothy Doster

We propose a representation of Gaussian processes (GPs) based on powers of the integral operator defined by a kernel function, we call these stochastic processes integral Gaussian processes (IGPs). Sample paths from IGPs are functions…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Sayan Mukherjee
‹ Prev 1 3 4 5 6 7 10 Next ›