English
Related papers

Related papers: A universal reproducing kernel Hilbert space for l…

200 papers

An adaptive observer is designed for online estimation of Hilbert-Schmidt operators from online measurement of the state for some class of nonlinear infinite-dimensional dynamical systems. Convergence is ensured under detectability and…

Optimization and Control · Mathematics 2022-10-10 Lucas Brivadis , Antoine Chaillet , Jean Auriol

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Mohammad Khosravi , Roy S. Smith

Universal approximation theorem suggests that a shallow neural network can approximate any function. The input to neurons at each layer is a weighted sum of previous layer neurons and then an activation is applied. These activation…

Machine Learning · Computer Science 2020-10-30 Bhaavan Goel

Many recent theoretical works on \emph{meta-learning} aim to achieve guarantees in leveraging similar representational structures from related tasks towards simplifying a target task. The main aim of theoretical guarantees on the subject is…

Machine Learning · Statistics 2025-05-21 Dimitri Meunier , Zhu Li , Arthur Gretton , Samory Kpotufe

We introduce so-called functional input neural networks defined on a possibly infinite dimensional weighted space with values also in a possibly infinite dimensional output space. To this end, we use an additive family to map the input…

Machine Learning · Statistics 2025-12-03 Christa Cuchiero , Philipp Schmocker , Josef Teichmann

This paper introduces a diagonal adaptive kernel model that dynamically learns kernel eigenvalues and output coefficients simultaneously during training. Unlike fixed-kernel methods tied to the neural tangent kernel theory, the diagonal…

Machine Learning · Computer Science 2025-01-16 Yicheng Li , Qian Lin

In this article, the reproducing kernel Hilbert space [0, 1] is employed for solving a class of third-order periodic boundary value problem by using fitted reproducing kernel algorithm. The reproducing kernel function is built to get fast…

Numerical Analysis · Mathematics 2017-04-18 Asad Freihat , Radwan Abu-Gdairi , Hammad Khalil , Eman Abuteen , Mohammed Al-Smadi , Rahmat Ali Khan

We find probability error bounds for approximations of functions $f$ in a separable reproducing kernel Hilbert space $\mathcal{H}$ with reproducing kernel $K$ on a base space $X$, firstly in terms of finite linear combinations of functions…

Numerical Analysis · Mathematics 2024-02-26 Ata Deniz Aydin , Aurelian Gheondea

Kernel methods are powerful machine learning techniques which implement generic non-linear functions to solve complex tasks in a simple way. They Have a solid mathematical background and exhibit excellent performance in practice. However,…

Machine Learning · Computer Science 2021-01-27 J. Emmanuel Johnson , Valero Laparra , Adrián Pérez-Suay , Miguel D. Mahecha , Gustau Camps-Valls

In this paper, we develop a theory of learning nonlinear input-output maps with fading memory by dissipative quantum systems, as a quantum counterpart of the theory of approximating such maps using classical dynamical systems. The theory…

Quantum Physics · Physics 2024-12-20 Jiayin Chen , Hendra I. Nurdin

Motivated by the success of reinforcement learning (RL) for discrete-time tasks such as AlphaGo and Atari games, there has been a recent surge of interest in using RL for continuous-time control of physical systems (cf. many challenging…

Optimization and Control · Mathematics 2018-12-03 Motoya Ohnishi , Masahiro Yukawa , Mikael Johansson , Masashi Sugiyama

An extension of reproducing kernel Hilbert space (RKHS) theory provides a new framework for modeling functional regression models with functional responses. The approach only presumes a general nonlinear regression structure as opposed to…

Statistics Theory · Mathematics 2008-12-17 Heng Lian

Our main theorem is in the generality of the axioms of Hilbert space, and the theory of unbounded operators. Consider two Hilbert spaces such that their intersection contains a fixed vector space D. It is of interest to make a precise…

Functional Analysis · Mathematics 2017-01-19 Palle Jorgensen , Erin Pearse , Feng Tian

This note characterizes multiplicative linear functionals on reproducing kernel Hilbert spaces of functions on the Euclidean unit ball in complex d-dimensional space, in terms of their action on kernel functions. The kernels considered are…

Functional Analysis · Mathematics 2026-05-22 Tirthankar Bhattacharyya , Jaikishan , Poornendu Kumar

This article studies sufficient conditions on families of approximating kernels which provide $N$--term approximation errors from an associated nonlinear approximation space which match the best known orders of $N$--term wavelet expansion.…

Functional Analysis · Mathematics 2019-03-15 Keaton Hamm , Jeff Ledford

In this paper we present a systematic study of regular sequences of quasi-nonexpansive operators in Hilbert space. We are interested, in particular, in weakly, boundedly and linearly regular sequences of operators. We show that the type of…

Optimization and Control · Mathematics 2018-02-13 Andrzej Cegielski , Simeon Reich , Rafał Zalas

This paper studies the construction of a refinement kernel for a given operator-valued reproducing kernel such that the vector-valued reproducing kernel Hilbert space of the refinement kernel contains that of the given one as a subspace.…

Machine Learning · Computer Science 2011-02-08 Yuesheng Xu , Haizhang Zhang , Qinghui Zhang

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi

Kernel approximation via nonlinear random feature maps is widely used in speeding up kernel machines. There are two main challenges for the conventional kernel approximation methods. First, before performing kernel approximation, a good…

Machine Learning · Statistics 2015-03-16 Felix X. Yu , Sanjiv Kumar , Henry Rowley , Shih-Fu Chang

We study the approximation of operators acting on probability measures on a product space with prescribed marginal. Let $I$ be a label space endowed with a reference measure $\lambda$, and define $\cal M_\lambda$ as the set of probability…

Optimization and Control · Mathematics 2026-03-24 Samy Mekkaoui , Huyên Pham , Xavier Warin