English
Related papers

Related papers: Vector-Valued Reproducing Kernel Banach Spaces for…

200 papers

This manuscript presents an algorithm for obtaining an approximation of a nonlinear high order control affine dynamical system. Controlled trajectories of the system are leveraged as the central unit of information via embedding them in…

Optimization and Control · Mathematics 2026-01-23 Moad Abudia , Tejasvi Channagiri , Joel A. Rosenfeld , Rushikesh Kamalapurkar

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

We develop a comprehensive framework for spatio-temporal prediction of time-varying vector fields using operator-valued reproducing kernel Hilbert spaces (OV RKHS). By integrating Sobolev regularity with Koopman operator theory, we…

General Mathematics · Mathematics 2026-05-12 Mahishanka Withanachchi

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Mohammad Khosravi , Roy S. Smith

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

Despite the many successful applications of deep learning models for multidimensional signal and image processing, most traditional neural networks process data represented by (multidimensional) arrays of real numbers. The intercorrelation…

Machine Learning · Computer Science 2024-08-02 Marcos Eduardo Valle

In this paper, we establish a novel connection between the metric entropy growth and the embeddability of function spaces into reproducing kernel Hilbert/Banach spaces. Metric entropy characterizes the information complexity of function…

Numerical Analysis · Mathematics 2025-08-28 Yiping Lu , Daozhe Lin , Qiang Du

We develop a variational framework to understand the properties of the functions learned by neural networks fit to data. We propose and study a family of continuous-domain linear inverse problems with total variation-like regularization in…

Machine Learning · Statistics 2021-02-15 Rahul Parhi , Robert D. Nowak

Given a reproducing kernel Hilbert space H of real-valued functions and a suitable measure mu over the source space D (subset of R), we decompose H as the sum of a subspace of centered functions for mu and its orthogonal in H. This…

Machine Learning · Statistics 2012-12-10 Nicolas Durrande , David Ginsbourger , Olivier Roustant , Laurent Carraro

In this paper we study the variational problem associated to support vector regression in Banach function spaces. Using the Fenchel-Rockafellar duality theory, we give explicit formulation of the dual problem as well as of the related…

Optimization and Control · Mathematics 2017-05-08 Saverio Salzo , Johan A. K. Suykens

To characterize the function space explored by neural networks (NNs) is an important aspect of learning theory. In this work, noticing that a multi-layer NN generates implicitly a hierarchy of reproducing kernel Hilbert spaces (RKHSs) -…

Machine Learning · Computer Science 2024-04-12 Zhengdao Chen

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Machine Learning · Statistics 2021-12-22 Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda , Fuyuta Komura , Takeshi Katsura , Yoshinobu Kawahara

A mathematical model for variable selection in functional regression models with scalar response is proposed. By "variable selection" we mean a procedure to replace the whole trajectories of the functional explanatory variables with their…

Methodology · Statistics 2017-04-21 José R. Berrendero , Beatriz Bueno-Larraz , Antonio Cuevas

This paper presents a framework for computing random operator-valued feature maps for operator-valued positive definite kernels. This is a generalization of the random Fourier features for scalar-valued kernels to the operator-valued case.…

Machine Learning · Computer Science 2016-08-22 Ha Quang Minh

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola

This paper is devoted to the study of vector valued reproducing kernel Hilbert spaces. We focus on two aspects: vector valued feature maps and universal kernels. In particular we characterize the structure of translation invariant kernels…

Functional Analysis · Mathematics 2008-07-11 C. Carmeli , E. De Vito , A. Toigo , V. Umanità

In this paper, we consider the reproducing property in Reproducing Kernel Hilbert Spaces (RKHS). We establish a reproducing property for the closure of the class of combinations of composition operators under minimal conditions. This allows…

Statistics Theory · Mathematics 2025-04-01 Fatima-Zahrae El-Boukkouri , Josselin Garnier , Olivier Roustant

Kernel methods are powerful tools to capture nonlinear patterns behind data. They implicitly learn high (even infinite) dimensional nonlinear features in the Reproducing Kernel Hilbert Space (RKHS) while making the computation tractable by…

Machine Learning · Statistics 2017-11-28 Shuai Zhang , Jianxin Li , Pengtao Xie , Yingchun Zhang , Minglai Shao , Haoyi Zhou , Mengyi Yan

Automatic 3D neuron reconstruction is critical for analysing the morphology and functionality of neurons in brain circuit activities. However, the performance of existing tracing algorithms is hinged by the low image quality. Recently, a…

Image and Video Processing · Electrical Eng. & Systems 2021-09-17 Heng Wang , Chaoyi Zhang , Jianhui Yu , Yang Song , Siqi Liu , Wojciech Chrzanowski , Weidong Cai

In this paper we construct and theoretically analyse group equivariant convolutional kernel networks (CKNs) which are useful in understanding the geometry of (equivariant) CNNs through the lens of reproducing kernel Hilbert spaces (RKHSs).…

Machine Learning · Computer Science 2024-08-09 Soutrik Roy Chowdhury