English
Related papers

Related papers: Vector-Valued Reproducing Kernel Banach Spaces for…

200 papers

Motivated by multi-task machine learning with Banach spaces, we propose the notion of vector-valued reproducing kernel Banach spaces (RKBS). Basic properties of the spaces and the associated reproducing kernels are investigated. We also…

Functional Analysis · Mathematics 2012-02-20 Haizhang Zhang , Jun Zhang

Identifying an appropriate function space for deep neural networks remains a key open question. While shallow neural networks are naturally associated with Reproducing Kernel Banach Spaces (RKBS), deep networks present unique challenges. In…

Machine Learning · Computer Science 2025-01-08 Tjeerd Jan Heeringa , Len Spek , Christoph Brune

Characterizing the function spaces defined by neural networks helps understanding the corresponding learning models and their inductive bias. While in some limits neural networks correspond to function spaces that are Hilbert spaces, these…

Machine Learning · Statistics 2025-08-22 Francesca Bartolucci , Ernesto De Vito , Lorenzo Rosasco , Stefano Vigogna

Focusing on establishing a mathematical basis for kernel methods in sparse multi-task learning, we explore the theory of vector-valued reproducing kernel Banach spaces (RKBSs) endowed with $\ell_{p,1}$-norms ($1\le p\le +\infty$),…

Functional Analysis · Mathematics 2025-08-05 Liangzhi Chen , Haizhang Zhang , Jun Zhang

In this paper, we introduce a generalization of Reproducing Kernel Banach Spaces (RKBS), which we term \emph{Generalized Reproducing Kernel Banach Spaces} (GRKBS). The motivation stems from recent results showing that classical fully…

Functional Analysis · Mathematics 2026-01-21 Raul Felipe-Sosa

Recently, there has been emerging interest in constructing reproducing kernel Banach spaces (RKBS) for applied and theoretical purposes such as machine learning, sampling reconstruction, sparse approximation and functional analysis.…

Machine Learning · Computer Science 2021-12-09 Rongrong Lin , Haizhang Zhang , Jun Zhang

Motivated by the growing interest in representation learning approaches that uncover the latent structure of high-dimensional data, this work proposes new algorithms for reconstruction-based manifold learning within Reproducing-Kernel…

Machine Learning · Computer Science 2026-05-07 Enrique Feito-Casares , Francisco M. Melgarejo-Meseguer , José-Luis Rojo-Álvarez

This paper introduces a novel theoretical framework for the analysis of vector-valued neural networks through the development of vector-valued variation spaces, a new class of reproducing kernel Banach spaces. These spaces emerge from…

Machine Learning · Statistics 2024-08-21 Joseph Shenouda , Rahul Parhi , Kangwook Lee , Robert D. Nowak

This article studies constructions of reproducing kernel Banach spaces (RKBSs) which may be viewed as a generalization of reproducing kernel Hilbert spaces (RKHSs). A key point is to endow Banach spaces with reproducing kernels such that…

Functional Analysis · Mathematics 2017-06-27 Yuesheng Xu , Qi Ye

In this paper we solve support vector machines in reproducing kernel Banach spaces with reproducing kernels defined on nonsymmetric domains instead of the traditional methods in reproducing kernel Hilbert spaces. Using the orthogonality of…

Machine Learning · Statistics 2015-01-16 Gregory E. Fasshauer , Fred J. Hickernell , Qi Ye

Reproducing Kernel Hilbert spaces (RKHS) have been a very successful tool in various areas of machine learning. Recently, Barron spaces have been used to prove bounds on the generalisation error for neural networks. Unfortunately, Barron…

Functional Analysis · Mathematics 2023-03-14 Len Spek , Tjeerd Jan Heeringa , Felix Schwenninger , Christoph Brune

This paper introduces a hypothesis space for deep learning based on deep neural networks (DNNs). By treating a DNN as a function of two variables - the input variable and the parameter variable - we consider the set of DNNs where the…

Machine Learning · Statistics 2025-08-15 Rui Wang , Yuesheng Xu , Mingsong Yan

Since its introduction, the Discrete Variable Representation (DVR) basis set has become an invaluable representation of state vectors and Hermitian operators in non-relativistic quantum dynamics and spectroscopy calculations. On the other…

Computational Physics · Physics 2014-05-30 Hamse Mussa

Characterizing the function spaces corresponding to neural networks can provide a way to understand their properties. In this paper we discuss how the theory of reproducing kernel Banach spaces can be used to tackle this challenge. In…

Machine Learning · Statistics 2021-10-27 Francesca Bartolucci , Ernesto De Vito , Lorenzo Rosasco , Stefano Vigogna

This paper is devoted to the study of vector valued reproducing kernel Hilbert spaces. We focus on reproducing kernels in vector-valued reproducing kernel Hilbert spaces. In particular we extend reproducing kernels to relative reproducing…

Functional Analysis · Mathematics 2016-01-07 Ali Ebadian , Saeed Hashemi Sababe

Recent works have characterized the function-space inductive bias of infinite-width bounded-norm single-hidden-layer neural networks as a kind of bounded-variation-type space. This novel neural network Banach space encompasses many…

Machine Learning · Computer Science 2025-09-03 Akash Kumar , Rahul Parhi , Mikhail Belkin

Substring kernels are classical tools for representing biological sequences or text. However, when large amounts of annotated data are available, models that allow end-to-end training such as neural networks are often preferred. Links…

Machine Learning · Statistics 2019-10-18 Dexiong Chen , Laurent Jacob , Julien Mairal

Reproducing kernel Hilbert spaces provide a foundational framework for kernel-based learning, where regularization and interpolation problems admit finite-dimensional solutions through classical representer theorems. Many modern learning…

Machine Learning · Computer Science 2026-02-10 Isabel de la Higuera , Francisco Herrera , M. Victoria Velasco

The study of Neural Tangent Kernels (NTKs) has provided much needed insight into convergence and generalization properties of neural networks in the over-parametrized (wide) limit by approximating the network using a first-order Taylor…

Machine Learning · Statistics 2023-02-02 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh

This paper studies the construction of a refinement kernel for a given operator-valued reproducing kernel such that the vector-valued reproducing kernel Hilbert space of the refinement kernel contains that of the given one as a subspace.…

Machine Learning · Computer Science 2011-02-08 Yuesheng Xu , Haizhang Zhang , Qinghui Zhang
‹ Prev 1 2 3 10 Next ›