English
Related papers

Related papers: Representer Theorems in Banach Spaces: Minimum Nor…

200 papers

The representer theorem is one of the most important mathematical foundations for regularised learning and kernel methods. Classical formulations of the theorem state sufficient conditions under which a regularisation problem on a Hilbert…

Functional Analysis · Mathematics 2019-11-04 Kevin Schlegel

We consider a general regularised interpolation problem for learning a parameter vector from data. The well known representer theorem says that under certain conditions on the regulariser there exists a solution in the linear span of the…

Functional Analysis · Mathematics 2019-05-14 Kevin Schlegel

We consider a general regularised interpolation problem for learning a parameter vector from data. The well known representer theorem says that under certain conditions on the regulariser there exists a solution in the linear span of the…

Machine Learning · Computer Science 2018-04-26 Kevin Schlegel

Sparsity of a learning solution is a desirable feature in machine learning. Certain reproducing kernel Banach spaces (RKBSs) are appropriate hypothesis spaces for sparse learning methods. The goal of this paper is to understand what kind of…

Functional Analysis · Mathematics 2024-03-08 Rui Wang , Yuesheng Xu , Mingsong Yan

Reproducing kernel Hilbert spaces provide a foundational framework for kernel-based learning, where regularization and interpolation problems admit finite-dimensional solutions through classical representer theorems. Many modern learning…

Machine Learning · Computer Science 2026-02-10 Isabel de la Higuera , Francisco Herrera , M. Victoria Velasco

This article delves into the study of the theory of regularized learning in Banach spaces for linear-functional data. It encompasses discussions on representer theorems, pseudo-approximation theorems, and convergence theorems. Regularized…

Machine Learning · Computer Science 2025-03-05 Qi Ye

The standard approach for dealing with the ill-posedness of the training problem in machine learning and/or the reconstruction of a signal from a limited number of measurements is regularization. The method is applicable whenever the…

Optimization and Control · Mathematics 2020-07-13 Michael Unser

We characterize the solution of a broad class of convex optimization problems that address the reconstruction of a function from a finite number of linear measurements. The underlying hypothesis is that the solution is decomposable as a…

Optimization and Control · Mathematics 2021-07-26 Michael Unser , Shayan Aziznejad

In this paper we introduce the class of infinite infimal convolution functionals and apply these functionals to the regularization of ill-posed inverse problems. The proposed regularization involves an infimal convolution of a continuously…

Optimization and Control · Mathematics 2024-12-17 Kristian Bredies , Marcello Carioni , Martin Holler , Yury Korolev , Carola-Bibiane Schönlieb

This paper proposes a unified framework for the investigation of constrained learning theory in reflexive Banach spaces of features via regularized empirical risk minimization. The focus is placed on Tikhonov-like regularization with…

Statistics Theory · Mathematics 2016-10-20 Patrick L. Combettes , Saverio Salzo , Silvia Villa

Characterizing the function spaces defined by neural networks helps understanding the corresponding learning models and their inductive bias. While in some limits neural networks correspond to function spaces that are Hilbert spaces, these…

Machine Learning · Statistics 2025-08-22 Francesca Bartolucci , Ernesto De Vito , Lorenzo Rosasco , Stefano Vigogna

We consider ill-posed linear operator equations with operators acting between Banach spaces. For solution approximation, the methods of choice here are projection methods onto finite dimensional subspaces, thus extending existing results…

Numerical Analysis · Mathematics 2016-04-26 Uno Hämarik , Barbara Kaltenbacher , Urve Kangro , Elena Resmerita

Learning methods in Banach spaces are often formulated as regularization problems which minimize the sum of a data fidelity term in a Banach norm and a regularization term in another Banach norm. Due to the infinite dimensional nature of…

Functional Analysis · Mathematics 2023-12-12 Raymond Cheng , Rui Wang , Yuesheng Xu

We develop a variational framework to understand the properties of the functions learned by neural networks fit to data. We propose and study a family of continuous-domain linear inverse problems with total variation-like regularization in…

Machine Learning · Statistics 2021-02-15 Rahul Parhi , Robert D. Nowak

In this paper we provide a finite-sample and an infinite-sample representer theorem for the concatenation of (linear combinations of) kernel functions of reproducing kernel Hilbert spaces. These results serve as mathematical foundation for…

Machine Learning · Computer Science 2018-06-08 Bastian Bohn , Michael Griebel , Christian Rieger

The purpose of this paper is to study an implicit scheme for a representation of nonexpansive mappings on a closed convex subset of a smooth and uniformly convex Banach space with respect to a left regular sequence of means defined on an…

Functional Analysis · Mathematics 2015-06-10 Ebrahim Soori

Targeting at sparse learning, we construct Banach spaces B of functions on an input space X with the properties that (1) B possesses an l1 norm in the sense that it is isometrically isomorphic to the Banach space of integrable functions on…

Machine Learning · Statistics 2015-01-16 Guohui Song , Haizhang Zhang , Fred J. Hickernell

This work will be centered in commutative Banach subalgebras of the algebra of bounded linear operators defined on a Free Banach spaces of countable type. The main goal of this work wil be to formulate a representation theorem for these…

Functional Analysis · Mathematics 2017-07-25 José Aguayo , Miguel Nova , Jacqueline Ojeda

The purpose of this paper is devoted to studying representation of measures of non generalized compactness, in particular, measures of noncompactness, of non-weak compactness, and of non-super weak compactness, etc, defined on Banach spaces…

Functional Analysis · Mathematics 2021-03-15 Xiaoling Chen , Lixin Cheng

This paper introduces a hypothesis space for deep learning based on deep neural networks (DNNs). By treating a DNN as a function of two variables - the input variable and the parameter variable - we consider the set of DNNs where the…

Machine Learning · Statistics 2025-08-15 Rui Wang , Yuesheng Xu , Mingsong Yan
‹ Prev 1 2 3 10 Next ›