English
Related papers

Related papers: Representer Theorems in Banach Spaces: Minimum Nor…

200 papers

Characterizing the function spaces corresponding to neural networks can provide a way to understand their properties. In this paper we discuss how the theory of reproducing kernel Banach spaces can be used to tackle this challenge. In…

Machine Learning · Statistics 2021-10-27 Francesca Bartolucci , Ernesto De Vito , Lorenzo Rosasco , Stefano Vigogna

We consider composite linear inverse problems where the signal to recover is modeled as a sum of two functions. We study a variational framework formulated as an optimization problem over the pairs of components using two regularization…

Optimization and Control · Mathematics 2026-05-25 Adrian Jarret , Julien Fageot

Well known to the machine learning community, the random feature model is a parametric approximation to kernel interpolation or regression methods. It is typically used to approximate functions mapping a finite-dimensional input space to…

Numerical Analysis · Mathematics 2022-06-23 Nicholas H. Nelsen , Andrew M. Stuart

When optimization theorists consider optimization problems in infinite dimensional spaces, they need to deal with closed convex subsets(usually cones) which mostly have empty interior. These subsets often prevent optimization theorists from…

Functional Analysis · Mathematics 2022-10-19 Lixin Cheng , Weihao Mao

We address the issue of binary classification in Banach spaces in presence of uncertainty. We show that a number of results from classical support vector machines theory can be appropriately generalised to their robust counterpart in Banach…

Machine Learning · Statistics 2022-02-18 Mohammed Sbihi , Nicolas Couellan

Given a category of objects, it is both useful and important to know if all the objects in the category may be realised as sub-objects -- via morphisms in the given category -- of a single object in that category enjoying some nice…

Functional Analysis · Mathematics 2019-07-18 M. A. Sofi

In the first part of this paper, we consider nonlinear extension of frame theory by introducing bi-Lipschitz maps $F$ between Banach spaces. Our linear model of bi-Lipschitz maps is the analysis operator associated with Hilbert frames,…

Information Theory · Computer Science 2015-06-12 Qiyu Sun , Wai-Shing Tang

We consider abstract inverse problems between infinite-dimensional Banach spaces. These inverse problems are typically nonlinear and ill-posed, making the inversion with limited and noisy measurements a delicate process. In this work, we…

Functional Analysis · Mathematics 2022-12-20 Giovanni S. Alberti , Ángel Arroyo , Matteo Santacesaria

This paper explores some important aspects of the theory of rearrangement-invariant quasi-Banach function spaces. We focus on two main topics. Firstly, we prove an analogue of the Luxemburg representation theorem for rearrangement-invariant…

Functional Analysis · Mathematics 2025-10-15 Anna Musilová , Aleš Nekvinda , Dalimil Peša , Hana Turčinová

In this paper we solve support vector machines in reproducing kernel Banach spaces with reproducing kernels defined on nonsymmetric domains instead of the traditional methods in reproducing kernel Hilbert spaces. Using the orthogonality of…

Machine Learning · Statistics 2015-01-16 Gregory E. Fasshauer , Fred J. Hickernell , Qi Ye

The minimum-norm interpolator (MNI) framework has recently attracted considerable attention as a tool for understanding generalization in overparameterized models, such as neural networks. In this work, we study the MNI under a $2$-uniform…

Functional Analysis · Mathematics 2026-04-01 Gil Kur , Pierre Bizeul

We study the solutions of infinite dimensional linear inverse problems over Banach spaces. The regularizer is defined as the total variation of a linear mapping of the function to recover, while the data fitting term is a near arbitrary…

Optimization and Control · Mathematics 2017-11-03 Axel Flinth , Pierre Weiss

We develop Banach spaces for ReLU neural networks of finite depth $L$ and infinite width. The spaces contain all finite fully connected $L$-layer networks and their $L^2$-limiting objects under bounds on the natural path-norm. Under this…

Machine Learning · Statistics 2020-07-31 Weinan E , Stephan Wojtowytsch

In this short article we present the theory of sparse representations recovery in convex regularized optimization problems introduced in (Carioni and Del Grande, arXiv:2311.08072, 2023). We focus on the scenario where the unknowns belong to…

Optimization and Control · Mathematics 2024-06-17 Marcello Carioni , Leonardo Del Grande

Tensor-based methods are receiving a growing interest in scientific computing for the numerical solution of problems defined in high dimensional tensor product spaces. A family of methods called Proper Generalized Decompositions methods…

Numerical Analysis · Mathematics 2011-12-02 Antonio Falco , Anthony Nouy

In this paper, we introduce a novel two-point gradient method for solving the ill-posed problems in Banach spaces and study its convergence analysis. The method is based on the well known iteratively regularized Landweber iteration method…

Numerical Analysis · Mathematics 2022-05-12 Gaurav Mittal , Ankik Kumar Giri

In statistical learning theory, interpolation spaces of the form $[\mathrm{L}^2,H]_{\theta,r}$, where $H$ is a reproducing kernel Hilbert space, are in widespread use. So far, however, they are only well understood for fine index $r=2$. We…

Functional Analysis · Mathematics 2025-12-23 Michael Bitzer , Ingo Steinwart

We develop a mathematical framework to address a broad class of metric and preference learning problems within a Hilbert space. We obtain a novel representer theorem for the simultaneous task of metric and preference learning. Our key…

Machine Learning · Computer Science 2025-10-28 Peyman Morteza

Consider linear ill-posed problems governed by the system $A_i x = y_i$ for $i =1, \cdots, p$, where each $A_i$ is a bounded linear operator from a Banach space $X$ to a Hilbert space $Y_i$. In case $p$ is huge, solving the problem by an…

Numerical Analysis · Mathematics 2023-05-17 Qinian Jin , Xiliang Lu , Liuying Zhang

It is well known that in the calculus of variations and in optimization there exist many formulations of the fundamental propositions on the attainment of the infima of sequentially weakly lower semicontinuous coercive functions on…

Functional Analysis · Mathematics 2022-05-04 Yan Tang , Shiqing Zhang , Tiexin Guo