English
Related papers

Related papers: Regularized Learning Schemes in Feature Banach Spa…

200 papers

We consider a statistical inverse learning problem, where the task is to estimate a function $f$ based on noisy point evaluations of $Af$, where $A$ is a linear operator. The function $Af$ is evaluated at i.i.d. random design points $u_n$,…

Machine Learning · Statistics 2021-11-02 Tatiana A. Bubba , Martin Burger , Tapio Helin , Luca Ratti

This work is concerned with linear inverse problems where a distributed parameter is known a priori to only take on values from a given discrete set. This property can be promoted in Tikhonov regularization with the aid of a suitable convex…

Optimization and Control · Mathematics 2018-04-19 Christian Clason , Thi Bich Tram Do

Operator learning is a data-driven approximation of mappings between infinite-dimensional function spaces, such as the solution operators of partial differential equations. Kernel-based operator learning can offer accurate, theoretically…

Machine Learning · Computer Science 2025-12-22 Xinyue Yu , Hayden Schaeffer

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

Learning methods in Banach spaces are often formulated as regularization problems which minimize the sum of a data fidelity term in a Banach norm and a regularization term in another Banach norm. Due to the infinite dimensional nature of…

Functional Analysis · Mathematics 2023-12-12 Raymond Cheng , Rui Wang , Yuesheng Xu

The goal of this work is to serve as a foundation for deep studies of the topology of state, action, and policy spaces in reinforcement learning. By studying these spaces from a mathematical perspective, we expect to gain more insight into…

Machine Learning · Computer Science 2024-10-08 David Krame Kadurha

Feature selection identifies subsets of informative features and reduces dimensions in the original feature space, helping provide insights into data generation or a variety of domain problems. Existing methods mainly depend on feature…

Machine Learning · Computer Science 2021-06-07 Xinxing Wu , Qiang Cheng

This article addresses the challenge of learning effective regularizers for linear inverse problems. We analyze and compare several types of learned variational regularization against the theoretical benchmark of the optimal affine…

Numerical Analysis · Mathematics 2025-10-15 Sebastian Banert , Christoph Brauer , Dirk Lorenz , Lionel Tondji

We consider Tikhonov-type variational regularization of ill-posed linear operator equations in Banach spaces with general convex penalty functionals. Upper bounds for certain error measures expressing the distance between exact and…

Numerical Analysis · Mathematics 2017-12-06 Jens Flemming

This work introduces Bilinear Classes, a new structural framework, which permit generalization in reinforcement learning in a wide variety of settings through the use of function approximation. The framework incorporates nearly all existing…

Machine Learning · Computer Science 2021-07-13 Simon S. Du , Sham M. Kakade , Jason D. Lee , Shachar Lovett , Gaurav Mahajan , Wen Sun , Ruosong Wang

In this paper we derive higher order convergence rates in terms of the Bregman distance for Tikhonov like convex regularisation for linear operator equations on Banach spaces. The approach is based on the idea of variational inequalities,…

Optimization and Control · Mathematics 2011-07-14 Markus Grasmair

The success of deep neural networks is mostly due their ability to learn meaningful features from the data. Features learned in the hidden layers of deep neural networks trained in computer vision tasks have been shown to be similar to…

Machine Learning · Computer Science 2017-01-04 Biswajit Paria , Vikas Reddy , Anirban Santara , Pabitra Mitra

This paper studies Tikhonov regularization for finitely smoothing operators in Banach spaces when the penalization enforces too much smoothness in the sense that the penalty term is not finite at the true solution. In a Hilbert space…

Numerical Analysis · Mathematics 2022-03-07 Philip Miller , Thorsten Hohage

We consider a general regularised interpolation problem for learning a parameter vector from data. The well known representer theorem says that under certain conditions on the regulariser there exists a solution in the linear span of the…

Functional Analysis · Mathematics 2019-05-14 Kevin Schlegel

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key contribution is a control-theoretic regularizer for dynamics fitting rooted in the notion of…

Optimization and Control · Mathematics 2019-08-01 Sumeet Singh , Spencer M. Richards , Vikas Sindhwani , Jean-Jacques E. Slotine , Marco Pavone

Many recent successful (deep) reinforcement learning algorithms make use of regularization, generally based on entropy or Kullback-Leibler divergence. We propose a general theory of regularized Markov Decision Processes that generalizes…

Machine Learning · Computer Science 2019-06-05 Matthieu Geist , Bruno Scherrer , Olivier Pietquin

In the context of image processing, given a $k$-th order, homogeneous and linear differential operator with constant coefficients, we study a class of variational problems whose regularizing terms depend on the operator. Precisely, the…

Numerical Analysis · Mathematics 2022-11-15 Valerio Pagliari , Kostas Papafitsoros , Bogdan Raiţă , Andreas Vikelis

In this paper, we discuss the construction, analysis and implementation of a novel iterative regularization scheme with general convex penalty term for nonlinear inverse problems in Banach spaces based on the homotopy perturbation…

Numerical Analysis · Mathematics 2018-01-10 Jing Wang , Wei Wang , Bo Han