English
Related papers

Related papers: Learning nonlocal regularization operators

200 papers

In the context of image processing, given a $k$-th order, homogeneous and linear differential operator with constant coefficients, we study a class of variational problems whose regularizing terms depend on the operator. Precisely, the…

Numerical Analysis · Mathematics 2022-11-15 Valerio Pagliari , Kostas Papafitsoros , Bogdan Raiţă , Andreas Vikelis

A class of algorithms comprised by certain semismooth Newton and active-set methods is able to solve convex minimization problems involving sparsity-inducing regularizers very rapidly; the speed advantage of methods from this class is a…

Optimization and Control · Mathematics 2021-12-08 Miguel Simões

We introduce a general framework for analyzing learning algorithms based on the notion of self-regularization, which captures implicit complexity control without requiring explicit regularization. This is motivated by previous observations…

Machine Learning · Statistics 2026-03-19 Max Schölpple , Liu Fanghui , Ingo Steinwart

Neural networks functions are supposed to be able to encode the desired solution of an inverse problem very efficiently. In this paper, we consider the problem of solving linear inverse problems with neural network coders. First we…

Functional Analysis · Mathematics 2023-03-27 Otmar Scherzer , Bernd Hofmann , Zuhair Nashed

This survey synthesizes the current state of the art on the regularity theory for solutions to the optimal partition problem. Namely, we consider non-negative, vector-valued Sobolev functions whose components have mutually disjoint support,…

Analysis of PDEs · Mathematics 2025-10-10 Roberto Ognibene , Bozhidar Velichkov

Imitation learning methods are used to infer a policy in a Markov decision process from a dataset of expert demonstrations by minimizing a divergence measure between the empirical state occupancy measures of the expert and the policy. The…

Machine Learning · Computer Science 2023-08-21 Ivan Ovinnikov , Joachim M. Buhmann

We prove a semiclassical resolvent estimate for a broad class of non-self-adjoint, non-elliptic pseudodifferential operators in the low-lying spectral regime. The proof relies on improved ellipticity properties for the symbol of the…

Spectral Theory · Mathematics 2026-01-27 Stepan Malkov

Operator inference learns low-dimensional dynamical-system models with polynomial nonlinear terms from trajectories of high-dimensional physical systems (non-intrusive model reduction). This work focuses on the large class of physical…

Numerical Analysis · Mathematics 2021-07-07 Nihar Sawant , Boris Kramer , Benjamin Peherstorfer

In this article, we consider the Tikhonov regularization of an optimal control problem of semilinear partial differential equations with box constraints on the control. We derive a-priori regularization error estimates for the control under…

Optimization and Control · Mathematics 2017-05-04 Frank Pörner , Daniel Wachsmuth

We study the problem of optimizing nonlinear objective functions over bipartite matchings. While the problem is generally intractable, we provide several efficient algorithms for it, including a deterministic algorithm for maximizing convex…

Optimization and Control · Mathematics 2008-07-24 Yael Berstein , Shmuel Onn

This paper deals with Tikhonov regularization for linear and nonlinear ill-posed operator equations with wavelet Besov norm penalties. We focus on $B^0_{p,1}$ penalty terms which yield estimators that are sparse with respect to a wavelet…

Numerical Analysis · Mathematics 2019-09-04 Thorsten Hohage , Philip Miller

Positive definite operator-valued kernels generalize the well-known notion of reproducing kernels, and are naturally adapted to multi-output learning situations. This paper addresses the problem of learning a finite linear combination of…

Machine Learning · Statistics 2012-06-15 Hachem Kadri , Alain Rakotomamonjy , Francis Bach , Philippe Preux

The purpose of this paper is to provide tools for analyzing the compactness of sequences in Sobolev spaces, in particular if the sequence gets mapped onto a compact set by some nonlinear operator. Here, our focus lies on a very general…

Analysis of PDEs · Mathematics 2007-11-07 Stefan Krömer , Markus Lilli

Machine learning is a field which studies how machines can alter and adapt their behavior, improving their actions according to the information they are given. This field is subdivided into multiple areas, among which the best known are…

Machine Learning · Computer Science 2018-12-06 David Charte , Francisco Charte , Salvador García , Francisco Herrera

In this paper, we study the existence of minimizers of the Sobolev quotient for a class of nonlocal operators with an orthotropic structure having different exponents of integrability and different orders of differentiability. Our method is…

Analysis of PDEs · Mathematics 2021-07-15 Jamil Chaker , Minhyun Kim , Marvin Weidner

Recently, the stochastic asymptotical regularization (SAR) has been developed in (\emph{Inverse Problems}, 39: 015007, 2023) for the uncertainty quantification of the stable approximate solution of linear ill-posed inverse problems. In this…

Numerical Analysis · Mathematics 2024-08-27 Haie Long , Ye Zhang

A regularization algorithm using inexact function values and inexact derivatives is proposed and its evaluation complexity analyzed. This algorithm is applicable to unconstrained problems and to problems with inexpensive constraints (that…

Optimization and Control · Mathematics 2019-04-22 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

In this paper, we introduce a new functional point of view on bilevel optimization problems for machine learning, where the inner objective is minimized over a function space. These types of problems are most often solved by using methods…

Machine Learning · Statistics 2024-12-10 Ieva Petrulionyte , Julien Mairal , Michael Arbel

By selecting different filter functions, spectral algorithms can generate various regularization methods to solve statistical inverse problems within the learning-from-samples framework. This paper combines distributed spectral algorithms…

Machine Learning · Statistics 2025-02-18 Jiading Liu , Lei Shi

Despite a variety of available techniques the issue of the proper regularization parameter choice for inverse problems still remains one of the biggest challenges. The main difficulty lies in constructing a rule, allowing to compute the…

Numerical Analysis · Mathematics 2017-10-13 Ernesto De Vito , Massimo Fornasier , Valeriya Naumova