English
Related papers

Related papers: Convergence rates for regularization functionals w…

200 papers

The Augmented Lagrangian Method as an approach for regularizing inverse problems received much attention recently, e.g. under the name Bregman iteration in imaging. This work shows convergence (rates) for this method when Morozov's…

Numerical Analysis · Mathematics 2012-04-19 Klaus Frick , Dirk A. Lorenz , Elena Resmerita

We study the application of the Augmented Lagrangian Method to the solution of linear ill-posed problems. Previously, linear convergence rates with respect to the Bregman distance have been derived under the classical assumption of a…

Numerical Analysis · Mathematics 2015-06-04 Klaus Frick , Markus Grasmair

In this paper we introduce two conceptual algorithms for minimising abstract convex functions. Both algorithms rely on solving a proximal-type subproblem with an abstract Bregman distance based proximal term. We prove their convergence when…

Optimization and Control · Mathematics 2026-01-09 Reinier Díaz Millán , Julien Ugon

We consider a statistical inverse learning problem, where the task is to estimate a function $f$ based on noisy point evaluations of $Af$, where $A$ is a linear operator. The function $Af$ is evaluated at i.i.d. random design points $u_n$,…

Machine Learning · Statistics 2021-11-02 Tatiana A. Bubba , Martin Burger , Tapio Helin , Luca Ratti

We propose a novel framework for the regularised inversion of deep neural networks. The framework is based on the authors' recent work on training feed-forward neural networks without the differentiation of activation functions. The…

Numerical Analysis · Mathematics 2023-03-06 Xiaoyu Wang , Martin Benning

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

Machine Learning · Computer Science 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

Motivated by a constrained minimization problem, it is studied the gradient flows with respect to Hessian Riemannian metrics induced by convex functions of Legendre type. The first result characterizes Hessian Riemannian structures on…

Optimization and Control · Mathematics 2018-11-27 Felipe Alvarez , Jérôme Bolte , Olivier Brahic

It is now well understood that convex programming can be used to estimate the frequency components of a spectrally sparse signal from $2m+1$ uniform temporal measurements. It is conjectured that a phase transition on the success of the…

Information Theory · Computer Science 2021-10-18 Maxime Ferreira Da Costa , Wei Dai

We establish a general principle which states that regularizing an inverse problem with a convex function yields solutions which are convex combinations of a small number of atoms. These atoms are identified with the extreme points and…

Optimization and Control · Mathematics 2018-11-27 Claire Boyer , Antonin Chambolle , Yohann De Castro , Vincent Duval , Frédéric De Gournay , Pierre Weiss

We consider a class of infinite-dimensional optimization problems in which a distributed vector-valued variable should pointwise almost everywhere take values from a given finite set $\mathcal{M}\subset\mathbb{R}^m$. Such hybrid…

Optimization and Control · Mathematics 2021-11-09 Christian Clason , Carla Tameling , Benedikt Wirth

Statistical inverse learning theory, a field that lies at the intersection of inverse problems and statistical learning, has lately gained more and more attention. In an effort to steer this interplay more towards the variational…

Statistics Theory · Mathematics 2022-04-27 Tatiana A. Bubba , Luca Ratti

Variational sparsity regularization based on $\ell^1$-norms and other nonlinear functionals has gained enormous attention recently, both with respect to its applications and its mathematical analysis. A focus in regularization theory has…

Numerical Analysis · Mathematics 2015-06-11 Martin Burger , Jens Flemming , Bernd Hofmann

All imaging modalities such as computed tomography (CT), emission tomography and magnetic resonance imaging (MRI) require a reconstruction approach to produce an image. A common image processing task for applications that utilise those…

Deep metric learning techniques have been used for visual representation in various supervised and unsupervised learning tasks through learning embeddings of samples with deep networks. However, classic approaches, which employ a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Zhiyuan Li , Ziru Liu , Anna Zou , Anca L. Ralescu

We study variational regularization methods in a general framework, more precisely those methods that use a discrepancy and a regularization functional. While several sets of sufficient conditions are known to obtain a regularization…

Functional Analysis · Mathematics 2015-06-04 Dirk Lorenz , Nadja Worliczek

Bregman divergences generalize measures such as the squared Euclidean distance and the KL divergence, and arise throughout many areas of machine learning. In this paper, we focus on the problem of approximating an arbitrary Bregman…

Machine Learning · Statistics 2020-11-04 Ali Siahkamari , Xide Xia , Venkatesh Saligrama , David Castanon , Brian Kulis

This work addresses the problem of error concealment in video transmission systems over noisy channels employing Bregman divergences along with regularization. Error concealment intends to improve the effects of disturbances at the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-11 Alessandra M. Coelho , Vania V. Estrela , Felipe P. do Carmo , Sandro R. Fernandes

This work proposes a novel convex-non-convex formulation of the image segmentation and the image completion problems. The proposed approach is based on the minimization of a functional involving two distinct regularization terms: one…

Numerical Analysis · Mathematics 2025-09-01 Mohamed El Guide , Anas El Hachimi , Khalide Jbilou , Lothar Reichel

Many descent algorithms for multiobjective optimization have been developed in the last two decades. Tanabe et al. (Comput Optim Appl 72(2):339--361, 2019) proposed a proximal gradient method for multiobjective optimization, which can solve…

Optimization and Control · Mathematics 2022-04-11 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

In the context of convex variational regularization it is a known result that, under suitable differentiability assumptions, source conditions in the form of variational inequalities imply range conditions, while the converse implication…

Optimization and Control · Mathematics 2018-02-16 Clemens Kirisits , Otmar Scherzer