English
Related papers

Related papers: Weakly Convex Regularisers for Inverse Problems: C…

200 papers

The emergence of deep-learning-based methods to solve image-reconstruction problems has enabled a significant increase in reconstruction quality. Unfortunately, these new methods often lack reliability and explainability, and there is a…

Image and Video Processing · Electrical Eng. & Systems 2023-08-28 Alexis Goujon , Sebastian Neumayer , Pakshal Bohra , Stanislas Ducotterd , Michael Unser

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

This paper introduces a novel double regularization scheme for bilevel optimization problems whose lower-level problem is composite and convex, but not necessarily strongly convex, in the lower-level variable. The analysis focuses on the…

Optimization and Control · Mathematics 2026-02-06 Mattia Solla , Johannes O. Royset

Inverse problems are inherently ill-posed, suffering from non-uniqueness and instability. Classical regularization methods provide mathematically well-founded solutions, ensuring stability and convergence, but often at the cost of reduced…

Numerical Analysis · Mathematics 2026-01-21 Markus Haltmeier , Gyeongha Hwang

This study proposes a cubic regularization of the Newton method for generating weakly efficient points of unconstrained vector optimization problems under no convexity assumption on the objective function. It is observed that at a given…

Optimization and Control · Mathematics 2025-05-20 Debdas Ghosh

We study variational regularisation methods for inverse problems with imperfect forward operators whose errors can be modelled by order intervals in a partial order of a Banach lattice. We carry out analysis with respect to existence and…

Numerical Analysis · Mathematics 2020-12-25 Leon Bungert , Martin Burger , Yury Korolev , Carola-Bibiane Schoenlieb

In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss…

Numerical Analysis · Mathematics 2021-01-15 Barbara Kaltenbacher , Kha Van Huynh

We consider the problem of supervised learning with convex loss functions and propose a new form of iterative regularization based on the subgradient method. Unlike other regularization approaches, in iterative regularization no constraint…

Machine Learning · Statistics 2015-04-02 Junhong Lin , Lorenzo Rosasco , Ding-Xuan Zhou

In this paper, we study the iteration complexity of cubic regularization of Newton method for solving composite minimization problems with uniformly convex objective. We introduce the notion of second-order condition number of a certain…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov

Dual first-order methods are powerful techniques for large-scale convex optimization. Although an extensive research effort has been devoted to studying their convergence properties, explicit convergence rates for the primal iterates have…

Optimization and Control · Mathematics 2015-02-24 Jie Lu , Mikael Johansson

In this work, we consider ill-posed inverse problems in which the forward operator is continuous and weakly closed, and the sought solution belongs to a weakly closed constraint set. We propose a regularization method based on minimizing…

Numerical Analysis · Mathematics 2025-05-27 Barbara Palumbo , Paolo Massa , Federico Benvenuto

We establish a result which states that regularizing an inverse problem with the gauge of a convex set $C$ yields solutions which are linear combinations of a few extreme points or elements of the extreme rays of $C$. These can be…

Optimization and Control · Mathematics 2018-12-12 Claire Boyer , Antonin Chambolle , Yohann de Castro , Vincent Duval , Frédéric de Gournay , Pierre Weiss

We introduce a fully-corrective generalized conditional gradient method for convex minimization problems involving total variation regularization on multidimensional domains. It relies on alternatively updating an active set of subsets of…

Optimization and Control · Mathematics 2025-12-01 Giacomo Cristinelli , José A. Iglesias , Daniel Walter

Recently, data-driven techniques have demonstrated remarkable effectiveness in addressing challenges related to MR imaging inverse problems. However, these methods still exhibit certain limitations in terms of interpretability and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Huayu Wang , Chen Luo , Taofeng Xie , Qiyu Jin , Guoqing Chen , Zhuo-Xu Cui , Dong Liang

In this paper a robust second-order method is developed for the solution of strongly convex l1-regularized problems. The main aim is to make the proposed method as inexpensive as possible, while even difficult problems can be efficiently…

Optimization and Control · Mathematics 2015-01-13 Kimon Fountoulakis , Jacek Gondzio

In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic…

Optimization and Control · Mathematics 2019-03-20 Nicolas Loizou , Peter Richtárik

In this paper we consider a class of optimization problems with a strongly convex objective function and the feasible set given by an intersection of a simple convex set with a set given by a number of linear equality and inequality…

Optimization and Control · Mathematics 2016-05-11 Alexey Chernov , Pavel Dvurechensky , Alexander Gasnikov

We extend the standard notion of self-concordance to non-convex optimization and develop a family of second-order algorithms with global convergence guarantees. In particular, two function classes -- \textit{weakly self-concordant}…

Optimization and Control · Mathematics 2026-04-07 Donald Goldfarb , Lexiao Lai , Tianyi Lin , Jiayu Zhang

Machine learning techniques for the solution of inverse problems have become an attractive approach in the last decade, while their theoretical foundations are still in their infancy. In this chapter we want to pursue the study of…

Numerical Analysis · Mathematics 2025-12-10 Martin Burger , Samira Kabri , Gitta Kutyniok , Yunseok Lee , Lukas Weigand

In the context of linear inverse problems, we propose and study a general iterative regularization method allowing to consider large classes of regularizers and data-fit terms. The algorithm we propose is based on a primal-dual diagonal…

Optimization and Control · Mathematics 2017-08-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa