English
Related papers

Related papers: On Representer Theorems and Convex Regularization

200 papers

Many works on inverse problems in the imaging sciences consider regularization via one or more penalty functions or constraint sets. When the models/images are not easily described using one or a few penalty functions/constraints, additive…

Image and Video Processing · Electrical Eng. & Systems 2019-03-12 Bas Peters , Felix J. Herrmann

This work addresses arbitrary convex vector optimization problems, which constitute a general framework for multi-criteria decision-making in diverse real-world applications. Due to their complexity, such problems are typically tackled…

Optimization and Control · Mathematics 2026-03-31 Daniel Dörfler , Rebecca Köhler , Andreas Löhne

In this work, we propose Regularization-by-Equivariance (REV), a novel structure-adaptive regularization scheme for solving imaging inverse problems under incomplete measurements. This regularization scheme utilizes the equivariant…

Optimization and Control · Mathematics 2022-02-15 Junqi Tang

The Calder\'on problem consists in recovering an unknown coefficient of a partial differential equation from boundary measurements of its solution. These measurements give rise to a highly nonlinear forward operator. As a consequence, the…

Analysis of PDEs · Mathematics 2025-07-02 Giovanni S. Alberti , Romain Petit , Simone Sanna

In this article we investigate the connection between regularization theory for inverse problems and dynamic programming theory. This is done by developing two new regularization methods, based on dynamic programming techniques. The aim of…

Numerical Analysis · Mathematics 2021-01-26 S. Kindermann , A. Leitao

We introduce a novel algorithm for solving learning problems where both the loss function and the regularizer are non-convex but belong to the class of difference of convex (DC) functions. Our contribution is a new general purpose proximal…

Machine Learning · Computer Science 2015-07-03 Alain Rakotomamonjy , Remi Flamary , Gilles Gasso

Motivated by recent increased interest in optimization algorithms for non-convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical…

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function. These upper bounds are tight at the current estimate, and each iteration monotonically drives the objective…

Optimization and Control · Mathematics 2015-02-03 Julien Mairal

Consider reconstructing a signal $x$ by minimizing a weighted sum of a convex differentiable negative log-likelihood (NLL) (data-fidelity) term and a convex regularization term that imposes a convex-set constraint on $x$ and enforces its…

Computation · Statistics 2017-02-28 Renliang Gu , Aleksandar Dogandžić

We consider regularization of non-convex optimization problems involving a non-linear least-squares objective. By adding an auxiliary set of variables, we introduce a novel regularization framework whose corresponding objective function is…

Optimization and Control · Mathematics 2021-11-23 Rixon Crane , Fred Roosta

Designing appropriate variational regularization schemes is a crucial part of solving inverse problems, making them better-posed and guaranteeing that the solution of the associated optimization problem satisfies desirable properties.…

Machine Learning · Computer Science 2020-06-09 Ronan Fablet , Lucas Drumetz , Francois Rousseau

The inverse conductivity problem aims at determining the unknown conductivity inside a bounded domain from boundary measurements. In practical applications, algorithms based on minimizing a regularized residual functional subject to PDE…

Numerical Analysis · Mathematics 2025-10-02 Lefu Cai , Zhixin Liu , Minghui Song , Xianchao Wang

We shall investigate randomized algorithms for solving large-scale linear inverse problems with general regularizations. We first present some techniques to transform inverse problems of general form into the ones of standard form, then…

Numerical Analysis · Mathematics 2014-12-30 Hua Xiang , Jun Zou

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

The formulation of norms on continuous-domain Banach spaces with exact pixel-based discretization is advantageous for solving inverse problems (IPs). In this paper, we investigate a new regularization that is a convex combination of a TV…

Numerical Analysis · Mathematics 2025-09-30 Vincent Guillemet , Michael Unser

In a recent paper by A. Chambolle et al. [Geometric properties of solutions to the total variation denoising problem. Inverse Problems 33, 2017] it was proven that if the subgradient of the total variation at the noise free data is not…

Optimization and Control · Mathematics 2021-06-09 José A. Iglesias , Gwenael Mercier , Otmar Scherzer

In this paper we study the convex envelopes of a new class of functions. Using this approach, we are able to unify two important classes of regularizers from unbiased non-convex formulations and weighted nuclear norm penalties. This opens…

Optimization and Control · Mathematics 2021-03-18 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

In this paper, we will present a generalization for a minimization problem from I. Daubechies, M. Defrise, and C. Demol [3]. This generalization is useful for solving many practical problems in which more than one constraint are involved.…

Optimization and Control · Mathematics 2019-12-20 Saman Khoramian

In general, standard necessary optimality conditions cannot be formulated in a straightforward manner for semi-smooth shape optimization problems. In this paper, we consider shape optimization problems constrained by variational…

Optimization and Control · Mathematics 2020-12-17 Daniel Luft , Volker H. Schulz , Kathrin Welker

Demixing is the problem of identifying multiple structured signals from a superimposed observation. This work analyzes a general framework, based on convex optimization, for solving demixing problems. We present a new solution to determine…

Systems and Control · Computer Science 2023-07-19 Chun-Yen Kuo , Gang-Xuan Lin , Chun-Shien Lu