English
Related papers

Related papers: Bilevel parameter learning for higher-order total …

200 papers

In this work we consider a generalized bilevel optimization framework for solving inverse problems. We introduce fractional Laplacian as a regularizer to improve the reconstruction quality, and compare it with the total variation…

Image and Video Processing · Electrical Eng. & Systems 2020-06-24 Harbir Antil , Zichao Di , Ratna Khatri

We introduce a method for fast estimation of data-adapted, spatio-temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV)-minimization. Our approach is inspired by recent…

We consider the bilevel optimisation approach proposed by De Los Reyes, Sch\"onlieb (2013) for learning the optimal parameters in a Total Variation (TV) denoising model featuring for multiple noise distributions. In applications, the use of…

Optimization and Control · Mathematics 2014-06-24 Luca Calatroni , Juan Carlos De Los Reyes , Carola-Bibiane Schönlieb

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

We consider a bilevel optimisation strategy based on normalised residual whiteness loss for estimating the weighted total variation parameter maps for denoising images corrupted by additive white Gaussian noise. Compared to supervised and…

Optimization and Control · Mathematics 2025-03-12 Monica Pragliola , Luca Calatroni , Alessandro Lanza

We present a novel regularization approach to train neural networks that enjoys better generalization and test error than standard stochastic gradient descent. Our approach is based on the principles of cross-validation, where a validation…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Simon Jenni , Paolo Favaro

Many optimization problems require hyperparameters, i.e., parameters that must be pre-specified in advance, such as regularization parameters and parametric regularizers in variational regularization methods for inverse problems, and…

Optimization and Control · Mathematics 2025-10-09 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

In this paper, a variational, multi-dimensional model for image reconstruction is proposed, in which the regularization term consists of the $r$-order (an)-isotropic total variation seminorms $TV^r$, with $r\in \mathbb R^+$, defined via the…

Analysis of PDEs · Mathematics 2019-01-17 Pan Liu , Xin Yang Lu

We present a method for supervised learning of sparsity-promoting regularizers for denoising signals and images. Sparsity-promoting regularization is a key ingredient in solving modern signal reconstruction problems; however, the operators…

Machine Learning · Computer Science 2023-09-07 Avrajit Ghosh , Michael T. McCann , Madeline Mitchell , Saiprasad Ravishankar

We extend a recently introduced deep unrolling framework for learning spatially varying regularisation parameters in inverse imaging problems to the case of Total Generalised Variation (TGV). The framework combines a deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Thanh Trung Vu , Andreas Kofler , Kostas Papafitsoros

A computational method is introduced for choosing the regularization parameter for total variation (TV) regularization. The approach is based on computing reconstructions at a few different resolutions and various values of regularization…

Variational regularization methods are commonly used to approximate solutions of inverse problems. In recent years, model-based variational regularization methods have often been replaced with data-driven ones such as the fields-of-expert…

Optimization and Control · Mathematics 2024-01-17 Danilo Riccio , Matthias J. Ehrhardt , Martin Benning

We introduce a novel regulariser based on the natural vector field operations gradient, divergence, curl and shear. For suitable choices of the weighting parameters contained in our model it generalises well-known first- and second-order…

Numerical Analysis · Mathematics 2018-11-01 Eva-Maria Brinkmann , Martin Burger , Joana Sarah Grah

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

We consider simple bilevel optimization problems where the goal is to compute among the optimal solutions of a composite convex optimization problem, one that minimizes a secondary objective function. Our main contribution is threefold. (i)…

Optimization and Control · Mathematics 2025-04-14 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

We introduce a framework based on bilevel programming that unifies gradient-based hyperparameter optimization and meta-learning. We show that an approximate version of the bilevel problem can be solved by taking into explicit account the…

Machine Learning · Statistics 2018-07-04 Luca Franceschi , Paolo Frasconi , Saverio Salzo , Riccardo Grazzi , Massimilano Pontil

We address the image restoration problem under Poisson noise corruption. The Kullback-Leibler divergence, which is typically adopted in the variational framework as data fidelity term in this case, is coupled with the second-order Total…

Numerical Analysis · Mathematics 2022-05-27 Daniela di Serafino , Monica Pragliola

This article studies Gauss-Newton-type methods for over-determined systems to find solutions to bilevel programming problems. To proceed, we use the lower-level value function reformulation of bilevel programs and consider necessary…

Optimization and Control · Mathematics 2020-03-09 Joerg Fliege , Andrey Tin , Alain Zemkoho

Bilevel programs are optimization problems where some variables are solutions to optimization problems themselves, and they arise in a variety of control applications, including: control of vehicle traffic networks, inverse reinforcement…

Optimization and Control · Mathematics 2017-09-27 Aurélien Ouattara , Anil Aswani

In this paper we present a bilevel optimization scheme for the solution of a general image deblurring problem, in which a parametric variational-like approach is encapsulated within a machine learning scheme to provide a high quality…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Silvia Bonettini , Giorgia Franchini , Danilo Pezzi , Marco Prato