English
Related papers

Related papers: Bilevel approaches for learning of variational ima…

200 papers

This review discusses methods for learning parameters for image reconstruction problems using bilevel formulations. Image reconstruction typically involves optimizing a cost function to recover a vector of unknown variables that agrees with…

Optimization and Control · Mathematics 2022-06-16 Caroline Crockett , Jeffrey A. Fessler

Bilevel learning is a powerful optimization technique that has extensively been employed in recent years to bridge the world of model-driven variational approaches with data-driven methods. Upon suitable parametrization of the desired…

Bilevel learning has gained prominence in machine learning, inverse problems, and imaging applications, including hyperparameter optimization, learning data-adaptive regularizers, and optimizing forward operators. The large-scale nature of…

Optimization and Control · Mathematics 2025-05-20 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

In the context of image processing, given a $k$-th order, homogeneous and linear differential operator with constant coefficients, we study a class of variational problems whose regularizing terms depend on the operator. Precisely, the…

Numerical Analysis · Mathematics 2022-11-15 Valerio Pagliari , Kostas Papafitsoros , Bogdan Raiţă , Andreas Vikelis

Variational regularization is commonly used to solve linear inverse problems, and involves augmenting a data fidelity by a regularizer. The regularizer is used to promote a priori information and is weighted by a regularization parameter.…

Optimization and Control · Mathematics 2024-01-23 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

This chapter presents a self-contained approach of variational analysis and generalized differentiation to deriving necessary optimality in problems of bilevel optimization with Lipschitzian data. We mainly concentrate on optimistic models,…

Optimization and Control · Mathematics 2019-07-16 Boris S. Mordukhovich

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

We consider a bilevel optimisation approach for parameter learning in higher-order total variation image reconstruction models. Apart from the least squares cost functional, naturally used in bilevel learning, we propose and analyse an…

Optimization and Control · Mathematics 2020-02-13 J. C. De los Reyes , C. -B. Schönlieb , T. Valkonen

In this paper we consider the problem of learning variational models in the context of supervised learning via risk minimization. Our goal is to provide a deeper understanding of the two approaches of learning of variational models via…

Machine Learning · Statistics 2023-09-07 Christoph Brauer , Niklas Breustedt , Timo de Wolff , Dirk A. Lorenz

We consider an unsupervised bilevel optimization strategy for learning regularization parameters in the context of imaging inverse problems in the presence of additive white Gaussian noise. Compared to supervised and semi-supervised metrics…

Optimization and Control · Mathematics 2024-03-13 Carlo Santambrogio , Monica Pragliola , Alessandro Lanza , Marco Donatelli , Luca Calatroni

We propose a bilevel optimization approach for the estimation of parameters in nonlocal image denoising models. The parameters we consider are both the fidelity weight and weights within the kernel of the nonlocal operator. In both cases we…

Optimization and Control · Mathematics 2021-09-24 M. D'Elia , J. C. De los Reyes , A. Miniguano-Trujillo

Variational regularization methods are commonly used to approximate solutions of inverse problems. In recent years, model-based variational regularization methods have often been replaced with data-driven ones such as the fields-of-expert…

Optimization and Control · Mathematics 2024-01-17 Danilo Riccio , Matthias J. Ehrhardt , Martin Benning

Bilevel learning refers to machine learning problems that can be formulated as bilevel optimization models, where decisions are organized in a hierarchical structure. This paradigm has recently gained considerable attention in machine…

Optimization and Control · Mathematics 2026-05-05 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo , Alain Zemkoho

This paper presents a comprehensive review of techniques proposed in the literature for solving bilevel optimization problems encountered in various real-life applications. Bilevel optimization is an appropriate choice for hierarchical…

Optimization and Control · Mathematics 2025-11-06 Dhaval Pujara , Ankur Sinha

A novel class of semi-norms, generalising the notion of the isotropic total variation $TV_{2}$ and the an-isotropic total variation $TV_{1}$ is introduced. A supervised learning method via bilevel optimisation is proposed for the…

Analysis of PDEs · Mathematics 2019-03-29 Pan Liu , Carola-Bibiane Schönlieb

In this paper we propose a bilevel optimization approach for the placement of space and time observations in variational data assimilation problems. Within the framework of supervised learning, we consider a bilevel problem where the…

Optimization and Control · Mathematics 2019-10-09 Paula Castro , Juan Carlos De los Reyes

Data augmentation is a key practice in machine learning for improving generalization performance. However, finding the best data augmentation hyperparameters requires domain knowledge or a computationally demanding search. We address this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Saypraseuth Mounsaveng , Issam Laradji , Ismail Ben Ayed , David Vazquez , Marco Pedersoli

We explore anisotropic regularisation methods in the spirit of [Holler & Kunisch, 14]. Based on ground truth data, we propose a bilevel optimisation strategy to compute the optimal regularisation parameters of such a model for the…

Numerical Analysis · Mathematics 2016-02-04 Martin Benning , Carola-Bibiane Schönlieb , Tuomo Valkonen , Verner Vlačić

We consider a bilevel optimization approach in function space for the choice of spatially dependent regularization parameters in TV image restoration models. First- and second-order optimality conditions for the bilevel problem are studied,…

Optimization and Control · Mathematics 2016-10-18 C. Chung , J. C. De los Reyes , C. B. Schoenlieb

We study the feature-based newsvendor problem, in which a decision-maker has access to historical data consisting of demand observations and exogenous features. In this setting, we investigate feature selection, aiming to derive sparse,…

Machine Learning · Computer Science 2022-09-13 Breno Serrano , Stefan Minner , Maximilian Schiffer , Thibaut Vidal
‹ Prev 1 2 3 10 Next ›