English
Related papers

Related papers: Bilevel Optimization and Variational Analysis

200 papers

This article studies Gauss-Newton-type methods for over-determined systems to find solutions to bilevel programming problems. To proceed, we use the lower-level value function reformulation of bilevel programs and consider necessary…

Optimization and Control · Mathematics 2020-03-09 Joerg Fliege , Andrey Tin , Alain Zemkoho

We introduce a framework based on bilevel programming that unifies gradient-based hyperparameter optimization and meta-learning. We show that an approximate version of the bilevel problem can be solved by taking into explicit account the…

Machine Learning · Statistics 2018-07-04 Luca Franceschi , Paolo Frasconi , Saverio Salzo , Riccardo Grazzi , Massimilano Pontil

The literature on pessimistic linear bilevel optimization with coupling constraints is rather scarce and it has been common sense that these problems are harder to tackle than pessimistic bilevel problems without coupling constraints. In…

Optimization and Control · Mathematics 2026-05-08 Dorothee Henke , Henri Lefebvre , Martin Schmidt , Johannes Thürauf

In this work we derive a second-order approach to bilevel optimization, a type of mathematical programming in which the solution to a parameterized optimization problem (the "lower" problem) is itself to be optimized (in the "upper"…

Optimization and Control · Mathematics 2022-05-06 Robert Dyro , Edward Schmerling , Nikos Arechiga , Marco Pavone

Recently, lower-level constrained bilevel optimization has attracted increasing attention. However, existing methods mostly focus on either deterministic cases or problems with linear constraints. The main challenge in stochastic cases with…

Optimization and Control · Mathematics 2025-10-13 Hantao Nie , Jiaxiang Li , Zaiwen Wen

Some recent works in machine learning and computer vision involve the solution of a bi-level optimization problem. Here the solution of a parameterized lower-level problem binds variables that appear in the objective of an upper-level…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Stephen Gould , Basura Fernando , Anoop Cherian , Peter Anderson , Rodrigo Santa Cruz , Edison Guo

We consider the optimistic bilevel optimization problem, known to have a wide range of applications in engineering, that we transform into a single-level optimization problem by means of the lower-level optimal value function reformulation.…

Optimization and Control · Mathematics 2021-01-26 Andrey Tin , Alain B. Zemkoho

A simple bilevel variational problem where the lower level is a variational inequality while the upper level is an optimization problem is studied. We consider an inexact version of the lower problem, which guarantees enough regularity to…

Optimization and Control · Mathematics 2025-10-22 Giancarlo Bigi , Riccardo Tomassini

Bilevel linear programming (LP) is one of the simplest classes of bilevel optimization problems, yet it is known to be NP-hard in general. Specifically, determining whether the optimal objective value of a bilevel LP is at least as good as…

Optimization and Control · Mathematics 2026-03-23 Nagisa Sugishita , Margarida Carvalho

We address the problem of optimal scale-dependent parameter learning in total variation image denoising. Such problems are formulated as bilevel optimization instances with total variation denoising problems as lower-level constraints. For…

Optimization and Control · Mathematics 2021-07-20 Juan Carlos De los Reyes , David Villacís

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

We consider a multiobjective bilevel optimization problem with vector-valued upper- and lower-level objective functions. Such problems have attracted a lot of interest in recent years. However, so far, scalarization has appeared to be the…

Optimization and Control · Mathematics 2022-01-05 Lahoussine Lafhim , Alain Zemkoho

Stochastic bilevel optimization generalizes the classic stochastic optimization from the minimization of a single objective to the minimization of an objective function that depends the solution of another optimization problem. Recently,…

Optimization and Control · Mathematics 2022-04-01 Tianyi Chen , Yuejiao Sun , Quan Xiao , Wotao Yin

The paper is devoted to a systematic study and characterizations of notions of local maximal monotonicity and their strong counterparts for set-valued operators that appear in variational analysis, optimization, and their applications. We…

Optimization and Control · Mathematics 2023-08-29 Pham Duy Khanh , Vu Vinh Huy Khoa , Boris S. Mordukhovich , Vo Thanh Phat

For the singular integral definition of the fractional Laplacian, we consider an adaptive finite element method steered by two-level error indicators. For this algorithm, we show linear convergence in two and three space dimensions as well…

Numerical Analysis · Mathematics 2022-09-28 Markus Faustmann , Ernst Peter Stephan , David Wörgötter

Here, necessary optimal condition for Optimistic Bilevel programming problem is obtained in Asplund spaces. Also we have got necessary optimal conditions in finite dimensional spaces, by assuming differentiability on the given functions.

Optimization and Control · Mathematics 2019-01-11 Suvendu Pattanaik

Variational regularization is commonly used to solve linear inverse problems, and involves augmenting a data fidelity by a regularizer. The regularizer is used to promote a priori information and is weighted by a regularization parameter.…

Optimization and Control · Mathematics 2024-01-23 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

This paper addresses the problem of stochastic optimization with decision-dependent uncertainty, a class of problems where the probability distribution of the uncertain parameters is influenced by the decision-maker's actions. While recent…

Optimization and Control · Mathematics 2025-09-12 John Cotrina , Gonzalo Flores , David Salas , Anton Svensson

Dealing with uncertainty in optimization parameters is an important and longstanding challenge. Typically, uncertain parameters are predicted accurately, and then a deterministic optimization problem is solved. However, the decisions…

Machine Learning · Computer Science 2025-08-11 Víctor Bucarey , Sophia Calderón , Gonzalo Muñoz , Frederic Semet

This paper firstly proposes a convex bilevel optimization paradigm to formulate and optimize popular learning and vision problems in real-world scenarios. Different from conventional approaches, which directly design their iteration schemes…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Risheng Liu , Long Ma , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang