English
Related papers

Related papers: A Bilevel Approach for Parameter Learning in Inver…

200 papers

Ensemble Kalman inversion is a parallelizable methodology for solving inverse or parameter estimation problems. Although it is based on ideas from Kalman filtering, it may be viewed as a derivative-free optimization method. In its most…

Numerical Analysis · Mathematics 2024-12-20 Neil K. Chada , Andrew M. Stuart , Xin T. Tong

This paper presents an error analysis of classical and learned Tikhonov regularization schemes for inverse problems. We first demonstrate, both theoretically and numerically, that using a fixed regularization parameter across varying noise…

Numerical Analysis · Mathematics 2026-04-02 Arne Behrens , Meira Iske , Ming Jiang , Peter Maass , Sebastian Neumayer

Bilevel optimization formulates hierarchical decision-making processes that arise in many real-world applications such as in pricing, network design, and infrastructure defense planning. In this paper, we consider a class of bilevel…

Optimization and Control · Mathematics 2021-04-20 Geunyeong Byeon , Pascal Van Hentenryck

In this paper we propose a bilevel optimization approach for the placement of space and time observations in variational data assimilation problems. Within the framework of supervised learning, we consider a bilevel problem where the…

Optimization and Control · Mathematics 2019-10-09 Paula Castro , Juan Carlos De los Reyes

In this paper we study convex bi-level optimization problems for which the inner level consists of minimization of the sum of smooth and nonsmooth functions. The outer level aims at minimizing a smooth and strongly convex function over the…

Optimization and Control · Mathematics 2017-02-15 Shoham Sabach , Shimrit Shtern

Bilevel optimization has found extensive applications in modern machine learning problems such as hyperparameter optimization, neural architecture search, meta-learning, etc. While bilevel problems with a unique inner minimal point (e.g.,…

Optimization and Control · Mathematics 2022-06-09 Daouda Sow , Kaiyi Ji , Ziwei Guan , Yingbin Liang

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

Some recent works in machine learning and computer vision involve the solution of a bi-level optimization problem. Here the solution of a parameterized lower-level problem binds variables that appear in the objective of an upper-level…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Stephen Gould , Basura Fernando , Anoop Cherian , Peter Anderson , Rodrigo Santa Cruz , Edison Guo

We consider a bilevel learning framework for learning linear operators. In this framework, the learnable parameters are optimized via a loss function that also depends on the minimizer of a convex optimization problem (denoted lower-level…

Optimization and Control · Mathematics 2025-06-10 Lea Bogensperger , Matthias J. Ehrhardt , Thomas Pock , Mohammad Sadegh Salehi , Hok Shing Wong

This paper firstly proposes a convex bilevel optimization paradigm to formulate and optimize popular learning and vision problems in real-world scenarios. Different from conventional approaches, which directly design their iteration schemes…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Risheng Liu , Long Ma , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

In multi-robot systems, achieving coordinated missions remains a significant challenge due to the coupled nature of coordination behaviors and the lack of global information for individual robots. To mitigate these challenges, this paper…

Robotics · Computer Science 2024-08-22 Zechen Hu , Daigo Shishika , Xuesu Xiao , Xuan Wang

We consider the optimistic bilevel optimization problem, known to have a wide range of applications in engineering, that we transform into a single-level optimization problem by means of the lower-level optimal value function reformulation.…

Optimization and Control · Mathematics 2021-01-26 Andrey Tin , Alain B. Zemkoho

Bilevel optimization and bilevel minimax optimization have recently emerged as unifying frameworks for a range of machine-learning tasks, including hyperparameter optimization and reinforcement learning. The existing literature focuses on…

Machine Learning · Computer Science 2026-04-23 Xuelin Zhang , Peipei Yuan

In this article, we consider the Tikhonov regularization of an optimal control problem of semilinear partial differential equations with box constraints on the control. We derive a-priori regularization error estimates for the control under…

Optimization and Control · Mathematics 2017-05-04 Frank Pörner , Daniel Wachsmuth

This paper is concerned with second-order optimality conditions for Tikhonov regularized optimal control problems governed by the obstacle problem. Using a simple observation that allows to characterize the structure of optimal controls on…

Optimization and Control · Mathematics 2019-06-24 Constantin Christof , Gerd Wachsmuth

We consider choice of the regularization parameter in Tikhonov method in the case of the unknown noise level of the data. From known heuristic parameter choice rules often the best results were obtained in the quasi-optimality criterion…

Numerical Analysis · Mathematics 2017-08-08 Toomas Raus , Uno Hämarik

We investigate the ill-posed inverse problem of recovering unknown spatially dependent parameters in nonlinear evolution PDEs. We propose a bi-level Landweber scheme, where the upper-level parameter reconstruction embeds a lower-level state…

Numerical Analysis · Mathematics 2024-03-07 Tram Thi Ngoc Nguyen

This paper continues earlier work and is concerned with the inverse problem of parameter identification in variational inequalities of the second kind that does not only treat the parameter linked to a bilinear form, but importantly also…

Optimization and Control · Mathematics 2021-01-01 Joachim Gwinner

We consider hierarchical variational inequality problems, or more generally, variational inequalities defined over the set of zeros of a monotone operator. This framework includes convex optimization over equilibrium constraints and…

Optimization and Control · Mathematics 2026-01-07 Daniel Cortild , Meggie Marschner , Mathias Staudigl

This paper is concerned with an optimization problem that is constrained by the Kantorovich optimal transportation problem. This bilevel optimization problem can be reformulated as a mathematical problem with complementarity constraints in…

Optimization and Control · Mathematics 2022-11-15 Sebastian Hillbrecht , Paul Manns , Christian Meyer