English
Related papers

Related papers: Bilevel Optimization based on Iterative Approximat…

200 papers

This paper studies a class of simple bilevel optimization problems where we minimize a composite convex function at the upper-level subject to a composite convex lower-level problem. Existing methods either provide asymptotic guarantees for…

Optimization and Control · Mathematics 2024-03-06 Jiulin Wang , Xu Shi , Rujun Jiang

In this article we provide a comprehensive review of the different evolutionary algorithm techniques used to address multimodal optimization problems, classifying them according to the nature of their approach. On the one hand there are…

Neural and Evolutionary Computing · Computer Science 2015-08-24 Noe Casas

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

Some recent works in machine learning and computer vision involve the solution of a bi-level optimization problem. Here the solution of a parameterized lower-level problem binds variables that appear in the objective of an upper-level…

Computer Vision and Pattern Recognition · Computer Science 2016-07-22 Stephen Gould , Basura Fernando , Anoop Cherian , Peter Anderson , Rodrigo Santa Cruz , Edison Guo

The Bilevel Optimization Problem is a hierarchical optimization problem with two agents, a leader and a follower. The leader make their own decisions first, and the followers make the best choices accordingly. The leader knows the…

Artificial Intelligence · Computer Science 2023-12-12 Sunhyeon Kwon , Hwayong Choi , Sungsoo Park

In many applications, including Stackelberg games, machine learning, and power systems \cite{Mackay2018Selftuning,Heinrich1952The,Wang2021Bi-Level}, the decisions in a minimax optimization problem can be constrained by a solution to an…

Optimization and Control · Mathematics 2026-04-28 Yaling Hu , Jiani Wang , Yu-hong Dai , Xiaojiao Tong

This paper studies simple bilevel problems, where a convex upper-level function is minimized over the optimal solutions of a convex lower-level problem. We first show the fundamental difficulty of simple bilevel problems, that the…

Optimization and Control · Mathematics 2025-01-28 Huaqing Zhang , Lesi Chen , Jing Xu , Jingzhao Zhang

Current state-of-the-art solution techniques for solving bilevel optimization problems either assume strong problem regularity criteria or are computationally intractable. In this paper we address power system problems of bilevel structure,…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Domagoj Vlah , Karlo Šepetanc , Hrvoje Pandžić

Bayesian optimization is a sequential method for minimizing objective functions that are expensive to evaluate and about which few assumptions can be made. By using all gathered data to train a Gaussian process model for the function and…

Machine Learning · Computer Science 2026-05-07 Jesse Schneider , William J. Welch

Bilevel optimization has emerged as a technique for addressing a wide range of machine learning problems that involve an outer objective implicitly determined by the minimizer of an inner problem. While prior works have primarily focused on…

Machine Learning · Computer Science 2025-11-18 Fares El Khoury , Edouard Pauwels , Samuel Vaiter , Michael Arbel

This paper combines the idea of a hierarchical distributed genetic algorithm with different inter-agent partnering strategies. Cascading clusters of sub-populations are built from bottom up, with higher-level sub-populations optimising…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Uwe Aickelin

Recently, bi-level optimization (BLO) has taken center stage in some very exciting developments in the area of signal processing (SP) and machine learning (ML). Roughly speaking, BLO is a classical optimization problem that involves two…

Machine Learning · Computer Science 2023-12-22 Yihua Zhang , Prashant Khanduri , Ioannis Tsaknakis , Yuguang Yao , Mingyi Hong , Sijia Liu

In optimization-based image restoration models, the correct selection of hyperparameters is crucial for achieving superior performance. However, current research typically involves manual tuning of these hyperparameters, which is highly…

Optimization and Control · Mathematics 2026-04-03 Hang Xie , Xuewen Li , Peili Li , Qiuyu Wang

This paper presents a planning pipeline framework for locomotion in rope-assisted robots climbing vertical surfaces. The proposed framework is formulated as a bi-level optimization scheme that addresses a mixed-integer problem: selecting…

Robotics · Computer Science 2026-04-30 Ruben Malacarne , Ioannis Tsikelis , Enrico Mingo Hoffman , Michele Focchi

In this work we propose an improvement of the $x$-space algorithm developed for solving a class of min--max bilevel optimization problems (Tang Y., Richard J.P.P., Smith J.C. (2016), A class of algorithms for mixed-integer bilevel min--max…

Optimization and Control · Mathematics 2021-05-19 Kübra Tanınmış , Necati Aras , İ. Kuban Altınel

A wide range of decision problems can be formulated as bilevel programs with independent followers, which as a special case include two-stage stochastic programs. These problems are notoriously difficult to solve especially when a large…

Optimization and Control · Mathematics 2025-09-25 Timothy C. Y. Chan , Bo Lin , Shoshanna Saxe

Bilevel optimization with traffic equilibrium constraints plays an important role in transportation planning and management problems such as traffic control, transport network design, and congestion pricing. In this paper, we consider a…

Optimization and Control · Mathematics 2023-06-27 Akshit Goyal , Andrew Lamperski

Many optimization problems require hyperparameters, i.e., parameters that must be pre-specified in advance, such as regularization parameters and parametric regularizers in variational regularization methods for inverse problems, and…

Optimization and Control · Mathematics 2025-10-09 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

Multi-modal multi-objective optimization is to locate (almost) equivalent Pareto optimal solutions as many as possible. While decomposition-based evolutionary algorithms have good performance for multi-objective optimization, they are…

Neural and Evolutionary Computing · Computer Science 2020-10-01 Ryoji Tanabe , Hisao Ishibuchi

In recent advances in solving the problem of transmission network expansion planning, the use of robust optimization techniques has been put forward, as an alternative to stochastic mathematical programming methods, to make the problem…

Computational Engineering, Finance, and Science · Computer Science 2016-09-28 Roberto Minguez , Raquel Garcia-Bertrand