English
Related papers

Related papers: A novel approach for bilevel programs based on Wol…

200 papers

We explore the class of trilevel equilibrium problems with a focus on energy-environmental applications and present a novel single-level reformulation for such problems, based on strong duality. To the best of our knowledge, only one…

Optimization and Control · Mathematics 2024-07-08 Olli Herrala , Steven A. Gabriel , Fabricio Oliveira , Tommi Ekholm

We present a blended conditional gradient approach for minimizing a smooth convex function over a polytope P, combining the Frank--Wolfe algorithm (also called conditional gradient) with gradient-based steps, different from away steps and…

Optimization and Control · Mathematics 2025-03-24 Gábor Braun , Sebastian Pokutta , Dan Tu , Stephen Wright

Large-scale optimization problems arising from the discretization of problems involving PDEs sometimes admit solutions that can be well approximated by low-rank matrices. In this paper, we will exploit this low-rank approximation property…

Numerical Analysis · Mathematics 2024-05-01 Marco Sutti , Bart Vandereycken

Current state-of-the-art solution techniques for solving bilevel optimization problems either assume strong problem regularity criteria or are computationally intractable. In this paper we address power system problems of bilevel structure,…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Domagoj Vlah , Karlo Šepetanc , Hrvoje Pandžić

We present differentially private (DP) algorithms for bilevel optimization, a problem class that received significant attention lately in various machine learning applications. These are the first algorithms for such problems under standard…

Machine Learning · Computer Science 2026-01-15 Guy Kornowski

The pursuit of robustness has recently been a popular topic in reinforcement learning (RL) research, yet the existing methods generally suffer from efficiency issues that obstruct their real-world implementation. In this paper, we introduce…

Machine Learning · Computer Science 2024-04-15 Yang Hu , Haitong Ma , Bo Dai , Na Li

In recent years, bilevel approaches have become very popular to efficiently estimate high-dimensional hyperparameters of machine learning models. However, to date, binary parameters are handled by continuous relaxation and rounding…

Machine Learning · Computer Science 2025-03-20 Sara Venturini , Marianna de Santis , Jordan Patracone , Francesco Rinaldi , Saverio Salzo , Martin Schmidt

We present two first-order primal-dual algorithms for solving saddle point formulations of linear programs, namely FWLP (Frank-Wolfe Linear Programming) and FWLP-P. The former iteratively applies the Frank-Wolfe algorithm to both the primal…

Optimization and Control · Mathematics 2024-02-29 Matthew Hough , Stephen A. Vavasis

Practical optimization problems may contain different kinds of difficulties that are often not tractable if one relies on a particular optimization method. Different optimization approaches offer different strengths that are good at…

Neural and Evolutionary Computing · Computer Science 2024-07-08 Ankur Sinha , Dhaval Pujara , Hemant Kumar Singh

Gradient methods have become mainstream techniques for Bi-Level Optimization (BLO) in learning and vision fields. The validity of existing works heavily relies on solving a series of approximation subproblems with extraordinarily high…

Optimization and Control · Mathematics 2022-05-23 Risheng Liu , Xuan Liu , Wei Yao , Shangzhi Zeng , Jin Zhang

We consider a multiobjective bilevel optimization problem with vector-valued upper- and lower-level objective functions. Such problems have attracted a lot of interest in recent years. However, so far, scalarization has appeared to be the…

Optimization and Control · Mathematics 2022-01-05 Lahoussine Lafhim , Alain Zemkoho

This paper studies simple bilevel problems, where a convex upper-level function is minimized over the optimal solutions of a convex lower-level problem. We first show the fundamental difficulty of simple bilevel problems, that the…

Optimization and Control · Mathematics 2025-01-28 Huaqing Zhang , Lesi Chen , Jing Xu , Jingzhao Zhang

In this workshop, we present a compact but rigorous introduction to second-order optimality conditions for mathematical programs with equilibrium constraints (MPECs). We start from the classical nonlinear programming template, then explain…

Optimization and Control · Mathematics 2026-04-24 Jiguang Yu

Bilevel optimization problems are a class of challenging optimization problems, which contain two levels of optimization tasks. In these problems, the optimal solutions to the lower level problem become possible feasible candidates to the…

Neural and Evolutionary Computing · Computer Science 2013-10-08 Ankur Sinha , Pekka Malo , Kalyanmoy Deb

Model predictive control (MPC) has been widely used in many fields, often in hierarchical architectures that combine controllers and decision-making layers at different levels. However, when such architectures are cast as bilevel…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Ryuta Moriyasu , Carmen Amo Alonso , Marco Pavone

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

Optimization and Control · Mathematics 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

This paper studies bilevel polynomial optimization in which lower-level constraint functions depend linearly on lower-level variables. We show that such bilevel program can be reformulated as a disjunctive program by using…

Optimization and Control · Mathematics 2026-02-27 Jiawang Nie , Jane J. Ye , Suhan Zhong

Dantzig-Wolfe (DW) decomposition is a well-known technique in mixed-integer programming (MIP) for decomposing and convexifying constraints to obtain potentially strong dual bounds. We investigate cutting planes that can be derived using the…

Optimization and Control · Mathematics 2023-10-09 Rui Chen , Oktay Gunluk , Andrea Lodi

We present a novel analysis of semidefinite programs (SDPs) with positive duality gaps, i.e. different optimal values in the primal and dual problems. These SDPs are extremely pathological, often unsolvable, and also serve as models of more…

Optimization and Control · Mathematics 2020-05-18 Gabor Pataki

In the rank-constrained optimization problem (RCOP), it minimizes a linear objective function over a prespecified closed rank-constrained domain set and $m$ generic two-sided linear matrix inequalities. Motivated by the Dantzig-Wolfe (DW)…

Optimization and Control · Mathematics 2023-06-16 Yongchun Li , Weijun Xie