English
Related papers

Related papers: Bilevel Mixed-Integer Linear Program with Binary T…

200 papers

Hyperparameter optimization in machine learning is often achieved using naive techniques that only lead to an approximate set of hyperparameters. Although techniques such as Bayesian optimization perform an intelligent search on a given…

Machine Learning · Computer Science 2023-06-21 Ankur Sinha , Satender Gunwal , Shivam Kumar

We study a class of bilevel convex optimization problems where the goal is to find the minimizer of an objective function in the upper level, among the set of all optimal solutions of an optimization problem in the lower level. A wide range…

Optimization and Control · Mathematics 2018-09-27 Mostafa Amini , Farzad Yousefian

In recent years, bilevel approaches have become very popular to efficiently estimate high-dimensional hyperparameters of machine learning models. However, to date, binary parameters are handled by continuous relaxation and rounding…

Machine Learning · Computer Science 2025-03-20 Sara Venturini , Marianna de Santis , Jordan Patracone , Francesco Rinaldi , Saverio Salzo , Martin Schmidt

Boolean networks are dynamical models of disease development in which the activation levels of genes are represented by binary variables. Given a Boolean network, controls represent mutations or medical treatments that fix the activation…

Optimization and Control · Mathematics 2026-04-02 Kyungduk Moon , Kangbok Lee , Loïc Paulevé

This paper presents the first generic bi-objective binary linear branch-and-cut algorithm. Studying the impact of valid inequalities in solution and objective spaces, two cutting frameworks are proposed. The multi-point separation problem…

Discrete Mathematics · Computer Science 2024-10-14 Pierre Fouilhoux , Lucas Létocart , Yue Zhang

Multiagent planning and coordination problems are common and known to be computationally hard. We show that a wide range of two-agent problems can be formulated as bilinear programs. We present a successive approximation algorithm that…

Artificial Intelligence · Computer Science 2014-01-16 Marek Petrik , Shlomo Zilberstein

We consider the convex bilevel optimization problem, also known as simple bilevel programming. There are two challenges in solving convex bilevel optimization problems. Firstly, strong duality is not guaranteed due to the lack of Slater…

Optimization and Control · Mathematics 2025-09-29 Khanh-Hung Giang-Tran , Nam Ho-Nguyen , Fatma Kılınç-Karzan , Lingqing Shen

In this paper we propose a bilevel optimization approach for the placement of space and time observations in variational data assimilation problems. Within the framework of supervised learning, we consider a bilevel problem where the…

Optimization and Control · Mathematics 2019-10-09 Paula Castro , Juan Carlos De los Reyes

In this paper, we consider bilevel optimization problem where the lower-level has coupled constraints, i.e. the constraints depend both on the upper- and lower-level variables. In particular, we consider two settings for the lower-level…

Optimization and Control · Mathematics 2025-03-14 Xiaotian Jiang , Jiaxiang Li , Mingyi Hong , Shuzhong Zhang

Bilevel optimization enjoys a wide range of applications in emerging machine learning and signal processing problems such as hyper-parameter optimization, image reconstruction, meta-learning, adversarial training, and reinforcement…

Machine Learning · Computer Science 2025-01-08 Han Shen , Quan Xiao , Tianyi Chen

Machine learning components commonly appear in larger decision-making pipelines; however, the model training process typically focuses only on a loss that measures accuracy between predicted values and ground truth values. Decision-focused…

Machine Learning · Computer Science 2019-07-19 Aaron Ferber , Bryan Wilder , Bistra Dilkina , Milind Tambe

We study a pessimistic stochastic bilevel program in the context of sequential two-player games, where the leader makes a binary here-and-now decision, and the follower responds a continuous wait-and-see decision after observing the…

Optimization and Control · Mathematics 2022-06-09 Akshit Goyal , Yiling Zhang , Chuan He

In this paper, we introduce a new functional point of view on bilevel optimization problems for machine learning, where the inner objective is minimized over a function space. These types of problems are most often solved by using methods…

Machine Learning · Statistics 2024-12-10 Ieva Petrulionyte , Julien Mairal , Michael Arbel

Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both the lower and upper levels are constrained on Riemannian…

Optimization and Control · Mathematics 2024-11-05 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Akiko Takeda

Inspired by multigrid methods for linear systems of equations, multilevel optimization methods have been proposed to solve structured optimization problems. Multilevel methods make more assumptions regarding the structure of the…

Optimization and Control · Mathematics 2019-11-27 Chin Pang Ho , Michal Kocvara , Panos Parpas

This paper is concerned with the value function approach to multiobjective bilevel optimization which exploits a lower level frontier-type mapping in order to replace the hierarchical model of two interdependent multiobjective optimization…

Optimization and Control · Mathematics 2023-10-30 Daniel Hoff , Patrick Mehlitz

We consider bilevel linear problems, where some parameters are stochastic, and the leader has to decide in a here-and-now fashion, while the follower has complete information. In this setting, the leader's outcome can be modeled by a random…

Optimization and Control · Mathematics 2019-02-01 J. Burtscheidt , M. Claus , S. Dempe

We study the representability of sets that admit extended formulations using mixed-integer bilevel programs. We show that feasible regions modeled by continuous bilevel constraints (with no integer variables), complementarity constraints,…

Optimization and Control · Mathematics 2018-10-10 Amitabh Basu , Christopher Thomas Ryan , Sriram Sankaranarayanan

We investigate relaxations for a class of discrete bilevel programs where the interaction constraints linking the leader and the follower are linear. Our approach reformulates the upper-level optimality constraints by projecting the…

Optimization and Control · Mathematics 2024-07-26 Leonardo Lozano , David Bergman , Andre Augusto Cire

It is well known that bilevel optimization problems are hard to solve both in theory and practice. In this paper, we highlight a further computational difficulty when it comes to solving bilevel problems with continuous but nonconvex lower…

Optimization and Control · Mathematics 2023-05-04 Yasmine Beck , Daniel Bienstock , Martin Schmidt , Johannes Thürauf