English
Related papers

Related papers: Network Relaxations for Discrete Bilevel Optimizat…

200 papers

We study the feature-based newsvendor problem, in which a decision-maker has access to historical data consisting of demand observations and exogenous features. In this setting, we investigate feature selection, aiming to derive sparse,…

Machine Learning · Computer Science 2022-09-13 Breno Serrano , Stefan Minner , Maximilian Schiffer , Thibaut Vidal

This paper presents a novel robust trajectory optimization method for constrained nonlinear dynamical systems subject to unknown bounded disturbances. In particular, we seek optimal control policies that remain robustly feasible with…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

This paper introduces a novel double regularization scheme for bilevel optimization problems whose lower-level problem is composite and convex, but not necessarily strongly convex, in the lower-level variable. The analysis focuses on the…

Optimization and Control · Mathematics 2026-02-06 Mattia Solla , Johannes O. Royset

Approximate linear programming (ALP) and its variants have been widely applied to Markov Decision Processes (MDPs) with a large number of states. A serious limitation of ALP is that it has an intractable number of constraints, as a result…

Systems and Control · Computer Science 2017-04-11 Chandrashekar Lakshminarayanan , Shalabh Bhatnagar , Csaba Szepesvari

The hyperparameter optimization of neural network can be expressed as a bilevel optimization problem. The bilevel optimization is used to automatically update the hyperparameter, and the gradient of the hyperparameter is the approximate…

Machine Learning · Computer Science 2022-12-14 Shuo Yang , Yang Jiao , Shaoyu Dou , Mana Zheng , Chen Zhu

Bilevel optimization, a well-established field for modeling hierarchical decision-making problems, has recently intersected with sustainability studies and practices, resulting in a series of works focusing on bilevel optimization problems…

Optimization and Control · Mathematics 2026-04-07 Giulia Caselli , Manuel Iori , Ivana Ljubić

It is well-known that coupling constraints in linear bilevel optimization can lead to disconnected feasible sets, which is not possible without coupling constraints. However, there is no difference between linear bilevel problems with and…

Optimization and Control · Mathematics 2024-06-18 Dorothee Henke , Henri Lefebvre , Martin Schmidt , Johannes Thürauf

This paper firstly proposes a convex bilevel optimization paradigm to formulate and optimize popular learning and vision problems in real-world scenarios. Different from conventional approaches, which directly design their iteration schemes…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Risheng Liu , Long Ma , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

In this paper, we investigate optimal control problems governed by semilinear elliptic variational inequalities involving constraints on the state, and more precisely the obstacle problem. Since we adopt a numerical point of view, we first…

Optimization and Control · Mathematics 2020-07-10 El Hassene Osmani , Mounir Haddou , Naceurdine Bensalem

We consider a linear relaxation of a generalized minimum-cost network flow problem with binary input dependencies. In this model the flows through certain arcs are bounded by linear (or more generally, piecewise linear concave) functions of…

Optimization and Control · Mathematics 2022-05-27 Hemanshu Kaul , Adam Rumpf

In this paper, we exploit the so-called value function reformulation of the bilevel optimization problem to develop duality results for the problem. Our approach builds on Fenchel-Lagrange-type duality to establish suitable results for the…

Optimization and Control · Mathematics 2022-05-24 Houria En-Naciri , Lahoussine Lafhim , Alain Zemkoho

We propose an optimization proxy in terms of iterative implicit gradient methods for solving constrained optimization problems with nonconvex loss functions. This framework can be applied to a broad range of machine learning settings,…

Optimization and Control · Mathematics 2025-10-14 Harshal D. Kaushik , Ming Jin

In social network analysis, the size of the k-core, i.e., the maximal induced subgraph of the network with minimum degree at least k, is frequently adopted as a typical metric to evaluate the cohesiveness of a community. We address the…

Optimization and Control · Mathematics 2023-05-03 Martina Cerulli , Domenico Serra , Carmine Sorgente , Claudia Archetti , Ivana Ljubic

We propose a new family of multilevel methods for unconstrained minimization. The resulting strategies are multilevel extensions of high-order optimization methods based on q-order Taylor models (with q >= 1) that have been recently…

Numerical Analysis · Mathematics 2019-04-10 Henri Calandra , Serge Gratton , Elisa Riccietti , Xavier Vasseur

Bilevel Optimization has experienced significant advancements recently with the introduction of new efficient algorithms. Mirroring the success in single-level optimization, stochastic gradient-based algorithms are widely used in bilevel…

Optimization and Control · Mathematics 2024-11-12 Junyi Li , Heng Huang

In multi-robot systems, achieving coordinated missions remains a significant challenge due to the coupled nature of coordination behaviors and the lack of global information for individual robots. To mitigate these challenges, this paper…

Robotics · Computer Science 2024-08-22 Zechen Hu , Daigo Shishika , Xuesu Xiao , Xuan Wang

Linear Programming (LP) relaxations have become powerful tools for finding the most probable (MAP) configuration in graphical models. These relaxations can be solved efficiently using message-passing algorithms such as belief propagation…

Data Structures and Algorithms · Computer Science 2012-06-18 David Sontag , Talya Meltzer , Amir Globerson , Tommi S. Jaakkola , Yair Weiss

Linear programming has played a crucial role in shaping decision-making, resource allocation, and cost reduction in various domains. In this paper, we investigate the application of overparametrized neural networks and their implicit bias…

Optimization and Control · Mathematics 2023-10-05 Haoyue Wang , Promit Ghosal , Rahul Mazumder

Many problems in machine learning involve bilevel optimization (BLO), including hyperparameter optimization, meta-learning, and dataset distillation. Bilevel problems consist of two nested sub-problems, called the outer and inner problems,…

Machine Learning · Computer Science 2022-12-29 Paul Vicol , Jonathan Lorraine , Fabian Pedregosa , David Duvenaud , Roger Grosse

Optimal planning with respect to learned neural network (NN) models in continuous action and state spaces using mixed-integer linear programming (MILP) is a challenging task for branch-and-bound solvers due to the poor linear relaxation of…

Artificial Intelligence · Computer Science 2019-07-29 Buser Say , Scott Sanner , Sylvie Thiébaux