English
Related papers

Related papers: Complexity of near-optimal robust versions of mult…

200 papers

In robust combinatorial optimization, we would like to find a solution that performs well under all realizations of an uncertainty set of possible parameter values. How we model this uncertainty set has a decisive influence on the…

Optimization and Control · Mathematics 2024-04-30 Marc Goerigk , Mohammad Khosravi

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

Bilevel optimization has found successful applications in various machine learning problems, including hyper-parameter optimization, data cleaning, and meta-learning. However, its huge computational cost presents a significant challenge for…

Machine Learning · Computer Science 2024-11-05 Xiaoyu Wang , Rui Pan , Renjie Pi , Jipeng Zhang

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

Machine Learning · Computer Science 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos

In the present article we propose a mixed-integer approximation of adjustable-robust optimization (ARO) problems, that have both, continuous and discrete variables on the lowest level. As these trilevel problems are notoriously hard to…

Optimization and Control · Mathematics 2023-10-11 Jan Kronqvist , Boda Li , Jan Rolfes

We study approaches to robust model-based design of experiments in the context of maximum-likelihood estimation. These approaches provide robustification of model-based methodologies for the design of optimal experiments by accounting for…

Methodology · Statistics 2021-09-03 Anwesh Reddy Gottu Mukkula , Michal Mateáš , Miroslav Fikar , Radoslav Paulen

We study multilevel techniques, commonly used in PDE multigrid literature, to solve structured optimization problems. For a given hierarchy of levels, we formulate a coarse model that approximates the problem at each level and provides a…

Optimization and Control · Mathematics 2025-05-19 Ferdinand Vanmaele , Yara Elshiaty , Stefania Petra

This paper reviews gradient-based techniques to solve bilevel optimization problems. Bilevel optimization is a general way to frame the learning of systems that are implicitly defined through a quantity that they minimize. This…

Machine Learning · Computer Science 2023-05-26 Nicolas Zucchet , João Sacramento

Formal explainability guarantees the rigor of computed explanations, and so it is paramount in domains where rigor is critical, including those deemed high-risk. Unfortunately, since its inception formal explainability has been hampered by…

Artificial Intelligence · Computer Science 2024-12-04 Xuanxiang Huang , Joao Marques-Silva

Despite the vast success of Deep Neural Networks in numerous application domains, it has been shown that such models are not robust i.e., they are vulnerable to small adversarial perturbations of the input. While extensive work has been…

Machine Learning · Computer Science 2020-02-24 Sharon Qian , Dimitris Kalimeris , Gal Kaplun , Yaron Singer

Bilevel optimization reveals the inner structure of otherwise oblique optimization problems, such as hyperparameter tuning, neural architecture search, and meta-learning. A common goal in bilevel optimization is to minimize a…

Optimization and Control · Mathematics 2026-04-29 Lesi Chen , Jing Xu , Jingzhao Zhang

Multistage robust optimization problems can be interpreted as two-person zero-sum games between two players. We exploit this game-like nature and utilize a game tree search in order to solve quantified integer programs (QIPs). In this…

Optimization and Control · Mathematics 2021-06-25 Michael Hartisch

We consider the convex bilevel optimization problem, also known as simple bilevel programming. There are two challenges in solving convex bilevel optimization problems. Firstly, strong duality is not guaranteed due to the lack of Slater…

Optimization and Control · Mathematics 2025-09-29 Khanh-Hung Giang-Tran , Nam Ho-Nguyen , Fatma Kılınç-Karzan , Lingqing Shen

This paper studies simple bilevel problems, where a convex upper-level function is minimized over the optimal solutions of a convex lower-level problem. We first show the fundamental difficulty of simple bilevel problems, that the…

Optimization and Control · Mathematics 2025-01-28 Huaqing Zhang , Lesi Chen , Jing Xu , Jingzhao Zhang

Bilevel optimization deals with nested problems in which a leader takes the first decision to minimize their objective function while accounting for a follower's best-response reaction. Constrained bilevel problems with integer variables…

Optimization and Control · Mathematics 2024-11-04 Justin Dumouchelle , Esther Julien , Jannis Kurtz , Elias B. Khalil

We consider bilevel linear problems, where the right-hand side of the lower level problems is stochastic. The leader has to decide in a here-and-now fashion, while the follower has complete information. In this setting, the leader's outcome…

Optimization and Control · Mathematics 2019-07-11 Johanna Burtscheidt , Matthias Claus

In this paper we begin by discussing the simple bilevel programming problem (SBP) and its extension the simple mathematical programming problem under equilibrium constraints (SMPEC). Here we first define both these problems and study their…

Optimization and Control · Mathematics 2019-12-16 Stephan Dempe , Nguyen Dinh , Joydeep Dutta , Tanushree Pandit

We consider relative or subjective optimization problems where the goal function and feasible set are dependent of the current state of the system under consideration. In general, they are formulated as quasi-equilibrium problems, hence…

Optimization and Control · Mathematics 2020-03-19 I. V. Konnov

When applying optimization method to a real-world problem, the possession of prior knowledge and preliminary analysis on the landscape of a global optimization problem can give us an insight into the complexity of the problem. This…

Neural and Evolutionary Computing · Computer Science 2017-07-11 Pramudita Satria Palar , Koji Shimoyama

We discuss the computational complexity and feasibility properties of scenario based techniques for uncertain optimization programs. We consider different solution alternatives ranging from the standard scenario approach to recursive…

Optimization and Control · Mathematics 2014-12-16 Nikolaos Kariotoglou , Kostas Margellos , John Lygeros