English
Related papers

Related papers: Reliability of Single-Level Equality-Constrained I…

200 papers

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

In this paper, we focus on simple bilevel optimization problems, where we minimize a convex smooth objective function over the optimal solution set of another convex smooth constrained optimization problem. We present a novel bilevel…

Optimization and Control · Mathematics 2024-06-03 Jincheng Cao , Ruichen Jiang , Erfan Yazdandoost Hamedani , Aryan Mokhtari

We consider simple bilevel optimization problems where the goal is to compute among the optimal solutions of a composite convex optimization problem, one that minimizes a secondary objective function. Our main contribution is threefold. (i)…

Optimization and Control · Mathematics 2025-04-14 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

Stochastic bilevel optimization generalizes the classic stochastic optimization from the minimization of a single objective to the minimization of an objective function that depends the solution of another optimization problem. Recently,…

Optimization and Control · Mathematics 2022-04-01 Tianyi Chen , Yuejiao Sun , Quan Xiao , Wotao Yin

Bilevel optimization has arisen as a powerful tool for solving a variety of machine learning problems. Two current popular bilevel optimizers AID-BiO and ITD-BiO naturally involve solving one or two sub-problems, and consequently, whether…

Machine Learning · Computer Science 2022-06-02 Kaiyi Ji , Mingrui Liu , Yingbin Liang , Lei Ying

Bilevel optimization is an important class of optimization problems where one optimization problem is nested within another. While various methods have emerged to address unconstrained general bilevel optimization problems, there has been a…

Optimization and Control · Mathematics 2024-03-15 Nazanin Abolfazli , Ruichen Jiang , Aryan Mokhtari , Erfan Yazdandoost Hamedani

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

Bilevel optimisation is used in inverse imaging problems for hyperparameter learning/identification and experimental design, for instance, to find optimal regularisation parameters and forward operators. However, computationally, the…

Optimization and Control · Mathematics 2025-08-06 Ensio Suonperä , Tuomo Valkonen

Bilevel optimization is a key framework in hierarchical decision-making, where one problem is embedded within the constraints of another. In this work, we propose a control-theoretic approach to solving bilevel optimization problems. Our…

Optimization and Control · Mathematics 2025-03-25 Sina Sharifi , Nazanin Abolfazli , Erfan Yazdandoost Hamedani , Mahyar Fazlyab

In Inverse Optimization (IO), an expert agent solves an optimization problem parametric in an exogenous signal. From a learning perspective, the goal is to learn the expert's cost function given a dataset of signals and corresponding…

Optimization and Control · Mathematics 2024-01-25 Pedro Zattoni Scroccaro , Bilge Atasoy , Peyman Mohajerin Esfahani

This paper investigates whether a single, unified cost function can explain and predict human reaching movements, in contrast with existing approaches that rely on subject- or posture-specific optimization criteria. Using the Minimal…

Robotics · Computer Science 2026-03-10 Sarmad Mehrdad , Maxime Sabbah , Vincent Bonnet , Ludovic Righetti

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

Computational level explanations based on optimal feedback control with signal-dependent noise have been able to account for a vast array of phenomena in human sensorimotor behavior. However, commonly a cost function needs to be assumed for…

Machine Learning · Computer Science 2021-10-22 Matthias Schultheis , Dominik Straub , Constantin A. Rothkopf

Integrated learning and optimization (ILO) is a framework in contextual optimization which aims to train a predictive model for the probability distribution of the underlying problem data uncertainty, with the goal of enhancing the quality…

Optimization and Control · Mathematics 2026-01-26 Yuan Tao , Huifu Xu

In this paper, we study multi-block min-max bilevel optimization problems, where the upper level is non-convex strongly-concave minimax objective and the lower level is a strongly convex objective, and there are multiple blocks of dual…

Optimization and Control · Mathematics 2022-11-22 Quanqi Hu , Yongjian Zhong , Tianbao Yang

In this work, we consider bilevel optimization when the lower-level problem is strongly convex. Recent works show that with a Hessian-vector product (HVP) oracle, one can provably find an $\epsilon$-stationary point within…

Optimization and Control · Mathematics 2026-05-26 Lesi Chen , Yaohua Ma , Jingzhao Zhang

Bilevel optimization is a hierarchical framework where an upper-level optimization problem is constrained by a lower-level problem, commonly used in machine learning applications such as hyperparameter optimization. Existing bilevel…

Optimization and Control · Mathematics 2026-03-03 Yuman Wu , Xiaochuan Gong , Jie Hao , Mingrui Liu

Incentive-based load curtailment unlocks critical demand-side flexibility but is hindered by the limited knowledge of private user parameters and the inherent nonsmoothness of responses due to physical device constraints. We address this…

Systems and Control · Electrical Eng. & Systems 2026-05-27 Zhisen Jiang , Florian Dörfler , Saverio Bolognani

The design of the performance index, also referred to as cost or reward shaping, is central to both optimal control and reinforcement learning, as it directly determines the behaviors, trade-offs, and objectives that the resulting control…

Systems and Control · Electrical Eng. & Systems 2025-10-14 Ayush Rai , Shaoshuai Mou , Brian D. O. Anderson

In this work, we study first-order algorithms for solving Bilevel Optimization (BO) where the objective functions are smooth but possibly nonconvex in both levels and the variables are restricted to closed convex sets. As a first step, we…

Optimization and Control · Mathematics 2024-02-13 Jeongyeol Kwon , Dohyun Kwon , Stephen Wright , Robert Nowak