English
Related papers

Related papers: Achieving Hierarchy-Free Approximation for Bilevel…

200 papers

We consider Stackelberg pricing games, which are also known as bilevel pricing problems, or combinatorial price-setting problems. This family of problems consists of games between two players: the leader and the follower. There is a market…

Computer Science and Game Theory · Computer Science 2025-11-11 Christoph Grüne , Dorothee Henke , Eva Rotenberg , Lasse Wulf

We propose a new family of multilevel methods for unconstrained minimization. The resulting strategies are multilevel extensions of high-order optimization methods based on q-order Taylor models (with q >= 1) that have been recently…

Numerical Analysis · Mathematics 2019-04-10 Henri Calandra , Serge Gratton , Elisa Riccietti , Xavier Vasseur

We develop primal-dual coordinate methods for solving bilinear saddle-point problems of the form $\min_{x \in \mathcal{X}} \max_{y\in\mathcal{Y}} y^\top A x$ which contain linear programming, classification, and regression as special cases.…

Data Structures and Algorithms · Computer Science 2020-09-18 Yair Carmon , Yujia Jin , Aaron Sidford , Kevin Tian

We consider a bilevel problem involving two monotone equilibrium bifunctions and we show that this problem can be solved by a proximal point method with generalized proximal distances. We propose a framework for the convergence analysis of…

Optimization and Control · Mathematics 2014-07-09 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , P. A. Soares , A. Soubeyran

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

A very simple first-order algorithm is proposed for solving nonlinear optimization problems with deterministic nonlinear equality constraints. This algorithm adaptively selects steps in the plane tangent to the constraints or steps that…

Optimization and Control · Mathematics 2026-03-11 Serge Gratton , Philippe L. Toint

In this paper, we propose a class of super-schemes for efficiently solving nonlinear unconstrained optimization problems. The proposed approach introduces two novel choices of step-size parameters, leading to efficient descent directions…

Optimization and Control · Mathematics 2026-04-24 Tugal Zhanlav , Lkhamsuren Altangerel , Khuder Otgondorj

Our aim is to explain mathematical programs with equilibrium constraints (MPECs), motivate them through applications, present the main equivalent formulations of equilibrium constraints, and summarize the basic existence theory for optimal…

Optimization and Control · Mathematics 2026-05-04 Louis Shuo Wang

In this work, we study first-order algorithms for solving Bilevel Optimization (BO) where the objective functions are smooth but possibly nonconvex in both levels and the variables are restricted to closed convex sets. As a first step, we…

Optimization and Control · Mathematics 2024-02-13 Jeongyeol Kwon , Dohyun Kwon , Stephen Wright , Robert Nowak

We consider a class of hierarchical noncooperative $N$-player games where the $i$th player solves a parametrized stochastic mathematical program with equilibrium constraints (MPEC) with the caveat that the implicit form of the $i$th…

Optimization and Control · Mathematics 2022-02-23 Shisheng Cui , Uday V. Shanbhag

Invex programs are a special kind of non-convex problems which attain global minima at every stationary point. While classical first-order gradient descent methods can solve them, they converge very slowly. In this paper, we propose new…

Optimization and Control · Mathematics 2023-07-11 Adarsh Barik , Suvrit Sra , Jean Honorio

Bilevel optimization has arisen as a powerful tool in modern machine learning. However, due to the nested structure of bilevel optimization, even gradient-based methods require second-order derivative approximations via Jacobian- or/and…

Machine Learning · Computer Science 2022-06-07 Daouda Sow , Kaiyi Ji , Yingbin Liang

Two-level stochastic optimization formulations have become instrumental in a number of machine learning contexts such as continual learning, neural architecture search, adversarial learning, and hyperparameter tuning. Practical stochastic…

Optimization and Control · Mathematics 2023-11-08 Tommaso Giovannelli , Griffin Dean Kent , Luis Nunes Vicente

This paper is concerned with the derivation of first- and second-order sufficient optimality conditions for optimistic bilevel optimization problems involving smooth functions. First-order sufficient optimality conditions are obtained by…

Optimization and Control · Mathematics 2019-11-06 Patrick Mehlitz , Alain B. Zemkoho

We give a converging semidefinite programming hierarchy of outer approximations for the set of quantum correlations of fixed dimension and derive analytical bounds on the convergence speed of the hierarchy. In particular, we give a…

Quantum Physics · Physics 2021-07-05 Hyejung H. Jee , Carlo Sparaciari , Omar Fawzi , Mario Berta

We present a new feasible proximal gradient method for constrained optimization where both the objective and constraint functions are given by the summation of a smooth, possibly nonconvex function and a convex simple function. The…

Optimization and Control · Mathematics 2024-02-01 Digvijay Boob , Qi Deng , Guanghui Lan

We investigate first-order notions of correlated equilibria in smooth games, in which players do not incur any regret against small modifications of their actions prescribed by some vector field. We define two such notions, based on local…

Computer Science and Game Theory · Computer Science 2025-11-05 Mete Şeref Ahunbay

A long-standing open question in Integer Programming is whether integer programs with constraint matrices with bounded subdeterminants are efficiently solvable. An important special case thereof are congruency-constrained integer programs…

Optimization and Control · Mathematics 2023-04-26 Martin Nägele , Richard Santiago , Rico Zenklusen

This paper investigates a class of stochastic bilevel optimization problems where the upper-level function is nonconvex with potentially unbounded smoothness and the lower-level problem is strongly convex. These problems have significant…

Machine Learning · Computer Science 2025-01-16 Xiaochuan Gong , Jie Hao , Mingrui Liu

A growing body of work in game theory extends the traditional Stackelberg game to settings with one leader and multiple followers who play a Nash equilibrium. Standard approaches for computing equilibria in these games reformulate the…

Computer Science and Game Theory · Computer Science 2021-12-07 Kai Wang , Lily Xu , Andrew Perrault , Michael K. Reiter , Milind Tambe