English
Related papers

Related papers: Bilevel Polynomial Programs and Semidefinite Relax…

200 papers

Bilevel hyperparameter optimization has received growing attention thanks to the fast development of machine learning. Due to the tremendous size of data sets, the scale of bilevel hyperparameter optimization problem could be extremely…

Optimization and Control · Mathematics 2025-10-27 Yixin Wang , Qingna Li , Liwei Zhang

This paper studies simple bilevel problems, where a convex upper-level function is minimized over the optimal solutions of a convex lower-level problem. We first show the fundamental difficulty of simple bilevel problems, that the…

Optimization and Control · Mathematics 2025-01-28 Huaqing Zhang , Lesi Chen , Jing Xu , Jingzhao Zhang

We consider the problem of inference in higher-order undirected graphical models with binary labels. We formulate this problem as a binary polynomial optimization problem and propose several linear programming relaxations for it. We compare…

Optimization and Control · Mathematics 2024-12-17 Aida Khajavirad , Yakun Wang

Recently, there has been significant interest in convex relaxations of the optimal power flow (OPF) problem. A semidefinite programming (SDP) relaxation globally solves many OPF problems. However, there exist practical problems for which…

Optimization and Control · Mathematics 2016-11-17 Daniel K. Molzahn , Ian A. Hiskens

Bilevel optimization has been widely applied in many important machine learning applications such as hyperparameter optimization and meta-learning. Recently, several momentum-based algorithms have been proposed to solve bilevel optimization…

Machine Learning · Computer Science 2021-12-17 Junjie Yang , Kaiyi Ji , Yingbin Liang

In this paper, we propose a new convergent conic programming hierarchy of relaxations involving both semi-definite cone and second-order cone constraints for solving nonconvex polynomial optimization problems to global optimality. The…

Optimization and Control · Mathematics 2018-09-19 T. D Chuong , V. Jeyakumar , G. Li

This paper studies the problem of stochastic bilevel optimization where the upper-level function is nonconvex with potentially unbounded smoothness and the lower-level function is strongly convex. This problem is motivated by meta-learning…

Machine Learning · Computer Science 2024-12-31 Xiaochuan Gong , Jie Hao , Mingrui Liu

In this paper, we propose some new semidefinite relaxations for a class of nonconvex complex quadratic programming problems, which widely appear in the areas of signal processing and power system. By deriving new valid constraints to the…

Optimization and Control · Mathematics 2023-05-18 Yingzhe Xu , Cheng Lu , Zhibin Deng , Ya-Feng Liu

Despite the numerous uses of semidefinite programming (SDP) and its universal solvability via interior point methods (IPMs), it is rarely applied to practical large-scale problems. This mainly owes to the computational cost of IPMs that…

Optimization and Control · Mathematics 2024-03-19 Yifan Ran , Stefan Vlaski , Wei Dai

This paper proposes a joint decomposition method that combines La- grangian decomposition and generalized Benders decomposition, to efficiently solve multiscenario nonconvex mixed-integer nonlinear programming (MINLP) problems to global…

Optimization and Control · Mathematics 2018-02-22 Emmanuel Ogbe , Xiang Li

When the lower-level optimal solution set-valued mapping of a bilevel optimization problem is not single-valued, we are faced with an ill-posed problem, which gives rise to the optimistic and pessimistic bilevel optimization problems, as…

Optimization and Control · Mathematics 2024-08-13 Imane Benchouk , Khadra Nachi , Alain Zemkoho

We investigate a family of bilevel imaging learning problems where the lower-level instance corresponds to a convex variational model involving first- and second-order nonsmooth sparsity-based regularizers. By using geometric properties of…

Optimization and Control · Mathematics 2023-03-21 Juan Carlos De los Reyes

In order to verify programs or hybrid systems, one often needs to prove that certain formulas are unsatisfiable. In this paper, we consider conjunctions of polynomial inequalities over the reals. Classical algorithms for deciding these not…

Numerical Analysis · Mathematics 2009-02-02 David Monniaux

A polynomial optimization problem (POP) consists of minimizing a multivariate real polynomial on a semi-algebraic set $K$ described by polynomial inequalities and equations. In its full generality it is a non-convex, multi-extremal,…

Optimization and Control · Mathematics 2014-05-29 Cédric Josz , Didier Henrion

Due to the large number of submissions that more and more conferences experience, finding an automatized way to well distribute the submitted papers among reviewers has become necessary. We model the peer-reviewing matching problem as a…

Multiagent Systems · Computer Science 2023-07-25 Gennaro Auricchio , Ruixiao Zhang , Jie Zhang , Xiaohao Cai

We consider the convex bilevel optimization problem, also known as simple bilevel programming. There are two challenges in solving convex bilevel optimization problems. Firstly, strong duality is not guaranteed due to the lack of Slater…

Optimization and Control · Mathematics 2025-09-29 Khanh-Hung Giang-Tran , Nam Ho-Nguyen , Fatma Kılınç-Karzan , Lingqing Shen

This paper studies a class of simple bilevel optimization problems where we minimize a composite convex function at the upper-level subject to a composite convex lower-level problem. Existing methods either provide asymptotic guarantees for…

Optimization and Control · Mathematics 2024-03-06 Jiulin Wang , Xu Shi , Rujun Jiang

Semidefinite programming is an indispensable tool in computer vision, but general-purpose solvers for semidefinite programs are often too slow and memory intensive for large-scale problems. We propose a general framework to approximately…

Computer Vision and Pattern Recognition · Computer Science 2016-08-10 Sohil Shah , Abhay Kumar , Carlos Castillo , David Jacobs , Christoph Studer , Tom Goldstein

We prove that every semidefinite moment relaxation of a polynomial optimization problem (POP) with a ball constraint can be reformulated as a semidefinite program involving a matrix with constant trace property (CTP). As a result such…

Optimization and Control · Mathematics 2020-12-17 Ngoc Hoang Anh Mai , Jean-Bernard Lasserre , Victor Magron , Jie Wang

Mixed integer bilinear programs (MIBLPs) offer tools to resolve robotics motion planning problems with orthogonal rotation matrices or static moment balance, but require long solving times. Recent work utilizing data-driven methods has…

Robotics · Computer Science 2024-08-02 Xuan Lin , Gabriel Ikaika Fernandez , Dennis Hong