English
Related papers

Related papers: A Tight SDP Relaxation for the Cubic-Quartic Regul…

200 papers

We study the maximization of sums of heterogeneous quadratic forms over the Stiefel manifold, a nonconvex problem that arises in several modern signal processing and machine learning applications such as heteroscedastic probabilistic…

Optimization and Control · Mathematics 2025-04-09 Kyle Gilman , Sam Burer , Laura Balzano

For verifying the safety of neural networks (NNs), Fazlyab et al. (2019) introduced a semidefinite programming (SDP) approach called DeepSDP. This formulation can be viewed as the dual of the SDP relaxation for a problem formulated as a…

Optimization and Control · Mathematics 2025-04-15 Godai Azuma , Sunyoung Kim , Makoto Yamashita

Gradient descent-ascent (GDA) is a widely used algorithm for minimax optimization. However, GDA has been proved to converge to stationary points for nonconvex minimax optimization, which are suboptimal compared with local minimax points. In…

Optimization and Control · Mathematics 2023-02-21 Ziyi Chen , Zhengyang Hu , Qunwei Li , Zhe Wang , Yi Zhou

We consider the exact solution of problem $(QP)$ that consists in minimizing a quadratic function subject to quadratic constraints. Starting from the classical convex relaxation that uses the McCormick's envelopes, we introduce 12…

Optimization and Control · Mathematics 2020-05-07 Amélie Lambert

For general quadratically-constrained quadratic programming (QCQP), we propose a parabolic relaxation described with convex quadratic constraints. An interesting property of the parabolic relaxation is that the original non-convex feasible…

Optimization and Control · Mathematics 2022-08-09 Ramtin Madani , Mersedeh Ashraphijuo , Mohsen Kheirandishfard , Alper Atamturk

We study continuous quadratic submodular minimization with bounds and propose a polynomially sized semidefinite relaxation, which is provably tight for dimension $n \le 3$ and empirically tight for larger $n$. We apply the relaxation to two…

Optimization and Control · Mathematics 2026-04-07 Samuel Burer , Karthik Natarajan

In this paper, we study the \emph{sparse integer least squares problem} (SILS), an NP-hard variant of least squares with sparse $\{0, \pm 1\}$-vectors. We propose an $\ell_1$-based SDP relaxation, and a randomized algorithm for SILS, which…

Optimization and Control · Mathematics 2026-05-19 Alberto Del Pia , Dekun Zhou

The current bottleneck of globally solving mixed-integer (non-convex) quadratically constrained problem (MIQCP) is still to construct strong but computationally cheap convex relaxations, especially when dense quadratic functions are…

Optimization and Control · Mathematics 2014-03-24 Hongbo Dong

We consider the minimization of non-convex functions that typically arise in machine learning. Specifically, we focus our attention on a variant of trust region methods known as cubic regularization. This approach is particularly attractive…

Machine Learning · Computer Science 2017-07-04 Jonas Moritz Kohler , Aurelien Lucchi

We study robust convex quadratic programs where the uncertain problem parameters can contain both continuous and integer components. Under the natural boundedness assumption on the uncertainty set, we show that the generic problems are…

Optimization and Control · Mathematics 2018-12-19 Areesh Mittal , Can Gokalp , Grani A. Hanasusanto

For nonconvex quadratically constrained quadratic programs (QCQPs), we first show that, under certain feasibility conditions, the standard semidefinite (SDP) relaxation is exact for QCQPs with bipartite graph structures. The exact optimal…

Optimization and Control · Mathematics 2022-05-03 Godai Azuma , Mituhiro Fukuda , Sunyoung Kim , Makoto Yamashita

This paper focuses on the study of a mathematical program with equilibrium constraints, where the objective and the constraint functions are all polynomials. We present a method for finding its global minimizers and global minimum using a…

Optimization and Control · Mathematics 2019-03-25 Liguo Jiao , Jae Hyoung Lee , Tien-Son Pham

This paper proposes a squared smoothing Newton method via the Huber smoothing function for solving semidefinite programming problems (SDPs). We first study the fundamental properties of the matrix-valued mapping defined upon the Huber…

Optimization and Control · Mathematics 2024-10-10 Ling Liang , Defeng Sun , Kim-Chuan Toh

This work introduces a new cubic regularization method for nonconvex unconstrained multiobjective optimization problems. At each iteration of the method, a model associated with the cubic regularization of each component of the objective…

Optimization and Control · Mathematics 2025-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

This paper studies how to solve semi-infinite polynomial programming (SIPP) problems by semidefinite relaxation method. We first introduce two SDP relaxation methods for solving polynomial optimization problems with finitely many…

Optimization and Control · Mathematics 2013-06-11 Li Wang , Feng Guo

In this paper, we consider a class of nonconvex complex quadratic programming (CQP) problems, which find a broad spectrum of signal processing applications. By using the polar coordinate representations of the complex variables, we first…

Information Theory · Computer Science 2020-08-20 Cheng Lu , Ya-Feng Liu , Jing Zhou

Correspondence problems are often modelled as quadratic optimization problems over permutations. Common scalable methods for approximating solutions of these NP-hard problems are the spectral relaxation for non-convex energies and the…

Graphics · Computer Science 2017-05-18 Nadav Dym , Haggai Maron , Yaron Lipman

This paper considers the problem of solving a special quartic-quadratic optimization problem with a single sphere constraint, namely, finding a global and local minimizer of…

Optimization and Control · Mathematics 2019-08-05 Haixiang Zhang , Andre Milzarek , Zaiwen Wen , Wotao Yin

There has been growing interest in high-order tensor methods for nonconvex optimization, with adaptive regularization, as they possess better/optimal worst-case evaluation complexity globally and faster convergence asymptotically. These…

Optimization and Control · Mathematics 2025-01-17 Coralia Cartis , Wenqi Zhu

The $p$-regularized subproblem (p-RS) is a regularisation technique in computing a Newton-like step for unconstrained optimization, which globally minimizes a local quadratic approximation of the objective function while incorporating with…

Optimization and Control · Mathematics 2018-05-01 Yong Hsia , Ruey-Lin Sheu , Ya-xiang Yuan