English
Related papers

Related papers: Block-Coordinate Minimization for Large SDPs with …

200 papers

A semidefinite program (SDP) is a particular kind of convex optimization problem with applications in operations research, combinatorial optimization, quantum information science, and beyond. In this work, we propose variational quantum…

Quantum Physics · Physics 2024-06-19 Dhrumil Patel , Patrick J. Coles , Mark M. Wilde

In many applications, it is desired to obtain extreme eigenvalues and eigenvectors of large Hermitian matrices by efficient and compact algorithms. In particular, orthogonalization-free methods are preferred for large-scale problems for…

Numerical Analysis · Mathematics 2023-12-05 Shixin Zheng , Haizhao Yang , Xiangxiong Zhang

We study the projected gradient descent method on low-rank matrix problems with a strongly convex objective. We use the Burer-Monteiro factorization approach to implicitly enforce low-rankness; such factorization introduces non-convexity in…

It is well-known that the Burer-Monteiro (B-M) factorization approach can efficiently solve low-rank matrix optimization problems under the RIP condition. It is natural to ask whether B-M factorization-based methods can succeed on any…

Optimization and Control · Mathematics 2021-10-22 Baturalp Yalcin , Haixiang Zhang , Javad Lavaei , Somayeh Sojoudi

By concisely representing a joint function of many variables as the combination of small functions, discrete graphical models (GMs) provide a powerful framework to analyze stochastic and deterministic systems of interacting variables. One…

Optimization and Control · Mathematics 2021-11-25 Valentin Durante , George Katsirelos , Thomas Schiex

Semidefinite programs (SDPs) are powerful theoretical tools that have been studied for over two decades, but their practical use remains limited due to computational difficulties in solving large-scale, realistic-sized problems. In this…

Optimization and Control · Mathematics 2018-05-15 Richard Y. Zhang , Javad Lavaei

Block-coordinate descent algorithms and alternating minimization methods are fundamental optimization algorithms and an important primitive in large-scale optimization and machine learning. While various block-coordinate-descent-type…

Optimization and Control · Mathematics 2019-07-02 Jelena Diakonikolas , Lorenzo Orecchia

In this paper, we present a new stochastic algorithm, namely the stochastic block mirror descent (SBMD) method for solving large-scale nonsmooth and stochastic optimization problems. The basic idea of this algorithm is to incorporate the…

Optimization and Control · Mathematics 2013-09-10 Cong D. Dang , Guanghui Lan

To address difficult optimization problems, convex relaxations based on semidefinite programming are now common place in many fields. Although solvable in polynomial time, large semidefinite programs tend to be computationally challenging.…

Optimization and Control · Mathematics 2016-05-31 Afonso S. Bandeira , Nicolas Boumal , Vladislav Voroninski

This paper develops distributed synchronous and asynchronous algorithms for the large-scale semi-definite programming with diagonal constraints, which has wide applications in combination optimization, image processing and community…

Optimization and Control · Mathematics 2021-04-02 Xia Jiang , Xianlin Zeng , Jian Sun , Jie Chen

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

Block coordinate descent (BCD) methods approach optimization problems by performing gradient steps along alternating subgroups of coordinates. This is in contrast to full gradient descent, where a gradient step updates all coordinates…

Numerical Analysis · Mathematics 2019-07-29 Simon Rabanser , Lukas Neumann , Markus Haltmeier

In this paper, we consider an SDP relaxation of the quadratic knapsack problem (QKP). After using the Burer-Monteiro factorization, we get a non-convex optimization problem, whose feasible region is an algebraic variety. Although there…

Optimization and Control · Mathematics 2023-03-14 Tianyun Tang , Kim-Chuan Toh

$K$-means clustering is a widely used machine learning method for identifying patterns in large datasets. Recently, semidefinite programming (SDP) relaxations have been proposed for solving the $K$-means optimization problem, which enjoy…

Machine Learning · Statistics 2024-04-16 Yubo Zhuang , Xiaohui Chen , Yun Yang , Richard Y. Zhang

We propose a non-convex optimization algorithm, based on the Burer-Monteiro (BM) factorization, for the quantum process tomography problem, in order to estimate a low-rank process matrix $\chi$ for near-unitary quantum gates. In this work,…

Quantum Physics · Physics 2024-07-01 David A. Quiroga , Anastasios Kyrillidis

We address the rectangular matrix completion problem by lifting the unknown matrix to a positive semidefinite matrix in higher dimension, and optimizing a nonconvex objective over the semidefinite factor using a simple gradient descent…

Machine Learning · Statistics 2016-11-23 Qinqing Zheng , John Lafferty

In this paper, we consider a bilevel polynomial optimization problem where the objective and the constraint functions of both the upper and the lower level problems are polynomials. We present methods for finding its global minimizers and…

Optimization and Control · Mathematics 2016-01-14 V. Jeyakumar , J. B. Lasserre , G. Li , T. S. Pham

Most existing methodologies of estimating low-rank matrices rely on Burer-Monteiro factorization, but these approaches can suffer from slow convergence, especially when dealing with solutions characterized by a large condition number,…

Optimization and Control · Mathematics 2024-03-06 Teng Zhang , Xing Fan

Semidefinite programming (SDP) is a fundamental class of convex optimization problems with diverse applications in mathematics, engineering, machine learning, and related disciplines. This paper investigates the application of the…

Optimization and Control · Mathematics 2025-10-15 Zilong Cui , Ran Gu

Block coordinate descent (BCD) methods and their variants have been widely used in coping with large-scale nonconstrained optimization problems in many fields such as imaging processing, machine learning, compress sensing and so on. For…

Optimization and Control · Mathematics 2018-04-04 Daoli Zhu , Lei Zhao