English
Related papers

Related papers: Global Optimization for Cardinality-constrained Mi…

200 papers

Semidefinite Programming (SDP) provides tight lower bounds for Optimal Power Flow problems. However, solving large-scale SDP problems requires exploiting sparsity. In this paper, we experiment several clique decomposition algorithms that…

Optimization and Control · Mathematics 2019-12-20 Julie Sliwak , Miguel Anjos , Lucas Létocart , Jean Maeght , Emiliano Traversi

K-means plays a vital role in data mining and is the simplest and most widely used algorithm under the Euclidean Minimum Sum-of-Squares Clustering (MSSC) model. However, its performance drastically drops when applied to vast amounts of…

Machine Learning · Computer Science 2023-11-27 Rustam Mussabayev , Nenad Mladenovic , Bassem Jarboui , Ravil Mussabayev

Semidefinite programs (SDPs) are standard convex problems that are frequently found in control and optimization applications. Interior-point methods can solve SDPs in polynomial time up to arbitrary accuracy, but scale poorly as the size of…

Optimization and Control · Mathematics 2022-01-10 Jared Miller , Yang Zheng , Mario Sznaier , Antonis Papachristodoulou

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

In this paper, we concentrate on a particular category of quadratically constrained quadratic programming (QCQP): nonconvex QCQP with one equality constraint. This type of QCQP problem optimizes a quadratic objective under a fixed…

Optimization and Control · Mathematics 2025-06-05 Licheng Zhao , Rui Zhou , Wenqiang Pu

We show a new way to round vector solutions of semidefinite programming (SDP) hierarchies into integral solutions, based on a connection between these hierarchies and the spectrum of the input graph. We demonstrate the utility of our method…

Data Structures and Algorithms · Computer Science 2011-04-26 Boaz Barak , Prasad Raghavendra , David Steurer

Under mild conditions on the noise level of the measurements, rotation averaging satisfies strong duality, which enables global solutions to be obtained via semidefinite programming (SDP) relaxation. However, generic solvers for SDP are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Álvaro Parra , Shin-Fang Chng , Tat-Jun Chin , Anders Eriksson , Ian Reid

Random projection, a dimensionality reduction technique, has been found useful in recent years for reducing the size of optimization problems. In this paper, we explore the use of sparse sub-gaussian random projections to approximate…

Optimization and Control · Mathematics 2024-06-21 Monse Guedes-Ayala , Pierre-Louis Poirion , Lars Schewe , Akiko Takeda

We consider clustering problems where the goal is to determine an optimal partition of a given point set in Euclidean space in terms of a collection of affine subspaces. While there is vast literature on heuristics for this kind of problem,…

Optimization and Control · Mathematics 2016-07-26 Francesco Silvestri , Gerhard Reinelt , Christoph Schnörr

We introduce a model-free relax-and-round algorithm for k-means clustering based on a semidefinite relaxation due to Peng and Wei. The algorithm interprets the SDP output as a denoised version of the original data and then rounds this…

Machine Learning · Statistics 2016-05-11 Dustin G. Mixon , Soledad Villar , Rachel Ward

Solution methods for the minimum sum-of-squares clustering (MSSC) problem are analyzed and developed in this paper. Based on the DCA (Difference-of-Convex functions Algorithms) in DC programming and recently established qualitative…

Optimization and Control · Mathematics 2019-01-30 Tran Hung Cuong , Jen-Chih Yao , Nguyen Dong Yen

We present a general approach to rounding semidefinite programming relaxations obtained by the Sum-of-Squares method (Lasserre hierarchy). Our approach is based on using the connection between these relaxations and the Sum-of-Squares proof…

Data Structures and Algorithms · Computer Science 2013-12-24 Boaz Barak , Jonathan Kelner , David Steurer

Semidefinite programming is an indispensable tool in computer vision, but general-purpose solvers for semidefinite programs are often too slow and memory intensive for large-scale problems. We propose a general framework to approximately…

Computer Vision and Pattern Recognition · Computer Science 2016-08-10 Sohil Shah , Abhay Kumar , Carlos Castillo , David Jacobs , Christoph Studer , Tom Goldstein

It is well-known that any sum of squares (SOS) program can be cast as a semidefinite program (SDP) of a particular structure and that therein lies the computational bottleneck for SOS programs, as the SDPs generated by this procedure are…

Optimization and Control · Mathematics 2017-10-05 Amir Ali Ahmadi , Georgina Hall , Antonis Papachristodoulou , James Saunderson , Yang Zheng

This paper presents an algorithm to solve the Soft k-Means problem globally. Unlike Fuzzy c-Means, Soft k-Means (SkM) has a matrix factorization-type objective and has been shown to have a close relation with the popular probability…

Machine Learning · Computer Science 2022-12-08 Feiping Nie , Hong Chen , Rong Wang , Xuelong Li

Exact solution of hard combinatorial optimization problems often relies on strong convex relaxations, but solving these relaxations repeatedly inside a branch-and-bound algorithm can be prohibitively expensive. Hence, we consider this…

Machine Learning · Computer Science 2026-05-11 Hao Chen , Chendi Qian , Christopher Morris , Andrea Lodi , Can Li

We consider semidefinite programs (SDPs) of size n with equality constraints. In order to overcome scalability issues, Burer and Monteiro proposed a factorized approach based on optimizing over a matrix Y of size $n$ by $k$ such that $X =…

Machine Learning · Statistics 2018-11-29 Thomas Pumir , Samy Jelassi , Nicolas Boumal

This paper studies a distributionally robust portfolio optimization model with a cardinality constraint for limiting the number of invested assets. We formulate this model as a mixed-integer semidefinite optimization (MISDO) problem by…

Optimization and Control · Mathematics 2022-12-22 Ken Kobayashi , Yuichi Takano , Kazuhide Nakata

In this survey we consider polynomial optimization problems, asking to minimize a polynomial function over a compact semialgebraic set, defined by polynomial inequalities. This models a great variety of (in general, nonlinear nonconvex)…

Optimization and Control · Mathematics 2025-01-16 Monique Laurent , Lucas Slot

Clustering is a hard discrete optimization problem. Nonconvex approaches such as low-rank semidefinite programming (SDP) have recently demonstrated promising statistical and local algorithmic guarantees for cluster recovery. Due to the…

Machine Learning · Computer Science 2026-03-05 Peng Xu , Chun-Ying Hou , Xiaohui Chen , Richard Y. Zhang