English
Related papers

Related papers: Improved Conic Reformulations for K-means Clusteri…

200 papers

Spectral Clustering as a relaxation of the normalized/ratio cut has become one of the standard graph-based clustering methods. Existing methods for the computation of multiple clusters, corresponding to a balanced $k$-cut of the graph, are…

Machine Learning · Statistics 2015-05-26 Syama Sundar Rangapuram , Pramod Kaushik Mudrakarta , Matthias Hein

The min-knapsack problem with compactness constraints extends the classical knapsack problem, in the case of ordered items, by introducing a restriction ensuring that they cannot be too far apart. This problem has applications in…

Optimization and Control · Mathematics 2025-04-28 Hubert Villuendas , Mathieu Besançon , Jérôme Malick

It is well-known that by adding integrality constraints to the semidefinite programming (SDP) relaxation of the max-cut problem, the resulting integer semidefinite program is an exact formulation of the problem. In this paper we show…

Optimization and Control · Mathematics 2023-11-09 Frank de Meijer , Renata Sotirov

Semidefinite programming (SDP) is the task of optimizing a linear function over the common solution set of finitely many linear matrix inequalities (LMIs). For the running time of SDP solvers, the maximal matrix size of these LMIs is…

Optimization and Control · Mathematics 2021-01-29 Claus Scheiderer

Seeking tighter relaxations of combinatorial optimization problems, semidefinite programming is a generalization of linear programming that offers better bounds and is still polynomially solvable. Yet, in practice, a semidefinite program is…

Optimization and Control · Mathematics 2023-11-17 Daniel Porumbel

A geometric nonconvex conic optimization problem (COP) was recently proposed by Kim, Kojima and Toh as a unified framework for convex conic reformulation of a class of quadratic optimization problems and polynomial optimization problems.…

Optimization and Control · Mathematics 2024-09-11 Naohiko Arima , Sunyoung Kim , Masakazu Kojima

Clustering is a fundamental unsupervised learning approach. Many clustering algorithms -- such as $k$-means -- rely on the euclidean distance as a similarity measure, which is often not the most relevant metric for high dimensional data…

Machine Learning · Computer Science 2019-10-22 Aude Genevay , Gabriel Dulac-Arnold , Jean-Philippe Vert

We introduce and study conic geometric programs (CGPs), which are convex optimization problems that unify geometric programs (GPs) and conic optimization problems such as semidefinite programs (SDPs). A CGP consists of a linear objective…

Optimization and Control · Mathematics 2013-10-14 Venkat Chandrasekaran , Parikshit Shah

K-means is a classical clustering algorithm with wide applications. However, soft K-means, or fuzzy c-means at m=1, remains unsolved since 1981. To address this challenging open problem, we propose a novel clustering model, i.e.…

Machine Learning · Computer Science 2020-11-23 Yujian Li , Bowen Liu , Zhaoying Liu , Ting Zhang

Convex clustering is an attractive clustering algorithm with favorable properties such as efficiency and optimality owing to its convex formulation. It is thought to generalize both k-means clustering and agglomerative clustering. However,…

Machine Learning · Statistics 2021-05-19 Canh Hao Nguyen , Hiroshi Mamitsuka

In this paper, "chance optimization" problems are introduced, where one aims at maximizing the probability of a set defined by polynomial inequalities. These problems are, in general, nonconvex and computationally hard. With the objective…

Optimization and Control · Mathematics 2015-05-12 Ashkan Jasour , Necdet Serhat Aybat , Constantino Lagoa

We propose the formulation of convex Generalized Disjunctive Programming (GDP) problems using conic inequalities leading to conic GDP problems. We then show the reformulation of conic GDPs into Mixed-Integer Conic Programming (MICP)…

Optimization and Control · Mathematics 2024-02-20 David E. Bernal Neira , Ignacio E. Grossmann

We consider solving high-order semidefinite programming (SDP) relaxations of nonconvex polynomial optimization problems (POPs) that often admit degenerate rank-one optimal solutions. Instead of solving the SDP alone, we propose a new…

Optimization and Control · Mathematics 2021-10-27 Heng Yang , Ling Liang , Luca Carlone , Kim-Chuan Toh

Mirror descent (MD) is a powerful first-order optimization technique that subsumes several optimization algorithms including gradient descent (GD). In this work, we develop a semi-definite programming (SDP) framework to analyze the…

Optimization and Control · Mathematics 2022-01-19 Youbang Sun , Mahyar Fazlyab , Shahin Shahrampour

In this paper we consider the dictionary learning problem for sparse representation. We first show that this problem is NP-hard by polynomial time reduction of the densest cut problem. Then, using successive convex approximation strategies,…

Machine Learning · Computer Science 2015-11-06 Meisam Razaviyayn , Hung-Wei Tseng , Zhi-Quan Luo

Clustering is a NP-hard problem. Thus, no optimal algorithm exists, heuristics are applied to cluster the data. Heuristics can be very resource-intensive, if not applied properly. For substantially large data sets computational efficiencies…

Databases · Computer Science 2020-03-11 Mujahid Sultan

Semidefinite programs (SDPs) -- some of the most useful and versatile optimization problems of the last few decades -- are often pathological: the optimal values of the primal and dual problems may differ and may not be attained. Such SDPs…

Optimization and Control · Mathematics 2019-10-23 Gabor Pataki

Clustering large, mixed data is a central problem in data mining. Many approaches adopt the idea of k-means, and hence are sensitive to initialisation, detect only spherical clusters, and require a priori the unknown number of clusters. We…

Machine Learning · Statistics 2020-11-13 Joshua Tobin , Mimi Zhang

In this paper a novel possibilistic c-means clustering algorithm, called Adaptive Possibilistic c-means, is presented. Its main feature is that {\it all} its parameters, after their initialization, are properly adapted during its execution.…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Spyridoula D. Xenaki , Konstantinos D. Koutroumbas , Athanasios A. Rontogiannis

An optimization problem considering AC power flow constraints and integer decision variables can usually be posed as a mixed-integer quadratically constrained quadratic program (MIQCQP) problem. In this paper, first, a set of valid linear…

Optimization and Control · Mathematics 2015-09-18 Qifeng Li