English
Related papers

Related papers: Clustering using Max-norm Constrained Optimization

200 papers

Clustering under pairwise constraints is an important knowledge discovery tool that enables the learning of appropriate kernels or distance metrics to improve clustering performance. These pairwise constraints, which come in the form of…

Machine Learning · Computer Science 2022-03-24 Benedikt Boecking , Vincent Jeanselme , Artur Dubrawski

Convex clustering, a convex relaxation of k-means clustering and hierarchical clustering, has drawn recent attentions since it nicely addresses the instability issue of traditional nonconvex clustering methods. Although its computational…

Methodology · Statistics 2019-01-01 Binhuan Wang , Yilong Zhang , Will Wei Sun , Yixin Fang

Sum-of-norms clustering is a method for assigning $n$ points in $\mathbb{R}^d$ to $K$ clusters, $1\le K\le n$, using convex optimization. Recently, Panahi et al.\ proved that sum-of-norms clustering is guaranteed to recover a mixture of…

Machine Learning · Computer Science 2019-02-20 Tao Jiang , Stephen Vavasis , Chen Wen Zhai

We study the problem of clustering with relative constraints, where each constraint specifies relative similarities among instances. In particular, each constraint $(x_i, x_j, x_k)$ is acquired by posing a query: is instance $x_i$ more…

Machine Learning · Computer Science 2015-01-05 Yuanli Pei , Xiaoli Z. Fern , Rómer Rosales , Teresa Vania Tjahja

In this paper, we study a number of well-known combinatorial optimization problems that fit in the following paradigm: the input is a collection of (potentially inconsistent) local relationships between the elements of a ground set (e.g.,…

Data Structures and Algorithms · Computer Science 2021-02-24 Vaggos Chatziafratis , Mohammad Mahdian , Sara Ahmadian

Matrix rank minimization problem is in general NP-hard. The nuclear norm is used to substitute the rank function in many recent studies. Nevertheless, the nuclear norm approximation adds all singular values together and the approximation…

Computer Vision and Pattern Recognition · Computer Science 2015-11-02 Zhao Kang , Chong Peng , Qiang Cheng

We propose a convex optimization formulation with the nuclear norm and $\ell_1$-norm to find a large approximately rank-one submatrix of a given nonnegative matrix. We develop optimality conditions for the formulation and characterize the…

Optimization and Control · Mathematics 2010-11-09 Xuan Vinh Doan , Stephen A. Vavasis

We analyze the clustering problem through a flexible probabilistic model that aims to identify an optimal partition on the sample X 1 , ..., X n. We perform exact clustering with high probability using a convex semidefinite estimator that…

Statistics Theory · Mathematics 2017-05-19 Martin Royer

A data filtering method for cluster analysis is proposed, based on minimizing a least squares function with a weighted $\ell_0$-norm penalty. To overcome the discontinuity of the objective function, smooth non-convex functions are employed…

Optimization and Control · Mathematics 2017-05-23 Andrea Cristofari

Subspace clustering refers to the problem of segmenting a set of data points approximately drawn from a union of multiple linear subspaces. Aiming at the subspace clustering problem, various subspace clustering algorithms have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2016-10-17 Yu Song , Yiquan Wu

Semi-supervised clustering methods incorporate a limited amount of supervision into the clustering process. Typically, this supervision is provided by the user in the form of pairwise constraints. Existing methods use such constraints in…

Machine Learning · Statistics 2016-09-26 Toon Van Craenendonck , Hendrik Blockeel

This paper aims to investigate the effectiveness of the recently proposed Boosted Difference of Convex functions Algorithm (BDCA) when applied to clustering with constraints and set clustering with constraints problems. This is the first…

Optimization and Control · Mathematics 2023-10-24 Tuyen Tran , Kate Figenschou , Phan Tu Vuong

We use convex relaxation techniques to produce lower bounds on the optimal value of subset selection problems and generate good approximate solutions. We then explicitly bound the quality of these relaxations by studying the approximation…

Optimization and Control · Mathematics 2010-06-21 Francis Bach , Selin Damla Ahipasaoglu , Alexandre d'Aspremont

Convex clustering is a recent stable alternative to hierarchical clustering. It formulates the recovery of progressively coalescing clusters as a regularized convex problem. While convex clustering was originally designed for handling…

Applications · Statistics 2019-12-12 Claire Donnat , Susan Holmes

Convex clustering is a modern method with both hierarchical and $k$-means clustering characteristics. Although convex clustering can capture complex clustering structures hidden in data, the existing convex clustering algorithms are not…

Machine Learning · Statistics 2023-12-22 Daniel J. W. Touw , Patrick J. F. Groenen , Yoshikazu Terada

An important form of prior information in clustering comes in form of cannot-link and must-link constraints. We present a generalization of the popular spectral clustering technique which integrates such constraints. Motivated by the…

Machine Learning · Statistics 2015-05-26 Syama Sundar Rangapuram , Matthias Hein

We introduce a novel method for clustering using a semidefinite programming (SDP) relaxation of the Max k-Cut problem. The approach is based on a new methodology for rounding the solution of an SDP relaxation using iterated linear…

Optimization and Control · Mathematics 2022-07-07 Pedro Felzenszwalb , Caroline Klivans , Alice Paul

The most important ingredient for solving mixed-integer nonlinear programs (MINLPs) to global epsilon-optimality with spatial branch and bound is a tight, computationally tractable relaxation. Due to both theoretical and practical…

Optimization and Control · Mathematics 2019-12-03 Benjamin Müller , Gonzalo Muñoz , Maxime Gasse , Ambros Gleixner , Andrea Lodi , Felipe Serrano

Rank minimization is of interest in machine learning applications such as recommender systems and robust principal component analysis. Minimizing the convex relaxation to the rank minimization problem, the nuclear norm, is an effective…

Optimization and Control · Mathematics 2021-03-30 April Sagan , John E. Mitchell

Convex clustering is a convex relaxation of the $k$-means and hierarchical clustering. It involves solving a convex optimization problem with the objective function being a squared error loss plus a fusion penalty that encourages the…

Methodology · Statistics 2024-10-10 Qiang Sun , Archer Gong Zhang , Chenyu Liu , Kean Ming Tan