English
Related papers

Related papers: A Performance Guarantee for Spectral Clustering

200 papers

Clustering is one of the most fundamental tools in data science and machine learning, and k-means clustering is one of the most common such methods. There is a variety of approximate algorithms for the k-means problem, but computing the…

Optimization and Control · Mathematics 2024-02-22 Martin Ryner , Jan Kronqvist , Johan Karlsson

For random graphs distributed according to a stochastic block model, we consider the inferential task of partioning vertices into blocks using spectral techniques. Spectral partioning using the normalized Laplacian and the adjacency matrix…

Given the widespread popularity of spectral clustering (SC) for partitioning graph data, we study a version of constrained SC in which we try to incorporate the fairness notion proposed by Chierichetti et al. (2017). According to this…

Machine Learning · Statistics 2019-05-14 Matthäus Kleindessner , Samira Samadi , Pranjal Awasthi , Jamie Morgenstern

Probabilistic relaxations of graph cuts offer a differentiable alternative to spectral clustering, enabling end-to-end and online learning without eigendecompositions, yet prior work centered on RatioCut and lacked general guarantees and…

Machine Learning · Computer Science 2026-04-02 Ayoub Ghriss

Clustering the nodes of a graph is a cornerstone of graph analysis and has been extensively studied. However, some popular methods are not suitable for very large graphs: e.g., spectral clustering requires the computation of the spectral…

Machine Learning · Computer Science 2025-06-13 Etienne Lasalle , Rémi Vaudaine , Titouan Vayer , Pierre Borgnat , Rémi Gribonval , Paulo Gonçalves , Màrton Karsai

Semi-supervised learning is highly useful in common scenarios where labeled data is scarce but unlabeled data is abundant. The graph (or nonlocal) Laplacian is a fundamental smoothing operator for solving various learning tasks. For…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Or Streicher , Guy Gilboa

Cluster deletion is an NP-hard graph clustering objective with applications in computational biology and social network analysis, where the goal is to delete a minimum number of edges to partition a graph into cliques. We first provide a…

Data Structures and Algorithms · Computer Science 2024-04-26 Vicente Balmaseda , Ying Xu , Yixin Cao , Nate Veldt

Regularization of the classical Laplacian matrices was empirically shown to improve spectral clustering in sparse networks. It was observed that small regularizations are preferable, but this point was left as a heuristic argument. In this…

Machine Learning · Computer Science 2020-05-18 Lorenzo Dall'Amico , Romain Couillet , Nicolas Tremblay

We study the problem of $k$-way clustering in signed graphs. Considerable attention in recent years has been devoted to analyzing and modeling signed graphs, where the affinity measure between nodes takes either positive or negative values.…

Machine Learning · Statistics 2020-11-04 Mihai Cucuringu , Apoorv Vikram Singh , Déborah Sulem , Hemant Tyagi

In recent years, spectral clustering has become a standard method for data analysis used in a broad range of applications. In this paper we propose a new class of algorithms for multiway spectral clustering based on optimization of a…

Machine Learning · Computer Science 2016-05-05 James Voss , Mikhail Belkin , Luis Rademacher

Combinatorial optimization problems for clustering are known to be NP-hard. Most optimization methods are not able to find the global optimum solution for all datasets. To solve this problem, we propose a global optimal path-based…

Machine Learning · Computer Science 2019-09-18 Qidong Liu , Ruisheng Zhang

Normalized-Cut (N-Cut) is a famous model of spectral clustering. The traditional N-Cut solvers are two-stage: 1) calculating the continuous spectral embedding of normalized Laplacian matrix; 2) discretization via $K$-means or spectral…

Machine Learning · Computer Science 2023-11-28 Feiping Nie , Jitao Lu , Danyang Wu , Rong Wang , Xuelong Li

Spectral clustering is popular among practitioners and theoreticians alike. While performance guarantees for spectral clustering are well understood, recent studies have focused on enforcing ``fairness'' in clusters, requiring them to be…

Machine Learning · Computer Science 2022-09-27 Shubham Gupta , Ambedkar Dukkipati

Subspace clustering aims to group data points into multiple clusters of which each corresponds to one subspace. Most existing subspace clustering approaches assume that input data lie on linear subspaces. In practice, however, this…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Liangli Zhen , Dezhong Peng , Wei Wang , Xin Yao

Spectral clustering and diffusion maps are celebrated dimensionality reduction algorithms built on eigen-elements related to the diffusive structure of the data. The core of these procedures is the approximation of a Laplacian through a…

Machine Learning · Statistics 2023-02-15 Loucas Pillaud-Vivien , Francis Bach

Correlation clustering is a central topic in unsupervised learning, with many applications in ML and data mining. In correlation clustering, one receives as input a signed graph and the goal is to partition it to minimize the number of…

Data Structures and Algorithms · Computer Science 2021-06-17 Vincent Cohen-Addad , Silvio Lattanzi , Slobodan Mitrović , Ashkan Norouzi-Fard , Nikos Parotsidis , Jakub Tarnawski

We present a new clustering algorithm that is based on searching for natural gaps in the components of the lowest energy eigenvectors of the Laplacian of a graph. In comparing the performance of the proposed method with a set of other…

Machine Learning · Computer Science 2017-10-10 W. R. Casper , Balu Nadiga

This paper establishes the consistency of spectral approaches to data clustering. We consider clustering of point clouds obtained as samples of a ground-truth measure. A graph representing the point cloud is obtained by assigning weights to…

Statistics Theory · Mathematics 2015-08-11 Nicolás García Trillos , Dejan Slepčev

We study the hierarchy of communities in real-world networks under a generic stochastic block model, in which the connection probabilities are structured in a binary tree. Under such model, a standard recursive bi-partitioning algorithm is…

Statistics Theory · Mathematics 2021-11-19 Lihua Lei , Xiaodong Li , Xingmei Lou

This article proposes a first analysis of kernel spectral clustering methods in the regime where the dimension $p$ of the data vectors to be clustered and their number $n$ grow large at the same rate. We demonstrate, under a $k$-class…

Statistics Theory · Mathematics 2016-04-22 Romain Couillet , Florent Benaych-Georges