English
Related papers

Related papers: Fast Spectral Clustering Using Autoencoders and La…

200 papers

Given a point set S and an unknown metric d on S, we study the problem of efficiently partitioning S into k clusters while querying few distances between the points. In our model we assume that we have access to one versus all queries that…

Data Structures and Algorithms · Computer Science 2011-05-10 Konstantin Voevodski , Maria-Florina Balcan , Heiko Roglin , Shang-Hua Teng , Yu Xia

Spectral clustering is a powerful method for finding structure in a dataset through the eigenvectors of a similarity matrix. It often outperforms traditional clustering algorithms such as $k$-means when the structure of the individual…

Numerical Analysis · Mathematics 2019-04-26 Paola Favati , Grazia Lotti , Ornella Menchi , Francesco Romani

Cluster structure detection is a fundamental task for the analysis of graphs, in order to understand and to visualize their functional characteristics. Among the different cluster structure detection methods, spectral clustering is…

Machine Learning · Statistics 2020-04-09 Camille Champion , Blazère Mélanie , Burcelin Rémy , Loubes Jean-Michel , Risser Laurent

In recent years, spectral clustering has become one of the most popular clustering algorithms for image segmentation. However, it has restricted applicability to large-scale images due to its high computational complexity. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2018-12-13 Chongyang Zhang , Guofeng Zhu , Minxin Chen , Hong Chen , Chenjian Wu

Spectral clustering is a standard approach to label nodes on a graph by studying the (largest or lowest) eigenvalues of a symmetric real matrix such as e.g. the adjacency or the Laplacian. Recently, it has been argued that using instead a…

Disordered Systems and Neural Networks · Physics 2015-04-30 Alaa Saade , Florent Krzakala , Lenka Zdeborová

Our previous experiments demonstrated that subsets collections of (short) documents (with several hundred entries) share a common normalized in some way eigenvalue spectrum of combinatorial Laplacian. Based on this insight, we propose a…

Machine Learning · Computer Science 2023-08-23 Mieczysław A. Kłopotek , Bartłmiej Starosta , Sławomir T. Wierzchoń

Clustering of data sets is a standard problem in many areas of science and engineering. The method of spectral clustering is based on embedding the data set using a kernel function, and using the top eigenvectors of the normalized Laplacian…

Statistics Theory · Mathematics 2015-04-08 Geoffrey Schiebinger , Martin J. Wainwright , Bin Yu

Spectral clustering has become one of the most popular algorithms in data clustering and community detection. We study the performance of classical two-step spectral clustering via the graph Laplacian to learn the stochastic block model.…

Machine Learning · Statistics 2020-04-22 Shaofeng Deng , Shuyang Ling , Thomas Strohmer

Spectral clustering uses a graph Laplacian spectral embedding to enhance the cluster structure of some data sets. When the embedding is one dimensional, it can be used to sort the items (spectral ordering). A number of empirical results…

Data Structures and Algorithms · Computer Science 2018-07-20 Antoine Recanati , Thomas Kerdreux , Alexandre d'Aspremont

The eigendeomposition of nearest-neighbor (NN) graph Laplacian matrices is the main computational bottleneck in spectral clustering. In this work, we introduce a highly-scalable, spectrum-preserving graph sparsification algorithm that…

Machine Learning · Computer Science 2018-10-12 Yongyu Wang , Zhuo Feng

Spectral clustering is a fast and popular algorithm for finding clusters in networks. Recently, Chaudhuri et al. (2012) and Amini et al.(2012) proposed inspired variations on the algorithm that artificially inflate the node degrees for…

Machine Learning · Statistics 2013-09-18 Tai Qin , Karl Rohe

Spectral clustering has found extensive use in many areas. Most traditional spectral clustering algorithms work in three separate steps: similarity graph construction; continuous labels learning; discretizing the learned labels by k-means…

Machine Learning · Computer Science 2017-11-15 Zhao Kang , Chong Peng , Qiang Cheng , Zenglin Xu

Graph clustering or community detection constitutes an important task for investigating the internal structure of graphs, with a plethora of applications in several domains. Traditional techniques for graph clustering, such as spectral…

Consistency is a key property of all statistical procedures analyzing randomly sampled data. Surprisingly, despite decades of work, little is known about consistency of most clustering algorithms. In this paper we investigate consistency of…

Statistics Theory · Mathematics 2008-12-18 Ulrike von Luxburg , Mikhail Belkin , Olivier Bousquet

Recently, a number of works have studied clustering strategies that combine classical clustering algorithms and deep learning methods. These approaches follow either a sequential way, where a deep representation is learned using a deep…

Machine Learning · Computer Science 2019-06-13 Severine Affeldt , Lazhar Labiod , Mohamed Nadif

We present a principled spectral approach to the well-studied constrained clustering problem. It reduces clustering to a generalized eigenvalue problem on Laplacians. The method works in nearly-linear time and provides concrete guarantees…

Social and Information Networks · Computer Science 2016-01-20 Mihai Cucuringu , Ioannis Koutis , Sanjay Chawla

In this paper we propose a Deep Autoencoder MIxture Clustering (DAMIC) algorithm based on a mixture of deep autoencoders where each cluster is represented by an autoencoder. A clustering network transforms the data into another space and…

Machine Learning · Computer Science 2019-03-28 Shlomo E. Chazan , Sharon Gannot , Jacob Goldberger

This work studies the classical spectral clustering algorithm which embeds the vertices of some graph $G=(V_G, E_G)$ into $\mathbb{R}^k$ using $k$ eigenvectors of some matrix of $G$, and applies $k$-means to partition $V_G$ into $k$…

Data Structures and Algorithms · Computer Science 2022-08-04 Peter Macgregor , He Sun

Spectral clustering is a popular method for effectively clustering nonlinearly separable data. However, computational limitations, memory requirements, and the inability to perform incremental learning challenge its widespread application.…

Machine Learning · Computer Science 2023-11-15 Jo-Chun Chen , Hung-Hsuan Chen

Unsupervised localization and segmentation are long-standing computer vision challenges that involve decomposing an image into semantically-meaningful segments without any labeled data. These tasks are particularly interesting in an…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina , Andrea Vedaldi