English
Related papers

Related papers: Divide-and-conquer based Large-Scale Spectral Clus…

200 papers

In recent years, spectral clustering has become one of the most popular clustering algorithms for image segmentation. However, it has restricted applicability to large-scale images due to its high computational complexity. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2018-12-13 Chongyang Zhang , Guofeng Zhu , Minxin Chen , Hong Chen , Chenjian Wu

Semi-supervised clustering is a basic problem in various applications. Most existing methods require knowledge of the ideal cluster number, which is often difficult to obtain in practice. Besides, satisfying the must-link constraints is…

Optimization and Control · Mathematics 2025-03-07 Wei Liu , Xin Liu , Michael K. Ng , Zaikun Zhang

We consider the problem of clustering a set of high-dimensional data points into sets of low-dimensional linear subspaces. The number of subspaces, their dimensions, and their orientations are unknown. We propose a simple and low-complexity…

Information Theory · Computer Science 2013-03-18 Reinhard Heckel , Helmut Bölcskei

Spectral clustering has been one of the widely used methods for community detection in networks. However, large-scale networks bring computational challenges to the eigenvalue decomposition therein. In this paper, we study the spectral…

Social and Information Networks · Computer Science 2022-01-07 Hai Zhang , Xiao Guo , Xiangyu Chang

Clustering is an effective tool for astronomical spectral analysis, to mine clustering patterns among data. With the implementation of large sky surveys, many clustering methods have been applied to tackle spectroscopic and photometric data…

Instrumentation and Methods for Astrophysics · Physics 2022-12-19 Haifeng Yang , Chenhui Shi , Jianghui Cai , Lichan Zhou , Yuqing Yang , Xujun Zhao , Yanting He , Jing Hao

The discrete distribution is often used to describe complex instances in machine learning, such as images, sequences, and documents. Traditionally, clustering of discrete distributions (D2C) has been approached using Wasserstein barycenter…

Machine Learning · Computer Science 2024-08-19 Zixiao Wang , Dong Qiao , Jicong Fan

We develop a distributed Block Chebyshev-Davidson algorithm to solve large-scale leading eigenvalue problems for spectral analysis in spectral clustering. First, the efficiency of the Chebyshev-Davidson algorithm relies on the prior…

Machine Learning · Computer Science 2024-01-08 Qiyuan Pang , Haizhao Yang

If learning methods are to scale to the massive sizes of modern datasets, it is essential for the field of machine learning to embrace parallel and distributed computing. Inspired by the recent development of matrix factorization methods…

Machine Learning · Computer Science 2013-10-29 Lester Mackey , Ameet Talwalkar , Michael I. Jordan

Hypergraph spectral analysis has emerged as an effective tool processing complex data structures in data analysis. The surface of a three-dimensional (3D) point cloud and the multilateral relationship among their points can be naturally…

Signal Processing · Electrical Eng. & Systems 2021-01-01 Songyang Zhang , Shuguang Cui , Zhi Ding

Spectral clustering is a widely studied problem, yet its complexity is prohibitive for dynamic graphs of even modest size. We claim that it is possible to reuse information of past cluster assignments to expedite computation. Our approach…

Machine Learning · Statistics 2017-06-13 Lionel Martin , Andreas Loukas , Pierre Vandergheynst

The divide and conquer strategy, which breaks a massive data set into a se- ries of manageable data blocks, and then combines the independent results of data blocks to obtain a final decision, has been recognized as a state-of-the-art…

Machine Learning · Computer Science 2016-03-15 Xiangyu Chang , Shaobo Lin , Yao Wang

This paper presents a class of new algorithms for distributed statistical estimation that exploit divide-and-conquer approach. We show that one of the key benefits of the divide-and-conquer strategy is robustness, an important…

Statistics Theory · Mathematics 2018-08-29 Stanislav Minsker , Nate Strawn

Spectral clustering is a leading and popular technique in unsupervised data analysis. Two of its major limitations are scalability and generalization of the spectral embedding (i.e., out-of-sample-extension). In this paper we introduce a…

Machine Learning · Statistics 2024-11-06 Uri Shaham , Kelly Stanton , Henry Li , Boaz Nadler , Ronen Basri , Yuval Kluger

Based on the spectral divide-and-conquer algorithm by Nakatsukasa and Higham [SIAM J. Sci. Comput., 35(3): A1325-A1349, 2013], we propose a new algorithm for computing all the eigenvalues and eigenvectors of a symmetric banded matrix. For…

Numerical Analysis · Mathematics 2018-01-22 Ana Šušnjara , Daniel Kressner

Spectral clustering is a fundamental technique in the field of data mining and information processing. Most existing spectral clustering algorithms integrate dimensionality reduction into the clustering process assisted by manifold learning…

Machine Learning · Computer Science 2014-11-25 Xiaojun Chang , Feiping Nie , Zhigang Ma , Yi Yang , Xiaofang Zhou

In this work, we introduce a novel methodology for divisive hierarchical clustering. Our divisive (``top-down'') approach is motivated by the fact that agglomerative hierarchical clustering (``bottom-up''), which is commonly used for…

Methodology · Statistics 2025-10-07 Jan O. Bauer

Algorithms for community detection are usually stochastic, leading to different partitions for different choices of random seeds. Consensus clustering has proven to be an effective technique to derive more stable and accurate partitions…

Physics and Society · Physics 2019-04-23 Aditya Tandon , Aiiad Albeshri , Vijey Thayananthan , Wadee Alhalabi , Santo Fortunato

Recently, graph mining approaches have become very popular, especially in domains such as bioinformatics, chemoinformatics and social networks. In this scope, one of the most challenging tasks is frequent subgraph discovery. This task has…

Databases · Computer Science 2016-08-24 Sabeur Aridhi , Laurent d'Orazio , Mondher Maddouri , Engelbert Mephu Nguifo

We extensively describe our recently established "divide-and-conquer" semiclassical method [M. Ceotto, G. Di Liberto and R. Conte, Phys. Rev. Lett. 119, 010401 (2017)] and propose a new implementation of it to increase the accuracy of…

Chemical Physics · Physics 2018-01-15 Giovanni Di Liberto , Riccardo Conte , Michele Ceotto

Directed networks are broadly used to represent asymmetric relationships among units. Co-clustering aims to cluster the senders and receivers of directed networks simultaneously. In particular, the well-known spectral clustering algorithm…

Machine Learning · Statistics 2022-04-12 Xiao Guo , Yixuan Qiu , Hai Zhang , Xiangyu Chang