English
Related papers

Related papers: Kernel Cuts: MRF meets Kernel & Spectral Clusterin…

200 papers

Several clustering methods (e.g., Normalized Cut and Ratio Cut) divide the Min Cut cost function by a cluster dependent factor (e.g., the size or the degree of the clusters), in order to yield a more balanced partitioning. We, instead,…

Machine Learning · Computer Science 2025-02-06 Morteza Haghir Chehreghani

Spectral clustering, as a popular tool for data clustering, requires an eigen-decomposition step on a given affinity to obtain the spectral embedding. Nevertheless, such a step suffers from the lack of generalizability and scalability.…

Machine Learning · Computer Science 2025-03-13 Wei He , Shangzhi Zhang , Chun-Guang Li , Xianbiao Qi , Rong Xiao , Jun Guo

In this paper, we propose a special fusion method for combining ensembles of base classifiers utilizing new neural networks in order to improve overall efficiency of classification. While ensembles are designed such that each classifier is…

Machine Learning · Computer Science 2009-12-08 Mehdi Salkhordeh Haghighi , Hadi Sadoghi Yazdi , Abedin Vahedian , Hamed Modaghegh

Spectral clustering methods which are frequently used in clustering and community detection applications are sensitive to the specific graph constructions particularly when imbalanced clusters are present. We show that ratio cut (RCut) or…

Machine Learning · Statistics 2016-11-18 Cem Aksoylar , Jing Qian , Venkatesh Saligrama

In this work, we investigate the generalization properties of random feature methods. Our analysis extends prior results for Tikhonov regularization to a broad class of spectral regularization techniques and further generalizes the setting…

Machine Learning · Statistics 2026-03-03 Mike Nguyen , Nicole Mücke

The performance of spectral clustering can be considerably improved via regularization, as demonstrated empirically in Amini et. al (2012). Here, we provide an attempt at quantifying this improvement through theoretical analysis. Under the…

Machine Learning · Statistics 2014-07-22 Antony Joseph , Bin Yu

Spectral graph theory is well known and widely used in computer vision. In this paper, we analyze image segmentation algorithms that are based on spectral graph theory, e.g., normalized cut, and show that there is a natural connection…

Computer Vision and Pattern Recognition · Computer Science 2016-11-09 Chengxi Ye , Yuxu Lin , Mingli Song , Chun Chen , David W. Jacobs

Kernel-based classification methods, particularly the support vector machine (SVM), are among the most common algorithms for hyperspectral data classification. The Radial Basis function (RBF) kernel has earned great popularity in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Saeid Niazmardi

Normalized-cut graph partitioning aims to divide the set of nodes in a graph into $k$ disjoint clusters to minimize the fraction of the total edges between any cluster and all other clusters. In this paper, we consider a fair variant of the…

Machine Learning · Computer Science 2023-10-10 Jia Li , Yanhao Wang , Arpit Merchant

Clustering techniques are consolidated as a powerful strategy for analyzing the extensive data generated from molecular modeling. In particular, some tools have been developed to cluster configurations from classical simulations with a…

Computational Physics · Physics 2025-07-08 Rafael Bicudo Ribeiro , Henrique Musseli Cezar

Spectral clustering is sensitive to how graphs are constructed from data particularly when proximal and imbalanced clusters are present. We show that Ratio-Cut (RCut) or normalized cut (NCut) objectives are not tailored to imbalanced data…

Machine Learning · Statistics 2013-09-11 Jing Qian , Venkatesh Saligrama

Probabilistic relaxations of graph cuts offer a differentiable alternative to spectral clustering, enabling end-to-end and online learning without eigendecompositions, yet prior work centered on RatioCut and lacked general guarantees and…

Machine Learning · Computer Science 2026-04-02 Ayoub Ghriss

Kernel fusion is a popular and effective approach for combining multiple features that characterize different aspects of data. Traditional approaches for Multiple Kernel Learning (MKL) attempt to learn the parameters for combining the…

Spectral clustering (SC) and graph-based semi-supervised learning (SSL) algorithms are sensitive to how graphs are constructed from data. In particular if the data has proximal and unbalanced clusters these algorithms can lead to poor…

Machine Learning · Statistics 2013-02-22 Jing Qian , Venkatesh Saligrama

Metric clustering is fundamental in areas ranging from Combinatorial Optimization and Data Mining, to Machine Learning and Operations Research. However, in a variety of situations we may have additional requirements or knowledge, distinct…

Machine Learning · Computer Science 2021-03-04 Brian Brubach , Darshan Chakrabarti , John P. Dickerson , Aravind Srinivasan , Leonidas Tsepenekas

We introduce a novel end-to-end approach for learning to cluster in the absence of labeled examples. Our clustering objective is based on optimizing normalized cuts, a criterion which measures both intra-cluster similarity as well as…

Machine Learning · Computer Science 2019-10-18 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

This paper describes a graph clustering algorithm that aims to minimize the normalized cut criterion and has a model order selection procedure. The performance of the proposed algorithm is comparable to spectral approaches in terms of…

Artificial Intelligence · Computer Science 2011-05-06 Seyed Salim Tabatabaei , Mark Coates , Michael Rabbat

Spectral clustering is one of the most effective clustering approaches that capture hidden cluster structures in the data. However, it does not scale well to large-scale problems due to its quadratic complexity in constructing similarity…

Machine Learning · Computer Science 2019-11-26 Lingfei Wu , Pin-Yu Chen , Ian En-Hsu Yen , Fangli Xu , Yinglong Xia , Charu Aggarwal

Random features (RFs) are a popular technique to scale up kernel methods in machine learning, replacing exact kernel evaluations with stochastic Monte Carlo estimates. They underpin models as diverse as efficient transformers (by…

Machine Learning · Statistics 2024-10-04 Isaac Reid , Stratis Markou , Krzysztof Choromanski , Richard E. Turner , Adrian Weller

In the era of pre-trained models, image clustering task is usually addressed by two relevant stages: a) to produce features from pre-trained vision models; and b) to find clusters from the pre-trained features. However, these two stages are…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 W. He , Z. Huang , X. Meng , X. Qi , R. Xiao , C. -G. Li