English
Related papers

Related papers: Multiclass spectral feature scaling method for dim…

200 papers

Choosing a meaningful subset of features from high-dimensional observations in unsupervised settings can greatly enhance the accuracy of downstream analysis, such as clustering or dimensionality reduction, and provide valuable insights into…

Machine Learning · Computer Science 2024-12-23 Daniel Segal , Ofir Lindenbaum , Ariel Jaffe

Spectral clustering and diffusion maps are celebrated dimensionality reduction algorithms built on eigen-elements related to the diffusive structure of the data. The core of these procedures is the approximation of a Laplacian through a…

Machine Learning · Statistics 2023-02-15 Loucas Pillaud-Vivien , Francis Bach

Observational data usually comes with a multimodal nature, which means that it can be naturally represented by a multi-layer graph whose layers share the same set of vertices (users) with different edges (pairwise relationships). In this…

Machine Learning · Computer Science 2015-08-31 Xiaowen Dong , Pascal Frossard , Pierre Vandergheynst , Nikolai Nefedov

Unsupervised localization and segmentation are long-standing computer vision challenges that involve decomposing an image into semantically-meaningful segments without any labeled data. These tasks are particularly interesting in an…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina , Andrea Vedaldi

The cost of computing the spectrum of Laplacian matrices hinders the application of spectral clustering to large data sets. While approximations recover computational tractability, they can potentially affect clustering performance. This…

Machine Learning · Statistics 2016-08-15 Yufei Han , Maurizio Filippone

Spectral clustering has become a popular technique due to its high performance in many contexts. It comprises three main steps: create a similarity graph between N objects to cluster, compute the first k eigenvectors of its Laplacian matrix…

Data Structures and Algorithms · Computer Science 2016-05-24 Nicolas Tremblay , Gilles Puy , Remi Gribonval , Pierre Vandergheynst

In this paper, we propose a scalable algorithm for spectral embedding. The latter is a standard tool for graph clustering. However, its computational bottleneck is the eigendecomposition of the graph Laplacian matrix, which prevents its…

Machine Learning · Computer Science 2019-04-12 Mireille El Gheche , Giovanni Chierchia , Pascal Frossard

Subspace clustering algorithms are notorious for their scalability issues because building and processing large affinity matrices are demanding. In this paper, we introduce a method that simultaneously learns an embedding space along…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Tong Zhang , Pan Ji , Mehrtash Harandi , Richard Hartley , Ian Reid

The problem of dimension reduction is of increasing importance in modern data analysis. In this paper, we consider modeling the collection of points in a high dimensional space as a union of low dimensional subspaces. In particular we…

Machine Learning · Statistics 2020-06-12 Weiwei Li , Jan Hannig , Sayan Mukherjee

Spectral clustering is discussed from many perspectives, by extending it to rectangular arrays and discrepancy minimization too. Near optimal clusters are obtained with singular value decomposition and with the weighted $k$-means algorithm.…

Combinatorics · Mathematics 2022-01-06 Marianna Bolla , Vilas Winstein , Tao You , Frank Seidl , Fatma Abdelkhalek

Consistency is a key property of all statistical procedures analyzing randomly sampled data. Surprisingly, despite decades of work, little is known about consistency of most clustering algorithms. In this paper we investigate consistency of…

Statistics Theory · Mathematics 2008-12-18 Ulrike von Luxburg , Mikhail Belkin , Olivier Bousquet

While orthogonalization exists in current dimensionality reduction methods in spectral clustering on undirected graphs, it does not scale in parallel computing environments. We propose four orthogonalization-free methods for spectral…

Signal Processing · Electrical Eng. & Systems 2024-11-05 Qiyuan Pang , Haizhao Yang

High-dimensional clustering analysis is a challenging problem in statistics and machine learning, with broad applications such as the analysis of microarray data and RNA-seq data. In this paper, we propose a new clustering procedure called…

Methodology · Statistics 2022-10-31 Tianqi Liu , Yu Lu , Biqing Zhu , Hongyu Zhao

Multidimensional scaling visualizes dissimilarities among objects and reduces data dimensionality. While many methods address symmetric proximity data, asymmetric and especially three-way proximity data (capturing relationships across…

Methodology · Statistics 2025-11-21 Aleix Alcacer , Rafael Benitez , Vicente J. Bolos , Irene Epifanio

Graph-Laplacians and their spectral embeddings play an important role in multiple areas of machine learning. This paper is focused on graph-Laplacian dimension reduction for the spectral clustering of data as a primary application. Spectral…

Machine Learning · Computer Science 2021-09-08 Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

Spectral clustering is one of the most popular clustering methods. However, the high computational cost due to the involved eigen-decomposition procedure can immediately hinder its applications in large-scale tasks. In this paper we use…

Machine Learning · Computer Science 2023-01-24 Yongyu Wang

As annotations of data can be scarce in large-scale practical problems, leveraging unlabelled examples is one of the most important aspects of machine learning. This is the aim of semi-supervised learning. To benefit from the access to…

Machine Learning · Statistics 2021-11-30 Vivien Cabannes , Loucas Pillaud-Vivien , Francis Bach , Alessandro Rudi

Spectral clustering uses a graph Laplacian spectral embedding to enhance the cluster structure of some data sets. When the embedding is one dimensional, it can be used to sort the items (spectral ordering). A number of empirical results…

Data Structures and Algorithms · Computer Science 2018-07-20 Antoine Recanati , Thomas Kerdreux , Alexandre d'Aspremont

Spectral clustering is one of the most important algorithms in data mining and machine intelligence; however, its computational complexity limits its application to truly large scale data analysis. The computational bottleneck in spectral…

Machine Learning · Computer Science 2015-05-13 Christos Boutsidis , Alex Gittens , Prabhanjan Kambadur

Weakly supervised person search aims to jointly detect and match persons with only bounding box annotations. Existing approaches typically focus on improving the features by exploring relations of persons. However, scale variation problem…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Benzhi Wang , Yang Yang , Jinlin Wu , Guo-jun Qi , Zhen Lei