English
Related papers

Related papers: Towards Robust Nonlinear Subspace Clustering: A Ke…

200 papers

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Clustering high-dimensional datasets is hard because interpoint distances become less informative in high-dimensional spaces. We present a clustering algorithm that performs nonlinear dimensionality reduction and clustering jointly. The…

Machine Learning · Computer Science 2018-03-06 Sohil Atul Shah , Vladlen Koltun

Kernel fusion is a popular and effective approach for combining multiple features that characterize different aspects of data. Traditional approaches for Multiple Kernel Learning (MKL) attempt to learn the parameters for combining the…

Kernel $k$-means clustering is a powerful tool for unsupervised learning of non-linearly separable data. Since the earliest attempts, researchers have noted that such algorithms often become trapped by local minima arising from…

Machine Learning · Statistics 2020-11-13 Debolina Paul , Saptarshi Chakraborty , Swagatam Das , Jason Xu

We propose a novel method of introducing structure into existing machine learning techniques by developing structure-based similarity and distance measures. To learn structural information, low-dimensional structure of the data is captured…

Machine Learning · Statistics 2011-10-27 Joseph Wang , Venkatesh Saligrama , David A. Castañón

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

Empirical data can often be considered as samples from a set of probability distributions. Kernel methods have emerged as a natural approach for learning to classify these distributions. Although numerous kernels between distributions have…

Machine Learning · Computer Science 2024-12-02 Oleksii Kachaiev , Stefano Recanatesi

This work introduces a new unsupervised representation learning technique called Deep Convolutional Transform Learning (DCTL). By stacking convolutional transforms, our approach is able to learn a set of independent kernels at different…

Machine Learning · Computer Science 2020-10-05 Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

Multiple kernel methods based on k-means aims to integrate a group of kernels to improve the performance of kernel k-means clustering. However, we observe that most existing multiple kernel k-means methods exploit the nonlinear relationship…

Machine Learning · Computer Science 2020-10-01 Liang Du , Haiying Zhang , Xin Ren , Xiaolin Lv

We propose a low-rank transformation-learning framework to robustify subspace clustering. Many high-dimensional data, such as face images and motion sequences, lie in a union of low-dimensional subspaces. The subspace clustering problem has…

Computer Vision and Pattern Recognition · Computer Science 2013-08-02 Qiang Qiu , Guillermo Sapiro

Manifold learning (ML) aims to seek low-dimensional embedding from high-dimensional data. The problem is challenging on real-world datasets, especially with under-sampling data, and we find that previous methods perform poorly in this case.…

Machine Learning · Computer Science 2022-07-27 Zelin Zang , Siyuan Li , Di Wu , Ge Wang , Lei Shang , Baigui Sun , Hao Li , Stan Z. Li

Clustering is an essential problem in machine learning and data mining. One vital factor that impacts clustering performance is how to learn or design the data representation (or features). Fortunately, recent advances in deep learning can…

Machine Learning · Computer Science 2015-01-14 Gang Chen

The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current methods enhance information diversity and reduce redundancy…

Machine Learning · Computer Science 2024-03-07 Rina Su , Yu Guo , Caiying Wu , Qiyu Jin , Tieyong Zeng

Deep kernel learning provides an elegant and principled framework for combining the structural properties of deep learning algorithms with the flexibility of kernel methods. By means of a deep neural network, we learn a parametrized kernel…

Machine Learning · Computer Science 2020-12-14 Prudencio Tossou , Basile Dura , Francois Laviolette , Mario Marchand , Alexandre Lacoste

A persistent structural weakness in deep clustering is the disconnect between feature learning and cluster assignment. Most architectures invoke an external clustering step, typically k-means, to produce pseudo-labels that guide training,…

Machine Learning · Computer Science 2026-04-03 Giansalvo Cirrincione

Asymmetric data naturally exist in real life, such as directed graphs. Different from the common kernel methods requiring Mercer kernels, this paper tackles the asymmetric kernel-based learning problem. We describe a nonlinear extension of…

Machine Learning · Computer Science 2023-06-13 Qinghua Tao , Francesco Tonin , Panagiotis Patrinos , Johan A. K. Suykens

Spectral Embedding (SE) has often been used to map data points from non-linear manifolds to linear subspaces for the purpose of classification and clustering. Despite significant advantages, the subspace structure of data in the original…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Hira Yaseen , Arif Mahmood

Most learning approaches treat dimensionality reduction (DR) and clustering separately (i.e., sequentially), but recent research has shown that optimizing the two tasks jointly can substantially improve the performance of both. The premise…

Machine Learning · Computer Science 2017-06-15 Bo Yang , Xiao Fu , Nicholas D. Sidiropoulos , Mingyi Hong

Subspace clustering is an unsupervised clustering technique designed to cluster data that is supported on a union of linear subspaces, with each subspace defining a cluster with dimension lower than the ambient space. Many existing…

Machine Learning · Computer Science 2021-03-23 Benjamin D. Haeffele , Chong You , René Vidal

Kernel methods have been successfully applied to the areas of pattern recognition and data mining. In this paper, we mainly discuss the issue of propagating labels in kernel space. A Kernel-Induced Label Propagation (Kernel-LP) framework by…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Zhao Zhang , Lei Jia , Mingbo Zhao , Guangcan Liu , Meng Wang , Shuicheng Yan