English
Related papers

Related papers: Deep Clustering with Associative Memories

200 papers

For better clustering performance, appropriate representations are critical. Although many neural network-based metric learning methods have been proposed, they do not directly train neural networks to improve clustering performance. We…

Machine Learning · Statistics 2021-03-02 Tomoharu Iwata

In data containing heterogeneous subpopulations, classification performance benefits from incorporating the knowledge of cluster structure in the classifier. Previous methods for such combined clustering and classification either 1) are…

Machine Learning · Computer Science 2023-01-04 Shivin Srivastava , Siddharth Bhatia , Lingxiao Huang , Lim Jun Heng , Kenji Kawaguchi , Vaibhav Rajan

Deep learning and especially the use of Deep Neural Networks (DNNs) provides impressive results in various regression and classification tasks. However, to achieve these results, there is a high demand for computing and storing resources.…

Machine Learning · Computer Science 2021-07-21 Erion-Vasilis Pikoulis , Christos Mavrokefalidis , Aris S. Lalos

Clustering is a fundamental learning task widely used as a first step in data analysis. For example, biologists use cluster assignments to analyze genome sequences, medical records, or images. Since downstream analysis is typically…

Machine Learning · Computer Science 2024-06-11 Jonathan Svirsky , Ofir Lindenbaum

Data clustering is an instrumental tool in the area of energy resource management. One problem with conventional clustering is that it does not take the final use of the clustered data into account, which may lead to a very suboptimal use…

Machine Learning · Computer Science 2021-06-03 Chao Zhang , Samson Lasaulce , Martin Hennebel , Lucas Saludjian , Patrick Panciatici , H. Vincent Poor

Image clustering has recently attracted significant attention due to the increased availability of unlabelled datasets. The efficiency of traditional clustering algorithms heavily depends on the distance functions used and the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

The discrete distribution clustering algorithm, namely D2-clustering, has demonstrated its usefulness in image classification and annotation where each object is represented by a bag of weighed vectors. The high computational complexity of…

Machine Learning · Computer Science 2013-02-07 Yu Zhang , James Z. Wang , Jia Li

Distribution learning finds probability density functions from a set of data samples, whereas clustering aims to group similar data points to form clusters. Although there are deep clustering methods that employ distribution learning…

Machine Learning · Computer Science 2024-08-08 Guanfang Dong , Zijie Tan , Chenqiu Zhao , Anup Basu

Clustering mixed data presents numerous challenges inherent to the very heterogeneous nature of the variables. A clustering algorithm should be able, despite of this heterogeneity, to extract discriminant pieces of information from the…

Machine Learning · Computer Science 2022-05-10 Robin Fuchs , Denys Pommeret , Cinzia Viroli

This paper presents a novel clustering concept that is based on jointly learned nonlinear transforms (NTs) with priors on the information loss and the discrimination. We introduce a clustering principle that is based on evaluation of a…

Machine Learning · Computer Science 2019-01-31 Dimche Kostadinov , Behrooz Razeghi , Taras Holotyak , Slava Voloshynovskiy

Deep neural networks suffer from the major limitation of catastrophic forgetting old tasks when learning new ones. In this paper we focus on class incremental continual learning in semantic segmentation, where new categories are made…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Umberto Michieli , Pietro Zanuttigh

This paper introduces a novel perspective about error in machine learning and proposes inverse feature learning (IFL) as a representation learning approach that learns a set of high-level features based on the representation of error for…

Machine Learning · Computer Science 2020-03-10 Behzad Ghazanfari , Fatemeh Afghah

Clustering methods based on deep neural networks have proven promising for clustering real-world data because of their high representational power. In this paper, we propose a systematic taxonomy of clustering methods that utilize deep…

Machine Learning · Computer Science 2018-09-17 Elie Aljalbout , Vladimir Golkov , Yawar Siddiqui , Maximilian Strobel , Daniel Cremers

We formulate a novel technique for the detection of functional clusters in discrete event data. The advantage of this algorithm is that no prior knowledge of the number of functional groups is needed, as our procedure progressively combines…

Neurons and Cognition · Quantitative Biology 2015-05-13 S. Feldt , J. Waddell , V. L. Hetrick , J. D. Berke , M. Zochowski

It has been hypothesized that some form of "modular" structure in artificial neural networks should be useful for learning, compositionality, and generalization. However, defining and quantifying modularity remains an open problem. We cast…

Machine Learning · Computer Science 2022-06-23 Richard D. Lange , David S. Rolnick , Konrad P. Kording

Clustering is a fundamental task in data analysis. Recently, deep clustering, which derives inspiration primarily from deep learning approaches, achieves state-of-the-art performance and has attracted considerable attention. Current deep…

Machine Learning · Computer Science 2020-02-13 Deyu Bo , Xiao Wang , Chuan Shi , Meiqi Zhu , Emiao Lu , Peng Cui

Objective functions that optimize deep neural networks play a vital role in creating an enhanced feature representation of the input data. Although cross-entropy-based loss formulations have been extensively used in a variety of supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraj

Deep neural networks (DNNs) offer a means of addressing the challenging task of clustering high-dimensional data. DNNs can extract useful features, and so produce a lower dimensional representation, which is more amenable to clustering…

Machine Learning · Computer Science 2021-07-23 Louis Mahon , Thomas Lukasiewicz

The state-of-the-art speaker diarization systems use agglomerative hierarchical clustering (AHC) which performs the clustering of previously learned neural embeddings. While the clustering approach attempts to identify speaker clusters, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-07 Prachi Singh , Sriram Ganapathy

Deep clustering can optimize representations of instances (i.e., representation learning) and explore the inherent data distribution (i.e., clustering) simultaneously, which demonstrates a superior performance over conventional clustering…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Qi Qian