English
Related papers

Related papers: Studying Cross-cluster Modularity in Neural Networ…

200 papers

Clustering is a widely used unsupervised learning technique involving an intensive discrete optimization problem. Associative Memory models or AMs are differentiable neural networks defining a recursive dynamical system, which have been…

Machine Learning · Computer Science 2023-06-07 Bishwajit Saha , Dmitry Krotov , Mohammed J. Zaki , Parikshit Ram

Modularity is designed to measure the strength of division of a network into clusters (known also as communities). Networks with high modularity have dense connections between the vertices within clusters but sparse connections between…

Probability · Mathematics 2017-07-18 Liudmila Ostroumova Prokhorenkova , Pawel Pralat , Andrei Raigorodskii

Graph-based clustering has shown promising performance in many tasks. A key step of graph-based approach is the similarity graph construction. In general, learning graph in kernel space can enhance clustering accuracy due to the…

Machine Learning · Computer Science 2019-05-22 Zhao Kang , Honghui Xu , Boyu Wang , Hongyuan Zhu , Zenglin Xu

We introduce the Neural Collaborative Subspace Clustering, a neural model that discovers clusters of data points drawn from a union of low-dimensional subspaces. In contrast to previous attempts, our model runs without the aid of spectral…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Tong Zhang , Pan Ji , Mehrtash Harandi , Wenbing Huang , Hongdong Li

We introduce a novel end-to-end approach for learning to cluster in the absence of labeled examples. Our clustering objective is based on optimizing normalized cuts, a criterion which measures both intra-cluster similarity as well as…

Machine Learning · Computer Science 2019-10-18 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

A widely used paradigm to improve the generalization performance of high-capacity neural models is through the addition of auxiliary unsupervised tasks during supervised training. Tasks such as similarity matching and input reconstruction…

Machine Learning · Computer Science 2022-01-19 Shivin Srivastava , Kenji Kawaguchi , Vaibhav Rajan

Clustering is a core task in machine learning with wide-ranging applications in data mining and pattern recognition. However, its unsupervised nature makes it inherently challenging. Many existing clustering algorithms suffer from critical…

Machine Learning · Computer Science 2025-07-29 Ahmed Shokry , Ayman Khalafallah

The problem of missing data has been persistent for a long time and poses a major obstacle in machine learning and statistical data analysis. Past works in this field have tried using various data imputation techniques to fill in the…

Machine Learning · Computer Science 2020-11-20 Rishab Khincha , Utkarsh Sarawgi , Wazeer Zulfikar , Pattie Maes

We study the problem of explainability-first clustering where explainability becomes a first-class citizen for clustering. Previous clustering approaches use decision trees for explanation, but only after the clustering is completed. In…

Machine Learning · Computer Science 2022-12-13 Hyunseung Hwang , Steven Euijong Whang

The structure of many complex networks includes edge directionality and weights on top of their topology. Network analysis that can seamlessly consider combination of these properties are desirable. In this paper, we study two important…

Social and Information Networks · Computer Science 2021-11-24 Frederique Oggier , Silivanxay Phetsouvanh , Anwitaman Datta

In this work, we evaluate two different image clustering objectives, k-means clustering and correlation clustering, in the context of Triplet Loss induced feature space embeddings. Specifically, we train a convolutional neural network to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Kalun Ho , Janis Keuper , Franz-Josef Pfreundt , Margret Keuper

The task of labeling data for training deep neural networks is daunting and tedious, requiring millions of labels to achieve the current state-of-the-art results. Such reliance on large amounts of labeled data can be relaxed by exploiting…

Machine Learning · Computer Science 2016-02-17 Aysegul Dundar , Jonghoon Jin , Eugenio Culurciello

Clustering is a fundamental learning task widely used as a first step in data analysis. For example, biologists use cluster assignments to analyze genome sequences, medical records, or images. Since downstream analysis is typically…

Machine Learning · Computer Science 2024-06-11 Jonathan Svirsky , Ofir Lindenbaum

This paper introduces the notion of co-modularity, to co-cluster observations of bipartite networks into co-communities. The task of co-clustering is to group together nodes of one type with nodes of another type, according to the…

Methodology · Statistics 2021-11-09 Thomas E. Bartlett

Transformers have emerged as a powerful neural network architecture capable of tackling a wide range of learning tasks. In this work, we provide a theoretical analysis of their ability to automatically extract structure from data in an…

Machine Learning · Statistics 2025-10-29 Rodrigo Maulen-Soto , Pierre Marion , Claire Boyer

Patchwork learning arises as a new and challenging data collection paradigm where both samples and features are observed in fragmented subsets. Due to technological limits, measurement expense, or multimodal data integration, such patchwork…

Methodology · Statistics 2024-06-21 Lili Zheng , Andersen Chang , Genevera I. Allen

This paper presents a neural network-based end-to-end clustering framework. We design a novel strategy to utilize the contrastive criteria for pushing data-forming clusters directly from raw data, in addition to learning a feature embedding…

Machine Learning · Computer Science 2016-04-27 Yen-Chang Hsu , Zsolt Kira

Deep neural networks trained to predict neural activity from visual input and behaviour have shown great potential to serve as digital twins of the visual cortex. Per-neuron embeddings derived from these models could potentially be used to…

Neural network-based clustering has recently gained popularity, and in particular a constrained clustering formulation has been proposed to perform transfer learning and image category discovery using deep learning. The core idea is to…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Yen-Chang Hsu , Zhaoyang Lv , Joel Schlosser , Phillip Odom , Zsolt Kira

This paper presents a novel clustering concept that is based on jointly learned nonlinear transforms (NTs) with priors on the information loss and the discrimination. We introduce a clustering principle that is based on evaluation of a…

Machine Learning · Computer Science 2019-01-31 Dimche Kostadinov , Behrooz Razeghi , Taras Holotyak , Slava Voloshynovskiy