English
Related papers

Related papers: Probing clustering in neural network representatio…

200 papers

In this paper, we study the problem of learning image classification models with label noise. Existing approaches depending on human supervision are generally not scalable as manually identifying correct or incorrect labels is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Kuang-Huei Lee , Xiaodong He , Lei Zhang , Linjun Yang

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive…

Machine Learning · Computer Science 2026-04-27 Leonardo Arrighi , Julia Eva Belloni , Aurélie Gallet , Ivan Gentile , Matteo Lippi , Marco Zullich

Unsupervised representation learning for image clustering is essential in computer vision. Although the advancement of visual models has improved image clustering with efficient visual representations, challenges still remain. Firstly,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Zijie Song , Zhenzhen Hu , Richang Hong

Recent studies have noted an intriguing phenomenon termed Neural Collapse, that is, when the neural networks establish the right correlation between feature spaces and the training targets, their last-layer features, together with the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yining Wang , Junjie Sun , Chenyue Wang , Mi Zhang , Min Yang

Tools to analyze the latent space of deep neural networks provide a step towards better understanding them. In this work, we motivate sparse subspace clustering (SSC) with an aim to learn affinity graphs from the latent structure of a given…

Machine Learning · Computer Science 2021-07-06 Uday Singh Saini , Pravallika Devineni , Evangelos E. Papalexakis

While deep face recognition has benefited significantly from large-scale labeled data, current research is focused on leveraging unlabeled data to further boost performance, reducing the cost of human annotation. Prior work has mostly been…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Aruni RoyChowdhury , Xiang Yu , Kihyuk Sohn , Erik Learned-Miller , Manmohan Chandraker

Face clustering is an essential tool for exploiting the unlabeled face data, and has a wide range of applications including face annotation and retrieval. Recent works show that supervised clustering can result in noticeable performance…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Lei Yang , Dapeng Chen , Xiaohang Zhan , Rui Zhao , Chen Change Loy , Dahua Lin

We discuss topological aspects of cluster analysis and show that inferring the topological structure of a dataset before clustering it can considerably enhance cluster detection: theoretical arguments and empirical evidence show that…

Machine Learning · Computer Science 2022-07-04 Moritz Herrmann , Daniyal Kazempour , Fabian Scheipl , Peer Kröger

Deep neural networks trained on a wide range of datasets demonstrate impressive transferability. Deep features appear general in that they are applicable to many datasets and tasks. Such property is in prevalent use in real-world…

Machine Learning · Computer Science 2019-09-27 Hong Liu , Mingsheng Long , Jianmin Wang , Michael I. Jordan

The pioneering method for unsupervised meta-learning, CACTUs, is a clustering-based approach with pseudo-labeling. This approach is model-agnostic and can be combined with supervised algorithms to learn from unlabeled data. However, it…

Machine Learning · Computer Science 2022-09-29 Xingping Dong , Jianbing Shen , Ling Shao

Deep subspace clustering (DSC) algorithms face several challenges that hinder their widespread adoption across variois application domains. First, clustering quality is typically assessed using only the encoder's output layer, disregarding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Lovro Sindicic , Ivica Kopriva

The clustering methods have recently absorbed even-increasing attention in learning and vision. Deep clustering combines embedding and clustering together to obtain optimal embedding subspace for clustering, which can be more effective…

Machine Learning · Computer Science 2019-05-01 Xu Yang , Cheng Deng , Feng Zheng , Junchi Yan , Wei Liu

Clustering is one of the most fundamental tasks in machine learning. Recently, deep clustering has become a major trend in clustering techniques. Representation learning often plays an important role in the effectiveness of deep clustering,…

Machine Learning · Computer Science 2021-06-02 Yaling Tao , Kentaro Takagi , Kouta Nakata

Finding a suitable data representation for a specific task has been shown to be crucial in many applications. The success of subspace clustering depends on the assumption that the data can be separated into different subspaces. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Zhengrui Ma , Zhao Kang , Guangchun Luo , Ling Tian

Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representations and optimize…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shen Yan , Yu Zheng , Wei Ao , Xiao Zeng , Mi Zhang

Representation learning, i.e. the generation of representations useful for downstream applications, is a task of fundamental importance that underlies much of the success of deep neural networks (DNNs). Recently, robustness to adversarial…

Machine Learning · Computer Science 2022-09-16 Christian Cianfarani , Arjun Nitin Bhagoji , Vikash Sehwag , Ben Y. Zhao , Prateek Mittal , Haitao Zheng

Clustering is typically measured by the ratio of triangles to all triples, open or closed. Generating clustered networks, and how clustering affects dynamics on networks, is reasonably well understood for certain classes of networks…

Physics and Society · Physics 2014-10-22 Martin Ritchie , Luc Berthouze , Thomas House , Istvan Z. Kiss

Subspace clustering is an important unsupervised clustering approach. It is based on the assumption that the high-dimensional data points are approximately distributed around several low-dimensional linear subspaces. The majority of the…

Machine Learning · Computer Science 2021-12-20 Maryam Abdolali , Nicolas Gillis

Clustering is essential to many tasks in pattern recognition and computer vision. With the advent of deep learning, there is an increasing interest in learning deep unsupervised representations for clustering analysis. Many works on this…

Machine Learning · Computer Science 2018-02-02 Caglar Aytekin , Xingyang Ni , Francesco Cricri , Emre Aksu

Convolutional neural networks trained without supervision come close to matching performance with supervised pre-training, but sometimes at the cost of an even higher number of parameters. Extracting subnetworks from these large…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Mathilde Caron , Ari Morcos , Piotr Bojanowski , Julien Mairal , Armand Joulin