English
Related papers

Related papers: Few-Example Clustering via Contrastive Learning

200 papers

Clustering is a core task in machine learning with wide-ranging applications in data mining and pattern recognition. However, its unsupervised nature makes it inherently challenging. Many existing clustering algorithms suffer from critical…

Machine Learning · Computer Science 2025-07-29 Ahmed Shokry , Ayman Khalafallah

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Contrastive learning has demonstrated strong performance in attributed hypergraph clustering. Typically, existing methods based on contrastive learning first learn node embeddings and then apply clustering algorithms, such as k-means, to…

Machine Learning · Computer Science 2026-03-11 Li Ni , Shuaikang Zeng , Lin Mu , Longlong Lin

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often overlap with each other in the representation space at the…

Machine Learning · Computer Science 2021-06-01 Dejiao Zhang , Feng Nan , Xiaokai Wei , Shangwen Li , Henghui Zhu , Kathleen McKeown , Ramesh Nallapati , Andrew Arnold , Bing Xiang

The goal of fair clustering is to find clusters such that the proportion of sensitive attributes (e.g., gender, race, etc.) in each cluster is similar to that of the entire dataset. Various fair clustering algorithms have been proposed that…

Machine Learning · Statistics 2026-02-26 Jinwon Park , Kunwoong Kim , Jihu Lee , Yongdai Kim

Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mohamed Afham , Ranga Rodrigo

Subspace clustering aims to group data points that lie in a union of low-dimensional subspaces and finds wide application in computer vision, hyperspectral imaging, and recommendation systems. However, most existing methods assume fully…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Huanran Li , Daniel Pimentel-Alarcón

Due to the scarcity of sampling data in reality, few-shot object detection (FSOD) has drawn more and more attention because of its ability to quickly train new detection concepts with less data. However, there are still failure…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Zeyu Shangguan , Lian Huai , Tong Liu , Xingqun Jiang

Contrastive analysis (CA) refers to the exploration of variations uniquely enriched in a target dataset as compared to a corresponding background dataset generated from sources of variation that are irrelevant to a given task. For example,…

Machine Learning · Computer Science 2023-10-31 Ethan Weinberger , Ian Covert , Su-In Lee

Federated clustering, an essential extension of centralized clustering for federated scenarios, enables multiple data-holding clients to collaboratively group data while keeping their data locally. In centralized scenarios, clustering…

Machine Learning · Computer Science 2025-06-03 Jing Liu , Jie Yan , Zhong-Yuan Zhang

In this paper, we explore how to utilize pre-trained language model to perform few-shot text classification where only a few annotated examples are given for each class. Since using traditional cross-entropy loss to fine-tune language model…

Computation and Language · Computer Science 2022-10-03 Liwen Sun , Jiawei Han

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

Machine Learning · Computer Science 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

We present Mixture of Contrastive Experts (MiCE), a unified probabilistic clustering framework that simultaneously exploits the discriminative representations learned by contrastive learning and the semantic structures captured by a latent…

Machine Learning · Computer Science 2021-05-06 Tsung Wei Tsai , Chongxuan Li , Jun Zhu

Clustering algorithms rely on complex optimisation processes that may be difficult to comprehend, especially for individuals who lack technical expertise. While many explainable artificial intelligence techniques exist for supervised…

Machine Learning · Computer Science 2024-09-20 Aurora Spagnol , Kacper Sokol , Pietro Barbiero , Marc Langheinrich , Martin Gjoreski

We address the problem of federated learning (FL) where users are distributed and partitioned into clusters. This setup captures settings where different groups of users have their own objectives (learning tasks) but by aggregating their…

Machine Learning · Statistics 2021-06-10 Avishek Ghosh , Jichan Chung , Dong Yin , Kannan Ramchandran

Client selection schemes are widely adopted to handle the communication-efficient problems in recent studies of Federated Learning (FL). However, the large variance of the model updates aggregated from the randomly-selected unrepresentative…

Machine Learning · Computer Science 2022-08-24 Guangyuan Shen , Dehong Gao , Duanxiao Song , Libin Yang , Xukai Zhou , Shirui Pan , Wei Lou , Fang Zhou

Model agnostic meta-learning algorithms aim to infer priors from several observed tasks that can then be used to adapt to a new task with few examples. Given the inherent diversity of tasks arising in existing benchmarks, recent methods use…

Machine Learning · Computer Science 2022-07-26 Rakshith Subramanyam , Mark Heimann , Jayram Thathachar , Rushil Anirudh , Jayaraman J. Thiagarajan

When training data is scarce, it is common to make use of a feature extractor that has been pre-trained on a large base dataset, either by fine-tuning its parameters on the ``target'' dataset or by directly adopting its representation as…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Raphael Lafargue , Yassir Bendou , Bastien Pasdeloup , Jean-Philippe Diguet , Ian Reid , Vincent Gripon , Jack Valmadre

Unsupervised representation learning with contrastive learning achieved great success. This line of methods duplicate each training batch to construct contrastive pairs, making each training batch and its augmented version forwarded…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Pengguang Chen , Shu Liu , Jiaya Jia