English
Related papers

Related papers: Semi-Supervised Clustering with Contrastive Learni…

200 papers

We compare the performance of different clustering algorithms applied to the task of unsupervised text categorization. We consider agglomerative clustering algorithms, principal direction divisive partitioning and (for the first time)…

Disordered Systems and Neural Networks · Physics 2007-05-23 D. Volk , M. G. Stepanov

It is well known that the success of deep neural networks is greatly attributed to large-scale labeled datasets. However, it can be extremely time-consuming and laborious to collect sufficient high-quality labeled data in most practical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Yao Yao , Junyi Shen , Jin Xu , Bin Zhong , Li Xiao

Recently, distant supervision has gained great success on Fine-grained Entity Typing (FET). Despite its efficiency in reducing manual labeling efforts, it also brings the challenge of dealing with false entity type labels, as distant…

Computation and Language · Computer Science 2019-04-16 Bo Chen , Xiaotao Gu , Yufeng Hu , Siliang Tang , Guoping Hu , Yueting Zhuang , Xiang Ren

Graph clustering is crucial for unraveling intricate data structures, yet it presents significant challenges due to its unsupervised nature. Recently, goal-directed clustering techniques have yielded impressive results, with contrastive…

Machine Learning · Computer Science 2025-07-21 Enhao Cheng , Shoujia Zhang , Jianhua Yin , Li Jin , Liqiang Nie

In this paper, we focus on unsupervised representation learning for clustering of images. Recent advances in deep clustering and unsupervised representation learning are based on the idea that different views of an input image (generated…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Aniket Anand Deshmukh , Jayanth Reddy Regatti , Eren Manavoglu , Urun Dogan

Determining phenotypes of diseases can have considerable benefits for in-hospital patient care and to drug development. The structure of high dimensional data sets such as electronic health records are often represented through an embedding…

This paper presents a new multitask learning framework that learns a shared representation among the tasks, incorporating both task and feature clusters. The jointly-induced clusters yield a shared latent subspace where task relationships…

Machine Learning · Statistics 2017-03-06 Keerthiram Murugesan , Jaime Carbonell , Yiming Yang

Clustering is a class of unsupervised learning methods that has been extensively applied and studied in computer vision. Little work has been done to adapt it to the end-to-end training of visual features on large scale datasets. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Mathilde Caron , Piotr Bojanowski , Armand Joulin , Matthijs Douze

In this paper, we propose a one-stage online clustering method called Contrastive Clustering (CC) which explicitly performs the instance- and cluster-level contrastive learning. To be specific, for a given dataset, the positive and negative…

Machine Learning · Computer Science 2020-09-22 Yunfan Li , Peng Hu , Zitao Liu , Dezhong Peng , Joey Tianyi Zhou , Xi Peng

Rapid progress in 3D semantic segmentation is inseparable from the advances of deep network models, which highly rely on large-scale annotated data for training. To address the high cost and challenges of 3D point-level labeling, we present…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Li Jiang , Shaoshuai Shi , Zhuotao Tian , Xin Lai , Shu Liu , Chi-Wing Fu , Jiaya Jia

Modeling domain intent within an evolving domain structure presents a significant challenge for domain-specific conversational recommendation systems (CRS). The conventional approach involves training an intent model using utterance-intent…

Information Retrieval · Computer Science 2025-05-06 Safikureshi Mondal , Subhasis Dasgupta , Amarnath Gupta

In this paper, we present a simple and efficient method for training deep neural networks in a semi-supervised setting where only a small portion of training data is labeled. We introduce self-ensembling, where we form a consensus…

Neural and Evolutionary Computing · Computer Science 2017-03-16 Samuli Laine , Timo Aila

Deep Learning has demonstrated a significant improvement against traditional machine learning approaches in different domains such as image and speech recognition. Their success on benchmark datasets is transferred to the real-world through…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Ahmad Mustapha , Wael Khreich , Wasim Masr

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Given an unlabeled dataset and an annotation budget, we study how to selectively label a fixed number of instances so that semi-supervised learning (SSL) on such a partially labeled dataset is most effective. We focus on selecting the right…

Machine Learning · Computer Science 2023-08-24 Xudong Wang , Long Lian , Stella X. Yu

Clustering has long been a popular unsupervised learning approach to identify groups of similar objects and discover patterns from unlabeled data in many applications. Yet, coming up with meaningful interpretations of the estimated clusters…

Methodology · Statistics 2020-05-26 Minjie Wang , Tianyi Yao , Genevera I. Allen

Fine-tuning pre-trained language models (PLMs) has demonstrated its effectiveness on various downstream NLP tasks recently. However, in many low-resource scenarios, the conventional fine-tuning strategies cannot sufficiently capture the…

Computation and Language · Computer Science 2021-11-15 Yusheng Su , Xu Han , Yankai Lin , Zhengyan Zhang , Zhiyuan Liu , Peng Li , Jie Zhou , Maosong Sun

Deep clustering can optimize representations of instances (i.e., representation learning) and explore the inherent data distribution (i.e., clustering) simultaneously, which demonstrates a superior performance over conventional clustering…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Qi Qian

We present a novel clustering objective that learns a neural network classifier from scratch, given only unlabelled data samples. The model discovers clusters that accurately match semantic classes, achieving state-of-the-art results in…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Xu Ji , João F. Henriques , Andrea Vedaldi

This paper presents a new semi-supervised framework with convolutional neural networks (CNNs) for text categorization. Unlike the previous approaches that rely on word embeddings, our method learns embeddings of small text regions from…

Machine Learning · Statistics 2015-11-03 Rie Johnson , Tong Zhang