English
Related papers

Related papers: Neighborhood Contrastive Learning for Novel Class …

200 papers

We study the new task of class-incremental Novel Class Discovery (class-iNCD), which refers to the problem of discovering novel categories in an unlabelled data set by leveraging a pre-trained model that has been trained on a labelled data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Subhankar Roy , Mingxuan Liu , Zhun Zhong , Nicu Sebe , Elisa Ricci

A good clustering algorithm can discover natural groupings in data. These groupings, if used wisely, provide a form of weak supervision for learning representations. In this work, we present Clustering-based Contrastive Learning (CCL), a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Vivek Sharma , Makarand Tapaswi , M. Saquib Sarfraz , Rainer Stiefelhagen

Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often overlap with each other in the representation space at the…

Machine Learning · Computer Science 2021-06-01 Dejiao Zhang , Feng Nan , Xiaokai Wei , Shangwen Li , Henghui Zhu , Kathleen McKeown , Ramesh Nallapati , Andrew Arnold , Bing Xiang

The problem of Novel Class Discovery (NCD) consists in extracting knowledge from a labeled set of known classes to accurately partition an unlabeled set of novel classes. While NCD has recently received a lot of attention from the…

Machine Learning · Computer Science 2024-06-04 Colin Troisemaine , Alexandre Reiffers-Masson , Stéphane Gosselin , Vincent Lemaire , Sandrine Vaton

Novel Categories Discovery (NCD) facilitates learning from a partially annotated label space and enables deep learning (DL) models to operate in an open-world setting by identifying and differentiating instances of novel classes based on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Zahid Hasan , Masud Ahmed , Abu Zaher Md Faridee , Sanjay Purushotham , Heesung Kwon , Hyungtae Lee , Nirmalya Roy

Deep representations have shown promising performance when transferred to downstream tasks in a black-box manner. Yet, their inherent lack of interpretability remains a significant challenge, as these features are often opaque to human…

Machine Learning · Computer Science 2024-04-24 Yifei Wang , Qi Zhang , Yaoyu Guo , Yisen Wang

Deep clustering successfully provides more effective features than conventional ones and thus becomes an important technique in current unsupervised learning. However, most deep clustering methods ignore the vital positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Zhiyuan Dang , Cheng Deng , Xu Yang , Heng Huang

Generalized category discovery (GCD) is a recently proposed open-world task. Given a set of images consisting of labeled and unlabeled instances, the goal of GCD is to automatically cluster the unlabeled samples using information…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Xiangli Yang , Xinglin Pan , Irwin King , Zenglin Xu

Continual Novel Class Discovery (CNCD) aims to continually discover novel classes without labels while maintaining the recognition capability for previously learned classes. The main challenges faced by CNCD include the feature-discrepancy…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Yifan Yu , Shaokun Wang , Yuhang He , Junzhe Chen , Yihong Gong

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

Generalized Class Discovery (GCD) aims to dynamically assign labels to unlabelled data partially based on knowledge learned from labelled data, where the unlabelled data may come from known or novel classes. The prevailing approach…

Machine Learning · Computer Science 2024-05-01 Ye Wang , Yaxiong Wang , Yujiao Wu , Bingchen Zhao , Xueming Qian

Existing deep learning models have achieved promising performance in recognizing skin diseases from dermoscopic images. However, these models can only recognize samples from predefined categories, when they are deployed in the clinic, data…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Wei Feng , Lie Ju , Lin Wang , Kaimin Song , Zongyuan Ge

Unsupervised out-of-distribution (OOD) Detection aims to separate the samples falling outside the distribution of training data without label information. Among numerous branches, contrastive learning has shown its excellent capability of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Menglong Chen , Xingtai Gui , Shicai Fan

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

Machine Learning · Computer Science 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

This paper studies the problem of novel category discovery on single- and multi-modal data with labels from different but relevant categories. We present a generic, end-to-end framework to jointly learn a reliable representation and assign…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Xuhui Jia , Kai Han , Yukun Zhu , Bradley Green

Contrastive learning, a dominant self-supervised technique, emphasizes similarity in representations between augmentations of the same input and dissimilarity for different ones. Although low contrastive loss often correlates with high…

Machine Learning · Computer Science 2023-11-22 Yunzhe Zhang , Yao Lu , Qi Xuan

Recently, graph collaborative filtering methods have been proposed as an effective recommendation approach, which can capture users' preference over items by modeling the user-item interaction graphs. In order to reduce the influence of…

Information Retrieval · Computer Science 2022-02-16 Zihan Lin , Changxin Tian , Yupeng Hou , Wayne Xin Zhao

Self-supervised learning algorithms based on instance discrimination train encoders to be invariant to pre-defined transformations of the same instance. While most methods treat different views of the same image as positives for a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Debidatta Dwibedi , Yusuf Aytar , Jonathan Tompson , Pierre Sermanet , Andrew Zisserman

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

Computation and Language · Computer Science 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

In this paper, we propose a one-stage online clustering method called Contrastive Clustering (CC) which explicitly performs the instance- and cluster-level contrastive learning. To be specific, for a given dataset, the positive and negative…

Machine Learning · Computer Science 2020-09-22 Yunfan Li , Peng Hu , Zitao Liu , Dezhong Peng , Joey Tianyi Zhou , Xi Peng