English
Related papers

Related papers: Contrastive Learning Subspace for Text Clustering

200 papers

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

Most multi-view clustering methods are limited by shallow models without sound nonlinear information perception capability, or fail to effectively exploit complementary information hidden in different views. To tackle these issues, we…

Machine Learning · Computer Science 2022-10-14 Fu Lele , Zhang Lei , Yang Jinghua , Chen Chuan , Zhang Chuanfu , Zheng Zibin

Contrastive learning is widely used in clustering tasks due to its discriminative representation. However, the conflict problem between classes is difficult to solve effectively. Existing methods try to solve this problem through prototype…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Shihao Dong , Xiaotong Zhou , Yuhui Zheng , Huiying Xu , Xinzhong Zhu

Contrastive self-supervised learning (CSL) based on instance discrimination typically attracts positive samples while repelling negatives to learn representations with pre-defined binary self-supervision. However, vanilla CSL is inadequate…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Yifei Zhang , Chang Liu , Yu Zhou , Weiping Wang , Qixiang Ye , Xiangyang Ji

Natural language inference (NLI) is an increasingly important task for natural language understanding, which requires one to infer the relationship between the sentence pair (premise and hypothesis). Many recent works have used contrastive…

Computation and Language · Computer Science 2022-05-02 Shu'ang Li , Xuming Hu , Li Lin , Lijie Wen

Image classification datasets exhibit a non-negligible fraction of mislabeled examples, often due to human error when one class superficially resembles another. This issue poses challenges in supervised contrastive learning (SCL), where the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zijun Long , George Killick , Lipeng Zhuang , Richard McCreadie , Gerardo Aragon Camarasa , Paul Henderson

Efficiently capturing the complex spatiotemporal representations from large-scale unlabeled traffic data remains to be a challenging task. In considering of the dilemma, this work employs the advanced contrastive learning and proposes a…

Machine Learning · Computer Science 2023-12-19 Lincan Li , Kaixiang Yang , Fengji Luo , Jichao Bi

Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Chen Feng , Ioannis Patras

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

Machine Learning · Computer Science 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

A good clustering algorithm can discover natural groupings in data. These groupings, if used wisely, provide a form of weak supervision for learning representations. In this work, we present Clustering-based Contrastive Learning (CCL), a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Vivek Sharma , Makarand Tapaswi , M. Saquib Sarfraz , Rainer Stiefelhagen

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Representations of events described in text are important for various tasks. In this work, we present SWCC: a Simultaneous Weakly supervised Contrastive learning and Clustering framework for event representation learning. SWCC learns event…

Computation and Language · Computer Science 2022-03-16 Jun Gao , Wei Wang , Changlong Yu , Huan Zhao , Wilfred Ng , Ruifeng Xu

Contrastive self-supervised learning has become a prominent technique in representation learning. The main step in these methods is to contrast semantically similar and dissimilar pairs of samples. However, in the domain of Natural Language…

Computation and Language · Computer Science 2022-06-07 Amrita Bhattacharjee , Mansooreh Karami , Huan Liu

The image-text retrieval task aims to retrieve relevant information from a given image or text. The main challenge is to unify multimodal representation and distinguish fine-grained differences across modalities, thereby finding similar…

Multimedia · Computer Science 2024-05-20 Ziyu Gong , Chengcheng Mai , Yihua Huang

Cross-lingual summarization (CLS) is a sophisticated branch in Natural Language Processing that demands models to accurately translate and summarize articles from different source languages. Despite the improvement of the subsequent…

Computation and Language · Computer Science 2024-11-27 Sanzana Karim Lora , M. Sohel Rahman , Rifat Shahriyar

Clustering is the task of gathering similar data samples into clusters without using any predefined labels. It has been widely studied in machine learning literature, and recent advancements in deep learning have revived interest in this…

Machine Learning · Computer Science 2023-09-04 Mohammadreza Sadeghi , Hadi Hojjati , Narges Armanfard