English
Related papers

Related papers: Hierarchical Semi-Supervised Contrastive Learning …

200 papers

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

Machine Learning · Computer Science 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

With the recent promising results of contrastive learning in the self-supervised learning paradigm, supervised contrastive learning has successfully extended these contrastive approaches to supervised contexts, outperforming cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jaewon Kim , Hyukjong Lee , Jooyoung Chang , Sang Min Park

Due to the unsupervised nature of anomaly detection, the key to fueling deep models is finding supervisory signals. Different from current reconstruction-guided generative models and transformation-based contrastive models, we devise novel…

Machine Learning · Computer Science 2023-05-26 Hongzuo Xu , Yijie Wang , Juhui Wei , Songlei Jian , Yizhou Li , Ning Liu

We propose a framework for sequence-to-sequence contrastive learning (SeqCLR) of visual representations, which we apply to text recognition. To account for the sequence-to-sequence structure, each feature map is divided into different…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Aviad Aberdam , Ron Litman , Shahar Tsiper , Oron Anschel , Ron Slossberg , Shai Mazor , R. Manmatha , Pietro Perona

Unsupervised learning of disease subtypes from multi-omics data presents a significant opportunity for advancing personalized medicine. We introduce OmicsCL, a modular contrastive learning framework that jointly embeds heterogeneous omics…

Machine Learning · Computer Science 2025-05-02 Atahan Karagoz

Learning good image representations that are beneficial to downstream tasks is a challenging task in computer vision. As such, a wide variety of self-supervised learning approaches have been proposed. Among them, contrastive learning has…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Yun Yue , Fangzhou Lin , Kazunori D Yamada , Ziming Zhang

Session-based recommendation, which aims to predict the next item of users' interest as per an existing sequence interaction of items, has attracted growing applications of Contrastive Learning (CL) with improved user and item…

Information Retrieval · Computer Science 2023-12-21 Zhengxiang Shi , Xi Wang , Aldo Lipani

Unsupervised sentence representation learning remains a critical challenge in modern natural language processing (NLP) research. Recently, contrastive learning techniques have achieved significant success in addressing this issue by…

Computation and Language · Computer Science 2024-11-20 Wenxiao Liu , Zihong Yang , Chaozhuo Li , Zijin Hong , Jianfeng Ma , Zhiquan Liu , Litian Zhang , Feiran Huang

Understanding causal heterogeneity is essential for scientific discovery in domains such as biology and medicine. However, existing methods lack causal awareness, with insufficient modeling of heterogeneity, confounding, and observational…

Machine Learning · Computer Science 2025-10-29 Wenrui Li , Qinghao Zhang , Xiaowo Wang

Self-supervised learning based on instance discrimination has shown remarkable progress. In particular, contrastive learning, which regards each image as well as its augmentations as an individual class and tries to distinguish them from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Haohang Xu , Xiaopeng Zhang , Hao Li , Lingxi Xie , Hongkai Xiong , Qi Tian

Existing deep learning-based cross-view geo-localization methods primarily focus on improving the accuracy of cross-domain image matching, rather than enabling models to comprehensively capture contextual information around the target and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Suofei Zhang , Xinxin Wang , Xiaofu Wu , Quan Zhou , Haifeng Hu

Recent years have witnessed many successful applications of contrastive learning in diverse domains, yet its self-supervised version still remains many exciting challenges. As the negative samples are drawn from unlabeled datasets, a…

Machine Learning · Computer Science 2024-02-01 Bin Liu , Bang Wang , Tianrui Li

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Unsupervised person re-identification (ReID) aims to match a query image of a pedestrian to the images in gallery set without supervision labels. The most popular approaches to tackle unsupervised person ReID are usually performing a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 He Sun , Mingkun Li , Chun-Guang Li

For medical image segmentation, contrastive learning is the dominant practice to improve the quality of visual representations by contrasting semantically similar and dissimilar pairs of samples. This is enabled by the observation that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Chenyu You , Weicheng Dai , Yifei Min , Fenglin Liu , David A. Clifton , S Kevin Zhou , Lawrence Hamilton Staib , James S Duncan

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

Open-set supervised anomaly detection (OSAD) - a recently emerging anomaly detection area - aims at utilizing a few samples of anomaly classes seen during training to detect unseen anomalies (i.e., samples from open-set anomaly classes),…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Jiawen Zhu , Choubo Ding , Yu Tian , Guansong Pang

Unsupervised cell type identification is crucial for uncovering and characterizing heterogeneous populations in single cell omics studies. Although a range of clustering methods have been developed, most focus exclusively on intrinsic…

Artificial Intelligence · Computer Science 2025-12-12 Liang Peng , Haopeng Liu , Yixuan Ye , Cheng Liu , Wenjun Shen , Si Wu , Hau-San Wong

Unsupervised domain adaptation without consuming annotation process for unlabeled target data attracts appealing interests in semantic segmentation. However, 1) existing methods neglect that not all semantic representations across domains…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jiahua Dong , Yang Cong , Gan Sun , Yuyang Liu , Xiaowei Xu