English
Related papers

Related papers: PRCL: Probabilistic Representation Contrastive Lea…

200 papers

Preserving maximal information is one of principles of designing self-supervised learning methodologies. To reach this goal, contrastive learning adopts an implicit way which is contrasting image pairs. However, we believe it is not fully…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Hong-Yu Zhou , Chixiang Lu , Sibei Yang , Xiaoguang Han , Yizhou Yu

Graph contrastive learning (GCL) has emerged as a pivotal technique in the domain of graph representation learning. A crucial aspect of effective GCL is the caliber of generated positive and negative samples, which is intrinsically dictated…

Machine Learning · Computer Science 2024-02-19 Xinjian Zhao , Liang Zhang , Yang Liu , Ruocheng Guo , Xiangyu Zhao

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

Machine Learning · Computer Science 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Despite their effectiveness, current deep learning models face challenges with images coming from different domains with varying appearance and content. We introduce SegCLR, a versatile framework designed to segment images across different…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Alvaro Gomariz , Yusuke Kikuchi , Yun Yvonna Li , Thomas Albrecht , Andreas Maunz , Daniela Ferrara , Huanxiang Lu , Orcun Goksel

This paper is concerned with contrastive learning (CL) for low-level image restoration and enhancement tasks. We propose a new label-efficient learning paradigm based on residuals, residual contrastive learning (RCL), and derive an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Nanqing Dong , Matteo Maggioni , Yongxin Yang , Eduardo Pérez-Pellitero , Ales Leonardis , Steven McDonagh

Graph-based Semi-Supervised Learning (SSL) aims to transfer the labels of a handful of labeled data to the remaining massive unlabeled data via a graph. As one of the most popular graph-based SSL approaches, the recently proposed Graph…

Machine Learning · Computer Science 2020-09-22 Sheng Wan , Shirui Pan , Jian Yang , Chen Gong

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

Machine Learning · Computer Science 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

To overcome the data-hungry challenge, we have proposed a semi-supervised contrastive learning framework for the task of class-imbalanced semantic segmentation. First and foremost, to make the model operate in a semi-supervised manner, we…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kangcheng Liu

Pseudo supervision is regarded as the core idea in semi-supervised learning for semantic segmentation, and there is always a tradeoff between utilizing only the high-quality pseudo labels and leveraging all the pseudo labels. Addressing…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Siqi Fan , Fenghua Zhu , Zunlei Feng , Yisheng Lv , Mingli Song , Fei-Yue Wang

Contrastive Learning (CL) is a recent representation learning approach, which encourages inter-class separability and intra-class compactness in learned image representations. Since medical images often contain multiple semantic classes in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Prashant Pandey , Ajey Pai , Nisarg Bhatt , Prasenjit Das , Govind Makharia , Prathosh AP , Mausam

Contrastive Learning (CL) has emerged as a dominant technique for unsupervised representation learning which embeds augmented versions of the anchor close to each other (positive samples) and pushes the embeddings of other samples…

Artificial Intelligence · Computer Science 2022-06-15 Jun Xia , Lirong Wu , Ge Wang , Jintao Chen , Stan Z. Li

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

Machine Learning · Computer Science 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

Detectingandsegmentingobjectswithinwholeslideimagesis essential in computational pathology workflow. Self-supervised learning (SSL) is appealing to such annotation-heavy tasks. Despite the extensive benchmarks in natural images for dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Jiawei Yang , Hanbo Chen , Yuan Liang , Junzhou Huang , Lei He , Jianhua Yao

Medical image segmentation is a critical yet challenging task, primarily due to the difficulty of obtaining extensive datasets of high-quality, expert-annotated images. Contrastive learning presents a potential but still problematic…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuang Zeng , Lei Zhu , Xinliang Zhang , Hangzhou He , Yanye Lu

This paper focuses on learning representation on the whole graph level in an unsupervised manner. Learning graph-level representation plays an important role in a variety of real-world issues such as molecule property prediction, protein…

Machine Learning · Computer Science 2024-01-08 Ge Wang , Zelin Zang , Jiangbin Zheng , Jun Xia , Stan Z. Li

Self-supervised learning (SSL) has become prevalent for learning representations in computer vision. Notably, SSL exploits contrastive learning to encourage visual representations to be invariant under various image transformations. The…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Swati Jindal , Roberto Manduchi

Deterministic embeddings learned by contrastive learning (CL) methods such as SimCLR and SupCon achieve state-of-the-art performance but lack a principled mechanism for uncertainty quantification. We propose Variational Contrastive Learning…

Machine Learning · Computer Science 2025-10-08 Minoh Jeong , Seonho Kim , Alfred Hero

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

Sentence Representation Learning (SRL) is a crucial task in Natural Language Processing (NLP), where contrastive Self-Supervised Learning (SSL) is currently a mainstream approach. However, the reasons behind its remarkable effectiveness…

Computation and Language · Computer Science 2024-06-06 Mingxin Li , Richong Zhang , Zhijie Nie