English
Related papers

Related papers: LAC: Graph Contrastive Learning with Learnable Aug…

200 papers

Graph contrastive learning (GCL) is the most representative and prevalent self-supervised learning approach for graph-structured data. Despite its remarkable success, existing GCL methods highly rely on an augmentation scheme to learn the…

Machine Learning · Computer Science 2022-06-07 Haonan Wang , Jieyu Zhang , Qi Zhu , Wei Huang

Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising…

Machine Learning · Computer Science 2024-01-30 Wei Ju , Yiyang Gu , Zhengyang Mao , Ziyue Qiao , Yifang Qin , Xiao Luo , Hui Xiong , Ming Zhang

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

Graph-level anomaly detection (GLAD) has already gained significant importance and has become a popular field of study, attracting considerable attention across numerous downstream works. The core focus of this domain is to capture and…

Machine Learning · Computer Science 2024-07-17 Zitong Wang , Xuexiong Luo , Enfeng Song , Qiuqing Bai , Fu Lin

This paper proposes a scalable and straightforward pre-training paradigm for efficient visual conceptual representation called occluded image contrastive learning (OCL). Our OCL approach is simple: we randomly mask patches to generate…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Xiaoyu Yang , Lijian Xu , Hongsheng Li , Shaoting Zhang

Contrastive vision-language models, such as CLIP, have garnered considerable attention for various downstream tasks, mainly due to the remarkable ability of the learned features for generalization. However, the features they learned often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Yichao Cai , Yuhang Liu , Zhen Zhang , Javen Qinfeng Shi

Learning Electronic Health Records (EHRs) representation is a preeminent yet under-discovered research topic. It benefits various clinical decision support applications, e.g., medication outcome prediction or patient similarity search.…

Machine Learning · Computer Science 2024-02-22 Hao-Ren Yao , Nairen Cao , Katina Russell , Der-Chen Chang , Ophir Frieder , Jeremy Fineman

Data-Efficient GANs (DE-GANs), which aim to learn generative models with a limited amount of training data, encounter several challenges for generating high-quality samples. Since data augmentation strategies have largely alleviated the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ziqiang Li , Chaoyue Wang , Heliang Zheng , Jing Zhang , Bin Li

Contrastive deep graph clustering (CDGC) leverages the power of contrastive learning to group nodes into different clusters. The quality of contrastive samples is crucial for achieving better performance, making augmentation techniques a…

Machine Learning · Computer Science 2024-08-07 Xihong Yang , Erxue Min , Ke Liang , Yue Liu , Siwei Wang , Sihang Zhou , Huijun Wu , Xinwang Liu , En Zhu

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

Machine Learning · Computer Science 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

In this paper, we present CLCC, a novel contrastive learning framework for color constancy. Contrastive learning has been applied for learning high-quality visual representations for image classification. One key aspect to yield useful…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Yi-Chen Lo , Chia-Che Chang , Hsuan-Chao Chiu , Yu-Hao Huang , Chia-Ping Chen , Yu-Lin Chang , Kevin Jou

Sequential recommendation addresses the issue of preference drift by predicting the next item based on the user's previous behaviors. Recently, a promising approach using contrastive learning has emerged, demonstrating its effectiveness in…

Information Retrieval · Computer Science 2023-08-08 Dongjun Lee , Donggeun Ko , Jaekwang Kim

Accurate and efficient prediction of the molecular properties of drugs is one of the fundamental problems in drug research and development. Recent advancements in representation learning have been shown to greatly improve the performance of…

Biomolecules · Quantitative Biology 2022-06-17 Hui Liu , Yibiao Huang , Xuejun Liu , Lei Deng

Invariant Contrastive Learning (ICL) methods have achieved impressive performance across various domains. However, the absence of latent space representation for distortion (augmentation)-related information in the latent space makes ICL…

Machine Learning · Computer Science 2024-10-11 Sifan Song , Jinfeng Wang , Qiaochu Zhao , Xiang Li , Dufan Wu , Angelos Stefanidis , Jionglong Su , S. Kevin Zhou , Quanzheng Li

Contrastive learning (CL) has become the de-facto learning paradigm in self-supervised learning on graphs, which generally follows the "augmenting-contrasting" learning scheme. However, we observe that unlike CL in computer vision domain,…

Machine Learning · Computer Science 2023-06-19 Wen-Zhi Li , Chang-Dong Wang , Hui Xiong , Jian-Huang Lai

Unsupervised (or self-supervised) graph representation learning is essential to facilitate various graph data mining tasks when external supervision is unavailable. The challenge is to encode the information about the graph structure and…

Machine Learning · Computer Science 2020-09-16 Costas Mavromatis , George Karypis

Contrastively trained vision-language models have achieved remarkable progress in vision and language representation learning, leading to state-of-the-art models for various downstream multimodal tasks. However, recent research has…

Computation and Language · Computer Science 2023-10-26 Harman Singh , Pengchuan Zhang , Qifan Wang , Mengjiao Wang , Wenhan Xiong , Jingfei Du , Yu Chen

Graph contrastive learning (GCL) has emerged as a pivotal technique in the domain of graph representation learning. A crucial aspect of effective GCL is the caliber of generated positive and negative samples, which is intrinsically dictated…

Machine Learning · Computer Science 2024-02-19 Xinjian Zhao , Liang Zhang , Yang Liu , Ruocheng Guo , Xiangyu Zhao

Graph Contrastive Learning (GCL), learning the node representations by augmenting graphs, has attracted considerable attentions. Despite the proliferation of various graph augmentation strategies, some fundamental questions still remain…

Machine Learning · Computer Science 2022-10-06 Nian Liu , Xiao Wang , Deyu Bo , Chuan Shi , Jian Pei

Graph Neural Networks (GNNs) have demonstrated promising results on exploiting node representations for many downstream tasks through supervised end-to-end training. To deal with the widespread label scarcity issue in real-world…

Machine Learning · Computer Science 2023-08-02 Cheng Wu , Chaokun Wang , Jingcao Xu , Ziyang Liu , Kai Zheng , Xiaowei Wang , Yang Song , Kun Gai