English
Related papers

Related papers: A Simple Graph Contrastive Learning Framework for …

200 papers

Graph representation learning has emerged as a cornerstone for tasks like node classification and link prediction, yet prevailing self-supervised learning (SSL) methods face challenges such as computational inefficiency, reliance on…

Machine Learning · Computer Science 2025-09-04 Srinitish Srinivasan , Omkumar CU

Knowledge graph completion (KGC) aims to reason over known facts and infer the missing links. Text-based methods such as KGBERT (Yao et al., 2019) learn entity representations from natural language descriptions, and have the potential for…

Computation and Language · Computer Science 2022-03-07 Liang Wang , Wei Zhao , Zhuoyu Wei , Jingming Liu

Graph contrastive learning has gained significant progress recently. However, existing works have rarely explored non-aligned node-node contrasting. In this paper, we propose a novel graph contrastive learning method named RoSA that focuses…

Machine Learning · Computer Science 2022-05-03 Yun Zhu , Jianhao Guo , Fei Wu , Siliang Tang

Contrastive learning on graphs aims at extracting distinguishable high-level representations of nodes. In this paper, we theoretically illustrate that the entropy of a dataset can be approximated by maximizing the lower bound of the mutual…

Machine Learning · Computer Science 2023-07-27 Yixuan Ma , Xiaolin Zhang , Peng Zhang , Kun Zhan

Graph Contrastive Learning (GCL) leverages data augmentation techniques to produce contrasting views, enhancing the accuracy of recommendation systems through learning the consistency between contrastive views. However, existing…

Machine Learning · Computer Science 2024-08-07 Chu Zhao , Enneng Yang , Yuliang Liang , Jianzhe Zhao , Guibing Guo , Xingwei Wang

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

Contrastive learning has been the dominant approach to train state-of-the-art sentence embeddings. Previous studies have typically learned sentence embeddings either through the use of human-annotated natural language inference (NLI) data…

Computation and Language · Computer Science 2023-10-25 Junlei Zhang , Zhenzhong Lan , Junxian He

Graph Contrastive Learning (GCL) has emerged as a promising approach in the realm of graph self-supervised learning. Prevailing GCL methods mainly derive from the principles of contrastive learning in the field of computer vision: modeling…

Machine Learning · Computer Science 2023-08-03 Zhiyuan Ning , Pengfei Wang , Pengyang Wang , Ziyue Qiao , Wei Fan , Denghui Zhang , Yi Du , Yuanchun Zhou

Vector representations of natural language are ubiquitous in search applications. Recently, various methods based on contrastive learning have been proposed to learn textual representations from unlabelled data; by maximizing alignment…

Computation and Language · Computer Science 2023-07-17 Sachin J. Chanchani , Ruihong Huang

In this paper, we propose a hierarchical contrastive learning framework, HiCL, which considers local segment-level and global sequence-level relationships to improve training efficiency and effectiveness. Traditional methods typically…

Computation and Language · Computer Science 2023-10-17 Zhuofeng Wu , Chaowei Xiao , VG Vinod Vydiswaran

Short Text Classification (STC) is crucial for processing and understanding the brief but substantial content prevalent on contemporary digital platforms. The STC encounters difficulties in grasping the semantic and syntactic intricacies,…

Computation and Language · Computer Science 2025-01-22 Hui Wu , Yuanben Zhang , Zhonghe Han , Yingyan Hou , Lei Wang , Siye Liu , Qihang Gong , Yunping Ge

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of…

Machine Learning · Computer Science 2021-07-19 Ming Jin , Yizhen Zheng , Yuan-Fang Li , Chen Gong , Chuan Zhou , Shirui Pan

Inspired by the impressive success of contrastive learning (CL), a variety of graph augmentation strategies have been employed to learn node representations in a self-supervised manner. Existing methods construct the contrastive samples by…

Machine Learning · Computer Science 2022-12-14 Peiyao Zhao , Yuangang Pan , Xin Li , Xu Chen , Ivor W. Tsang , Lejian Liao

Feature quality is paramount for classification performance, particularly in few-shot scenarios. Contrastive learning, a widely adopted technique for enhancing feature quality, leverages sample relations to extract intrinsic features that…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Guowei Yin , Sheng Huang , Luwen Huangfu , Yi Zhang , Xiaohong Zhang

Effective sentence embeddings that capture semantic nuances and generalize well across diverse contexts are crucial for natural language processing tasks. We address this challenge by applying SimCSE (Simple Contrastive Learning of Sentence…

Computation and Language · Computer Science 2025-01-24 Yumeng Wang , Ziran Zhou , Junjin Wang

Graph contrastive learning has achieved great success in pre-training graph neural networks without ground-truth labels. Leading graph contrastive learning follows the classical scheme of contrastive learning, forcing model to identify the…

Machine Learning · Computer Science 2024-12-12 Junran Wu , Xueyuan Chen , Shangzhe Li

Trapped by the label scarcity in molecular property prediction and drug design, graph contrastive learning (GCL) came forward. Leading contrastive learning works show two kinds of view generators, that is, random or learnable data…

Machine Learning · Computer Science 2025-01-16 Xueyuan Chen , Shangzhe Li , Ruomei Liu , Bowen Shi , Jiaheng Liu , Junran Wu , Ke Xu

Graph contrastive learning (GCL) has recently emerged as an effective learning paradigm to alleviate the reliance on labelling information for graph representation learning. The core of GCL is to maximise the mutual information between the…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Yu Zheng , Xiaofei Zhou , Chen Gong , Vincent CS Lee , Shirui Pan

Recent advancements in Graph Contrastive Learning (GCL) have demonstrated remarkable effectiveness in improving graph representations. However, relying on predefined augmentations (e.g., node dropping, edge perturbation, attribute masking)…

Machine Learning · Computer Science 2025-02-27 Khaled Mohammed Saifuddin , Shihao Ji , Esra Akbas

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft
‹ Prev 1 3 4 5 6 7 10 Next ›