English
Related papers

Related papers: Graph-level Protein Representation Learning by Str…

200 papers

Large Language Models (LLMs) adapted via contrastive learning excel in general representation learning but struggle in vertical domains like chemistry and law, primarily due to a lack of domain-specific knowledge. This work identifies a…

Information Retrieval · Computer Science 2026-01-19 Xiaoyu Liang , Yuchen Peng , Jiale Luo , Wenhao Wang , Haoji Hu , Xincheng Zhou

Graph classification is a pivotal challenge in machine learning, especially within the realm of graph-based data, given its importance in numerous real-world applications such as social network analysis, recommendation systems, and…

Machine Learning · Computer Science 2024-07-03 Bowen Zhang , Zhichao Huang , Genan Dai , Guangning Xu , Xiaomao Fan , Hu Huang

Graph neural networks (GNNs) have limited expressive power, failing to represent many graph classes correctly. While more expressive graph representation learning (GRL) alternatives can distinguish some of these classes, they are…

Machine Learning · Computer Science 2021-12-08 Leonardo Cotta , Christopher Morris , Bruno Ribeiro

Graph Contrastive Learning (GCL) aims to learn node representations by aligning positive pairs and separating negative ones. However, few of researchers have focused on the inner law behind specific augmentations used in graph-based…

Machine Learning · Computer Science 2024-12-25 Jingyu Liu , Huayi Tang , Yong Liu

Contrastive deep graph clustering (CDGC) leverages the power of contrastive learning to group nodes into different clusters. The quality of contrastive samples is crucial for achieving better performance, making augmentation techniques a…

Machine Learning · Computer Science 2024-08-07 Xihong Yang , Erxue Min , Ke Liang , Yue Liu , Siwei Wang , Sihang Zhou , Huijun Wu , Xinwang Liu , En Zhu

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

Machine Learning · Computer Science 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

Contrastive learning (CL) has emerged as a powerful framework for learning representations of images and text in a self-supervised manner while enhancing model robustness against adversarial attacks. More recently, researchers have extended…

Machine Learning · Computer Science 2023-12-04 Filippo Guerranti , Zinuo Yi , Anna Starovoit , Rafiq Kamel , Simon Geisler , Stephan Günnemann

Deep Neural Networks have shown tremendous success in the area of object recognition, image classification and natural language processing. However, designing optimal Neural Network architectures that can learn and output arbitrary graphs…

Machine Learning · Computer Science 2019-07-02 Mital Kinderkhedia

We present the SCR framework for enhancing the training of graph neural networks (GNNs) with consistency regularization. Regularization is a set of strategies used in Machine Learning to reduce overfitting and improve the generalization…

Social and Information Networks · Computer Science 2022-06-14 Chenhui Zhang , Yufei He , Yukuo Cen , Zhenyu Hou , Wenzheng Feng , Yuxiao Dong , Xu Cheng , Hongyun Cai , Feng He , Jie Tang

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past…

Machine Learning · Computer Science 2023-04-25 Lin Shu , Chuan Chen , Zibin Zheng

Benefiting from the effectiveness of graph neural networks (GNNs) and contrastive learning, GNN-based contrastive learning has become mainstream for knowledge-aware recommendation. However, most existing contrastive learning-based methods…

Information Retrieval · Computer Science 2025-05-14 Shengyin Sun , Chen Ma

Knowledge representation learning (KRL) aims to represent entities and relations in knowledge graph in low-dimensional semantic space, which have been widely used in massive knowledge-driven tasks. In this article, we introduce the reader…

Computation and Language · Computer Science 2018-12-31 Yankai Lin , Xu Han , Ruobing Xie , Zhiyuan Liu , Maosong Sun

Graph representation learning (GRL) is a fundamental task in machine learning, aiming to encode high-dimensional graph-structured data into low-dimensional vectors. Self-supervised learning (SSL) methods are widely used in GRL because they…

Machine Learning · Computer Science 2024-11-12 Shifeng Xie , Jhony H. Giraldo

In recent years, methods that combine contrastive learning with graph neural networks have emerged to address the challenges of recommendation systems, demonstrating powerful performance and playing a significant role in this domain.…

Information Retrieval · Computer Science 2025-09-08 Hao Chen , Wenming Ma , Zihao Chu , Mingqi Li

Graph representation learning has emerged as a cornerstone for tasks like node classification and link prediction, yet prevailing self-supervised learning (SSL) methods face challenges such as computational inefficiency, reliance on…

Machine Learning · Computer Science 2025-09-04 Srinitish Srinivasan , Omkumar CU

Leveraging domain knowledge including fingerprints and functional groups in molecular representation learning is crucial for chemical property prediction and drug discovery. When modeling the relation between graph structure and molecular…

Machine Learning · Computer Science 2021-03-25 Yin Fang , Haihong Yang , Xiang Zhuang , Xin Shao , Xiaohui Fan , Huajun Chen

Graph Representation Learning (GRL) has experienced significant progress as a means to extract structural information in a meaningful way for subsequent learning tasks. Current approaches including shallow embeddings and Graph Neural…

Machine Learning · Computer Science 2020-06-19 Antonia Gogoglou , C. Bayan Bruss , Brian Nguyen , Reza Sarshogh , Keegan E. Hines

Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus…

Social and Information Networks · Computer Science 2021-08-12 Changshu Liu , Liangjian Wen , Zhao Kang , Guangchun Luo , Ling Tian

Graph Contrastive Learning (GCL) has shown promising performance in graph representation learning (GRL) without the supervision of manual annotations. GCL can generate graph-level embeddings by maximizing the Mutual Information (MI) between…

Machine Learning · Computer Science 2022-05-25 Jiawei Sun , Ruoxin Chen , Jie Li , Chentao Wu , Yue Ding , Junchi Yan