English
Related papers

Related papers: Leveraging Contrastive Learning for Enhanced Node …

200 papers

Graph clustering is essential in graph analysis for revealing structural patterns and node communities. Despite recent advances in self-supervised contrastive learning that have improved clustering via structural and attribute signals,…

Machine Learning · Computer Science 2026-05-28 Lei Zhang , Fubo Sun , Haipeng Yang , Zhong Guan , Likang Wu

Graph contrastive learning (GCL), as a popular approach to graph self-supervised learning, has recently achieved a non-negligible effect. To achieve superior performance, the majority of existing GCL methods elaborate on graph data…

Machine Learning · Computer Science 2022-05-03 Yuansheng Wang , Wangbin Sun , Kun Xu , Zulun Zhu , Liang Chen , Zibin Zheng

Graph convolution (GConv) is a widely used technique that has been demonstrated to be extremely effective for graph learning applications, most notably node categorization. On the other hand, many GConv-based models do not quantify the…

Machine Learning · Computer Science 2022-07-27 Zhiqian Chen , Zonghan Zhang

Node representation learning has demonstrated its effectiveness for various applications on graphs. Particularly, recent developments in contrastive learning have led to promising results in unsupervised node representation learning for a…

Machine Learning · Computer Science 2021-06-11 Öykü Deniz Köse , Yanning Shen

Graph Contrastive Learning (GCL) has proven highly effective in promoting the performance of Semi-Supervised Node Classification (SSNC). However, existing GCL methods are generally transferred from other fields like CV or NLP, whose…

Machine Learning · Computer Science 2022-04-28 Deli Chen , Yankai Lin , Lei Li , Xuancheng Ren , Peng Li , Jie Zhou , Xu Sun

Graph representation learning has emerged as a powerful tool for preserving graph topology when mapping nodes to vector representations, enabling various downstream tasks such as node classification and community detection. However, most…

Machine Learning · Computer Science 2025-03-21 Kaizhe Fan , Quanjun Li

Discrete-Time Dynamic Graphs (DTDGs), which are prevalent in real-world implementations and notable for their ease of data acquisition, have garnered considerable attention from both academic researchers and industry practitioners. The…

Machine Learning · Computer Science 2024-07-29 Xi Chen , Yun Xiong , Siwei Zhang , Jiawei Zhang , Yao Zhang , Shiyang Zhou , Xixi Wu , Mingyang Zhang , Tengfei Liu , Weiqiang Wang

We introduce a transformer-based GNN model, named UGformer, to learn graph representations. In particular, we present two UGformer variants, wherein the first variant (publicized in September 2019) is to leverage the transformer on a set of…

Machine Learning · Computer Science 2022-03-09 Dai Quoc Nguyen , Tu Dinh Nguyen , Dinh Phung

Recent progress in pretrained Transformer-based language models has shown great success in learning contextual representation of text. However, due to the quadratic self-attention complexity, most of the pretrained Transformers models can…

Computation and Language · Computer Science 2021-10-22 Peng Xu , Xinchi Chen , Xiaofei Ma , Zhiheng Huang , Bing Xiang

Graph representation learning has long been an important yet challenging task for various real-world applications. However, their downstream tasks are mainly performed in the settings of supervised or semi-supervised learning. Inspired by…

Machine Learning · Computer Science 2021-04-14 Shiyi Chen , Ziao Wang , Xinni Zhang , Xiaofeng Zhang , Dan Peng

Graph Neural Networks (GNNs) are characterized by their capacity of processing graph-structured data. However, due to the sparsity of labels under semi-supervised learning, they have been found to exhibit biased performance on specific…

Machine Learning · Computer Science 2025-12-16 Yihan Zhang

Learning expressive representations for high-dimensional yet sparse features has been a longstanding problem in information retrieval. Though recent deep learning methods can partially solve the problem, they often fail to handle the…

Information Retrieval · Computer Science 2023-05-30 Kaize Ding , Albert Jiongqian Liang , Bryan Perrozi , Ting Chen , Ruoxi Wang , Lichan Hong , Ed H. Chi , Huan Liu , Derek Zhiyuan Cheng

Graph learning methods have been extensively applied in diverse application areas. However, what kind of inherent graph properties e.g. graph proximity, graph structural information has been encoded into graph representation learning for…

Machine Learning · Computer Science 2024-08-08 Mingyu Zhao , Xingyu Huang , Ziyu Lyu , Yanlin Wang , Lixin Cui , Lu Bai

Graph contrastive learning (GCL) has recently achieved substantial advancements. Existing GCL approaches compare two different ``views'' of the same graph in order to learn node/graph representations. The underlying assumption of these…

Machine Learning · Computer Science 2024-01-18 Gehang Zhang , Bowen Yu , Jiangxia Cao , Xinghua Zhang , Jiawei Sheng , Chuan Zhou , Tingwen Liu

Constructing appropriate representations of molecules lies at the core of numerous tasks such as material science, chemistry and drug designs. Recent researches abstract molecules as attributed graphs and employ graph neural networks (GNN)…

Machine Learning · Computer Science 2021-07-29 Jianwen Chen , Shuangjia Zheng , Ying Song , Jiahua Rao , Yuedong Yang

With the rise of contrastive learning, unsupervised graph representation learning has been booming recently, even surpassing the supervised counterparts in some machine learning tasks. Most of existing contrastive models for graph…

Machine Learning · Computer Science 2021-12-16 Chunyang Zhang , Hongyu Yao , C. L. Philip Chen , Yuena Lin

Due to the fact much of today's data can be represented as graphs, there has been a demand for generalizing neural network models for graph data. One recent direction that has shown fruitful results, and therefore growing interest, is the…

Social and Information Networks · Computer Science 2018-08-21 Tyler Derr , Yao Ma , Jiliang Tang

Representation learning on networks aims to derive a meaningful vector representation for each node, thereby facilitating downstream tasks such as link prediction, node classification, and node clustering. In heterogeneous text-rich…

Computation and Language · Computer Science 2023-06-06 Bowen Jin , Yu Zhang , Qi Zhu , Jiawei Han

In recommender systems, most graph-based methods focus on positive user feedback, while overlooking the valuable negative feedback. Integrating both positive and negative feedback to form a signed graph can lead to a more comprehensive…

Information Retrieval · Computer Science 2024-05-07 Sirui Chen , Jiawei Chen , Sheng Zhou , Bohao Wang , Shen Han , Chanfei Su , Yuqing Yuan , Can Wang

Graph Convolutional Networks (GCNs) are predominantly tailored for graphs displaying homophily, where similar nodes connect, but often fail on heterophilic graphs. The strategy of adopting distinct approaches to learn from homophilic and…

Machine Learning · Computer Science 2025-04-09 Han Lei , Jiaxing Xu , Xia Dong , Yiping Ke