English
Related papers

Related papers: ConGraT: Self-Supervised Contrastive Pretraining f…

200 papers

Graph neural networks (GNNs) have been widely applied in the recommendation tasks and have obtained very appealing performance. However, most GNN-based recommendation methods suffer from the problem of data sparsity in practice. Meanwhile,…

Information Retrieval · Computer Science 2021-12-15 Yiqi Wang , Chaozhuo Li , Zheng Liu , Mingzheng Li , Jiliang Tang , Xing Xie , Lei Chen , Philip S. Yu

Node classification on text-attributed graphs (TAGs) is a fundamental task with broad applications in citation analysis, social networks, and recommendation systems. Current GNN-based approaches suffer from shallow text encoding and heavy…

Computation and Language · Computer Science 2026-04-21 Ziqing Wang , Kaize Ding

Graph representation learning nowadays becomes fundamental in analyzing graph-structured data. Inspired by recent success of contrastive methods, in this paper, we propose a novel framework for unsupervised graph representation learning by…

Machine Learning · Computer Science 2020-07-14 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Recently, much exertion has been paid to design graph self-supervised methods to obtain generalized pre-trained models, and adapt pre-trained models onto downstream tasks through fine-tuning. However, there exists an inherent gap between…

Machine Learning · Computer Science 2023-08-16 Yun Zhu , Jianhao Guo , Siliang Tang

The text-attributed graph (TAG) is one kind of important real-world graph-structured data with each node associated with raw texts. For TAGs, traditional few-shot node classification methods directly conduct training on the pre-processed…

Social and Information Networks · Computer Science 2024-07-23 Huanjing Zhao , Beining Yang , Yukuo Cen , Junyu Ren , Chenhui Zhang , Yuxiao Dong , Evgeny Kharlamov , Shu Zhao , Jie Tang

Representation learning on text-attributed graphs (TAGs) has become a critical research problem in recent years. A typical example of a TAG is a paper citation graph, where the text of each paper serves as node attributes. Initial graph…

Machine Learning · Computer Science 2024-03-08 Xiaoxin He , Xavier Bresson , Thomas Laurent , Adam Perold , Yann LeCun , Bryan Hooi

Heterogeneous Graph Neural Networks (HGNNs), have demonstrated excellent capabilities in processing heterogeneous information networks. Self-supervised learning on heterogeneous graphs, especially contrastive self-supervised strategy, shows…

Machine Learning · Computer Science 2025-06-09 Yanbei Liu , Chongxu Wang , Zhitao Xiao , Lei Geng , Yanwei Pang , Xiao Wang

Graph representation learning has emerged as a powerful technique for addressing real-world problems. Various downstream graph learning tasks have benefited from its recent developments, such as node classification, similarity search, and…

Machine Learning · Computer Science 2020-07-03 Jiezhong Qiu , Qibin Chen , Yuxiao Dong , Jing Zhang , Hongxia Yang , Ming Ding , Kuansan Wang , Jie Tang

In recent years, graph neural networks (GNNs) have been widely adopted in the representation learning of graph-structured data and provided state-of-the-art performance in various applications such as link prediction, node classification,…

Machine Learning · Computer Science 2021-04-14 Dasol Hwang , Jinyoung Park , Sunyoung Kwon , Kyung-Min Kim , Jung-Woo Ha , Hyunwoo J. Kim

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

Machine Learning · Computer Science 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

Text classification plays an important role in various downstream text-related tasks, such as sentiment analysis, fake news detection, and public opinion analysis. Recently, text classification based on Graph Neural Networks (GNNs) has made…

Computation and Language · Computer Science 2025-12-24 Zuo Wang , Ye Yuan

Temporal graph learning aims to generate high-quality representations for graph-based tasks with dynamic information, which has recently garnered increasing attention. In contrast to static graphs, temporal graphs are typically organized as…

Machine Learning · Computer Science 2024-04-30 Meng Liu , Ke Liang , Yawei Zhao , Wenxuan Tu , Sihang Zhou , Xinbiao Gan , Xinwang Liu , Kunlun He

To take full advantage of fast-growing unlabeled networked data, this paper introduces a novel self-supervised strategy for graph representation learning by exploiting natural supervision provided by the data itself. Inspired by human…

Machine Learning · Computer Science 2025-11-20 Zhen Peng , Yixiang Dong , Minnan Luo , Xiao-Ming Wu , Qinghua Zheng

The graph with complex annotations is the most potent data type, whose constantly evolving motivates further exploration of the unsupervised dynamic graph representation. One of the representative paradigms is graph contrastive learning. It…

Machine Learning · Computer Science 2024-12-20 Yiming Xu , Bin Shi , Teng Ma , Bo Dong , Haoyi Zhou , Qinghua Zheng

Supervised learning, while prevalent for information cascade modeling, often requires abundant labeled data in training, and the trained model is not easy to generalize across tasks and datasets. It often learns task-specific…

Social and Information Networks · Computer Science 2022-02-22 Xovee Xu , Fan Zhou , Kunpeng Zhang , Siyuan Liu

Self-supervision is recently surging at its new frontier of graph learning. It facilitates graph representations beneficial to downstream tasks; but its success could hinge on domain knowledge for handcraft or the often expensive trials and…

Machine Learning · Computer Science 2022-01-06 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

This paper studies learning on text-attributed graphs (TAGs), where each node is associated with a text description. An ideal solution for such a problem would be integrating both the text and graph structure information with large language…

Machine Learning · Computer Science 2023-03-02 Jianan Zhao , Meng Qu , Chaozhuo Li , Hao Yan , Qian Liu , Rui Li , Xing Xie , Jian Tang

We investigate node representation learning on text-attributed graphs (TAGs), where nodes are associated with text information. Although recent studies on graph neural networks (GNNs) and pretrained language models (PLMs) have exhibited…

Information Retrieval · Computer Science 2024-04-22 Peiyan Zhang , Chaozhuo Li , Liying Kang , Feiran Huang , Senzhang Wang , Xing Xie , Sunghun Kim

Text-attributed graphs (TAGs) are prevalent on the web and research over TAGs such as citation networks, e-commerce networks and social networks has attracted considerable attention in the web community. Recently, large language models…

Computation and Language · Computer Science 2024-03-12 Yijian Qin , Xin Wang , Ziwei Zhang , Wenwu Zhu

Contrastive learning has shown great promise in the field of graph representation learning. By manually constructing positive/negative samples, most graph contrastive learning methods rely on the vector inner product based similarity metric…

Machine Learning · Computer Science 2022-07-27 Yuehui Han , Le Hui , Haobo Jiang , Jianjun Qian , Jin Xie