English
Related papers

Related papers: Using Graph Algorithms to Pretrain Graph Completio…

200 papers

Graph learning algorithms have attained state-of-the-art performance on many graph analysis tasks such as node classification, link prediction, and clustering. It has, however, become hard to track the field's burgeoning progress. One…

Machine Learning · Computer Science 2022-04-05 Anton Tsitsulin , Benedek Rozemberczki , John Palowitch , Bryan Perozzi

Self-supervised learning is currently gaining a lot of attention, as it allows neural networks to learn robust representations from large quantities of unlabeled data. Additionally, multi-task learning can further improve representation…

Machine Learning · Computer Science 2020-12-07 Franco Manessi , Alessandro Rozza

Graph learning models have demonstrated great prowess in learning expressive representations from large-scale graph data in a wide variety of real-world scenarios. As a prevalent strategy for training powerful graph learning models, the…

Machine Learning · Computer Science 2025-06-11 Xingbo Fu , Zehong Wang , Zihan Chen , Jiazheng Li , Yaochen Zhu , Zhenyu Lei , Cong Shen , Yanfang Ye , Chuxu Zhang , Jundong Li

Recently, graph neural networks (GNNs) have shown its unprecedented success in many graph-related tasks. However, GNNs face the label scarcity issue as other neural networks do. Thus, recent efforts try to pre-train GNNs on a large-scale…

Machine Learning · Computer Science 2024-03-04 Zhili Wang , Shimin Di , Lei Chen , Xiaofang Zhou

Foundation models have shown great promise in various fields of study. A potential application of such models is in computer network traffic analysis, where these models can grasp the complexities of network traffic dynamics and adapt to…

Machine Learning · Computer Science 2024-09-13 Louis Van Langendonck , Ismael Castell-Uroz , Pere Barlet-Ros

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

Despite the prevalence of hypergraphs in a variety of high-impact applications, there are relatively few works on hypergraph representation learning, most of which primarily focus on hyperlink prediction, often restricted to the…

Machine Learning · Computer Science 2021-05-25 Boxin Du , Changhe Yuan , Robert Barton , Tal Neiman , Hanghang Tong

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

Pretraining plays a pivotal role in acquiring generalized knowledge from large-scale data, achieving remarkable successes as evidenced by large models in CV and NLP. However, progress in the graph domain remains limited due to fundamental…

Artificial Intelligence · Computer Science 2024-06-21 Yu Song , Haitao Mao , Jiachen Xiao , Jingzhe Liu , Zhikai Chen , Wei Jin , Carl Yang , Jiliang Tang , Hui Liu

Graphs have become an important modeling tool for web applications, and Graph Neural Networks (GNNs) have achieved great success in graph representation learning. However, the performance of traditional GNNs heavily relies on a large amount…

Machine Learning · Computer Science 2024-06-05 Chenghua Gong , Xiang Li , Jianxiang Yu , Cheng Yao , Jiaqi Tan , Chengcheng Yu

Recently, Graph Neural Networks (GNNs) have proven their effectiveness for recommender systems. Existing studies have applied GNNs to capture collaborative relations in the data. However, in real-world scenarios, the relations in a…

Information Retrieval · Computer Science 2021-11-30 Xiaohan Li , Zhiwei Liu , Stephen Guo , Zheng Liu , Hao Peng , Philip S. Yu , Kannan Achan

Recent years have seen a rise in the development of representational learning methods for graph data. Most of these methods, however, focus on node-level representation learning at various scales (e.g., microscopic, mesoscopic, and…

Machine Learning · Computer Science 2021-11-18 Lili Wang , Chenghan Huang , Weicheng Ma , Xinyuan Cao , Soroush Vosoughi

Self-supervised learning has gradually emerged as a powerful technique for graph representation learning. However, transferable, generalizable, and robust representation learning on graph data still remains a challenge for pre-training…

Machine Learning · Computer Science 2021-12-13 Pengyong Li , Jun Wang , Ziliang Li , Yixuan Qiao , Xianggen Liu , Fei Ma , Peng Gao , Seng Song , Guotong Xie

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

In this thesis, we study the problem of feature learning on heterogeneous knowledge graphs. These features can be used to perform tasks such as link prediction, classification and clustering on graphs. Knowledge graphs provide rich…

Machine Learning · Computer Science 2018-09-11 Sebastian Bischoff

With the rising interest in graph representation learning, a variety of approaches have been proposed to effectively capture a graph's properties. While these approaches have improved performance in graph machine learning tasks compared to…

Machine Learning · Computer Science 2019-10-09 Antonia Gogoglou , C. Bayan Bruss , Keegan E. Hines

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Complex node interactions are common in knowledge graphs, and these interactions also contain rich knowledge information. However, traditional methods usually treat a triple as a training unit during the knowledge representation learning…

Computation and Language · Computer Science 2021-10-01 Bin He , Di Zhou , Jinghui Xiao , Xin jiang , Qun Liu , Nicholas Jing Yuan , Tong Xu

This work presents the use of graph learning for the prediction of multi-step experimental outcomes for applications across experimental research, including material science, chemistry, and biology. The viability of geometric learning for…

Machine Learning · Computer Science 2024-08-13 Amanda A. Volk , Robert W. Epps , Jeffrey G. Ethier , Luke A. Baldwin