English
Related papers

Related papers: Graph Transformers for Large Graphs

200 papers

Recently, Transformer model, which has achieved great success in many artificial intelligence fields, has demonstrated its great potential in modeling graph-structured data. Till now, a great variety of Transformers has been proposed to…

Machine Learning · Computer Science 2022-02-18 Erxue Min , Runfa Chen , Yatao Bian , Tingyang Xu , Kangfei Zhao , Wenbing Huang , Peilin Zhao , Junzhou Huang , Sophia Ananiadou , Yu Rong

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

Attention mechanisms have become a cornerstone in modern neural networks, driving breakthroughs across diverse domains. However, their application to graph structured data, where capturing topological connections is essential, remains…

Machine Learning · Computer Science 2025-09-19 Xuanting Xie , Bingheng Li , Erlin Pan , Rui Hou , Wenyu Chen , Zhao Kang

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Graphs have become a central representation in machine learning for capturing relational and structured data across various domains. Traditional graph neural networks often struggle to capture long-range dependencies between nodes due to…

Machine Learning · Computer Science 2025-08-26 Leon Dimitrov

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

Machine Learning · Computer Science 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

The representation learning on textual graph is to generate low-dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph…

Computation and Language · Computer Science 2023-10-10 Junhan Yang , Zheng Liu , Shitao Xiao , Chaozhuo Li , Defu Lian , Sanjay Agrawal , Amit Singh , Guangzhong Sun , Xing Xie

Graph Neural Networks (GNNs) have gained momentum in graph representation learning and boosted the state of the art in a variety of areas, such as data mining (\emph{e.g.,} social network analysis and recommender systems), computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Chaoqi Chen , Yushuang Wu , Qiyuan Dai , Hong-Yu Zhou , Mutian Xu , Sibei Yang , Xiaoguang Han , Yizhou Yu

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Graph representation learning (GRL) methods, such as graph neural networks and graph transformer models, have been successfully used to analyze graph-structured data, mainly focusing on node classification and link prediction tasks.…

Machine Learning · Computer Science 2023-08-21 Van Thuy Hoang , O-Joun Lee

Graph Transformers (GTs) have demonstrated great effectiveness across various graph analytical tasks. However, the existing GTs focus on training and testing graph data originated from the same distribution, but fail to generalize under…

Machine Learning · Computer Science 2026-03-16 Tianyin Liao , Ziwei Zhang , Yufei Sun , Chunyu Hu , Jianxin Li

Graph Transformers (GTs) facilitate the comprehension of graph-structured data by calculating the self-attention of node pairs without considering node position information. To address this limitation, we introduce an innovative and…

Machine Learning · Computer Science 2023-12-12 Kushal Bose , Swagatam Das

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and labels--, and therefore…

Machine Learning · Computer Science 2021-10-26 Liheng Ma , Reihaneh Rabbany , Adriana Romero-Soriano

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems.…

Machine Learning · Computer Science 2024-01-31 Tao Wen , Elynn Chen , Yuzhou Chen

Recently, graph-based and Transformer-based deep learning networks have demonstrated excellent performances on various point cloud tasks. Most of the existing graph methods are based on static graph, which take a fixed input to establish…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Wei Zhou , Qian Wang , Weiwei Jin , Xinzhe Shi , Ying He

We present a novel graph Transformer generative adversarial network (GTGAN) to learn effective graph node relations in an end-to-end fashion for the challenging graph-constrained house generation task. The proposed graph-Transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Hao Tang , Zhenyu Zhang , Humphrey Shi , Bo Li , Ling Shao , Nicu Sebe , Radu Timofte , Luc Van Gool

Graph neural networks (GNNs) have achieved great success in many graph-based applications. However, the enormous size and high sparsity level of graphs hinder their applications under industrial scenarios. Although some scalable GNNs are…

Machine Learning · Computer Science 2022-06-10 Wentao Zhang , Ziqi Yin , Zeang Sheng , Yang Li , Wen Ouyang , Xiaosen Li , Yangyu Tao , Zhi Yang , Bin Cui

Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications. However, the sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs. Although existing Scalable…

Machine Learning · Computer Science 2023-12-13 Xinyi Gao , Wentao Zhang , Junliang Yu , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

Graph neural networks (GNNs) are powerful tools for learning from graph data and are widely used in various applications such as social network recommendation, fraud detection, and graph search. The graphs in these applications are…

Machine Learning · Computer Science 2021-06-14 Jialin Dong , Da Zheng , Lin F. Yang , Geroge Karypis

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh