English
Related papers

Related papers: Global Self-Attention as a Replacement for Graph C…

200 papers

Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data. However, most GNNs are designed for homogeneous graphs, in which all nodes and edges belong to the same types, making them…

Machine Learning · Computer Science 2020-03-04 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Yizhou Sun

A large number of real-world networks include multiple types of nodes and edges. Graph Neural Network (GNN) emerged as a deep learning framework to generate node and graph embeddings for downstream machine learning tasks. However, popular…

Machine Learning · Computer Science 2024-11-26 Ziynet Nesibe Kesimoglu , Serdar Bozdag

Graph Neural Networks (GNN) have emerged as a popular and standard approach for learning from graph-structured data. The literature on GNN highlights the potential of this evolving research area and its widespread adoption in real-life…

Machine Learning · Computer Science 2024-03-25 Sukhdeep Singh , Anuj Sharma , Vinod Kumar Chauhan

Graph link prediction has long been a central problem in graph representation learning in both network analysis and generative modeling. Recent progress in deep learning has introduced increasingly sophisticated architectures for capturing…

Machine Learning · Computer Science 2025-12-02 Siddhant Karki

Graph generation is a critical task in numerous domains, including molecular design and social network analysis, due to its ability to model complex relationships and structured data. While most modern graph generative models utilize…

Machine Learning · Computer Science 2025-06-04 Xiaohui Chen , Yinkai Wang , Jiaxing He , Yuanqi Du , Soha Hassoun , Xiaolin Xu , Li-Ping Liu

Edge features contain important information about graphs. However, current state-of-the-art neural network models designed for graph learning, e.g. graph convolutional networks (GCN) and graph attention networks (GAT), adequately utilize…

Machine Learning · Computer Science 2019-01-29 Liyu Gong , Qiang Cheng

Transformer attention architectures, similar to those developed for natural language processing, have recently proved efficient also in vision, either in conjunction with or as a replacement for convolutional layers. Typically, visual…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Rufin VanRullen , Andrea Alamia

Graph Convolutional Networks (GCNs) gained traction for graph representation learning, with recent attention on improving performance on heterophilic graphs for various real-world applications. The localized feature aggregation in a typical…

Machine Learning · Computer Science 2025-07-30 Garv Kaushik

Traffic forecasting is a significant part of intelligent transportation systems. One of the critical challenges of traffic forecasting is to find spatio-temporal correlations. In recent years, graph convolutional networks and graph…

Artificial Intelligence · Computer Science 2026-05-19 Tianchi Zhang

Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world…

Machine Learning · Computer Science 2024-11-11 Luis Müller , Daniel Kusuma , Blai Bonet , Christopher Morris

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Graph-based clustering plays an important role in the clustering area. Recent studies about graph convolution neural networks have achieved impressive success on graph type data. However, in general clustering tasks, the graph structure of…

Machine Learning · Computer Science 2024-04-23 Xuelong Li , Hongyuan Zhang , Rui Zhang

Graph Transformers (GTs) have shown strong empirical performance, yet current architectures vary widely in their use of attention mechanisms, positional embeddings (PEs), and expressivity. Existing expressivity results are often tied to…

Machine Learning · Computer Science 2025-11-12 Timo Stoll , Luis Müller , Christopher Morris

Dynamic graph representation learning has emerged as a crucial research area, driven by the growing need for analyzing time-evolving graph data in real-world applications. While recent approaches leveraging recurrent neural networks (RNNs)…

Machine Learning · Computer Science 2024-10-28 Shengxiang Hu , Guobing Zou , Song Yang , Shiyi Lin , Yanglan Gan , Bofeng Zhang

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

Machine Learning · Computer Science 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

Attention mechanisms have become a cornerstone in modern neural networks, driving breakthroughs across diverse domains. However, their application to graph structured data, where capturing topological connections is essential, remains…

Machine Learning · Computer Science 2025-09-19 Xuanting Xie , Bingheng Li , Erlin Pan , Rui Hou , Wenyu Chen , Zhao Kang

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and labels--, and therefore…

Machine Learning · Computer Science 2021-10-26 Liheng Ma , Reihaneh Rabbany , Adriana Romero-Soriano

Spectral graph convolutional neural networks (GCNNs) have been producing encouraging results in graph classification tasks. However, most spectral GCNNs utilize fixed graphs when aggregating node features, while omitting edge feature…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yang Yi , Xuequan Lu , Shang Gao , Antonio Robles-Kelly , Yuejie Zhang

Traffic flow forecasting is a highly challenging task due to the dynamic spatial-temporal road conditions. Graph neural networks (GNN) has been widely applied in this task. However, most of these GNNs ignore the effects of time-varying road…

Machine Learning · Computer Science 2023-07-13 Zhengdao Li , Wei Li , Kai Hwang

Various approaches have been proposed for providing efficient computational approaches for abstract argumentation. Among them, neural networks have permitted to solve various decision problems, notably related to arguments (credulous or…

Artificial Intelligence · Computer Science 2024-09-26 Paul Cibier , Jean-Guy Mailly