English
Related papers

Related papers: Graph Ordering Attention Networks

200 papers

Driven by the outstanding performance of neural networks in the structured Euclidean domain, recent years have seen a surge of interest in developing neural networks for graphs and data supported on graphs. The graph is leveraged at each…

Machine Learning · Computer Science 2021-07-28 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

Graph Neural Networks (GNNs) have been widely studied for graph data representation and learning. However, existing GNNs generally conduct context-aware learning on node feature representation only which usually ignores the learning of edge…

Machine Learning · Computer Science 2019-10-07 Bo Jiang , Leiling Wang , Jin Tang , Bin Luo

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Graph Neural Networks (GNNs) have shown expressive performance on graph representation learning by aggregating information from neighbors. Recently, some studies have discussed the importance of modeling neighborhood distribution on the…

Machine Learning · Computer Science 2023-01-31 Wendong Bi , Lun Du , Qiang Fu , Yanlin Wang , Shi Han , Dongmei Zhang

Graph Neural Networks (GNNs) have emerged as promising solutions for collaborative filtering (CF) through the modeling of user-item interaction graphs. The nucleus of existing GNN-based recommender systems involves recursive message passing…

Machine Learning · Computer Science 2024-05-21 Peiyan Zhang , Yuchen Yan , Xi Zhang , Chaozhuo Li , Senzhang Wang , Feiran Huang , Sunghun Kim

Graph neural networks (GNN) have been ubiquitous in graph node classification tasks. Most of GNN methods update the node embedding iteratively by aggregating its neighbors' information. However, they often suffer from negative disturbance,…

Machine Learning · Computer Science 2022-02-02 Jie Chen , Shouzhen Chen , Mingyuan Bai , Jian Pu , Junping Zhang , Junbin Gao

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance in tasks such as node classification and link prediction. However, most existing GNNs are designed to learn…

Machine Learning · Computer Science 2020-02-06 Seongjun Yun , Minbyul Jeong , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph Neural Networks (GNNs) is an architecture for structural data, and has been adopted in a mass of tasks and achieved fabulous results, such as link prediction, node classification, graph classification and so on. Generally, for a…

Machine Learning · Computer Science 2022-05-12 Ye Tang , Xuesong Yang , Xinrui Liu , Xiwei Zhao , Zhangang Lin , Changping Peng

Graph Neural Networks (GNNs) have achieved promising performance in a variety of graph-focused tasks. Despite their success, however, existing GNNs suffer from two significant limitations: a lack of interpretability in their results due to…

Machine Learning · Statistics 2024-11-19 Wenzhuo Zhou , Annie Qu , Keiland W. Cooper , Norbert Fortin , Babak Shahbaba

The Transformer architecture has recently gained considerable attention in the field of graph representation learning, as it naturally overcomes several limitations of Graph Neural Networks (GNNs) with customized attention mechanisms or…

Machine Learning · Computer Science 2025-04-01 Jianqing Liang , Min Chen , Jiye Liang

We introduce Attention Graphs, a new tool for mechanistic interpretability of Graph Neural Networks (GNNs) and Graph Transformers based on the mathematical equivalence between message passing in GNNs and the self-attention mechanism in…

Machine Learning · Computer Science 2025-02-26 Batu El , Deepro Choudhury , Pietro Liò , Chaitanya K. Joshi

In this paper, we present Conjoint Attentions (CAs), a class of novel learning-to-attend strategies for graph neural networks (GNNs). Besides considering the layer-wise node features propagated within the GNN, CAs can additionally…

Machine Learning · Computer Science 2021-12-14 Tiantian He , Yew-Soon Ong , Lu Bai

Graph Transformers (GTs) show considerable potential in graph representation learning. The architecture of GTs typically integrates Graph Neural Networks (GNNs) with global attention mechanisms either in parallel or as a precursor to…

Machine Learning · Computer Science 2026-02-04 Gang Wu , Zhengwei Wang

Graph or network data is ubiquitous in the real world, including social networks, information networks, traffic networks, biological networks and various technical networks. The non-Euclidean nature of graph data poses the challenge for…

Social and Information Networks · Computer Science 2019-09-06 Junjie Huang , Huawei Shen , Liang Hou , Xueqi Cheng

Message Passing Neural Networks have recently become the most popular approach to graph machine learning tasks; however, their receptive field is limited by the number of message passing layers. To increase the receptive field, Graph…

Machine Learning · Computer Science 2026-04-10 Oleg Platonov , Liudmila Prokhorenkova

While the expressive power and computational capabilities of graph neural networks (GNNs) have been theoretically studied, their optimization and learning dynamics, in general, remain largely unexplored. Our study undertakes the Graph…

Machine Learning · Computer Science 2023-10-26 Nimrah Mustafa , Aleksandar Bojchevski , Rebekka Burkholz

Graph Neural Networks (GNNs) are a powerful tool for handling structured graph data and addressing tasks such as node classification, graph classification, and clustering. However, the sparse nature of GNN computation poses new challenges…

Machine Learning · Computer Science 2023-08-24 Julia Bazinska , Andrei Ivanov , Tal Ben-Nun , Nikoli Dryden , Maciej Besta , Siyuan Shen , Torsten Hoefler

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Online continual learning for image classification is crucial for models to adapt to new data while retaining knowledge of previously learned tasks. This capability is essential to address real-world challenges involving dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Adjovi Sim , Zhengkui Wang , Aik Beng Ng , Shalini De Mello , Simon See , Wonmin Byeon