English
Related papers

Related papers: Optimization and Interpretability of Graph Attenti…

200 papers

We propose the joint graph attention neural network (GAT), clustering with adaptive neighbors (CAN) and probabilistic graphical model for dynamic power flow analysis and fault characteristics. In fact, computational efficiency is the main…

Machine Learning · Computer Science 2025-03-25 Tan Le , Van Le

Lots of neural network architectures have been proposed to deal with learning tasks on graph-structured data. However, most of these models concentrate on only node features during the learning process. The edge features, which usually play…

Machine Learning · Computer Science 2021-01-20 Jun Chen , Haopeng Chen

Graph Neural Networks (GNNs) have been widely studied for graph data representation and learning. However, existing GNNs generally conduct context-aware learning on node feature representation only which usually ignores the learning of edge…

Machine Learning · Computer Science 2019-10-07 Bo Jiang , Leiling Wang , Jin Tang , Bin Luo

With the growing use of deep learning methods, particularly graph neural networks, which encode intricate interconnectedness information, for a variety of real tasks, there is a necessity for explainability in such settings. In this paper,…

Machine Learning · Computer Science 2022-11-04 Harsh Patel , Shivam Sahni

One of the main challenges in managing traffic at multilane intersections is ensuring smooth coordination between human-driven vehicles (HDVs) and connected autonomous vehicles (CAVs). This paper presents a novel traffic signal control…

Multiagent Systems · Computer Science 2025-11-05 Manonmani Sekar , Nasim Nezamoddini

The success of motion prediction for autonomous driving relies on integration of information from the HD maps. As maps are naturally graph-structured, investigation on graph neural networks (GNNs) for encoding HD maps is burgeoning in…

Artificial Intelligence · Computer Science 2022-09-07 Fang Da , Yu Zhang

Despite the growing popularity of graph attention mechanisms, their theoretical understanding remains limited. This paper aims to explore the conditions under which these mechanisms are effective in node classification tasks through the…

Machine Learning · Computer Science 2025-05-14 Zhongtian Ma , Qiaosheng Zhang , Bocheng Zhou , Yexin Zhang , Shuyue Hu , Zhen Wang

Variants of Graph Neural Networks (GNNs) for representation learning have been proposed recently and achieved fruitful results in various fields. Among them, Graph Attention Network (GAT) first employs a self-attention strategy to learn…

Machine Learning · Computer Science 2021-07-28 Heng Chang , Yu Rong , Tingyang Xu , Wenbing Huang , Somayeh Sojoudi , Junzhou Huang , Wenwu Zhu

We propose a new network architecture, Gated Attention Networks (GaAN), for learning on graphs. Unlike the traditional multi-head attention mechanism, which equally consumes all attention heads, GaAN uses a convolutional sub-network to…

Machine Learning · Computer Science 2018-03-21 Jiani Zhang , Xingjian Shi , Junyuan Xie , Hao Ma , Irwin King , Dit-Yan Yeung

Traffic forecasting is one canonical example of spatial-temporal learning task in Intelligent Traffic System. Existing approaches capture spatial dependency with a pre-determined matrix in graph convolution neural operators. However, the…

Machine Learning · Computer Science 2022-06-08 Chen Weikang , Li Yawen , Xue Zhe , Li Ang , Wu Guobin

Graph Attention Network (GAT) is a graph neural network which is one of the strategies for modeling and representing explicit syntactic knowledge and can work with pre-trained models, such as BERT, in downstream tasks. Currently, there is…

Computation and Language · Computer Science 2023-05-24 Yuqian Dai , Serge Sharoff , Marc de Kamps

Graph Neural Networks (GNN) has demonstrated the superior performance in many challenging applications, including the few-shot learning tasks. Despite its powerful capacity to learn and generalize the model from few samples, GNN usually…

Machine Learning · Computer Science 2020-10-05 Hao Cheng , Joey Tianyi Zhou , Wee Peng Tay , Bihan Wen

Graphs have become a central representation in machine learning for capturing relational and structured data across various domains. Traditional graph neural networks often struggle to capture long-range dependencies between nodes due to…

Machine Learning · Computer Science 2025-08-26 Leon Dimitrov

Linear attention mechanisms have emerged as efficient alternatives to full self-attention in Graph Transformers, offering linear time complexity. However, existing linear attention models often suffer from a significant drop in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Zhaolin Hu , Kun Li , Hehe Fan , Yi Yang

Graph classification is a problem with practical applications in many different domains. Most of the existing methods take the entire graph into account when calculating graph features. In a graphlet-based approach, for instance, the entire…

Machine Learning · Computer Science 2017-09-20 John Boaz Lee , Ryan Rossi , Xiangnan Kong

Currently, attention mechanisms have garnered increasing attention in Graph Neural Networks (GNNs), such as Graph Attention Networks (GATs) and Graph Transformers (GTs). It is not only due to the commendable boost in performance they offer…

Machine Learning · Computer Science 2024-10-10 Lijie Hu , Tianhao Huang , Lu Yu , Wanyu Lin , Tianhang Zheng , Di Wang

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Few-shot Knowledge Graph (KG) completion is a focus of current research, where each task aims at querying unseen facts of a relation given its few-shot reference entity pairs. Recent attempts solve this problem by learning static…

Computation and Language · Computer Science 2021-07-06 Jiawei Sheng , Shu Guo , Zhenyu Chen , Juwei Yue , Lihong Wang , Tingwen Liu , Hongbo Xu

Graph attention networks learn neighbor importance through data-dependent coefficients, but standard layers lack explicit control over unreliable feature dimensions and use fixed sharpness of attention coefficient distributions. This paper…

Machine Learning · Computer Science 2026-05-29 Zhongtian Ma , Hao Wu , Yexin Zhang , Qiaosheng Zhang , Zhen Wang

Auto-encoders have emerged as a successful framework for unsupervised learning. However, conventional auto-encoders are incapable of utilizing explicit relations in structured data. To take advantage of relations in graph-structured data,…

Machine Learning · Computer Science 2019-05-28 Amin Salehi , Hasan Davulcu