English
Related papers

Related papers: How Attentive are Graph Attention Networks?

200 papers

We present graph attention networks (GATs), novel neural network architectures that operate on graph-structured data, leveraging masked self-attentional layers to address the shortcomings of prior methods based on graph convolutions or…

Machine Learning · Statistics 2018-02-06 Petar Veličković , Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Liò , Yoshua Bengio

While the expressive power and computational capabilities of graph neural networks (GNNs) have been theoretically studied, their optimization and learning dynamics, in general, remain largely unexplored. Our study undertakes the Graph…

Machine Learning · Computer Science 2023-10-26 Nimrah Mustafa , Aleksandar Bojchevski , Rebekka Burkholz

For automotive applications, the Graph Attention Network (GAT) is a prominently used architecture to include relational information of a traffic scenario during feature embedding. As shown in this work, however, one of the most popular GAT…

Machine Learning · Computer Science 2023-05-26 Marion Neumeier , Andreas Tollkühn , Sebastian Dorn , Michael Botsch , Wolfgang Utschick

Graph neural networks (GNNs) have garnered significant attention due to their ability to represent graph data. Among various GNN variants, graph attention network (GAT) stands out since it is able to dynamically learn the importance of…

Machine Learning · Computer Science 2024-08-19 Tiqiao Wei , Ye Yuan

Graph Attention Networks (GATs) have emerged as powerful models for learning expressive representations from such data by adaptively weighting neighboring nodes through attention mechanisms. However, most existing approaches primarily rely…

Machine Learning · Computer Science 2026-02-05 Farshad Noravesh , Reza Haffari , Layki Soon , Arghya Pal

Graph Attention Networks (GATs) have been intensively studied and widely used in graph data learning tasks. Existing GATs generally adopt the self-attention mechanism to conduct graph edge attention learning, requiring expensive…

Neural and Evolutionary Computing · Computer Science 2022-09-28 Beibei Wang , Bo Jiang

Graph attention networks (GATs) provide one of the best frameworks for learning node representations in relational data; but, existing variants such as Graph Attention Network (GAT) mainly operate on static graphs and rely on implicit…

Machine Learning · Computer Science 2026-04-14 Ami Chopra , Supriya Bordoloi , Shyamanta M. Hazarika

Existing Graph Neural Networks (GNNs) compute the message exchange between nodes by either aggregating uniformly (convolving) the features of all the neighboring nodes, or by applying a non-uniform score (attending) to the features. Recent…

Machine Learning · Computer Science 2023-03-02 Adrián Javaloy , Pablo Sanchez-Martin , Amit Levi , Isabel Valera

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Graph attention networks (GATs) are powerful tools for analyzing graph data from various real-world scenarios. To learn representations for downstream tasks, GATs generally attend to all neighbors of the central node when aggregating the…

Machine Learning · Computer Science 2022-10-31 Tiantian He , Haicang Zhou , Yew-Soon Ong , Gao Cong

Graph neural networks have become the standard approach for dealing with learning problems on graphs. Among the different variants of graph neural networks, graph attention networks (GATs) have been applied with great success to different…

Machine Learning · Computer Science 2023-07-18 Michail Chatzianastasis , Giannis Nikolentzos , Michalis Vazirgiannis

Graph Neural Networks (GNNs) have shown tremendous strides in performance for graph-structured problems especially in the domains of natural language processing, computer vision and recommender systems. Inspired by the success of the…

Machine Learning · Computer Science 2022-06-08 Kaustubh D. Dhole , Carl Yang

As one of the most popular GNN architectures, the graph attention networks (GAT) is considered the most advanced learning architecture for graph representation and has been widely used in various graph mining tasks with impressive results.…

Machine Learning · Computer Science 2023-01-18 Jingbo Zhou , Yixuan Du , Ruqiong Zhang , Rui Zhang

Graph Attention Networks(GATs) are useful deep learning models to deal with the graph data. However, recent works show that the classical GAT is vulnerable to adversarial attacks. It degrades dramatically with slight perturbations.…

Machine Learning · Computer Science 2022-08-05 Xianchen Zhou , Yaoyun Zeng , Hongxia Wang

Graph Attention Network (GAT) focuses on modelling simple undirected and single relational graph data only. This limits its ability to deal with more general and complex multi-relational graphs that contain entities with directed links of…

Artificial Intelligence · Computer Science 2021-09-14 Meiqi Chen , Yuan Zhang , Xiaoyu Kou , Yuntao Li , Yan Zhang

Machine learning models that can exploit the inherent structure in data have gained prominence. In particular, there is a surge in deep learning solutions for graph-structured data, due to its wide-spread applicability in several fields.…

Machine Learning · Computer Science 2020-02-12 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Andreas Spanias

Graph neural networks (GNNs) aim to learn well-trained representations in a lower-dimension space for downstream tasks while preserving the topological structures. In recent years, attention mechanism, which is brilliant in the fields of…

Social and Information Networks · Computer Science 2026-05-12 Chengcheng Sun , Chenhao Li , Xiang Lin , Tianji Zheng , Fanrong Meng , Xiaobin Rui , Zhixiao Wang

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node classification, link…

Machine Learning · Computer Science 2021-04-13 Yang Ye , Shihao Ji

Graph Attention Network (GAT) and GraphSAGE are neural network architectures that operate on graph-structured data and have been widely studied for link prediction and node classification. One challenge raised by GraphSAGE is how to smartly…

Machine Learning · Computer Science 2020-06-09 Anderson de Andrade , Chen Liu

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and labels--, and therefore…

Machine Learning · Computer Science 2021-10-26 Liheng Ma , Reihaneh Rabbany , Adriana Romero-Soriano
‹ Prev 1 2 3 10 Next ›