English
Related papers

Related papers: Graph Attention Retrospective

200 papers

Graph neural networks (GNNs) have garnered significant attention due to their ability to represent graph data. Among various GNN variants, graph attention network (GAT) stands out since it is able to dynamically learn the importance of…

Machine Learning · Computer Science 2024-08-19 Tiqiao Wei , Ye Yuan

The exploitation of graph structures is the key to effectively learning representations of nodes that preserve useful information in graphs. A remarkable property of graph is that a latent hierarchical grouping of nodes exists in a global…

Artificial Intelligence · Computer Science 2021-11-02 Lu Lin , Ethan Blaser , Hongning Wang

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

Machine Learning · Computer Science 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node classification, link…

Machine Learning · Computer Science 2021-04-13 Yang Ye , Shihao Ji

Graph Convolutional Networks (GCNs) are one of the most popular architectures that are used to solve classification problems accompanied by graphical information. We present a rigorous theoretical understanding of the effects of graph…

Machine Learning · Computer Science 2022-08-03 Aseem Baranwal , Kimon Fountoulakis , Aukosh Jagannath

Edge features contain important information about graphs. However, current state-of-the-art neural network models designed for graph learning, e.g. graph convolutional networks (GCN) and graph attention networks (GAT), adequately utilize…

Machine Learning · Computer Science 2019-01-29 Liyu Gong , Qiang Cheng

Graph neural networks (GNNs) aim to learn well-trained representations in a lower-dimension space for downstream tasks while preserving the topological structures. In recent years, attention mechanism, which is brilliant in the fields of…

Social and Information Networks · Computer Science 2026-05-12 Chengcheng Sun , Chenhao Li , Xiang Lin , Tianji Zheng , Fanrong Meng , Xiaobin Rui , Zhixiao Wang

Attention mechanism in graph neural networks is designed to assign larger weights to important neighbor nodes for better representation. However, what graph attention learns is not understood well, particularly when graphs are noisy. In…

Machine Learning · Computer Science 2022-04-12 Dongkwan Kim , Alice Oh

In colored graphs, node classes are often associated with either their neighbors class or with information not incorporated in the graph associated with each node. We here propose that node classes are also associated with topological…

Social and Information Networks · Computer Science 2019-11-19 Roy Abel , Idan Benami , Yoram Louzoun

Graph Convolutional Networks (GCN) have been effective at tasks that have rich relational structure and can preserve global structure information of a dataset in graph embeddings. Recently, many researchers focused on examining whether GCNs…

Computation and Language · Computer Science 2022-03-31 Soyeon Caren Han , Zihan Yuan , Kunze Wang , Siqu Long , Josiah Poon

Graph neural networks (GNNs) learn the representation of graph-structured data, and their expressiveness can be further enhanced by inferring node relations for propagation. Attention-based GNNs infer neighbor importance to manipulate the…

Machine Learning · Computer Science 2023-06-06 Soo Yong Lee , Fanchen Bu , Jaemin Yoo , Kijung Shin

Recently popularized graph neural networks achieve the state-of-the-art accuracy on a number of standard benchmark datasets for graph-based semi-supervised learning, improving significantly over existing approaches. These architectures…

Machine Learning · Statistics 2018-03-13 Kiran K. Thekumparampil , Chong Wang , Sewoong Oh , Li-Jia Li

Recently there has been increased interest in semi-supervised classification in the presence of graphical information. A new class of learning models has emerged that relies, at its most basic level, on classifying the data after first…

Machine Learning · Computer Science 2022-02-07 Aseem Baranwal , Kimon Fountoulakis , Aukosh Jagannath

The graph identification problem consists of discovering the interactions among nodes in a network given their state/feature trajectories. This problem is challenging because the behavior of a node is coupled to all the other nodes by the…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Eduardo Sebastian , Thai Duong , Nikolay Atanasov , Eduardo Montijano , Carlos Sagues

Graph classification is a problem with practical applications in many different domains. Most of the existing methods take the entire graph into account when calculating graph features. In a graphlet-based approach, for instance, the entire…

Machine Learning · Computer Science 2017-09-20 John Boaz Lee , Ryan Rossi , Xiangnan Kong

Graph neural networks have become the standard approach for dealing with learning problems on graphs. Among the different variants of graph neural networks, graph attention networks (GATs) have been applied with great success to different…

Machine Learning · Computer Science 2023-07-18 Michail Chatzianastasis , Giannis Nikolentzos , Michalis Vazirgiannis

Node classification in graphs aims to predict the categories of unlabeled nodes by utilizing a small set of labeled nodes. However, weighted graphs often contain noisy edges and anomalous edge weights, which can distort fine-grained…

Machine Learning · Computer Science 2025-04-01 Tingting Wang , Jiaxin Su , Haobing Liu , Ruobing Jiang

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to…

Machine Learning · Statistics 2019-04-02 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

Noise and inconsistency commonly exist in real-world information networks, due to inherent error-prone nature of human or user privacy concerns. To date, tremendous efforts have been made to advance feature learning from networks, including…

Machine Learning · Computer Science 2019-12-30 Min Shi , Yufei Tang , Xingquan Zhu , Jianxun Liu

Graph neural networks (GNNs) have achieved great success in many scenarios with graph-structured data. However, in many real applications, there are three issues when applying GNNs: graphs are unknown, nodes have noisy features, and graphs…

Machine Learning · Computer Science 2022-10-11 Yixiang Shan , Jielong Yang , Xing Liu , Yixing Gao , Hechang Chen , Shuzhi Sam Ge