English
Related papers

Related papers: Focus Where It Matters: Graph Selective State Focu…

200 papers

We present an attention-based spatial graph convolution (AGC) for graph neural networks (GNNs). Existing AGCs focus on only using node-wise features and utilizing one type of attention function when calculating attention weights. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Li , Yuichi Tanaka

The graph structure is a commonly used data storage mode, and it turns out that the low-dimensional embedded representation of nodes in the graph is extremely useful in various typical tasks, such as node classification, link prediction ,…

Social and Information Networks · Computer Science 2020-08-03 Xing Li , Wei Wei , Xiangnan Feng , Xue Liu , Zhiming Zheng

This paper studies four Graph Neural Network architectures (GNNs) for a graph classification task on a synthetic dataset created using classic generative models of Network Science. Since the synthetic networks do not contain (node or edge)…

Social and Information Networks · Computer Science 2024-01-12 Walid Guettala , László Gulyás

Graph Neural Networks (GNNs) have become increasingly popular for effectively modeling graph-structured data, and attention mechanisms have been pivotal in enabling these models to capture complex patterns. In our study, we reveal a…

Machine Learning · Computer Science 2025-03-10 Lorenzo Bini , Marco Sorbi , Stephane Marchand-Maillet

The crux of graph classification lies in the effective representation learning for the entire graph. Typical graph neural networks focus on modeling the local dependencies when aggregating features of neighboring nodes, and obtain the…

Machine Learning · Computer Science 2024-01-02 Wenjie Pei , Weina Xu , Zongze Wu , Weichao Li , Jinfan Wang , Guangming Lu , Xiangrong Wang

Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e.g., as can occur as a result of…

Machine Learning · Computer Science 2021-12-06 Yongyi Yang , Tang Liu , Yangkun Wang , Jinjing Zhou , Quan Gan , Zhewei Wei , Zheng Zhang , Zengfeng Huang , David Wipf

Graphs are useful for representing various realworld objects. However, graph neural networks (GNNs) tend to suffer from over-smoothing, where the representations of nodes of different classes become similar as the number of layers…

Machine Learning · Computer Science 2024-10-22 Jun Kato , Airi Mita , Keita Gobara , Akihiro Inokuchi

We propose a new network architecture, Gated Attention Networks (GaAN), for learning on graphs. Unlike the traditional multi-head attention mechanism, which equally consumes all attention heads, GaAN uses a convolutional sub-network to…

Machine Learning · Computer Science 2018-03-21 Jiani Zhang , Xingjian Shi , Junyuan Xie , Hao Ma , Irwin King , Dit-Yan Yeung

Graph Convolutional Networks (GCNs) have recently become the primary choice for learning from graph-structured data, superseding hash fingerprints in representing chemical compounds. However, GCNs lack the ability to take into account the…

Machine Learning · Computer Science 2020-07-03 Tomasz Danel , Przemysław Spurek , Jacek Tabor , Marek Śmieja , Łukasz Struski , Agnieszka Słowik , Łukasz Maziarka

Graph neural networks (GNNs) model representations from networked data and allow for decentralized inference through localized communications. Existing GNN architectures often assume ideal communications and ignore potential channel…

Signal Processing · Electrical Eng. & Systems 2024-05-22 Zhan Gao , Deniz Gunduz

Graph neural networks (GNNs) have been widely used in various graph-related problems such as node classification and graph classification, where superior performance is mainly established when natural node features are available. However,…

Machine Learning · Computer Science 2022-09-12 Hejie Cui , Zijie Lu , Pan Li , Carl Yang

Whilst spectral Graph Neural Networks (GNNs) are theoretically well-founded in the spectral domain, their practical reliance on polynomial approximation implies a profound linkage to the spatial domain. As previous studies rarely examine…

Machine Learning · Computer Science 2024-09-17 Jingwei Guo , Kaizhu Huang , Xinping Yi , Zixian Su , Rui Zhang

Graph Neural Networks have become one of the indispensable tools to learn from graph-structured data, and their usefulness has been shown in wide variety of tasks. In recent years, there have been tremendous improvements in architecture…

Machine Learning · Statistics 2021-11-15 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

In this work, we propose a methodology for investigating the use of semantic attention to enhance the explainability of Graph Neural Network (GNN)-based models. Graph Deep Learning (GDL) has emerged as a promising field for tasks like scene…

Machine Learning · Computer Science 2023-10-24 Efimia Panagiotaki , Daniele De Martini , Lars Kunze

Graph Neural Networks (GNNs) are powerful to learn the representation of graph-structured data. Most of the GNNs use the message-passing scheme, where the embedding of a node is iteratively updated by aggregating the information of its…

Machine Learning · Computer Science 2020-07-28 Shuo Zhang , Lei Xie

Graph Convolutional Networks (GCNs) have gained great popularity in tackling various analytics tasks on graph and network data. However, some recent studies raise concerns about whether GCNs can optimally integrate node features and…

Machine Learning · Computer Science 2020-07-14 Xiao Wang , Meiqi Zhu , Deyu Bo , Peng Cui , Chuan Shi , Jian Pei

Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce…

Machine Learning · Computer Science 2022-03-29 Zhihao Wen , Yuan Fang , Zemin Liu

Fault location in distribution grids is critical for reliability and minimizing outage durations. Yet, it remains challenging due to partial observability, given sparse measurement infrastructure. Recent works show promising results by…

Machine Learning · Computer Science 2026-05-11 Burak Karabulut , Carlo Manna , Chris Develder

Modern graph neural networks (GNNs) can be sensitive to changes in the input graph structure and node features, potentially resulting in unpredictable behavior and degraded performance. In this work, we introduce a spectral framework known…

Machine Learning · Computer Science 2024-10-11 Wuxinlin Cheng , Chenhui Deng , Ali Aghdaei , Zhiru Zhang , Zhuo Feng

Graph Neural Networks (GNNs) have become the state-of-the-art method for many applications on graph structured data. GNNs are a model for graph representation learning, which aims at learning to generate low dimensional node embeddings that…

Machine Learning · Computer Science 2022-05-23 Davide Buffelli , Fabio Vandin