English
Related papers

Related papers: A Bird's-Eye Tutorial of Graph Attention Architect…

200 papers

Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-smoothing and over-squashing. Recent studies have proposed…

Machine Learning · Computer Science 2025-02-28 Chaohao Yuan , Kangfei Zhao , Ercan Engin Kuruoglu , Liang Wang , Tingyang Xu , Wenbing Huang , Deli Zhao , Hong Cheng , Yu Rong

Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well…

Hardware Architecture · Computer Science 2021-12-28 Zhihui Zhang , Jingwen Leng , Lingxiao Ma , Youshan Miao , Chao Li , Minyi Guo

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Graph Neural Networks (GNNs) have risen to prominence in learning representations for graph structured data. A single GNN layer typically consists of a feature transformation and a feature aggregation operation. The former normally uses…

Machine Learning · Computer Science 2021-10-19 Yao Ma , Xiaorui Liu , Tong Zhao , Yozen Liu , Jiliang Tang , Neil Shah

Graph Neural Networks (GNNs) are powerful tools in representation learning for graphs. However, recent studies show that GNNs are vulnerable to carefully-crafted perturbations, called adversarial attacks. Adversarial attacks can easily fool…

Machine Learning · Computer Science 2020-06-30 Wei Jin , Yao Ma , Xiaorui Liu , Xianfeng Tang , Suhang Wang , Jiliang Tang

Graph Convolutional Networks (GCNs) are a popular method from graph representation learning that have proved effective for tasks like node classification tasks. Although typical GCN models focus on classifying nodes within a static graph,…

Machine Learning · Computer Science 2021-10-13 Yucai Fan , Yuhang Yao , Carlee Joe-Wong

Graph Neural Networks (GNNs) are increasingly important given their popularity and the diversity of applications. Yet, existing studies of their vulnerability to adversarial attacks rely on relatively small graphs. We address this gap and…

Machine Learning · Computer Science 2023-05-02 Simon Geisler , Tobias Schmidt , Hakan Şirin , Daniel Zügner , Aleksandar Bojchevski , Stephan Günnemann

Graphs have become a central representation in machine learning for capturing relational and structured data across various domains. Traditional graph neural networks often struggle to capture long-range dependencies between nodes due to…

Machine Learning · Computer Science 2025-08-26 Leon Dimitrov

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

Machine Learning · Computer Science 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

In this paper, we design Graph Neural Networks (GNNs) with attention mechanisms to tackle an important yet challenging nonlinear regression problem: massive network localization. We first review our previous network localization method…

Machine Learning · Computer Science 2025-04-08 Wenzhong Yan , Feng Yin , Juntao Wang , Geert Leus , Abdelhak M. Zoubir , Yang Tian

Graph Neural Networks (GNNs) are neural models that leverage the dependency structure in graphical data via message passing among the graph nodes. GNNs have emerged as pivotal architectures in analyzing graph-structured data, and their…

Machine Learning · Computer Science 2024-03-19 Xu Zheng , Farhad Shirani , Tianchun Wang , Wei Cheng , Zhuomin Chen , Haifeng Chen , Hua Wei , Dongsheng Luo

As large-scale graphs become more widespread, more and more computational challenges with extracting, processing, and interpreting large graph data are being exposed. It is therefore natural to search for ways to summarize these expansive…

Machine Learning · Computer Science 2024-01-05 Nasrin Shabani , Jia Wu , Amin Beheshti , Quan Z. Sheng , Jin Foo , Venus Haghighi , Ambreen Hanif , Maryam Shahabikargar

This paper is devoted to signal processing on point-clouds by means of neural networks. Nowadays, state-of-the-art in image processing and computer vision is mostly based on training deep convolutional neural networks on large datasets.…

Machine Learning · Computer Science 2021-04-06 Amitoz Azad , Julien Rabin , Abderrahim Elmoataz

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

Machine Learning · Computer Science 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

Graph neural networks (GNNs) have attracted increasing attention due to their superior performance in deep learning on graph-structured data. GNNs have succeeded across various domains such as social networks, chemistry, and electronic…

Cryptography and Security · Computer Science 2022-08-19 Lilas Alrahis , Satwik Patnaik , Muhammad Shafique , Ozgur Sinanoglu

Graph Neural Networks (GNNs) have emerged as powerful representation learning tools for capturing complex dependencies within diverse graph-structured data. Despite their success in a wide range of graph mining tasks, GNNs have raised…

Machine Learning · Computer Science 2024-06-19 Wenzhao Jiang , Hao Liu , Hui Xiong

The graph neural network (GNN) has demonstrated its superior performance in various applications. The working mechanism behind it, however, remains mysterious. GNN models are designed to learn effective representations for graph-structured…

Machine Learning · Computer Science 2022-06-10 Zepeng Zhang , Ziping Zhao

Recent graph neural networks (GNNs) with the attention mechanism have historically been limited to small-scale homogeneous graphs (HoGs). However, GNNs handling heterogeneous graphs (HeGs), which contain several entity and relation types,…

Machine Learning · Computer Science 2023-04-25 Roshni G. Iyer , Wei Wang , Yizhou Sun

Graph Neural Networks (GNNs) have emerged as a powerful and flexible framework for representation learning on irregular data. As they generalize the operations of classical CNNs on grids to arbitrary topologies, GNNs also bring much of the…

Machine Learning · Computer Science 2021-03-31 Mehdi Bahri , Gaétan Bahl , Stefanos Zafeiriou

Recently, there have been some breakthroughs in graph analysis by applying the graph neural networks (GNNs) following a neighborhood aggregation scheme, which demonstrate outstanding performance in many tasks. However, we observe that the…

Machine Learning · Computer Science 2021-04-13 Hanchen Wang , Defu Lian , Ying Zhang , Lu Qin , Xiangjian He , Yiguang Lin , Xuemin Lin