English
Related papers

Related papers: GAIN: Graph Attention & Interaction Network for In…

200 papers

We introduce Attention Graphs, a new tool for mechanistic interpretability of Graph Neural Networks (GNNs) and Graph Transformers based on the mathematical equivalence between message passing in GNNs and the self-attention mechanism in…

Machine Learning · Computer Science 2025-02-26 Batu El , Deepro Choudhury , Pietro Liò , Chaitanya K. Joshi

In this paper, we provide a theory of using graph neural networks (GNNs) for multi-node representation learning (where we are interested in learning a representation for a set of more than one node, such as link). We know that GNN is…

Machine Learning · Computer Science 2022-01-19 Muhan Zhang , Pan Li , Yinglong Xia , Kai Wang , Long Jin

Graph-based learning is a rapidly growing sub-field of machine learning with applications in social networks, citation networks, and bioinformatics. One of the most popular models is graph attention networks. They were introduced to allow a…

Machine Learning · Computer Science 2023-05-23 Kimon Fountoulakis , Amit Levi , Shenghao Yang , Aseem Baranwal , Aukosh Jagannath

With the ubiquitous graph-structured data in various applications, models that can learn compact but expressive vector representations of nodes have become highly desirable. Recently, bearing the message passing paradigm, graph neural…

Social and Information Networks · Computer Science 2021-04-13 Tong Chen , Hongzhi Yin , Jie Ren , Zi Huang , Xiangliang Zhang , Hao Wang

Vital nodes usually play a key role in complex networks. Uncovering these nodes is an important task in protecting the network, especially when the network suffers intentional attack. Many existing methods have not fully integrated the node…

Social and Information Networks · Computer Science 2025-09-24 Huaizhi Liao , Tian Qiu , Guang Chen

Network embedding is aimed at mapping nodes in a network into low-dimensional vector representations. Graph Neural Networks (GNNs) have received widespread attention and lead to state-of-the-art performance in learning node representations.…

Social and Information Networks · Computer Science 2023-03-17 Junjie Huang , Huawei Shen , Liang Hou , Xueqi Cheng

Graph neural networks (GNNs) are powerful tools for developing scalable, decentralized artificial intelligence in large-scale networked systems, such as wireless networks, power grids, and transportation networks. Currently, GNNs in…

Machine Learning · Computer Science 2024-12-10 Rostyslav Olshevskyi , Zhongyuan Zhao , Kevin Chan , Gunjan Verma , Ananthram Swami , Santiago Segarra

In this paper, we propose an end-to-end graph learning framework, namely Deep Iterative and Adaptive Learning for Graph Neural Networks (DIAL-GNN), for jointly learning the graph structure and graph embeddings simultaneously. We first cast…

Machine Learning · Computer Science 2019-12-18 Yu Chen , Lingfei Wu , Mohammed J. Zaki

Heterogeneous graph neural networks (HGNNs) have powerful capability to embed rich structural and semantic information of a heterogeneous graph into node representations. Existing HGNNs inherit many mechanisms from graph neural networks…

Machine Learning · Computer Science 2023-09-04 Xiaocheng Yang , Mingyu Yan , Shirui Pan , Xiaochun Ye , Dongrui Fan

Graph Neural Networks (GNNs) have achieved promising performance in semi-supervised node classification in recent years. However, the problem of insufficient supervision, together with representation collapse, largely limits the performance…

Machine Learning · Computer Science 2025-03-07 Xihong Yang , Yiqi Wang , Yue Liu , Yi Wen , Lingyuan Meng , Sihang Zhou , Xinwang Liu , En Zhu

Due to the fact much of today's data can be represented as graphs, there has been a demand for generalizing neural network models for graph data. One recent direction that has shown fruitful results, and therefore growing interest, is the…

Social and Information Networks · Computer Science 2018-08-21 Tyler Derr , Yao Ma , Jiliang Tang

Inspired by the immense success of deep learning, graph neural networks (GNNs) are widely used to learn powerful node representations and have demonstrated promising performance on different graph learning tasks. However, most real-world…

Machine Learning · Computer Science 2020-01-24 Kaize Ding , Yichuan Li , Jundong Li , Chenghao Liu , Huan Liu

Graph Neural Networks have become one of the indispensable tools to learn from graph-structured data, and their usefulness has been shown in wide variety of tasks. In recent years, there have been tremendous improvements in architecture…

Machine Learning · Statistics 2021-11-15 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

Graph neural networks (GNNs) have been widely used to learn vector representation of graph-structured data and achieved better task performance than conventional methods. The foundation of GNNs is the message passing procedure, which…

Machine Learning · Computer Science 2022-01-31 Takeshi D. Itoh , Takatomi Kubo , Kazushi Ikeda

Message-passing neural networks (MPNNs) have been successfully applied to representation learning on graphs in a variety of real-world applications. However, two fundamental weaknesses of MPNNs' aggregators limit their ability to represent…

Machine Learning · Computer Science 2020-02-17 Hongbin Pei , Bingzhe Wei , Kevin Chen-Chuan Chang , Yu Lei , Bo Yang

Graph neural networks (GNNs) have been applied into a variety of graph tasks. Most existing work of GNNs is based on the assumption that the given graph data is optimal, while it is inevitable that there exists missing or incomplete edges…

Machine Learning · Computer Science 2022-05-13 Qianggang Ding , Deheng Ye , Tingyang Xu , Peilin Zhao

This paper studies semi-supervised graph classification, a crucial task with a wide range of applications in social network analysis and bioinformatics. Recent works typically adopt graph neural networks to learn graph-level representations…

Machine Learning · Computer Science 2023-04-25 Wei Ju , Xiao Luo , Meng Qu , Yifan Wang , Chong Chen , Minghua Deng , Xian-Sheng Hua , Ming Zhang

Narrowing the performance gap between optimal and feasible detection in inter-symbol interference (ISI) channels, this paper proposes to use graph neural networks (GNNs) for detection that can also be used to perform joint detection and…

Information Theory · Computer Science 2025-07-16 Jannis Clausius , Marvin Rübenacke , Daniel Tandler , Stephan ten Brink

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

Machine Learning · Computer Science 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

Graph Neural Networks (GNNs) have gained considerable prominence in semi-supervised learning tasks in processing graph-structured data, primarily owing to their message-passing mechanism, which largely relies on the availability of clean…

Machine Learning · Computer Science 2024-11-07 Shuangjie Li , Baoming Zhang , Jianqing Song , Gaoli Ruan , Chongjun Wang , Junyuan Xie