中文
相关论文

相关论文: Understanding Attention and Generalization in Grap…

200 篇论文

Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for…

机器学习 · 计算机科学 2022-12-01 Moshe Eliasof , Eldad Haber , Eran Treister

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

机器学习 · 计算机科学 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen

We propose a novel technique to enhance Knowledge Graph Reasoning by combining Graph Convolution Neural Network (GCN) with the Attention Mechanism. This approach utilizes the Attention Mechanism to examine the relationships between entities…

信息检索 · 计算机科学 2025-03-24 Meera Gupta , Ravi Khanna , Divya Choudhary , Nandini Rao

Graph attention networks estimate the relational importance of node neighbors to aggregate relevant information over local neighborhoods for a prediction task. However, the inferred attentions are vulnerable to spurious correlations and…

机器学习 · 计算机科学 2023-03-02 Alexander P. Wu , Thomas Markovich , Bonnie Berger , Nils Hammerla , Rohit Singh

Graph Neural Networks (GNNs) have emerged as a notorious alternative to address learning problems dealing with non-Euclidean datasets. However, although most works assume that the graph is perfectly known, the observed topology is prone to…

机器学习 · 计算机科学 2023-12-12 Victor M. Tenorio , Samuel Rey , Antonio G. Marques

Graph neural networks (GNNs) have demonstrated remarkable capabilities in learning from graph-structured data, often outperforming traditional Multilayer Perceptrons (MLPs) in numerous graph-based tasks. Although existing works have…

机器学习 · 计算机科学 2025-06-09 Wei Huang , Yuan Cao , Haonan Wang , Xin Cao , Taiji Suzuki

Advanced methods of applying deep learning to structured data such as graphs have been proposed in recent years. In particular, studies have focused on generalizing convolutional neural networks to graph data, which includes redefining the…

机器学习 · 计算机科学 2019-06-14 Junhyun Lee , Inyeop Lee , Jaewoo Kang

In this paper, we design Graph Neural Networks (GNNs) with attention mechanisms to tackle an important yet challenging nonlinear regression problem: massive network localization. We first review our previous network localization method…

机器学习 · 计算机科学 2025-04-08 Wenzhong Yan , Feng Yin , Juntao Wang , Geert Leus , Abdelhak M. Zoubir , Yang Tian

The recent years we have seen the rise of graph neural networks for prediction tasks on graphs. One of the dominant architectures is graph attention due to its ability to make predictions using weighted edge features and not only node…

机器学习 · 计算机科学 2022-10-19 Kimon Fountoulakis , Dake He , Silvio Lattanzi , Bryan Perozzi , Anton Tsitsulin , Shenghao Yang

Graph attention networks (GATs) are powerful tools for analyzing graph data from various real-world scenarios. To learn representations for downstream tasks, GATs generally attend to all neighbors of the central node when aggregating the…

机器学习 · 计算机科学 2022-10-31 Tiantian He , Haicang Zhou , Yew-Soon Ong , Gao Cong

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations from structured data. Despite their growing popularity and success across various applications, GNNs encounter several challenges that limit their…

机器学习 · 计算机科学 2026-02-03 Yassine Abbahaddou

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

机器学习 · 计算机科学 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Graph neural networks (GNNs) have received great attention due to their success in various graph-related learning tasks. Several GNN frameworks have then been developed for fast and easy implementation of GNN models. Despite their…

机器学习 · 计算机科学 2022-11-08 Xin Huang , Jongryool Kim , Bradley Rees , Chul-Ho Lee

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

机器学习 · 计算机科学 2021-06-15 Marco Serafini , Hui Guan

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power.…

机器学习 · 计算机科学 2025-01-13 Bingxu Zhang , Changjun Fan , Shixuan Liu , Kuihua Huang , Xiang Zhao , Jincai Huang , Zhong Liu

Graph Neural Networks (GNNs) have shown remarkable performance on graph-structured data. However, recent empirical studies suggest that GNNs are very susceptible to distribution shift. There is still significant ambiguity about why…

机器学习 · 计算机科学 2023-06-07 Qi Zhu , Yizhu Jiao , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Graph Neural Networks (GNNs) are powerful tools for learning on structured data, yet the relationship between their expressivity and predictive performance remains unclear. We introduce a family of premetrics that capture different degrees…

机器学习 · 计算机科学 2025-05-19 Sohir Maskey , Raffaele Paolino , Fabian Jogl , Gitta Kutyniok , Johannes F. Lutzeyer

While the expressive power and computational capabilities of graph neural networks (GNNs) have been theoretically studied, their optimization and learning dynamics, in general, remain largely unexplored. Our study undertakes the Graph…

机器学习 · 计算机科学 2023-10-26 Nimrah Mustafa , Aleksandar Bojchevski , Rebekka Burkholz

Machine learning models that can exploit the inherent structure in data have gained prominence. In particular, there is a surge in deep learning solutions for graph-structured data, due to its wide-spread applicability in several fields.…

机器学习 · 计算机科学 2020-02-12 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Andreas Spanias

Graph neural networks (GNNs) have garnered significant attention due to their ability to represent graph data. Among various GNN variants, graph attention network (GAT) stands out since it is able to dynamically learn the importance of…

机器学习 · 计算机科学 2024-08-19 Tiqiao Wei , Ye Yuan