中文
相关论文

相关论文: Understanding Attention and Generalization in Grap…

200 篇论文

Graph Neural Networks (GNNs) require a relatively large number of labeled nodes and a reliable/uncorrupted graph connectivity structure in order to obtain good performance on the semi-supervised node classification task. The performance of…

机器学习 · 计算机科学 2021-07-01 Abdullah Alchihabi , Yuhong Guo

Traditional convolutional neural networks are limited to handling Euclidean space data, overlooking the vast realm of real-life scenarios represented as graph data, including transportation networks, social networks, and reference networks.…

机器学习 · 计算机科学 2023-07-04 Xingyu Liu , Juan Chen , Quan Wen

Graph Neural Networks (GNNs) have been studied through the lens of expressive power and generalization. However, their optimization properties are less well understood. We take the first step towards analyzing GNN training by studying the…

机器学习 · 计算机科学 2021-05-27 Keyulu Xu , Mozhi Zhang , Stefanie Jegelka , Kenji Kawaguchi

This paper studies the interplay between learning algorithms and graph structure for graph neural networks (GNNs). Existing theoretical studies on the learning dynamics of GNNs primarily focus on the convergence rates of learning algorithms…

机器学习 · 计算机科学 2025-08-21 Junwei Su , Chuan Wu

Driven by the outstanding performance of neural networks in the structured Euclidean domain, recent years have seen a surge of interest in developing neural networks for graphs and data supported on graphs. The graph is leveraged at each…

机器学习 · 计算机科学 2021-07-28 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

Attention-based graph neural networks (GNNs), such as graph attention networks (GATs), have become popular neural architectures for processing graph-structured data and learning node embeddings. Despite their empirical success, these models…

机器学习 · 统计学 2023-06-07 Dexiong Chen , Paolo Pellizzoni , Karsten Borgwardt

Graphs are widely used to describe real-world objects and their interactions. Graph Neural Networks (GNNs) as a de facto model for analyzing graphstructured data, are highly sensitive to the quality of the given graph structures. Therefore,…

机器学习 · 计算机科学 2022-02-16 Yanqiao Zhu , Weizhi Xu , Jinghao Zhang , Yuanqi Du , Jieyu Zhang , Qiang Liu , Carl Yang , Shu Wu

Graph neural networks (GNNs) are a class of effective deep learning models for node classification tasks; yet their predictive capability may be severely compromised under adversarially designed unnoticeable perturbations to the graph…

机器学习 · 计算机科学 2023-01-05 Xiao Zang , Jie Chen , Bo Yuan

We aim to deepen the theoretical understanding of Graph Neural Networks (GNNs) on large graphs, with a focus on their expressive power. Existing analyses relate this notion to the graph isomorphism problem, which is mostly relevant for…

机器学习 · 计算机科学 2023-05-25 Nicolas Keriven , Samuel Vaiter

Graph Neural Networks (GNNs) achieve strong performance on node classification tasks but remain difficult to interpret, particularly with respect to which input features drive their predictions. Existing global GNN explainers operate at the…

机器学习 · 计算机科学 2026-05-06 Rishi Raj Sahoo , Subhankar Mishra

Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training and testing graphs, inducing the degeneration of the generalization ability of GNNs on Out-Of-Distribution (OOD) settings. The…

机器学习 · 计算机科学 2024-03-12 Shaohua Fan , Xiao Wang , Chuan Shi , Peng Cui , Bai Wang

The expressive power of message-passing graph neural networks (MPNNs) is reasonably well understood, primarily through combinatorial techniques from graph isomorphism testing. However, MPNNs' generalization abilities -- making meaningful…

机器学习 · 计算机科学 2024-12-11 Antonis Vasileiou , Ben Finkelshtein , Floris Geerts , Ron Levie , Christopher Morris

Graph Neural Networks (GNNs), neural network architectures targeted to learning representations of graphs, have become a popular learning model for prediction tasks on nodes, graphs and configurations of points, with wide success in…

机器学习 · 计算机科学 2022-04-19 Stefanie Jegelka

Graph Neural Networks (GNN) have shown remarkable performance in different tasks. However, there are a few studies about GNN on recommender systems. GCN as a type of GNNs can extract high-quality embeddings for different entities in a…

信息检索 · 计算机科学 2022-01-17 Taher Hekmatfar , Saman Haratizadeh , Parsa Razban , Sama Goliaei

With the increased penetration of wind energy into the power grid, it has become increasingly important to be able to predict the expected power production for larger wind farms. Deep learning (DL) models can learn complex patterns in the…

机器学习 · 计算机科学 2022-06-07 Lars Ødegaard Bentsen , Narada Dilp Warakagoda , Roy Stenbro , Paal Engelstad

Graph Neural Networks (GNNs) exploit signals from node features and the input graph topology to improve node classification task performance. However, these models tend to perform poorly on heterophilic graphs, where connected nodes have…

机器学习 · 计算机科学 2021-12-08 Vijay Lingam , Chanakya Ekbote , Manan Sharma , Rahul Ragesh , Arun Iyer , Sundararajan Sellamanickam

Attention mechanism is contributing to the majority of recent advances in machine learning for natural language processing. Additionally, it results in an attention map that shows the proportional influence of each input in its decision.…

计算与语言 · 计算机科学 2025-01-23 Duc Hau Nguyen , Cyrielle Mallart , Guillaume Gravier , Pascale Sébillot

Recent advances in Graph Neural Networks (GNNs) have explored the potential of random noise as an input feature to enhance expressivity across diverse tasks. However, naively incorporating noise can degrade performance, while architectures…

机器学习 · 计算机科学 2025-02-05 Xiyuan Wang , Muhan Zhang

Graph neural networks (GNNs) are emerging for machine learning research on graph-structured data. GNNs achieve state-of-the-art performance on many tasks, but they face scalability challenges when it comes to real-world applications that…

机器学习 · 计算机科学 2026-04-02 Shichang Zhang , Atefeh Sohrabizadeh , Cheng Wan , Zijie Huang , Ziniu Hu , Yewen Wang , Yingyan , Lin , Jason Cong , Yizhou Sun

In many important graph data processing applications the acquired information includes both node features and observations of the graph topology. Graph neural networks (GNNs) are designed to exploit both sources of evidence but they do not…

机器学习 · 计算机科学 2021-10-28 Eli Chien , Jianhao Peng , Pan Li , Olgica Milenkovic