中文
相关论文

相关论文: Non-convolutional Graph Neural Networks

200 篇论文

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to…

机器学习 · 计算机科学 2019-11-14 Michael Lingzhi Li , Meng Dong , Jiawei Zhou , Alexander M. Rush

Graph Neural Networks (GNNs) are widely used for graph representation learning in many application domains. The expressiveness of vanilla GNNs is upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) test as they operate on rooted subtrees…

机器学习 · 计算机科学 2024-01-10 Jiaxing Xu , Aihu Zhang , Qingtian Bian , Vijay Prakash Dwivedi , Yiping Ke

Graph neural networks (GNNs) have achieved tremendous success in graph mining. However, the inability of GNNs to model substructures in graphs remains a significant drawback. Specifically, message-passing GNNs (MPGNNs), as the prevailing…

机器学习 · 计算机科学 2021-04-08 Qingqing Long , Yilun Jin , Yi Wu , Guojie Song

Graph neural network (GNN)'s success in graph classification is closely related to the Weisfeiler-Lehman (1-WL) algorithm. By iteratively aggregating neighboring node features to a center node, both 1-WL and GNN obtain a node representation…

机器学习 · 计算机科学 2021-10-27 Muhan Zhang , Pan Li

We study and compare different Graph Neural Network extensions that increase the expressive power of GNNs beyond the Weisfeiler-Leman test. We focus on (i) GNNs based on higher order WL methods, (ii) GNNs that preprocess small substructures…

机器学习 · 计算机科学 2022-02-01 Pál András Papp , Roger Wattenhofer

This paper introduces a generalization of Convolutional Neural Networks (CNNs) from low-dimensional grid data, such as images, to graph-structured data. We propose a novel spatial convolution utilizing a random walk to uncover the relations…

机器学习 · 统计学 2017-04-27 Yotam Hechtlinger , Purvasha Chakravarti , Jining Qin

Graph Neural Network (GNN) is an emerging technique for graph-based learning tasks such as node classification. In this work, we reveal the vulnerability of GNN to the imbalance of node labels. Traditional solutions for imbalanced…

机器学习 · 计算机科学 2022-02-08 Xiaohe Li , Lijie Wen , Yawen Deng , Fuli Feng , Xuming Hu , Lei Wang , Zide Fan

From the perspective of expressive power, this work compares multi-layer Graph Neural Networks (GNNs) with a simplified alternative that we call Graph-Augmented Multi-Layer Perceptrons (GA-MLPs), which first augments node features with…

机器学习 · 计算机科学 2020-12-03 Lei Chen , Zhengdao Chen , Joan Bruna

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

机器学习 · 计算机科学 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

Graph Neural Networks (GNNs) are effective tools for graph representation learning. Most GNNs rely on a recursive neighborhood aggregation scheme, named message passing, thereby their theoretical expressive power is limited to the…

机器学习 · 计算机科学 2023-09-19 Dingmin Wang , Shengchao Liu , Hanchen Wang , Bernardo Cuenca Grau , Linfeng Song , Jian Tang , Song Le , Qi Liu

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

机器学习 · 计算机科学 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Graph neural networks (GNNs) are a class of neural networks that allow to efficiently perform inference on data that is associated to a graph structure, such as, e.g., citation networks or knowledge graphs. While several variants of GNNs…

神经与进化计算 · 计算机科学 2018-02-27 Simone Scardapane , Steven Van Vaerenbergh , Danilo Comminiello , Aurelio Uncini

The invariance to permutations of the adjacency matrix, i.e., graph isomorphism, is an overarching requirement for Graph Neural Networks (GNNs). Conventionally, this prerequisite can be satisfied by the invariant operations over node…

机器学习 · 计算机科学 2022-05-31 Zhongyu Huang , Yingheng Wang , Chaozhuo Li , Huiguang He

Graph kernels used to be the dominant approach to feature engineering for structured data, which are superseded by modern GNNs as the former lacks learnability. Recently, a suite of Kernel Convolution Networks (KCNs) successfully…

机器学习 · 计算机科学 2024-02-12 Meng-Chieh Lee , Lingxiao Zhao , Leman Akoglu

Message passing graph neural networks (GNNs) are known to have their expressiveness upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) algorithm. To achieve more powerful GNNs, existing attempts either require ad hoc features, or…

机器学习 · 计算机科学 2024-01-24 Meng Liu , Haiyang Yu , Shuiwang Ji

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

机器学习 · 统计学 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Graph Neural Networks (GNNs) and their message passing framework that leverages both structural and feature information, have become a standard method for solving graph-based machine learning problems. However, these approaches still…

机器学习 · 计算机科学 2024-11-20 Simon Delarue , Thomas Bonald , Tiphaine Viard

We study the approximation power of Graph Neural Networks (GNNs) on latent position random graphs. In the large graph limit, GNNs are known to converge to certain "continuous" models known as c-GNNs, which directly enables a study of their…

机器学习 · 统计学 2021-06-01 Nicolas Keriven , Alberto Bietti , Samuel Vaiter

Graph neural networks are designed to learn functions on graphs. Typically, the relevant target functions are invariant with respect to actions by permutations. Therefore the design of some graph neural network architectures has been…

机器学习 · 统计学 2022-11-03 Ningyuan Huang , Soledad Villar

Graph Neural Networks (GNNs) have emerged as a notorious alternative to address learning problems dealing with non-Euclidean datasets. However, although most works assume that the graph is perfectly known, the observed topology is prone to…

机器学习 · 计算机科学 2023-12-12 Victor M. Tenorio , Samuel Rey , Antonio G. Marques