English
Related papers

Related papers: An Empirical Study of Retrieval-enhanced Graph Neu…

200 papers

Graph Neural Networks (GNNs) are widely used for graph representation learning in many application domains. The expressiveness of vanilla GNNs is upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) test as they operate on rooted subtrees…

Machine Learning · Computer Science 2024-01-10 Jiaxing Xu , Aihu Zhang , Qingtian Bian , Vijay Prakash Dwivedi , Yiping Ke

Graph neural networks (GNNs) are powerful machine learning models for various graph learning tasks. Recently, the limitations of the expressive power of various GNN models have been revealed. For example, GNNs cannot distinguish some…

Machine Learning · Computer Science 2021-01-19 Ryoma Sato , Makoto Yamada , Hisashi Kashima

Message passing graph neural networks (GNNs) are known to have their expressiveness upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) algorithm. To achieve more powerful GNNs, existing attempts either require ad hoc features, or…

Machine Learning · Computer Science 2024-01-24 Meng Liu , Haiyang Yu , Shuiwang Ji

We study and compare different Graph Neural Network extensions that increase the expressive power of GNNs beyond the Weisfeiler-Leman test. We focus on (i) GNNs based on higher order WL methods, (ii) GNNs that preprocess small substructures…

Machine Learning · Computer Science 2022-02-01 Pál András Papp , Roger Wattenhofer

Graph neural networks (GNNs) are popular to use for classifying structured data in the context of machine learning. But surprisingly, they are rarely applied to regression problems. In this work, we adopt GNN for a classic but challenging…

Machine Learning · Computer Science 2021-02-16 Wenzhong Yan , Di Jin , Zhidi Lin , Feng Yin

How to properly model graphs is a long-existing and important problem in NLP area, where several popular types of graphs are knowledge graphs, semantic graphs and dependency graphs. Comparing with other data structures, such as sequences…

Computation and Language · Computer Science 2019-07-16 Linfeng Song

Message passing Graph Neural Networks (GNNs) provide a powerful modeling framework for relational data. However, the expressive power of existing GNNs is upper-bounded by the 1-Weisfeiler-Lehman (1-WL) graph isomorphism test, which means…

Machine Learning · Computer Science 2021-02-08 Jiaxuan You , Jonathan Gomes-Selman , Rex Ying , Jure Leskovec

Graph neural networks (GNNs) are effective models for representation learning on relational data. However, standard GNNs are limited in their expressive power, as they cannot distinguish graphs beyond the capability of the Weisfeiler-Leman…

Machine Learning · Computer Science 2021-06-07 Ralph Abboud , İsmail İlkan Ceylan , Martin Grohe , Thomas Lukasiewicz

Various recent proposals increase the distinguishing power of Graph Neural Networks GNNs by propagating features between $k$-tuples of vertices. The distinguishing power of these "higher-order'' GNNs is known to be bounded by the…

Machine Learning · Computer Science 2021-06-15 Pablo Barceló , Floris Geerts , Juan Reutter , Maksimilian Ryschkov

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Graph representation learning has attracted much attention in supporting high quality candidate search at scale. Despite its effectiveness in learning embedding vectors for objects in the user-item interaction network, the computational…

Information Retrieval · Computer Science 2020-03-05 Qiaoyu Tan , Ninghao Liu , Xing Zhao , Hongxia Yang , Jingren Zhou , Xia Hu

Despite the remarkable success of Graph Neural Networks (GNNs), the common belief is that their representation power is limited and that they are at most as expressive as the Weisfeiler-Lehman (WL) algorithm. In this paper, we argue the…

Machine Learning · Computer Science 2023-07-25 Charilaos I. Kanatsoulis , Alejandro Ribeiro

Graph Neural Networks (GNNs), despite achieving remarkable performance across different tasks, are theoretically bounded by the 1-Weisfeiler-Lehman test, resulting in limitations in terms of graph expressivity. Even though prior works on…

Machine Learning · Computer Science 2024-04-02 Quang Truong , Peter Chin

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

Machine Learning · Computer Science 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Modern neuroimaging techniques, such as diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI), enable us to model the human brain as a brain network or connectome. Capturing brain networks' structural information…

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are…

Machine Learning · Computer Science 2021-11-09 Debmalya Mandal , Sourav Medya , Brian Uzzi , Charu Aggarwal

Graph Neural Networks (GNNs) have been popularly used for analyzing non-Euclidean data such as social network data and biological data. Despite their success, the design of graph neural networks requires a lot of manual work and domain…

Machine Learning · Computer Science 2020-11-03 Yang Gao , Hong Yang , Peng Zhang , Chuan Zhou , Yue Hu

Graph Neural Networks (GNNs) have emerged as a dominant approach in graph representation learning, yet they often struggle to capture consistent similarity relationships among graphs. While graph kernel methods such as the Weisfeiler-Lehman…

Machine Learning · Computer Science 2024-12-12 Xuyuan Liu , Yinghao Cai , Qihui Yang , Yujun Yan

Classical graph algorithms work well for combinatorial problems that can be thoroughly formalized and abstracted. Once the algorithm is derived, it generalizes to instances of any size. However, developing an algorithm that handles complex…

Machine Learning · Computer Science 2022-12-12 Florian Grötschla , Joël Mathys , Roger Wattenhofer