English
Related papers

Related papers: Reconstruction for Powerful Graph Representations

200 papers

Graph neural networks (GNNs) are the predominant approach for graph-based machine learning. While neural networks have shown great performance at learning useful representations, they are often criticized for their limited high-level…

Machine Learning · Computer Science 2024-07-09 Markus Zopf , Francesco Alesiani

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

Machine Learning · Computer Science 2021-06-08 Waïss Azizian , Marc Lelarge

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

As powerful tools for representation learning on graphs, graph neural networks (GNNs) have facilitated various applications from drug discovery to recommender systems. Nevertheless, the effectiveness of GNNs is immensely challenged by…

Machine Learning · Computer Science 2023-02-28 Wei Jin , Tong Zhao , Jiayuan Ding , Yozen Liu , Jiliang Tang , Neil Shah

Graph Neural Networks (GNNs) have recently gained widespread attention as a successful tool for analyzing graph-structured data. However, imperfect graph structure with noisy links lacks enough robustness and may damage graph…

Machine Learning · Computer Science 2025-03-25 Xianlin Zeng , Yufeng Wang , Yuqi Sun , Guodong Guo , Wenrui Ding , Baochang Zhang

Graph neural networks (GNNs) have become a powerful tool for processing graph-structured data but still face challenges in effectively aggregating and propagating information between layers, which limits their performance. We tackle this…

Machine Learning · Computer Science 2023-02-09 Maxim Fishman , Chaim Baskin , Evgenii Zheltonozhskii , Almog David , Ron Banner , Avi Mendelson

Graph neural networks (GNNs) are effective models for representation learning on relational data. However, standard GNNs are limited in their expressive power, as they cannot distinguish graphs beyond the capability of the Weisfeiler-Leman…

Machine Learning · Computer Science 2021-06-07 Ralph Abboud , İsmail İlkan Ceylan , Martin Grohe , Thomas Lukasiewicz

Deep reinforcement learning (DRL) has been widely used in many important tasks of communication networks. In order to improve the perception ability of DRL on the network, some studies have combined graph neural networks (GNNs) with DRL,…

Cryptography and Security · Computer Science 2025-01-22 Xuzeng Li , Tao Zhang , Jian Wang , Zhen Han , Jiqiang Liu , Jiawen Kang , Dusit Niyato , Abbas Jamalipour

Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data,…

Machine Learning · Computer Science 2021-04-06 Yuning You , Tianlong Chen , Yongduo Sui , Ting Chen , Zhangyang Wang , Yang Shen

We perform the first adversarial robustness study into Graph Neural Networks (GNNs) that are provably more powerful than traditional Message Passing Neural Networks (MPNNs). In particular, we use adversarial robustness as a tool to uncover…

Machine Learning · Computer Science 2024-07-04 Francesco Campi , Lukas Gosch , Tom Wollschläger , Yan Scholten , Stephan Günnemann

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

Machine Learning · Computer Science 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

How to properly model graphs is a long-existing and important problem in NLP area, where several popular types of graphs are knowledge graphs, semantic graphs and dependency graphs. Comparing with other data structures, such as sequences…

Computation and Language · Computer Science 2019-07-16 Linfeng Song

Graph Neural Networks (GNNs) have emerged as a notorious alternative to address learning problems dealing with non-Euclidean datasets. However, although most works assume that the graph is perfectly known, the observed topology is prone to…

Machine Learning · Computer Science 2023-12-12 Victor M. Tenorio , Samuel Rey , Antonio G. Marques

Graphical models capture relations between entities in a wide range of applications including social networks, biology, and natural language processing, among others. Graph neural networks (GNN) are neural models that operate over graphs,…

Machine Learning · Computer Science 2024-02-08 Xu Zheng , Farhad Shirani , Tianchun Wang , Shouwei Gao , Wenqian Dong , Wei Cheng , Dongsheng Luo

Recently, subgraphs-enhanced Graph Neural Networks (SGNNs) have been introduced to enhance the expressive power of Graph Neural Networks (GNNs), which was proved to be not higher than the 1-dimensional Weisfeiler-Leman isomorphism test. The…

Machine Learning · Computer Science 2023-01-20 Michele Guerra , Indro Spinelli , Simone Scardapane , Filippo Maria Bianchi

Graph neural networks (GNNs) are a powerful tool to learn representations on graphs by iteratively aggregating features from node neighbourhoods. Many variant models have been proposed, but there is limited understanding on both how to…

Machine Learning · Computer Science 2019-11-14 Michael Lingzhi Li , Meng Dong , Jiawei Zhou , Alexander M. Rush

Graph Neural Networks (GNNs) are a predominant method for graph representation learning. However, beyond subgraph frequency estimation, their application to network motif significance-profile (SP) prediction remains under-explored, with no…

Machine Learning · Computer Science 2025-07-11 Pedro C. Vieira , Miguel E. P. Silva , Pedro Manuel Pinto Ribeiro

Graph data, with its structurally variable nature, represents complex real-world phenomena like chemical compounds, protein structures, and social networks. Traditional Graph Neural Networks (GNNs) primarily utilize the message-passing…

Machine Learning · Computer Science 2025-02-05 Jianming Huang , Hiroyuki Kasai

We study and compare different Graph Neural Network extensions that increase the expressive power of GNNs beyond the Weisfeiler-Leman test. We focus on (i) GNNs based on higher order WL methods, (ii) GNNs that preprocess small substructures…

Machine Learning · Computer Science 2022-02-01 Pál András Papp , Roger Wattenhofer