English
Related papers

Related papers: Theoretical Insights into Line Graph Transformatio…

200 papers

Machine learning on graphs, especially using graph neural networks (GNNs), has seen a surge in interest due to the wide availability of graph data across a broad spectrum of disciplines, from life to social and engineering sciences. Despite…

As it is well known, the isomorphism problem for vertex-colored graphs with color multiplicity at most 3 is solvable by the classical 2-dimensional Weisfeiler-Leman algorithm (2-WL). On the other hand, the prominent Cai-F\"urer-Immerman…

Computational Complexity · Computer Science 2020-03-18 Frank Fuhlbrück , Johannes Köbler , Oleg Verbitsky

Rethink convolution-based graph neural networks (GNN) -- they characteristically suffer from limited expressiveness, over-smoothing, and over-squashing, and require specialized sparse kernels for efficient computation. Here, we design a…

Machine Learning · Computer Science 2024-10-01 Yuanqing Wang , Kyunghyun Cho

Graph Neural Networks (GNNs) have become essential in high-stakes domains such as drug discovery, yet their black-box nature remains a significant barrier to trustworthiness. While self-explainable GNNs attempt to bridge this gap, they…

Machine Learning · Computer Science 2026-02-25 Chuqin Geng , Li Zhang , Haolin Ye , Ziyu Zhao , Yuhe Jiang , Tara Saba , Xinyu Wang , Xujie Si

Graph-structured data consisting of objects (i.e., nodes) and relationships among objects (i.e., edges) are ubiquitous. Graph-level learning is a matter of studying a collection of graphs instead of a single graph. Traditional graph-level…

Machine Learning · Computer Science 2022-06-01 Ge Zhang , Jia Wu , Jian Yang , Shan Xue , Wenbin Hu , Chuan Zhou , Hao Peng , Quan Z. Sheng , Charu Aggarwal

Graphs are a widely used paradigm for representing non-Euclidean data, with applications ranging from social network analysis to biomolecular prediction. While graph learning has achieved remarkable progress, real-world graph data presents…

Graph Neural Networks (GNNs) are well-suited for learning on homophilous graphs, i.e., graphs in which edges tend to connect nodes of the same type. Yet, achievement of consistent GNN performance on heterophilous graphs remains an open…

Machine Learning · Computer Science 2023-08-30 Andrea Cavallo , Claas Grohnfeldt , Michele Russo , Giulio Lovisotto , Luca Vassio

Graphs serve as generic tools to encode the underlying relational structure of data. Often this graph is not given, and so the task of inferring it from nodal observations becomes important. Traditional approaches formulate a convex inverse…

Machine Learning · Computer Science 2024-06-24 Max Wasserman , Gonzalo Mateos

Research on the theoretical expressiveness of Graph Neural Networks (GNNs) has developed rapidly, and many methods have been proposed to enhance the expressiveness. However, most methods do not have a uniform expressiveness measure except…

Machine Learning · Computer Science 2024-06-04 Yanbo Wang , Muhan Zhang

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Recently, many works studied the expressive power of graph neural networks (GNNs) by linking it to the $1$-dimensional Weisfeiler--Leman algorithm ($1\text{-}\mathsf{WL}$). Here, the $1\text{-}\mathsf{WL}$ is a well-studied heuristic for…

Machine Learning · Computer Science 2023-05-31 Christopher Morris , Floris Geerts , Jan Tönshoff , Martin Grohe

Traditional Graph Self-Supervised Learning (GSSL) struggles to capture complex structural properties well. This limitation stems from two main factors: (1) the inadequacy of conventional Graph Neural Networks (GNNs) in representing…

Machine Learning · Computer Science 2025-02-25 Asiri Wijesinghe , Hao Zhu , Piotr Koniusz

The expressive power of graph neural networks (GNNs) is typically understood through their correspondence with graph isomorphism tests such as the Weisfeiler-Leman (WL) hierarchy. While more expressive GNNs can distinguish a richer set of…

Graph representation learning methods are highly effective in handling complex non-Euclidean data by capturing intricate relationships and features within graph structures. However, traditional methods face challenges when dealing with…

Machine Learning · Computer Science 2025-02-25 Hang Gao , Chenhao Zhang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu

Graph Neural Networks (GNNs) have exhibited impressive performance in many graph learning tasks. Nevertheless, the performance of GNNs can deteriorate when the input graph data suffer from weak information, i.e., incomplete structure,…

Machine Learning · Computer Science 2023-05-31 Yixin Liu , Kaize Ding , Jianling Wang , Vincent Lee , Huan Liu , Shirui Pan

Graph Neural Networks (GNNs) have proven to be useful for many different practical applications. However, many existing GNN models have implicitly assumed homophily among the nodes connected in the graph, and therefore have largely…

Machine Learning · Computer Science 2021-06-16 Jiong Zhu , Ryan A. Rossi , Anup Rao , Tung Mai , Nedim Lipka , Nesreen K. Ahmed , Danai Koutra

Designing expressive Graph Neural Networks (GNNs) is a fundamental topic in the graph learning community. So far, GNN expressiveness has been primarily assessed via the Weisfeiler-Lehman (WL) hierarchy. However, such an expressivity measure…

Machine Learning · Computer Science 2024-01-17 Bohang Zhang , Jingchu Gai , Yiheng Du , Qiwei Ye , Di He , Liwei Wang

Graph neural networks (GNNs) are powerful graph-based deep-learning models that have gained significant attention and demonstrated remarkable performance in various domains, including natural language processing, drug discovery, and…

Machine Learning · Computer Science 2023-06-06 Jaykumar Kakkad , Jaspal Jannu , Kartik Sharma , Charu Aggarwal , Sourav Medya

Graph, as an important data representation, is ubiquitous in many real world applications ranging from social network analysis to biology. How to correctly and effectively learn and extract information from graph is essential for a large…

Machine Learning · Computer Science 2020-10-27 Xiaodong Jiang , Ronghang Zhu , Pengsheng Ji , Sheng Li

This paper addresses the challenging problem of retrieval and matching of graph structured objects, and makes two key contributions. First, we demonstrate how Graph Neural Networks (GNN), which have emerged as an effective model for various…

Machine Learning · Computer Science 2019-05-14 Yujia Li , Chenjie Gu , Thomas Dullien , Oriol Vinyals , Pushmeet Kohli