中文
相关论文

相关论文: Higher-Order Graphon Neural Networks: Approximatio…

200 篇论文

Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their…

机器学习 · 计算机科学 2021-10-29 Rajat Talak , Siyi Hu , Lisa Peng , Luca Carlone

Probabilistic graphical models provide a powerful tool to describe complex statistical structure, with many real-world applications in science and engineering from controlling robotic arms to understanding neuronal computations. A major…

人工智能 · 计算机科学 2023-05-04 Yicheng Fei , Xaq Pitkow

Graph Neural Networks (GNNs) have emerged as a powerful technique for learning on relational data. Owing to the relatively limited number of message passing steps they perform -- and hence a smaller receptive field -- there has been…

机器学习 · 计算机科学 2022-06-27 Ameya Velingker , Ali Kemal Sinop , Ira Ktena , Petar Veličković , Sreenivas Gollapudi

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

机器学习 · 计算机科学 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

机器学习 · 计算机科学 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

机器学习 · 计算机科学 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

We present GERN, a novel scalable framework for training GNNs in node classification tasks, based on effective resistance, a standard tool in spectral graph theory. Our method progressively refines the GNN weights on a sequence of random…

机器学习 · 计算机科学 2025-02-25 Francesco Bonchi , Claudio Gentile , Francesco Paolo Nerini , André Panisson , Fabio Vitale

Graph Neural Networks (GNNs), which generalize the deep neural networks to graph-structured data, have achieved great success in modeling graphs. However, as an extension of deep learning for graphs, GNNs lack explainability, which largely…

机器学习 · 计算机科学 2021-08-30 Enyan Dai , Suhang Wang

While (message-passing) graph neural networks have clear limitations in approximating permutation-equivariant functions over graphs or general relational data, more expressive, higher-order graph neural networks do not scale to large…

机器学习 · 计算机科学 2022-08-31 Christopher Morris , Gaurav Rattan , Sandra Kiefer , Siamak Ravanbakhsh

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

机器学习 · 计算机科学 2023-05-16 Huayi Tang , Yong Liu

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power.…

机器学习 · 计算机科学 2025-01-13 Bingxu Zhang , Changjun Fan , Shixuan Liu , Kuihua Huang , Xiang Zhao , Jincai Huang , Zhong Liu

Deep learning methods are achieving ever-increasing performance on many artificial intelligence tasks. A major limitation of deep models is that they are not amenable to interpretability. This limitation can be circumvented by developing…

机器学习 · 计算机科学 2022-07-05 Hao Yuan , Haiyang Yu , Shurui Gui , Shuiwang Ji

Graph Neural Networks (GNNs) are learning models aimed at processing graphs and signals on graphs. The most popular and successful GNNs are based on message passing schemes. Such schemes inherently have limited expressive power when it…

机器学习 · 计算机科学 2022-06-24 Jacob Bamberger

The message-passing scheme is the core of graph representation learning. While most existing message-passing graph neural networks (MPNNs) are permutation-invariant in graph-level representation learning and permutation-equivariant in node-…

机器学习 · 计算机科学 2022-11-22 Chang Liu , Yuwen Yang , Yue Ding , Hongtao Lu

We address two fundamental questions about graph neural networks (GNNs). First, we prove that several important graph properties cannot be computed by GNNs that rely entirely on local information. Such GNNs include the standard message…

机器学习 · 计算机科学 2020-02-17 Vikas K. Garg , Stefanie Jegelka , Tommi Jaakkola

Graph Neural Networks (GNNs) have gained popularity in various learning tasks, with successful applications in fields like molecular biology, transportation systems, and electrical grids. These fields naturally use graph data, benefiting…

机器学习 · 计算机科学 2024-09-23 Caio F. Deberaldini Netto , Zhiyang Wang , Luana Ruiz

Distributed power allocation is important for interference-limited wireless networks with dense transceiver pairs. In this paper, we aim to design low signaling overhead distributed power allocation schemes by using graph neural networks…

信号处理 · 电气工程与系统科学 2023-03-06 Yifan Gu , Changyang She , Zhi Quan , Chen Qiu , Xiaodong Xu

Graph Neural Networks (GNNs) have emerged as a promising approach for ``learning to branch'' in Mixed-Integer Linear Programming (MILP). While standard Message-Passing GNNs (MPNNs) are efficient, they theoretically lack the expressive power…

机器学习 · 计算机科学 2025-12-11 Junru Zhou , Yicheng Wang , Pan Li

A fundamental challenge in understanding graph neural networks (GNNs) lies in characterizing their optimization dynamics and loss landscape geometry, critical for improving interpretability and robustness. While mode connectivity, a lens…

机器学习 · 计算机科学 2025-02-19 Bingheng Li , Zhikai Chen , Haoyu Han , Shenglai Zeng , Jingzhe Liu , Jiliang Tang

Graph neural networks (GNNs) are powerful machine learning models for various graph learning tasks. Recently, the limitations of the expressive power of various GNN models have been revealed. For example, GNNs cannot distinguish some…

机器学习 · 计算机科学 2021-01-19 Ryoma Sato , Makoto Yamada , Hisashi Kashima