English
Related papers

Related papers: Understanding Oversmoothing in Diffusion-Based GNN…

200 papers

While Hyperbolic Graph Neural Network (HGNN) has recently emerged as a powerful tool dealing with hierarchical graph data, the limitations of scalability and efficiency hinder itself from generalizing to deep models. In this paper, by…

Machine Learning · Computer Science 2024-06-10 Jiaxu Liu , Xinping Yi , Sihao Wu , Xiangyu Yin , Tianle Zhang , Xiaowei Huang , Shi Jin

With the increasing use of Graph Neural Networks (GNNs) in critical real-world applications, several post hoc explanation methods have been proposed to understand their predictions. However, there has been no work in generating explanations…

Machine Learning · Computer Science 2022-12-02 Valentina Giunchiglia , Chirag Varun Shukla , Guadalupe Gonzalez , Chirag Agarwal

Message Passing Neural Networks (MPNNs) hold a key position in machine learning on graphs, but they struggle with unintended behaviors, such as over-smoothing and over-squashing, due to irregular data structures. The observation and…

Machine Learning · Computer Science 2025-08-26 Junhyun Lee , Veronika Thost , Bumsoo Kim , Jaewoo Kang , Tengfei Ma

There has been tremendous success in the field of graph neural networks (GNNs) as a result of the development of the message-passing (MP) layer, which updates the representation of a node by combining it with its neighbors to address…

Machine Learning · Computer Science 2022-02-11 Hyeokjin Kwon , Jong-Min Lee

Using techniques of the theory of semigroups of linear operators we study the question of approximating solutions to equations governing diffusion in thin layers separated by a semi-permeable membrane. We show that as thickness of the…

Analysis of PDEs · Mathematics 2019-08-08 Adam Bobrowski

Diffusion models have gained popularity in graph generation tasks; however, the extent of their expressivity concerning the graph distributions they can learn is not fully understood. Unlike models in other domains, popular backbones for…

Machine Learning · Computer Science 2025-02-05 Xiyuan Wang , Yewei Liu , Lexi Pang , Siwei Chen , Muhan Zhang

This work examines the problem of graph learning over a diffusion network when data can be collected from a limited portion of the network (partial observability). The main question is to establish technical guarantees of consistent…

Statistics Theory · Mathematics 2020-06-08 Vincenzo Matta , Augusto Santos , Ali H. Sayed

Message Passing Neural Networks (MPNNs) is the building block of graph foundation models, but fundamentally suffer from oversmoothing and oversquashing. There has recently been a surge of interest in fixing both issues. Existing efforts…

Machine Learning · Computer Science 2025-10-21 Li Sun , Zhenhao Huang , Ming Zhang , Philip S. Yu

In recent years, hypergraph learning has attracted great attention due to its capacity in representing complex and high-order relationships. However, current neural network approaches designed for hypergraphs are mostly shallow, thus…

Machine Learning · Computer Science 2022-11-03 Guanzi Chen , Jiying Zhang , Xi Xiao , Yang Li

Graph neural networks (GNNs) have become a workhorse approach for learning from data defined over irregular domains, typically by implicitly assuming that the data structure is represented by a homophilic graph. However, recent works have…

Machine Learning · Computer Science 2024-09-16 Samuel Rey , Madeline Navarro , Victor M. Tenorio , Santiago Segarra , Antonio G. Marques

Graph Neural Networks (GNNs) have shown superior performance for semi-supervised learning of numerous web applications, such as classification on web services and pages, analysis of online social networks, and recommendation in e-commerce.…

Social and Information Networks · Computer Science 2023-06-06 Keke Huang , Jing Tang , Juncheng Liu , Renchi Yang , Xiaokui Xiao

Graph neural networks (GNNs) have achieved significant success in various applications. Most GNNs learn the node features with information aggregation of its neighbors and feature transformation in each layer. However, the node features…

Machine Learning · Computer Science 2024-07-30 Dongzhuoran Zhou , Hui Yang , Bo Xiong , Yue Ma , Evgeny Kharlamov

Semi-supervised learning (SSL) over graph-structured data emerges in many network science applications. To efficiently manage learning over graphs, variants of graph neural networks (GNNs) have been developed recently. By succinctly…

Machine Learning · Computer Science 2021-10-22 Alireza Sadeghi , Meng Ma , Bingcong Li , Georgios B. Giannakis

Graph convolutional networks have been successfully applied in various graph-based tasks. In a typical graph convolutional layer, node features are updated by aggregating neighborhood information. Repeatedly applying graph convolutions can…

Machine Learning · Computer Science 2022-07-11 Haimin Zhang , Min Xu , Guoqiang Zhang , Kenta Niwa

Due to the over-smoothing issue, most existing graph neural networks can only capture limited dependencies with their inherently finite aggregation layers. To overcome this limitation, we propose a new kind of graph convolution, called…

Machine Learning · Computer Science 2022-06-30 Qi Chen , Yifei Wang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

This paper formulates a multitask optimization problem where agents in the network have individual objectives to meet, or individual parameter vectors to estimate, subject to a smoothness condition over the graph. The smoothness condition…

Multiagent Systems · Computer Science 2019-11-18 Roula Nassif , Stefan Vlaski , Cedric Richard , Ali H. Sayed

Graph Neural Networks (GNNs) have emerged as a powerful category of learning architecture for handling graph-structured data. However, existing GNNs typically ignore crucial structural characteristics in node-induced subgraphs, which thus…

Machine Learning · Computer Science 2023-06-13 Kaixuan Chen , Shunyu Liu , Tongtian Zhu , Tongya Zheng , Haofei Zhang , Zunlei Feng , Jingwen Ye , Mingli Song

The recent rapid growth in mobile data traffic entails a pressing demand for improving the throughput of the underlying wireless communication networks. Network node deployment has been considered as an effective approach for throughput…

Networking and Internet Architecture · Computer Science 2022-09-16 Yifei Yang , Dongmian Zou , Xiaofan He

The Graph Convolutional Networks (GCN) proposed by Kipf and Welling is an effective model for semi-supervised learning, but faces the obstacle of over-smoothing, which will weaken the representation ability of GCN. Recently some works are…

Machine Learning · Computer Science 2022-05-20 Xue Liu , Dan Sun , Wei Wei

The popularity of deep learning techniques renewed the interest in neural architectures able to process complex structures that can be represented using graphs, inspired by Graph Neural Networks (GNNs). We focus our attention on the…

Machine Learning · Computer Science 2021-09-02 Matteo Tiezzi , Giuseppe Marra , Stefano Melacci , Marco Maggini