中文
相关论文

相关论文: Graph Coarsening with Message-Passing Guarantees

200 篇论文

Message passing plays a vital role in graph neural networks (GNNs) for effective feature learning. However, the over-reliance on input topology diminishes the efficacy of message passing and restricts the ability of GNNs. Despite efforts to…

机器学习 · 计算机科学 2024-12-03 Junshu Sun , Chenxue Yang , Xiangyang Ji , Qingming Huang , Shuhui Wang

Distributed Graph Neural Network (GNN) training suffers from substantial communication overhead due to the inherent neighborhood dependency in graph-structured data. This neighbor explosion problem requires workers to frequently exchange…

分布式、并行与集群计算 · 计算机科学 2026-01-27 Zizhao Zhang , Yihan Xue , Haotian Zhu , Sijia Li , Zhijun Wang , Yujie Xiao

Graph Neural Networks (GNNs) have demonstrated strong performance in graph mining tasks due to their message-passing mechanism, which is aligned with the homophily assumption that adjacent nodes exhibit similar behaviors. However, in many…

机器学习 · 计算机科学 2024-05-29 Zhuonan Zheng , Yuanchen Bei , Sheng Zhou , Yao Ma , Ming Gu , HongJia XU , Chengyu Lai , Jiawei Chen , Jiajun Bu

Graph Neural Networks (GNNs) have proven to be highly effective in various graph learning tasks. A key characteristic of GNNs is their use of a fixed number of message-passing steps for all nodes in the graph, regardless of each node's…

Graph neural networks (GNNs) have evolved into one of the most popular deep learning architectures. However, GNNs suffer from over-smoothing node information and, therefore, struggle to solve tasks where global graph properties are…

机器学习 · 计算机科学 2023-08-31 Bernhard Schäfl , Lukas Gruber , Johannes Brandstetter , Sepp Hochreiter

The attention mechanism has demonstrated superior performance for inference over nodes in graph neural networks (GNNs), however, they result in a high computational burden during both training and inference. We propose FastGAT, a method to…

机器学习 · 计算机科学 2020-10-06 Rakshith S Srinivasa , Cao Xiao , Lucas Glass , Justin Romberg , Jimeng Sun

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

机器学习 · 计算机科学 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Graph neural network have achieved impressive results in predicting molecular properties, but they do not directly account for local and hidden structures in the graph such as functional groups and molecular geometry. At each propagation…

机器学习 · 计算机科学 2020-02-25 Daniel Flam-Shepherd , Tony Wu , Pascal Friederich , Alan Aspuru-Guzik

Graph Neural Networks (GNNs) have emerged as a powerful technique for learning on relational data. Owing to the relatively limited number of message passing steps they perform -- and hence a smaller receptive field -- there has been…

机器学习 · 计算机科学 2022-06-27 Ameya Velingker , Ali Kemal Sinop , Ira Ktena , Petar Veličković , Sreenivas Gollapudi

As one of the core technologies for 5G systems, massive multiple-input multiple-output (MIMO) introduces dramatic capacity improvements along with very high beamforming and spatial multiplexing gains. When developing efficient physical…

信息论 · 计算机科学 2023-11-01 Hengtao He , Xianghao Yu , Jun Zhang , Shenghui Song , Khaled B. Letaief

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

机器学习 · 计算机科学 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

$\textbf{Graph Coarsening (GC)}$ is a prominent graph reduction technique that compresses large graphs to enable efficient learning and inference. However, existing GC methods generate only one coarsened graph per run and must recompute…

社会与信息网络 · 计算机科学 2025-05-23 Mohit Kataria , Shreyash Bhilwade , Sandeep Kumar , Jayadeva

Graph signal processing (GSP) is a framework to analyze and process graph-structured data. Many research works focus on developing tools such as Graph Fourier transforms (GFT), filters, and neural network models to handle graph signals.…

信号处理 · 电气工程与系统科学 2023-03-13 Feng Ji , Wee Peng Tay

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

机器学习 · 计算机科学 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Constructing appropriate representations of molecules lies at the core of numerous tasks such as material science, chemistry and drug designs. Recent researches abstract molecules as attributed graphs and employ graph neural networks (GNN)…

机器学习 · 计算机科学 2021-07-29 Jianwen Chen , Shuangjia Zheng , Ying Song , Jiahua Rao , Yuedong Yang

Most graph neural network models rely on a particular message passing paradigm, where the idea is to iteratively propagate node representations of a graph to each node in the direct neighborhood. While very prominent, this paradigm leads to…

机器学习 · 计算机科学 2023-01-24 Ralph Abboud , Radoslav Dimitrov , İsmail İlkan Ceylan

While many existing graph neural networks (GNNs) have been proven to perform $\ell_2$-based graph smoothing that enforces smoothness globally, in this work we aim to further enhance the local smoothness adaptivity of GNNs via $\ell_1$-based…

机器学习 · 计算机科学 2021-07-16 Xiaorui Liu , Wei Jin , Yao Ma , Yaxin Li , Hua Liu , Yiqi Wang , Ming Yan , Jiliang Tang

Graph Neural Networks (GNNs) are powerful tools for learning representations on graphs, such as social networks. However, their vulnerability to privacy inference attacks restricts their practicality, especially in high-stake domains. To…

机器学习 · 计算机科学 2023-08-28 Tianyi Zhao , Hui Hu , Lu Cheng

Graph neural networks (GNNs) use graph convolutions to exploit network invariances and learn meaningful feature representations from network data. However, on large-scale graphs convolutions incur in high computational cost, leading to…

机器学习 · 计算机科学 2022-06-29 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Machine learning on graphs, especially using graph neural networks (GNNs), has seen a surge in interest due to the wide availability of graph data across a broad spectrum of disciplines, from life to social and engineering sciences. Despite…