English
Related papers

Related papers: Layer-Neighbor Sampling -- Defusing Neighborhood E…

200 papers

Subgraph-wise sampling -- a promising class of mini-batch training techniques for graph neural networks (GNNs -- is critical for real-world applications. During the message passing (MP) in GNNs, subgraph-wise sampling methods discard…

Machine Learning · Computer Science 2024-08-22 Jie Wang , Zhihao Shi , Xize Liang , Defu Lian , Shuiwang Ji , Bin Li , Enhong Chen , Feng Wu

While message passing Graph Neural Networks (GNNs) have become increasingly popular architectures for learning with graphs, recent works have revealed important shortcomings in their expressive power. In response, several higher-order GNNs…

Machine Learning · Computer Science 2025-02-28 Behrooz Tahmasebi , Derek Lim , Stefanie Jegelka

Graph Neural Networks (GNNs) have demonstrated significant achievements in processing graph data, yet scalability remains a substantial challenge. To address this, numerous graph coarsening methods have been developed. However, most…

Machine Learning · Computer Science 2024-12-19 Shuyin Xia , Xinjun Ma , Zhiyuan Liu , Cheng Liu , Sen Zhao , Guoyin Wang

Node classifiers are required to comprehensively reduce prediction errors, training resources, and inference latency in the industry. However, most graph neural networks (GNN) concentrate only on one or two of them. The compromised aspects…

Machine Learning · Computer Science 2023-06-01 Yi Luo , Guangchun Luo , Ke Qin , Aiguo Chen

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

Machine Learning · Computer Science 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Deep learning has consistently defied state-of-the-art techniques in many fields over the last decade. However, we are just beginning to understand the capabilities of neural learning in symbolic domains. Deep learning architectures that…

Machine Learning · Computer Science 2020-03-10 Henrique Lemos , Marcelo Prates , Pedro Avelar , Luis Lamb

HyperAggregation is a hypernetwork-based aggregation function for Graph Neural Networks. It uses a hypernetwork to dynamically generate weights in the size of the current neighborhood, which are then used to aggregate this neighborhood.…

Machine Learning · Computer Science 2024-07-17 Nicolas Lell , Ansgar Scherp

In recent years, using a self-supervised learning framework to learn the general characteristics of graphs has been considered a promising paradigm for graph representation learning. The core of self-supervised learning strategies for graph…

Machine Learning · Computer Science 2022-12-09 Jiawei Zhu , Mei Hong , Ronghua Du , Haifeng Li

The goal of graph summarization is to represent large graphs in a structured and compact way. A graph summary based on equivalence classes preserves pre-defined features of a graph's vertex within a $k$-hop neighborhood such as the vertex…

Machine Learning · Computer Science 2022-12-09 Maximilian Blasi , Manuel Freudenreich , Johannes Horvath , David Richerby , Ansgar Scherp

As much as Graph Convolutional Networks (GCNs) have shown tremendous success in recommender systems and collaborative filtering (CF), the mechanism of how they, especially the core components (\textit{i.e.,} neighborhood aggregation)…

Information Retrieval · Computer Science 2022-04-26 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine

We propose interpretable graph neural networks for sampling and recovery of graph signals, respectively. To take informative measurements, we propose a new graph neural sampling module, which aims to select those vertices that maximally…

Machine Learning · Computer Science 2020-11-04 Siheng Chen , Maosen Li , Ya Zhang

Graph neural networks (GNNs) have been widely applied to numerous fields. A recent work which combines layered structure and residual connection proposes an improved deep architecture to extend CAmouflage-REsistant GNN (CARE-GNN) to deep…

Machine Learning · Computer Science 2022-02-15 Yufan Zeng , Jiashan Tang

K-nearest neighbors (KNN) is one of the earliest and most established algorithms in machine learning. For regression tasks, KNN averages the targets within a neighborhood which poses a number of challenges: the neighborhood definition is…

Machine Learning · Computer Science 2022-05-18 Youssef Nader , Leon Sixt , Tim Landgraf

Graph Convolutional Networks (GCNs) and their variants have achieved significant performances on various recommendation tasks. However, many existing GCN models tend to perform recursive aggregations among all related nodes, which can arise…

Information Retrieval · Computer Science 2022-10-17 Yue Xu , Hao Chen , Zengde Deng , Yuanchen Bei , Feiran Huang

Graph Neural Networks (GNNs) are widely used for node classification, yet their opaque decision-making limits trust and adoption. While local explanations offer insights into individual predictions, global explanation methods, those that…

Machine Learning · Computer Science 2025-10-30 Burouj Armgaan , Eshan Jain , Harsh Pandey , Mahesh Chandran , Sayan Ranu

Graph neural networks (GNNs) have revolutionized the field of machine learning on non-Euclidean data such as graphs and networks. GNNs effectively implement node representation learning through neighborhood aggregation and achieve…

Machine Learning · Computer Science 2024-04-30 Zehao Dong , Muhan Zhang , Yixin Chen

Graph Structure Learning (GSL) has demonstrated considerable potential in the analysis of graph-unknown non-Euclidean data across a wide range of domains. However, constructing an end-to-end graph structure learning model poses a challenge…

Machine Learning · Computer Science 2023-12-18 Xiaolong Fan , Maoguo Gong , Yue Wu , Zedong Tang , Jieyi Liu

Training of graph neural networks (GNNs) for large-scale node classification is challenging. A key difficulty lies in obtaining accurate hidden node representations while avoiding the neighborhood explosion problem. Here, we propose a new…

Machine Learning · Computer Science 2022-06-22 Haiyang Yu , Limei Wang , Bokun Wang , Meng Liu , Tianbao Yang , Shuiwang Ji

The training process of neural networks is known to be time-consuming, and having a deep architecture only aggravates the issue. This process consists mostly of matrix operations, among which matrix multiplication is the bottleneck. Several…

Machine Learning · Computer Science 2025-06-17 Sana Ebrahimi , Rishi Advani , Abolfazl Asudeh

We propose a dynamic neighborhood aggregation (DNA) procedure guided by (multi-head) attention for representation learning on graphs. In contrast to current graph neural networks which follow a simple neighborhood aggregation scheme, our…

Machine Learning · Computer Science 2019-04-16 Matthias Fey