English

Just Jump: Dynamic Neighborhood Aggregation in Graph Neural Networks

Machine Learning 2019-04-16 v2 Machine Learning

Abstract

We propose a dynamic neighborhood aggregation (DNA) procedure guided by (multi-head) attention for representation learning on graphs. In contrast to current graph neural networks which follow a simple neighborhood aggregation scheme, our DNA procedure allows for a selective and node-adaptive aggregation of neighboring embeddings of potentially differing locality. In order to avoid overfitting, we propose to control the channel-wise connections between input and output by making use of grouped linear projections. In a number of transductive node-classification experiments, we demonstrate the effectiveness of our approach.

Keywords

Cite

@article{arxiv.1904.04849,
  title  = {Just Jump: Dynamic Neighborhood Aggregation in Graph Neural Networks},
  author = {Matthias Fey},
  journal= {arXiv preprint arXiv:1904.04849},
  year   = {2019}
}