English

Inductive Representation Learning on Large Graphs

Social and Information Networks 2018-09-11 v4 Machine Learning Machine Learning

Abstract

Low-dimensional embeddings of nodes in large graphs have proved extremely useful in a variety of prediction tasks, from content recommendation to identifying protein functions. However, most existing approaches require that all nodes in the graph are present during training of the embeddings; these previous approaches are inherently transductive and do not naturally generalize to unseen nodes. Here we present GraphSAGE, a general, inductive framework that leverages node feature information (e.g., text attributes) to efficiently generate node embeddings for previously unseen data. Instead of training individual embeddings for each node, we learn a function that generates embeddings by sampling and aggregating features from a node's local neighborhood. Our algorithm outperforms strong baselines on three inductive node-classification benchmarks: we classify the category of unseen nodes in evolving information graphs based on citation and Reddit post data, and we show that our algorithm generalizes to completely unseen graphs using a multi-graph dataset of protein-protein interactions.

Keywords

Cite

@article{arxiv.1706.02216,
  title  = {Inductive Representation Learning on Large Graphs},
  author = {William L. Hamilton and Rex Ying and Jure Leskovec},
  journal= {arXiv preprint arXiv:1706.02216},
  year   = {2018}
}

Comments

Published in NIPS 2017; version with full appendix and minor corrections