English

Bridging the Gap between Spatial and Spectral Domains: A Survey on Graph Neural Networks

Machine Learning 2021-07-22 v4 Artificial Intelligence Computational Geometry Machine Learning

Abstract

Deep learning's success has been widely recognized in a variety of machine learning tasks, including image classification, audio recognition, and natural language processing. As an extension of deep learning beyond these domains, graph neural networks (GNNs) are designed to handle the non-Euclidean graph-structure which is intractable to previous deep learning techniques. Existing GNNs are presented using various techniques, making direct comparison and cross-reference more complex. Although existing studies categorize GNNs into spatial-based and spectral-based techniques, there hasn't been a thorough examination of their relationship. To close this gap, this study presents a single framework that systematically incorporates most GNNs. We organize existing GNNs into spatial and spectral domains, as well as expose the connections within each domain. A review of spectral graph theory and approximation theory builds a strong relationship across the spatial and spectral domains in further investigation.

Keywords

Cite

@article{arxiv.2002.11867,
  title  = {Bridging the Gap between Spatial and Spectral Domains: A Survey on Graph Neural Networks},
  author = {Zhiqian Chen and Fanglan Chen and Lei Zhang and Taoran Ji and Kaiqun Fu and Liang Zhao and Feng Chen and Lingfei Wu and Charu Aggarwal and Chang-Tien Lu},
  journal= {arXiv preprint arXiv:2002.11867},
  year   = {2021}
}