English

Principled approach to the selection of the embedding dimension of networks

Physics and Society 2021-06-22 v2 Social and Information Networks

Abstract

Network embedding is a general-purpose machine learning technique that encodes network structure in vector spaces with tunable dimension. Choosing an appropriate embedding dimension -- small enough to be efficient and large enough to be effective -- is challenging but necessary to generate embeddings applicable to a multitude of tasks. Existing strategies for the selection of the embedding dimension rely on performance maximization in downstream tasks. Here, we propose a principled method such that all structural information of a network is parsimoniously encoded. The method is validated on various embedding algorithms and a large corpus of real-world networks. The embedding dimension selected by our method in real-world networks suggest that efficient encoding in low-dimensional spaces is usually possible.

Keywords

Cite

@article{arxiv.2004.09928,
  title  = {Principled approach to the selection of the embedding dimension of networks},
  author = {Weiwei Gu and Aditya Tandon and Yong-Yeol Ahn and Filippo Radicchi},
  journal= {arXiv preprint arXiv:2004.09928},
  year   = {2021}
}

Comments

13 pages, 5 figures, Supplementary Information available this http://homes.sice.indiana.edu/filiradi/Mypapers/SI_nc.pdf