Principled approach to the selection of the embedding dimension of networks
Abstract
Network embedding is a general-purpose machine learning technique that encodes network structure in vector spaces with tunable dimension. Choosing an appropriate embedding dimension -- small enough to be efficient and large enough to be effective -- is challenging but necessary to generate embeddings applicable to a multitude of tasks. Existing strategies for the selection of the embedding dimension rely on performance maximization in downstream tasks. Here, we propose a principled method such that all structural information of a network is parsimoniously encoded. The method is validated on various embedding algorithms and a large corpus of real-world networks. The embedding dimension selected by our method in real-world networks suggest that efficient encoding in low-dimensional spaces is usually possible.
Keywords
Cite
@article{arxiv.2004.09928,
title = {Principled approach to the selection of the embedding dimension of networks},
author = {Weiwei Gu and Aditya Tandon and Yong-Yeol Ahn and Filippo Radicchi},
journal= {arXiv preprint arXiv:2004.09928},
year = {2021}
}
Comments
13 pages, 5 figures, Supplementary Information available this http://homes.sice.indiana.edu/filiradi/Mypapers/SI_nc.pdf