English

Runtime Performances Benchmark for Knowledge Graph Embedding Methods

Machine Learning 2020-11-10 v1 Hardware Architecture Neural and Evolutionary Computing Performance

Abstract

This paper wants to focus on providing a characterization of the runtime performances of state-of-the-art implementations of KGE alghoritms, in terms of memory footprint and execution time. Despite the rapidly growing interest in KGE methods, so far little attention has been devoted to their comparison and evaluation; in particular, previous work mainly focused on performance in terms of accuracy in specific tasks, such as link prediction. To this extent, a framework is proposed for evaluating available KGE implementations against graphs with different properties, with a particular focus on the effectiveness of the adopted optimization strategies. Graphs and models have been trained leveraging different architectures, in order to enlighten features and properties of both models and the architectures they have been trained on. Some results enlightened with experiments in this document are the fact that multithreading is efficient, but benefit deacreases as the number of threads grows in case of CPU. GPU proves to be the best architecture for the given task, even if CPU with some vectorized instructions still behaves well. Finally, RAM utilization for the loading of the graph never changes between different architectures and depends only on the type of graph, not on the model.

Keywords

Cite

@article{arxiv.2011.04275,
  title  = {Runtime Performances Benchmark for Knowledge Graph Embedding Methods},
  author = {Angelica Sofia Valeriani},
  journal= {arXiv preprint arXiv:2011.04275},
  year   = {2020}
}

Comments

arXiv admin note: text overlap with arXiv:1903.11406, arXiv:2002.00819 by other authors