English

Evaluating Word Embedding Hyper-Parameters for Similarity and Analogy Tasks

Computation and Language 2018-04-13 v1

Abstract

The versatility of word embeddings for various applications is attracting researchers from various fields. However, the impact of hyper-parameters when training embedding model is often poorly understood. How much do hyper-parameters such as vector dimensions and corpus size affect the quality of embeddings, and how do these results translate to downstream applications? Using standard embedding evaluation metrics and datasets, we conduct a study to empirically measure the impact of these hyper-parameters.

Keywords

Cite

@article{arxiv.1804.04211,
  title  = {Evaluating Word Embedding Hyper-Parameters for Similarity and Analogy Tasks},
  author = {Maryam Fanaeepour and Adam Makarucha and Jey Han Lau},
  journal= {arXiv preprint arXiv:1804.04211},
  year   = {2018}
}

Comments

8 pages, 16 figures

R2 v1 2026-06-23T01:21:00.393Z