Incorporating Both Distributional and Relational Semantics in Word Representations
Computation and Language
2015-03-24 v3
Abstract
We investigate the hypothesis that word representations ought to incorporate both distributional and relational semantics. To this end, we employ the Alternating Direction Method of Multipliers (ADMM), which flexibly optimizes a distributional objective on raw text and a relational objective on WordNet. Preliminary results on knowledge base completion, analogy tests, and parsing show that word representations trained on both objectives can give improvements in some cases.
Cite
@article{arxiv.1412.5836,
title = {Incorporating Both Distributional and Relational Semantics in Word Representations},
author = {Daniel Fried and Kevin Duh},
journal= {arXiv preprint arXiv:1412.5836},
year = {2015}
}
Comments
Accepted as a workshop contribution at ICLR2015. Long version at: arXiv:1412.4369