Distributional Clustering of English Words
cmp-lg
2008-02-03 v1 Computation and Language
Abstract
We describe and experimentally evaluate a method for automatically clustering words according to their distribution in particular syntactic contexts. Deterministic annealing is used to find lowest distortion sets of clusters. As the annealing parameter increases, existing clusters become unstable and subdivide, yielding a hierarchical ``soft'' clustering of the data. Clusters are used as the basis for class models of word coocurrence, and the models evaluated with respect to held-out test data.
Keywords
Cite
@article{arxiv.cmp-lg/9408011,
title = {Distributional Clustering of English Words},
author = {Fernando Pereira and Naftali Tishby and Lillian Lee},
journal= {arXiv preprint arXiv:cmp-lg/9408011},
year = {2008}
}
Comments
8 pages, appeared in the proceedings of ACL-93, Columbus, Ohio