Dynamic Nonlocal Language Modeling via Hierarchical Topic-Based Adaptation
Computation and Language
2007-05-23 v1
Abstract
This paper presents a novel method of generating and applying hierarchical, dynamic topic-based language models. It proposes and evaluates new cluster generation, hierarchical smoothing and adaptive topic-probability estimation techniques. These combined models help capture long-distance lexical dependencies. Experiments on the Broadcast News corpus show significant improvement in perplexity (10.5% overall and 33.5% on target vocabulary).
Cite
@article{arxiv.cs/0104019,
title = {Dynamic Nonlocal Language Modeling via Hierarchical Topic-Based Adaptation},
author = {Radu Florian and David Yarowsky},
journal= {arXiv preprint arXiv:cs/0104019},
year = {2007}
}
Comments
8 pages, 29 figures, presented at ACL99, College Park, Maryland