Weighted Parsing for Grammar-Based Language Models over Multioperator Monoids
Formal Languages and Automata Theory
2019-11-18 v1
Abstract
We develop a general framework for weighted parsing which is built on top of grammar-based language models and employs multioperator monoids as weight algebras. It generalizes previous work in that area (semiring parsing, weighted deductive parsing) and also covers applications outside the classical scope of parsing, e.g., algebraic dynamic programming. We show an algorithm for weighted parsing and, for a large class of weighted grammar-based language models, we prove formally that it terminates and is correct.
Keywords
Cite
@article{arxiv.1911.06585,
title = {Weighted Parsing for Grammar-Based Language Models over Multioperator Monoids},
author = {Richard Mörbitz and Heiko Vogler},
journal= {arXiv preprint arXiv:1911.06585},
year = {2019}
}
Comments
59 pages (89 with appendix)