Summarization is a challenging problem, and even more challenging is to manually create, correct, and evaluate the summaries. The severity of the problem grows when the inputs are multi-party dialogues in a meeting setup. To facilitate the research in this area, we present ALIGNMEET, a comprehensive tool for meeting annotation, alignment, and evaluation. The tool aims to provide an efficient and clear interface for fast annotation while mitigating the risk of introducing errors. Moreover, we add an evaluation mode that enables a comprehensive quality evaluation of meeting minutes. To the best of our knowledge, there is no such tool available. We release the tool as open source. It is also directly installable from PyPI.
@article{arxiv.2205.05433,
title = {ALIGNMEET: A Comprehensive Tool for Meeting Annotation, Alignment, and Evaluation},
author = {Peter Polák and Muskaan Singh and Anna Nedoluzhko and Ondřej Bojar},
journal= {arXiv preprint arXiv:2205.05433},
year = {2022}
}