An Annotation Scheme for Factuality and its Application to Parliamentary Proceedings
Abstract
Factuality assesses the extent to which a language utterance relates to real-world information; it determines whether utterances correspond to facts, possibilities, or imaginary situations, and as such, it is instrumental for fact checking. Factuality is a complex notion that relies on multiple linguistic signals, and has been studied in various disciplines. We present a complex, multi-faceted annotation scheme of factuality that combines concepts from a variety of previous works. We developed the scheme for Hebrew, but we trust that it can be adapted to other languages. We also present a set of almost 5,000 sentences in the domain of parliamentary discourse that we manually annotated according to this scheme. We report on inter-annotator agreement, and experiment with various approaches to automatically predict (some features of) the scheme, in order to extend the annotation to a large corpus.
Keywords
Cite
@article{arxiv.2509.26406,
title = {An Annotation Scheme for Factuality and its Application to Parliamentary Proceedings},
author = {Gili Goldin and Shira Wigderson and Ella Rabinovich and Shuly Wintner},
journal= {arXiv preprint arXiv:2509.26406},
year = {2026}
}
Comments
@InProceedings{goldin-EtAl:2025:RANLP, author = {Goldin, Gili and Wigderson, Shira and Rabinovich, Ella and Wintner, Shuly}, title = {An Annotation Scheme for Factuality in Parliamentary Proceedings}, booktitle = {Proceedings of RANLP 2025}, year = {2025}, address = {Varna, Bulgaria}, pages = {403--412} }