English

Ground Truth Generation for Multilingual Historical NLP using LLMs

Computation and Language 2025-11-19 v1 Artificial Intelligence

Abstract

Historical and low-resource NLP remains challenging due to limited annotated data and domain mismatches with modern, web-sourced corpora. This paper outlines our work in using large language models (LLMs) to create ground-truth annotations for historical French (16th-20th centuries) and Chinese (1900-1950) texts. By leveraging LLM-generated ground truth on a subset of our corpus, we were able to fine-tune spaCy to achieve significant gains on period-specific tests for part-of-speech (POS) annotations, lemmatization, and named entity recognition (NER). Our results underscore the importance of domain-specific models and demonstrate that even relatively limited amounts of synthetic data can improve NLP tools for under-resourced corpora in computational humanities research.

Keywords

Cite

@article{arxiv.2511.14688,
  title  = {Ground Truth Generation for Multilingual Historical NLP using LLMs},
  author = {Clovis Gladstone and Zhao Fang and Spencer Dean Stewart},
  journal= {arXiv preprint arXiv:2511.14688},
  year   = {2025}
}

Comments

13 pages, 5 tables, 1 figure

R2 v1 2026-07-01T07:43:46.508Z