English

DeMeVa at LeWiDi-2025: Modeling Perspectives with In-Context Learning and Label Distribution Learning

Computation and Language 2025-09-12 v1 Machine Learning

Abstract

This system paper presents the DeMeVa team's approaches to the third edition of the Learning with Disagreements shared task (LeWiDi 2025; Leonardelli et al., 2025). We explore two directions: in-context learning (ICL) with large language models, where we compare example sampling strategies; and label distribution learning (LDL) methods with RoBERTa (Liu et al., 2019b), where we evaluate several fine-tuning methods. Our contributions are twofold: (1) we show that ICL can effectively predict annotator-specific annotations (perspectivist annotations), and that aggregating these predictions into soft labels yields competitive performance; and (2) we argue that LDL methods are promising for soft label predictions and merit further exploration by the perspectivist community.

Keywords

Cite

@article{arxiv.2509.09524,
  title  = {DeMeVa at LeWiDi-2025: Modeling Perspectives with In-Context Learning and Label Distribution Learning},
  author = {Daniil Ignatev and Nan Li and Hugh Mee Wong and Anh Dang and Shane Kaszefski Yaschuk},
  journal= {arXiv preprint arXiv:2509.09524},
  year   = {2025}
}

Comments

11 pages, 4 figures; to appear at NLPerspectives@EMNLP-2025