English

The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Who

Computation and Language 2023-11-09 v2

Abstract

Automated fact-checking is often presented as an epistemic tool that fact-checkers, social media consumers, and other stakeholders can use to fight misinformation. Nevertheless, few papers thoroughly discuss how. We document this by analysing 100 highly-cited papers, and annotating epistemic elements related to intended use, i.e., means, ends, and stakeholders. We find that narratives leaving out some of these aspects are common, that many papers propose inconsistent means and ends, and that the feasibility of suggested strategies rarely has empirical backing. We argue that this vagueness actively hinders the technology from reaching its goals, as it encourages overclaiming, limits criticism, and prevents stakeholder feedback. Accordingly, we provide several recommendations for thinking and writing about the use of fact-checking artefacts.

Keywords

Cite

@article{arxiv.2304.14238,
  title  = {The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Who},
  author = {Michael Schlichtkrull and Nedjma Ousidhoum and Andreas Vlachos},
  journal= {arXiv preprint arXiv:2304.14238},
  year   = {2023}
}

Comments

Accepted to the Findings of EMNLP 2023