The Automated Verification of Textual Claims (AVeriTeC) shared task asks participants to retrieve evidence and predict veracity for real-world claims checked by fact-checkers. Evidence can be found either via a search engine, or via a knowledge store provided by the organisers. Submissions are evaluated using AVeriTeC score, which considers a claim to be accurately verified if and only if both the verdict is correct and retrieved evidence is considered to meet a certain quality threshold. The shared task received 21 submissions, 18 of which surpassed our baseline. The winning team was TUDA_MAI with an AVeriTeC score of 63%. In this paper we describe the shared task, present the full results, and highlight key takeaways from the shared task.
@article{arxiv.2410.23850,
title = {The Automated Verification of Textual Claims (AVeriTeC) Shared Task},
author = {Michael Schlichtkrull and Yulong Chen and Chenxi Whitehouse and Zhenyun Deng and Mubashara Akhtar and Rami Aly and Zhijiang Guo and Christos Christodoulopoulos and Oana Cocarascu and Arpit Mittal and James Thorne and Andreas Vlachos},
journal= {arXiv preprint arXiv:2410.23850},
year = {2024}
}