English
Related papers

Related papers: The Case for Claim Difficulty Assessment in Automa…

200 papers

Automatic fake news detection models are ostensibly based on logic, where the truth of a claim made in a headline can be determined by supporting or refuting evidence found in a resulting web query. These models are believed to be reasoning…

Computation and Language · Computer Science 2022-04-18 Ian Kelk , Benjamin Basseri , Wee Yi Lee , Richard Qiu , Chris Tanner

We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that SUPPORTS or REFUTES a given scientific claim, and to identify rationales justifying each decision. To study…

Computation and Language · Computer Science 2020-10-06 David Wadden , Shanchuan Lin , Kyle Lo , Lucy Lu Wang , Madeleine van Zuylen , Arman Cohan , Hannaneh Hajishirzi

The increasing prevalence of online misinformation has heightened the demand for automated fact-checking solutions. Large Language Models (LLMs) have emerged as potential tools for assisting in this task, but their effectiveness remains…

Computers and Society · Computer Science 2025-03-10 Nicolo' Fontana , Francesco Corso , Enrico Zuccolotto , Francesco Pierri

An important component of an automated fact-checking system is the claim check-worthiness detection system, which ranks sentences by prioritising them based on their need to be checked. Despite a body of research tackling the task, previous…

Computation and Language · Computer Science 2022-12-19 Amani S. Abumansour , Arkaitz Zubiaga

Recent studies investigated the challenge of assessing the strength of a given claim extracted from a dataset, particularly the claim's potential of being misleading and cherry-picked. We focus on claims that compare answers to an aggregate…

Databases · Computer Science 2024-08-28 Shunit Agmon , Amir Gilad , Brit Youngmann , Shahar Zoarets , Benny Kimelfeld

Given the volume of potentially false claims online, claim prioritization is essential in allocating limited human resources available for fact-checking. In this study, we perceive claim prioritization as an information retrieval (IR) task:…

Human-Computer Interaction · Computer Science 2026-01-23 Houjiang Liu , Jacek Gwizdka , Matthew Lease

With the growing importance of detecting misinformation, many studies have focused on verifying factual claims by retrieving evidence. However, canonical fact verification tasks do not apply to catching subtle differences in factually…

Computation and Language · Computer Science 2023-06-13 Miyoung Ko , Ingyu Seong , Hwaran Lee , Joonsuk Park , Minsuk Chang , Minjoon Seo

Fact verification (FV) aims to assess the veracity of a claim based on relevant evidence. The traditional approach for automated FV includes a three-part pipeline relying on short evidence snippets and encoder-only inference models. More…

Computation and Language · Computer Science 2025-02-21 Juraj Vladika , Ivana Hacajová , Florian Matthes

The Automated Verification of Textual Claims (AVeriTeC) shared task asks participants to retrieve evidence and predict veracity for real-world claims checked by fact-checkers. Evidence can be found either via a search engine, or via a…

Technological progress has led to concrete advancements in tasks that were regarded as challenging, such as automatic fact-checking. Interest in adopting these systems for public health and medicine has grown due to the high-stakes nature…

Computation and Language · Computer Science 2026-04-30 Sebastian Joseph , Lily Chen , Barry Wei , Michael Mackert , Iain J. Marshall , Paul Pu Liang , Ramez Kouzy , Byron C. Wallace , Junyi Jessy Li

Automated fact-checking systems verify claims against evidence to predict their veracity. In real-world scenarios, the retrieved evidence may not unambiguously support or refute the claim and yield conflicting but valid interpretations.…

Computation and Language · Computer Science 2023-12-15 Max Glockner , Ieva Staliūnaitė , James Thorne , Gisela Vallejo , Andreas Vlachos , Iryna Gurevych

To mitigate the negative effects of false information more effectively, the development of Artificial Intelligence (AI) systems to assist fact-checkers is needed. Nevertheless, the lack of focus on the needs of these stakeholders results in…

Computers and Society · Computer Science 2025-09-05 Andrea Hrckova , Robert Moro , Ivan Srba , Jakub Simko , Maria Bielikova

Real-world fact verification task aims to verify the factuality of a claim by retrieving evidence from the source document. The quality of the retrieved evidence plays an important role in claim verification. Ideally, the retrieved evidence…

Computation and Language · Computer Science 2023-05-08 Xuming Hu , Zhaochen Hong , Zhijiang Guo , Lijie Wen , Philip S. Yu

Fact-checking numerical claims is critical as the presence of numbers provide mirage of veracity despite being fake potentially causing catastrophic impacts on society. The prior works in automatic fact verification do not primarily focus…

Information Retrieval · Computer Science 2025-10-28 V Venktesh , Deepali Prabhu , Avishek Anand

A reasonable approach for fact checking a claim involves retrieving potentially relevant documents from different sources (e.g., news websites, social media, etc.), determining the stance of each document with respect to the claim, and…

Computation and Language · Computer Science 2018-04-24 Ramy Baly , Mitra Mohtarami , James Glass , Lluis Marquez , Alessandro Moschitti , Preslav Nakov

Technological advancement allows information to be shared in just a single click, which has enabled the rapid spread of false information. This makes automated fact-checking system necessary to ensure the safety and integrity of our online…

Artificial Intelligence · Computer Science 2025-12-02 Anab Maulana Barik , Shou Ziyi , Yang Kaiwen , Yang Qi , Shen Xin

Social media and user-generated content (UGC) have become increasingly important features of journalistic work in a number of different ways. However, the growth of misinformation means that news organisations have had devote more and more…

Human-Computer Interaction · Computer Science 2023-07-07 Rob Procter , Miguel Arana-Catania , Yulan He , Maria Liakata , Arkaitz Zubiaga , Elena Kochkina , Runcong Zhao

An optimal delivery of arguments is key to persuasion in any debate, both for humans and for AI systems. This requires the use of clear and fluent claims relevant to the given debate. Prior work has studied the automatic assessment of…

Computation and Language · Computer Science 2023-09-08 Gabriella Skitalinskaya , Maximilian Spliethöver , Henning Wachsmuth

Factchecking has always been a part of the journalistic process. However with newsroom budgets shrinking it is coming under increasing pressure just as the amount of false information circulating is on the rise. We therefore propose a…

Computation and Language · Computer Science 2019-07-04 Ben Adler , Giacomo Boscaini-Gilroy

Existing datasets for automated fact-checking have substantial limitations, such as relying on artificial claims, lacking annotations for evidence and intermediate reasoning, or including evidence published after the claim. In this paper we…

Computation and Language · Computer Science 2023-11-09 Michael Schlichtkrull , Zhijiang Guo , Andreas Vlachos