English
Related papers

Related papers: FactFinders at CheckThat! 2024: Refining Check-wor…

200 papers

This paper discusses the approach used by the Accenture Team for CLEF2021 CheckThat! Lab, Task 1, to identify whether a claim made in social media would be interesting to a wide audience and should be fact-checked. Twitter training and test…

Computation and Language · Computer Science 2021-07-14 Evan Williams , Paul Rodrigues , Sieu Tran

Claim verification can be a challenging task. In this paper, we present a method to enhance the robustness and reasoning capabilities of automated claim verification through the extraction of short facts from evidence. Our novel approach,…

Computation and Language · Computer Science 2024-07-29 Nazanin Jafari , James Allan

The fluency and creativity of large pre-trained language models (LLMs) have led to their widespread use, sometimes even as a replacement for traditional search engines. Yet language models are prone to making convincing but factually…

Computation and Language · Computer Science 2023-11-15 Katherine Tian , Eric Mitchell , Huaxiu Yao , Christopher D. Manning , Chelsea Finn

As the first step of automatic fact checking, claim check-worthiness detection is a critical component of fact checking systems. There are multiple lines of research which study this problem: check-worthiness ranking from political speeches…

Computation and Language · Computer Science 2020-09-17 Dustin Wright , Isabelle Augenstein

Fact tracing seeks to identify specific training examples that serve as the knowledge source for a given query. Existing approaches to fact tracing rely on assessing the similarity between each training sample and the query along a certain…

Computation and Language · Computer Science 2024-04-24 Si Chen , Feiyang Kang , Ning Yu , Ruoxi Jia

A common strategy for fact-checking long-form content generated by Large Language Models (LLMs) is extracting simple claims that can be verified independently. Since inaccurate or incomplete claims compromise fact-checking results, ensuring…

Computation and Language · Computer Science 2025-06-09 Dasha Metropolitansky , Jonathan Larson

In this digital age of news consumption, a news reader has the ability to react, express and share opinions with others in a highly interactive and fast manner. As a consequence, fake news has made its way into our daily life because of…

Computation and Language · Computer Science 2020-09-22 Gullal S. Cheema , Sherzod Hakimov , Ralph Ewerth

The integration of Large Language Models (LLMs) in information retrieval has raised a critical reevaluation of fairness in the text-ranking models. LLMs, such as GPT models and Llama2, have shown effectiveness in natural language…

Information Retrieval · Computer Science 2024-06-27 Yuan Wang , Xuyang Wu , Hsin-Tai Wu , Zhiqiang Tao , Yi Fang

The increasing threat of disinformation calls for automating parts of the fact-checking pipeline. Identifying text segments requiring fact-checking is known as claim detection (CD) and claim check-worthiness detection (CW), the latter…

Computation and Language · Computer Science 2024-10-22 Laura Majer , Jan Šnajder

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

Computation and Language · Computer Science 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao

Large language models (LLMs) demonstrate impressive capabilities in mathematical reasoning. However, despite these achievements, current evaluations are mostly limited to specific mathematical topics, and it remains unclear whether LLMs are…

Computation and Language · Computer Science 2025-04-01 Arash Gholami Davoodi , Seyed Pouyan Mousavi Davoudi , Pouya Pezeshkpour

We present an overview of the third edition of the CheckThat! Lab at CLEF 2020. The lab featured five tasks in two different languages: English and Arabic. The first four tasks compose the full pipeline of claim verification in social…

Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate…

Computation and Language · Computer Science 2024-11-08 Jerry Wei , Chengrun Yang , Xinying Song , Yifeng Lu , Nathan Hu , Jie Huang , Dustin Tran , Daiyi Peng , Ruibo Liu , Da Huang , Cosmo Du , Quoc V. Le

The recent proliferation of "fake news" has triggered a number of responses, most notably the emergence of several manual fact-checking initiatives. As a result and over time, a large number of fact-checked claims have been accumulated,…

Computation and Language · Computer Science 2020-05-14 Shaden Shaar , Giovanni Da San Martino , Nikolay Babulkov , Preslav Nakov

Large Language Models (LLMs) hold significant potential for advancing fact-checking by leveraging their capabilities in reasoning, evidence retrieval, and explanation generation. However, existing benchmarks fail to comprehensively evaluate…

Computation and Language · Computer Science 2025-06-17 Shuo Yang , Yuqin Dai , Guoqing Wang , Xinran Zheng , Jinfeng Xu , Jinze Li , Zhenzhe Ying , Weiqiang Wang , Edith C. H. Ngai

The pervasive spread of misinformation and disinformation poses a significant threat to society. Professional fact-checkers play a key role in addressing this threat, but the vast scale of the problem forces them to prioritize their limited…

Computers and Society · Computer Science 2024-01-31 Terrence Neumann , Sooyong Lee , Maria De-Arteaga , Sina Fazelpour , Matthew Lease

Knowledge Graphs (KGs) store structured factual knowledge by linking entities through relationships, crucial for many applications. These applications depend on the KG's factual accuracy, so verifying facts is essential, yet challenging.…

Databases · Computer Science 2026-02-12 Farzad Shami , Stefano Marchesin , Gianmaria Silvello

For the ACMMM25 challenge, we present a practical engineering approach to multimedia news source verification, utilizing Large Language Models (LLMs) like GPT-4o as the backbone of our pipeline. Our method processes images and videos…

Fact-checking based on commercial LLMs has become mainstream. Although these methods offer high explainability, it falls short in accuracy compared to traditional fine-tuning approaches, and data security is also a significant concern. In…

Computation and Language · Computer Science 2024-05-24 Guangyao Lu , Yulin Liu

Identifying check-worthy claims is often the first step of automated fact-checking systems. Tackling this task in a multilingual setting has been understudied. Encoding inputs with multilingual text representations could be one approach to…

Computation and Language · Computer Science 2021-09-21 Ipek Baris Schlicht , Angel Felipe Magnossão de Paula , Paolo Rosso