English
Related papers

Related papers: A Benchmark for Open-Domain Numerical Fact-Checkin…

200 papers

Automated scientific fact checking is difficult due to the complexity of scientific language and a lack of significant amounts of training data, as annotation requires domain expertise. To address this challenge, we propose scientific claim…

Computation and Language · Computer Science 2022-03-25 Dustin Wright , David Wadden , Kyle Lo , Bailey Kuehl , Arman Cohan , Isabelle Augenstein , Lucy Lu Wang

With the rise of social media, users are exposed to many misleading claims. However, the pervasive noise inherent in these posts presents a challenge in identifying precise and prominent claims that require verification. Extracting the…

Computation and Language · Computer Science 2024-02-13 Megha Sundriyal , Tanmoy Chakraborty , Preslav Nakov

In the midst of widespread misinformation and disinformation through social media and the proliferation of AI-generated texts, it has become increasingly difficult for people to validate and trust information they encounter. Many…

Computation and Language · Computer Science 2024-09-24 Preetam Prabhu Srikar Dammu , Himanshu Naidu , Mouly Dewan , YoungMin Kim , Tanya Roosta , Aman Chadha , Chirag Shah

Automated fact checking systems have been proposed that quickly provide veracity prediction at scale to mitigate the negative influence of fake news on people and on public opinion. However, most studies focus on veracity classifiers of…

Computation and Language · Computer Science 2022-06-15 Shih-Chieh Dai , Yi-Li Hsu , Aiping Xiong , Lun-Wei Ku

Identifying claims requiring verification is a critical task in automated fact-checking, especially given the proliferation of misinformation on social media platforms. Despite notable progress, challenges remain-particularly in handling…

Computation and Language · Computer Science 2025-07-22 Rrubaa Panchendrarajan , Arkaitz Zubiaga

Our collective attention span is shortened by the flood of online information. With \textit{FarFetched}, we address the need for automated claim validation based on the aggregated evidence derived from multiple online news sources. We…

Computation and Language · Computer Science 2024-07-16 Dimitris Papadopoulos , Katerina Metropoulou , Nikolaos Matsatsinis , Nikolaos Papadakis

Online misinformation remains a critical challenge, and fact-checkers increasingly rely on claim matching systems that use sentence embedding models to retrieve relevant fact-checks. However, as users interact with claims online, they often…

Computation and Language · Computer Science 2025-06-06 Jabez Magomere , Emanuele La Malfa , Manuel Tonneau , Ashkan Kazemi , Scott Hale

Fact verification systems typically assess whether a claim is supported by retrieved evidence, assuming that truthfulness depends solely on what is stated. However, many real-world claims are half-truths, factually correct yet misleading…

Computation and Language · Computer Science 2025-09-23 Yixuan Tang , Jincheng Wang , Anthony K. H. Tung

As generated text becomes more commonplace, it is increasingly important to evaluate how well-supported such text is by external knowledge sources. Many approaches for evaluating textual support rely on some method for decomposing text into…

Computation and Language · Computer Science 2024-03-19 Miriam Wanner , Seth Ebner , Zhengping Jiang , Mark Dredze , Benjamin Van Durme

With the growing importance of detecting misinformation, many studies have focused on verifying factual claims by retrieving evidence. However, canonical fact verification tasks do not apply to catching subtle differences in factually…

Computation and Language · Computer Science 2023-06-13 Miyoung Ko , Ingyu Seong , Hwaran Lee , Joonsuk Park , Minsuk Chang , Minjoon Seo

Current scientific fact-checking benchmarks exhibit several shortcomings, such as biases arising from crowd-sourced claims and an over-reliance on text-based evidence. We present SCITAB, a challenging evaluation dataset consisting of 1.2K…

Computation and Language · Computer Science 2023-10-24 Xinyuan Lu , Liangming Pan , Qian Liu , Preslav Nakov , Min-Yen Kan

The decompose-then-verify strategy for verification of Large Language Model (LLM) generations decomposes claims that are then independently verified. Decontextualization augments text (claims) to ensure it can be verified outside of the…

Computation and Language · Computer Science 2024-12-18 Miriam Wanner , Benjamin Van Durme , Mark Dredze

Evaluating the factuality of long-form generations from Large Language Models (LLMs) remains challenging due to efficiency bottlenecks and reliability concerns. Prior efforts attempt this by decomposing text into claims, searching for…

Computation and Language · Computer Science 2025-11-06 Yingjia Wan , Haochen Tan , Xiao Zhu , Xinyu Zhou , Zhiwei Li , Qingsong Lv , Changxuan Sun , Jiaqi Zeng , Yi Xu , Jianqiao Lu , Yinhong Liu , Zhijiang Guo

Fact-checking long-form text is challenging, and it is therefore common practice to break it down into multiple atomic claims. The typical approach to fact-checking these atomic claims involves retrieving a fixed number of pieces of…

Information Retrieval · Computer Science 2025-10-20 Zhuohan Xie , Rui Xing , Yuxia Wang , Jiahui Geng , Hasan Iqbal , Dhruv Sahnan , Iryna Gurevych , Preslav Nakov

Language models are increasingly being used in important decision pipelines, so ensuring the correctness of their outputs is crucial. Recent work has proposed evaluating the "factuality" of claims decomposed from a language model generation…

Computation and Language · Computer Science 2025-05-26 Maxon Rubin-Toles , Maya Gambhir , Keshav Ramji , Aaron Roth , Surbhi Goel

While there has been substantial progress in developing systems to automate fact-checking, they still lack credibility in the eyes of the users. Thus, an interesting approach has emerged: to perform automatic fact-checking by verifying…

Computation and Language · Computer Science 2022-10-11 Momchil Hardalov , Anton Chernyavskiy , Ivan Koychev , Dmitry Ilvovsky , Preslav Nakov

Our fight against false information is spearheaded by fact-checkers. They investigate the veracity of claims and document their findings as fact-checking reports. With the rapid increase in the amount of false information circulating…

Information Retrieval · Computer Science 2025-05-15 Enes Altuncu , Can Başkent , Sanjay Bhattacherjee , Shujun Li , Dwaipayan Roy

Fact verification plays a vital role in combating misinformation by assessing the veracity of claims through evidence retrieval and reasoning. However, traditional methods struggle with complex claims requiring multi-hop reasoning over…

Artificial Intelligence · Computer Science 2025-06-10 Liwen Zheng , Chaozhuo Li , Zheng Liu , Feiran Huang , Haoran Jia , Zaisheng Ye , Xi Zhang

Fact verification requires validating a claim in the context of evidence. We show, however, that in the popular FEVER dataset this might not necessarily be the case. Claim-only classifiers perform competitively with top evidence-aware…

Computation and Language · Computer Science 2019-09-04 Tal Schuster , Darsh J Shah , Yun Jie Serene Yeo , Daniel Filizzola , Enrico Santus , Regina Barzilay

Automatic fact verification has received significant attention recently. Contemporary automatic fact-checking systems focus on estimating truthfulness using numerical scores which are not human-interpretable. A human fact-checker generally…

Computation and Language · Computer Science 2023-05-30 Anku Rani , S. M Towhidul Islam Tonmoy , Dwip Dalal , Shreya Gautam , Megha Chakraborty , Aman Chadha , Amit Sheth , Amitava Das