English
Related papers

Related papers: QuanTemp: A real-world open-domain benchmark for f…

200 papers

The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. Difficulties lie in assessing the factuality of free-form responses in open…

Computation and Language · Computer Science 2025-10-30 Yuxia Wang , Minghan Wang , Hasan Iqbal , Georgi Georgiev , Jiahui Geng , Preslav Nakov

We present CFEVER, a Chinese dataset designed for Fact Extraction and VERification. CFEVER comprises 30,012 manually created claims based on content in Chinese Wikipedia. Each claim in CFEVER is labeled as "Supports", "Refutes", or "Not…

Computation and Language · Computer Science 2025-06-17 Ying-Jia Lin , Chun-Yi Lin , Chia-Jen Yeh , Yi-Ting Li , Yun-Yu Hu , Chih-Hao Hsu , Mei-Feng Lee , Hung-Yu Kao

Contemporary approaches to assisted scientific discovery use language models to automatically generate large numbers of potential hypothesis to test, while also automatically generating code-based experiments to test those hypotheses. While…

Artificial Intelligence · Computer Science 2025-09-23 Peter Jansen , Samiah Hassan , Ruoyao Wang

Fact-checking remains a demanding and time-consuming task, still largely dependent on manual verification and unable to match the rapid spread of misinformation online. This is particularly important because debunking false information…

Given the recent proliferation of false claims online, there has been a lot of manual fact-checking effort. As this is very time-consuming, human fact-checkers can benefit from tools that can support them and make them more efficient. Here,…

Computation and Language · Computer Science 2022-11-16 Shaden Shaar , Nikola Georgiev , Firoj Alam , Giovanni Da San Martino , Aisha Mohamed , Preslav Nakov

In the digital age, seeking health advice on the Internet has become a common practice. At the same time, determining the trustworthiness of online medical content is increasingly challenging. Fact-checking has emerged as an approach to…

Computation and Language · Computer Science 2024-03-26 Juraj Vladika , Phillip Schneider , Florian Matthes

The rapid spread of information in the digital age highlights the critical need for effective fact-checking tools, particularly for languages with limited resources, such as Vietnamese. In response to this challenge, we introduce…

Computation and Language · Computer Science 2024-12-23 Tran Thai Hoa , Tran Quang Duy , Khanh Quoc Tran , Kiet Van Nguyen

Misinformation can be countered with fact-checking, but the process is costly and slow. Identifying checkworthy claims is the first step, where automation can help scale fact-checkers' efforts. However, detection methods struggle with…

Artificial Intelligence · Computer Science 2025-06-05 Michiel van der Meer , Pavel Korshunov , Sébastien Marcel , Lonneke van der Plas

The Fact Extraction and VERification (FEVER) shared task was launched to support the development of systems able to verify claims by extracting supporting or refuting facts from raw text. The shared task organizers provide a large-scale…

Information Retrieval · Computer Science 2019-05-10 Andreas Hanselowski , Hao Zhang , Zile Li , Daniil Sorokin , Benjamin Schiller , Claudia Schulz , Iryna Gurevych

In this work, we introduce X-FACT: the largest publicly available multilingual dataset for factual verification of naturally existing real-world claims. The dataset contains short statements in 25 languages and is labeled for veracity by…

Computation and Language · Computer Science 2021-06-18 Ashim Gupta , Vivek Srikumar

Check-worthy claim detection aims at providing plausible misinformation to downstream fact-checking systems or human experts to check. This is a crucial step toward accelerating the fact-checking process. Many efforts have been put into how…

Computation and Language · Computer Science 2023-07-25 Yang Bai , Anthony Colas , Daisy Zhe Wang

Most existing work on automated fact checking is concerned with predicting the veracity of claims based on metadata, social network spread, language used in claims, and, more recently, evidence supporting or denying claims. A crucial piece…

Computation and Language · Computer Science 2020-04-14 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

The recent explosion of false claims in social media and on the Web in general has given rise to a lot of manual fact-checking initiatives. Unfortunately, the number of claims that need to be fact-checked is several orders of magnitude…

Computation and Language · Computer Science 2019-09-02 Dimitrina Zlatkova , Preslav Nakov , Ivan Koychev

The massive amount of misinformation spreading on the Internet on a daily basis has enormous negative impacts on societies. Therefore, we need automated systems helping fact-checkers in the combat against misinformation. In this paper, we…

Computation and Language · Computer Science 2021-02-16 Yavuz Selim Kartal , Busra Guvenen , Mucahid Kutlu

While there has been substantial progress in developing systems to automate fact-checking, they still lack credibility in the eyes of the users. Thus, an interesting approach has emerged: to perform automatic fact-checking by verifying…

Computation and Language · Computer Science 2022-10-11 Momchil Hardalov , Anton Chernyavskiy , Ivan Koychev , Dmitry Ilvovsky , Preslav Nakov

Claim verification can be a challenging task. In this paper, we present a method to enhance the robustness and reasoning capabilities of automated claim verification through the extraction of short facts from evidence. Our novel approach,…

Computation and Language · Computer Science 2024-07-29 Nazanin Jafari , James Allan

Current scientific fact-checking benchmarks exhibit several shortcomings, such as biases arising from crowd-sourced claims and an over-reliance on text-based evidence. We present SCITAB, a challenging evaluation dataset consisting of 1.2K…

Computation and Language · Computer Science 2023-10-24 Xinyuan Lu , Liangming Pan , Qian Liu , Preslav Nakov , Min-Yen Kan

Given the constantly growing proliferation of false claims online in recent years, there has been also a growing research interest in automatically distinguishing false rumors from factually true claims. Here, we propose a general-purpose…

Computation and Language · Computer Science 2017-10-03 Georgi Karadzhov , Preslav Nakov , Lluis Marquez , Alberto Barron-Cedeno , Ivan Koychev

The field of automated fact-checking increasingly depends on retrieving web-based evidence to determine the veracity of claims in real-world scenarios. A significant challenge in this process is not only retrieving relevant information, but…

Information Retrieval · Computer Science 2025-02-11 Venktesh V , Vinay Setty

The expansion of online social media platforms has led to a surge in online content consumption. However, this has also paved the way for disseminating false claims and misinformation. As a result, there is an escalating demand for a…

Computation and Language · Computer Science 2023-09-19 Megha Sundriyal , Md Shad Akhtar , Tanmoy Chakraborty