English
Related papers

Related papers: Evidence-based Interpretable Open-domain Fact-chec…

200 papers

Automated fact extraction and verification is a challenging task that involves finding relevant evidence sentences from a reliable corpus to verify the truthfulness of a claim. Existing models either (i) concatenate all the evidence…

Computation and Language · Computer Science 2020-10-13 Shyam Subramanian , Kyumin Lee

Large language models (LLMs) have made remarkable progress in various natural language processing tasks as a benefit of their capability to comprehend and reason with factual knowledge. However, a significant amount of factual knowledge is…

Computation and Language · Computer Science 2024-08-23 Sirui Huang , Yanggan Gu , Xuming Hu , Zhonghao Li , Qing Li , Guandong Xu

Political misinformation poses significant challenges to democratic processes, shaping public opinion and trust in media. Manual fact-checking methods face issues of scalability and annotator bias, while machine learning models require…

Computation and Language · Computer Science 2024-11-11 Veronica Chatrath , Marcelo Lotif , Shaina Raza

This paper investigates the role of dynamic external knowledge integration in improving counter-argument generation using Large Language Models (LLMs). While LLMs have shown promise in argumentative tasks, their tendency to generate…

Computation and Language · Computer Science 2025-06-23 Anar Yeginbergen , Maite Oronoz , Rodrigo Agerri

This study compares the performance of (1) fine-tuned language models and (2) large language models on the task of check-worthy claim detection. For the purpose of the comparison we composed a multilingual and multi-topical dataset…

Computation and Language · Computer Science 2024-10-14 Martin Hyben , Sebastian Kula , Ivan Srba , Robert Moro , Jakub Simko

The rapid adoption of Large Language Models (LLMs) has raised important concerns about the factual reliability of their outputs, particularly in low-resource languages such as Urdu. Existing automated fact-checking systems are predominantly…

In recent months, large language models (LLMs) have made significant progress in mathematical proof generation, but further advancement is hindered by the lack of a large-scale, high-quality dataset of human-evaluated proofs. While…

Evidence retrieval is a core part of automatic fact-checking. Prior work makes simplifying assumptions in retrieval that depart from real-world use cases: either no access to evidence, access to evidence curated by a human fact-checker, or…

Computation and Language · Computer Science 2024-06-18 Jifan Chen , Grace Kim , Aniruddh Sriram , Greg Durrett , Eunsol Choi

There is growing excitement about the potential of Language Models (LMs) to accelerate scientific discovery. Falsifying hypotheses is key to scientific progress, as it allows claims to be iteratively refined over time. This process requires…

Machine Learning · Computer Science 2025-02-27 Shiven Sinha , Shashwat Goel , Ponnurangam Kumaraguru , Jonas Geiping , Matthias Bethge , Ameya Prabhu

Fact-checking plays a crucial role in combating misinformation. Existing methods using large language models (LLMs) for claim decomposition face two key limitations: (1) insufficient decomposition, introducing unnecessary complexity to the…

Computation and Language · Computer Science 2025-03-11 Yani Huang , Richong Zhang , Zhijie Nie , Junfan Chen , Xuefeng Zhang

This article presents a pipeline for automated fact-checking leveraging publicly available Language Models and data. The objective is to assess the accuracy of textual claims using evidence from a ground-truth evidence corpus. The pipeline…

Computation and Language · Computer Science 2024-08-23 Jan Drchal , Herbert Ullrich , Tomáš Mlynář , Václav Moravec

Large Language Models (LLMs) have significantly impacted nearly every domain of human knowledge. However, the explainability of these models esp. to laypersons, which are crucial for instilling trust, have been examined through various…

Human-Computer Interaction · Computer Science 2024-12-12 Arion Das , Asutosh Mishra , Amitesh Patel , Soumilya De , V. Gurucharan , Kripabandhu Ghosh

Evaluating the factuality of long-form generations from Large Language Models (LLMs) remains challenging due to efficiency bottlenecks and reliability concerns. Prior efforts attempt this by decomposing text into claims, searching for…

Computation and Language · Computer Science 2025-11-06 Yingjia Wan , Haochen Tan , Xiao Zhu , Xinyu Zhou , Zhiwei Li , Qingsong Lv , Changxuan Sun , Jiaqi Zeng , Yi Xu , Jianqiao Lu , Yinhong Liu , Zhijiang Guo

Modern large language models (LLMs) are powerful generators driven by statistical next-token prediction. While effective at producing fluent text, this design biases models toward high-probability continuations rather than exhaustive and…

Machine Learning · Computer Science 2026-02-09 Zhaoyang Chen , Cody Fleming

Leveraging external knowledge to enhance the reasoning ability is crucial for commonsense question answering. However, the existing knowledge bases heavily rely on manual annotation which unavoidably causes deficiency in coverage of…

Computation and Language · Computer Science 2023-05-26 Zhifeng Li , Yifan Fan , Bowei Zou , Yu Hong

This study focuses on the evaluation of the Open Question Answering (Open-QA) task, which can directly estimate the factuality of large language models (LLMs). Current automatic evaluation methods have shown limitations, indicating that…

Computation and Language · Computer Science 2023-10-24 Cunxiang Wang , Sirui Cheng , Qipeng Guo , Yuanhao Yue , Bowen Ding , Zhikun Xu , Yidong Wang , Xiangkun Hu , Zheng Zhang , Yue Zhang

Large Language Models (LLMs) suffer from hallucinations and factual inaccuracies, especially in complex reasoning and fact verification tasks. Multi-Agent Debate (MAD) systems aim to improve answer accuracy by enabling multiple LLM agents…

Computation and Language · Computer Science 2026-01-09 Seyeon Jeong , Yeonjun Choi , JongWook Kim , Beakcheol Jang

Process discovery aims to derive process models from event logs, providing insights into operational behavior and forming a foundation for conformance checking and process improvement. However, models derived solely from event data may not…

Artificial Intelligence · Computer Science 2025-10-09 Ali Norouzifar , Humam Kourani , Marcus Dees , Wil van der Aalst

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

Fact verification plays a vital role in combating misinformation by assessing the veracity of claims through evidence retrieval and reasoning. However, traditional methods struggle with complex claims requiring multi-hop reasoning over…

Artificial Intelligence · Computer Science 2025-06-10 Liwen Zheng , Chaozhuo Li , Zheng Liu , Feiran Huang , Haoran Jia , Zaisheng Ye , Xi Zhang