English
Related papers

Related papers: FaVIQ: FAct Verification from Information-seeking …

200 papers

Combating disinformation is one of the burning societal crises -- about 67% of the American population believes that disinformation produces a lot of uncertainty, and 10% of them knowingly propagate disinformation. Evidence shows that…

Fact-checking is an essential tool to mitigate the spread of misinformation and disinformation. We introduce the task of fact-checking in dialogue, which is a relatively unexplored area. We construct DialFact, a testing benchmark dataset of…

Computation and Language · Computer Science 2022-03-25 Prakhar Gupta , Chien-Sheng Wu , Wenhao Liu , Caiming Xiong

In this paper, we explore the problem of Claim Extraction using one-to-many text generation methods, comparing LLMs, small summarization models finetuned for the task, and a previous NER-centric baseline QACG. As the current publications on…

Computation and Language · Computer Science 2025-02-10 Herbert Ullrich , Tomáš Mlynář , Jan Drchal

Detecting factual errors in textual information, whether generated by large language models (LLM) or curated by humans, is crucial for making informed decisions. LLMs' inability to attribute their claims to external knowledge and their…

Computation and Language · Computer Science 2023-10-27 Farima Fatahi Bayat , Kun Qian , Benjamin Han , Yisi Sang , Anton Belyi , Samira Khorshidi , Fei Wu , Ihab F. Ilyas , Yunyao Li

Contemporary approaches to assisted scientific discovery use language models to automatically generate large numbers of potential hypothesis to test, while also automatically generating code-based experiments to test those hypotheses. While…

Artificial Intelligence · Computer Science 2025-09-23 Peter Jansen , Samiah Hassan , Ruoyao Wang

Improvements in large language models have led to increasing optimism that they can serve as reliable evaluators of natural language generation outputs. In this paper, we challenge this optimism by thoroughly re-evaluating five…

Computation and Language · Computer Science 2025-01-31 Ameya Godbole , Robin Jia

Verifying complex political claims is a challenging task, especially when politicians use various tactics to subtly misrepresent the facts. Automatic fact-checking systems fall short here, and their predictions like "half-true" are not very…

Computation and Language · Computer Science 2022-11-02 Jifan Chen , Aniruddh Sriram , Eunsol Choi , Greg Durrett

With the growing importance of detecting misinformation, many studies have focused on verifying factual claims by retrieving evidence. However, canonical fact verification tasks do not apply to catching subtle differences in factually…

Computation and Language · Computer Science 2023-06-13 Miyoung Ko , Ingyu Seong , Hwaran Lee , Joonsuk Park , Minsuk Chang , Minjoon Seo

Automatic fact verification has become an increasingly popular topic in recent years and among datasets the Fact Extraction and VERification (FEVER) dataset is one of the most popular. In this work we present BEVERS, a tuned baseline system…

Computation and Language · Computer Science 2023-03-31 Mitchell DeHaven , Stephen Scott

Fact verification systems typically rely on neural network classifiers for veracity prediction which lack explainability. This paper proposes ProoFVer, which uses a seq2seq model to generate natural logic-based inferences as proofs. These…

Computation and Language · Computer Science 2022-07-05 Amrith Krishna , Sebastian Riedel , Andreas Vlachos

We present the results of the first Fact Extraction and VERification (FEVER) Shared Task. The task challenged participants to classify whether human-written factoid claims could be Supported or Refuted using evidence retrieved from…

Computation and Language · Computer Science 2018-12-03 James Thorne , Andreas Vlachos , Oana Cocarascu , Christos Christodoulopoulos , Arpit Mittal

Fact-checking requires retrieving evidence related to a claim under investigation. The task can be formulated as question generation based on a claim, followed by question answering. However, recent question generation approaches assume…

Computation and Language · Computer Science 2022-10-25 Nedjma Ousidhoum , Zhangdie Yuan , Andreas Vlachos

Fact-checking real-world claims often requires complex, multi-step reasoning due to the absence of direct evidence to support or refute them. However, existing fact-checking systems often lack transparency in their decision-making, making…

Computation and Language · Computer Science 2023-10-12 Liangming Pan , Xinyuan Lu , Min-Yen Kan , Preslav Nakov

Misleading or false information has been creating chaos in some places around the world. To mitigate this issue, many researchers have proposed automated fact-checking methods to fight the spread of fake news. However, most methods cannot…

Computation and Language · Computer Science 2024-10-08 Jing Yang , Didier Vega-Oliveros , Taís Seibt , Anderson Rocha

Existing real-world datasets for multimodal fact-checking have multiple limitations: they contain few instances, focus on only one or two languages and tasks, suffer from evidence leakage, or rely on external sets of news articles for…

Computation and Language · Computer Science 2026-01-13 Jiahui Geng , Jonathan Tonglet , Iryna Gurevych

Neural models for automated fact verification have achieved promising results thanks to the availability of large, human-annotated datasets. However, for each new domain that requires fact verification, creating a dataset by manually…

Computation and Language · Computer Science 2021-06-01 Liangming Pan , Wenhu Chen , Wenhan Xiong , Min-Yen Kan , William Yang Wang

Language models are becoming the default interface to factual knowledge, yet they often verify outputs more reliably than they generate them. This generation-verification gap (GV-gap) underlies many recent advances in self-improvement and…

Computation and Language · Computer Science 2026-05-28 Tim R. Davidson , Anja Surina , Caglar Gulcehre

In this work, we introduce X-FACT: the largest publicly available multilingual dataset for factual verification of naturally existing real-world claims. The dataset contains short statements in 25 languages and is labeled for veracity by…

Computation and Language · Computer Science 2021-06-18 Ashim Gupta , Vivek Srikumar

The internet gives the world an open platform to express their views and share their stories. While this is very valuable, it makes fake news one of our society's most pressing problems. Manual fact checking process is time consuming, which…

Online disinformation poses an escalating threat to society, driven increasingly by the rapid spread of misleading content across both multimedia and multilingual platforms. While automated fact-checking methods have advanced in recent…

Computation and Language · Computer Science 2026-01-19 Rafael Martins Frade , Rrubaa Panchendrarajan , Arkaitz Zubiaga