English
Related papers

Related papers: SURFACE: Semantically Rich Fact Validation with Ex…

200 papers

Lack of factual correctness is an issue that still plagues state-of-the-art summarization systems despite their impressive progress on generating seemingly fluent summaries. In this paper, we show that factual inconsistency can be caused by…

Computation and Language · Computer Science 2024-01-22 Asish Ghoshal , Arash Einolghozati , Ankit Arun , Haoran Li , Lili Yu , Vera Gor , Yashar Mehdad , Scott Wen-tau Yih , Asli Celikyilmaz

Fact verification models have enjoyed a fast advancement in the last two years with the development of pre-trained language models like BERT and the release of large scale datasets such as FEVER. However, the challenging problem of fake…

Computation and Language · Computer Science 2020-10-13 Qifei Li , Wangchunshu Zhou

Recent Deep Learning (DL) models have succeeded in achieving human-level accuracy on various natural language tasks such as question-answering, natural language inference (NLI), and textual entailment. These tasks not only require the…

Computation and Language · Computer Science 2019-10-17 Mayank Jobanputra

Fact verification (FV) is a challenging task which aims to verify a claim using multiple evidential sentences from trustworthy corpora, e.g., Wikipedia. Most existing approaches follow a three-step pipeline framework, including document…

Computation and Language · Computer Science 2022-04-25 Jiangui Chen , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

Automated fact checking systems have been proposed that quickly provide veracity prediction at scale to mitigate the negative influence of fake news on people and on public opinion. However, most studies focus on veracity classifiers of…

Computation and Language · Computer Science 2022-06-15 Shih-Chieh Dai , Yi-Li Hsu , Aiping Xiong , Lun-Wei Ku

We propose a novel paradigm for automatic fact-checking that leverages frame semantics to enhance the structured understanding of claims and guide the process of fact-checking them. To support this, we introduce a pilot dataset of…

Computation and Language · Computer Science 2025-08-21 Jacob Devasier , Rishabh Mediratta , Akshith Putta , Chengkai Li

FrameNet is a computational linguistics resource composed of semantic frames, high-level concepts that represent the meanings of words. In this paper, we present an approach to gather frame disambiguation annotations in sentences using a…

Computation and Language · Computer Science 2018-08-21 Anca Dumitrache , Lora Aroyo , Chris Welty

Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate…

Computation and Language · Computer Science 2024-11-08 Jerry Wei , Chengrun Yang , Xinying Song , Yifeng Lu , Nathan Hu , Jie Huang , Dustin Tran , Daiyi Peng , Ruibo Liu , Da Huang , Cosmo Du , Quoc V. Le

Fact-checking is an essential tool to mitigate the spread of misinformation and disinformation. We introduce the task of fact-checking in dialogue, which is a relatively unexplored area. We construct DialFact, a testing benchmark dataset of…

Computation and Language · Computer Science 2022-03-25 Prakhar Gupta , Chien-Sheng Wu , Wenhao Liu , Caiming Xiong

Fact verification (FV) is a challenging task which requires to retrieve relevant evidence from plain text and use the evidence to verify given claims. Many claims require to simultaneously integrate and reason over several pieces of…

Computation and Language · Computer Science 2019-08-07 Jie Zhou , Xu Han , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun

This paper describes a baseline for the second iteration of the Fact Extraction and VERification shared task (FEVER2.0) which explores the resilience of systems through adversarial evaluation. We present a collection of simple adversarial…

Computation and Language · Computer Science 2019-03-14 James Thorne , Andreas Vlachos

The problem of verifying whether a textual hypothesis holds based on the given evidence, also known as fact verification, plays an important role in the study of natural language understanding and semantic representation. However, existing…

Computation and Language · Computer Science 2020-06-16 Wenhu Chen , Hongmin Wang , Jianshu Chen , Yunkai Zhang , Hong Wang , Shiyang Li , Xiyou Zhou , William Yang Wang

With the widespread consumption of AI-generated content, there has been an increased focus on developing automated tools to verify the factual accuracy of such content. However, prior research and tools developed for fact verification treat…

Computation and Language · Computer Science 2025-03-20 Varich Boonsanong , Vidhisha Balachandran , Xiaochuang Han , Shangbin Feng , Lucy Lu Wang , Yulia Tsvetkov

Fact checking aims to predict claim veracity by reasoning over multiple evidence pieces. It usually involves evidence retrieval and veracity reasoning. In this paper, we focus on the latter, reasoning over unstructured text and structured…

Computation and Language · Computer Science 2024-02-21 Haisong Gong , Weizhi Xu , Shu wu , Qiang Liu , Liang Wang

While neural language models can generate text with remarkable fluency and coherence, controlling for factual correctness in generation remains an open research question. This major discrepancy between the surface-level fluency and the…

Computation and Language · Computer Science 2021-06-08 Saadia Gabriel , Asli Celikyilmaz , Rahul Jha , Yejin Choi , Jianfeng Gao

Fact verification tasks aim to identify the integrity of textual contents according to the truthful corpus. Existing fact verification models usually build a fully connected reasoning graph, which regards claim-evidence pairs as nodes and…

Machine Learning · Computer Science 2024-05-20 Yuqing Lan , Zhenghao Liu , Yu Gu , Xiaoyuan Yi , Xiaohua Li , Liner Yang , Ge Yu

Given a possibly false claim sentence, how can we automatically correct it with minimal editing? Existing methods either require a large number of pairs of false and corrected claims for supervised training or do not handle well errors…

Computation and Language · Computer Science 2023-02-24 Jiangjie Chen , Rui Xu , Wenxuan Zeng , Changzhi Sun , Lei Li , Yanghua Xiao

Automatic fact verification has become an increasingly popular topic in recent years and among datasets the Fact Extraction and VERification (FEVER) dataset is one of the most popular. In this work we present BEVERS, a tuned baseline system…

Computation and Language · Computer Science 2023-03-31 Mitchell DeHaven , Stephen Scott

Question answering from semi-structured tables can be seen as a semantic parsing task and is significant and practical for pushing the boundary of natural language understanding. Existing research mainly focuses on understanding contents…

Artificial Intelligence · Computer Science 2021-06-08 Xiaoyi Ruan , Meizhi Jin , Jian Ma , Haiqin Yang , Lianxin Jiang , Yang Mo , Mengyuan Zhou

Fact verification aims to automatically probe the veracity of a claim based on several pieces of evidence. Existing works are always engaging in accuracy improvement, let alone explainability, a critical capability of fact verification…

Artificial Intelligence · Computer Science 2024-06-17 Huanhuan Ma , Weizhi Xu , Yifan Wei , Liuji Chen , Liang Wang , Qiang Liu , Shu Wu , Liang Wang