English
Related papers

Related papers: TabFact: A Large-scale Dataset for Table-based Fac…

200 papers

Factuality in Large Language Models (LLMs) is a persistent challenge. Current benchmarks often assess short factual answers, overlooking the critical ability to generate structured, multi-record tabular outputs from parametric knowledge. We…

Computation and Language · Computer Science 2025-05-28 Dario Satriani , Enzo Veltri , Donatello Santoro , Paolo Papotti

Information verification is quite a challenging task, this is because many times verifying a claim can require picking pieces of information from multiple pieces of evidence which can have a hierarchy of complex semantic relations.…

Computation and Language · Computer Science 2021-02-23 Usama Khalid , Mirza Omer Beg

Automated fact verification plays an essential role in fostering trust in the digital space. Despite the growing interest, the verification of temporal facts has not received much attention in the community. Temporal fact verification…

Information Retrieval · Computer Science 2024-08-20 Anab Maulana Barik , Wynne Hsu , Mong Li Lee

Current scientific fact-checking benchmarks exhibit several shortcomings, such as biases arising from crowd-sourced claims and an over-reliance on text-based evidence. We present SCITAB, a challenging evaluation dataset consisting of 1.2K…

Computation and Language · Computer Science 2023-10-24 Xinyuan Lu , Liangming Pan , Qian Liu , Preslav Nakov , Min-Yen Kan

Fact-checking is an essential tool to mitigate the spread of misinformation and disinformation. We introduce the task of fact-checking in dialogue, which is a relatively unexplored area. We construct DialFact, a testing benchmark dataset of…

Computation and Language · Computer Science 2022-03-25 Prakhar Gupta , Chien-Sheng Wu , Wenhao Liu , Caiming Xiong

We introduce scientific claim verification, a new task to select abstracts from the research literature containing evidence that SUPPORTS or REFUTES a given scientific claim, and to identify rationales justifying each decision. To study…

Computation and Language · Computer Science 2020-10-06 David Wadden , Shanchuan Lin , Kyle Lo , Lucy Lu Wang , Madeleine van Zuylen , Arman Cohan , Hannaneh Hajishirzi

Understanding tables is an important and relevant task that involves understanding table structure as well as being able to compare and contrast information within cells. In this paper, we address this challenge by presenting a new dataset…

Computation and Language · Computer Science 2021-06-04 Nancy X. R. Wang , Diwakar Mahajan , Marina Danilevsky , Sara Rosenthal

We present TableBank, a new image-based table detection and recognition dataset built with novel weak supervision from Word and Latex documents on the internet. Existing research for image-based table detection and recognition usually…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Minghao Li , Lei Cui , Shaohan Huang , Furu Wei , Ming Zhou , Zhoujun Li

Despite recent success in natural language processing (NLP), fact verification still remains a difficult task. Due to misinformation spreading increasingly fast, attention has been directed towards automatically verifying the correctness of…

Computation and Language · Computer Science 2024-08-15 Tobias A. Opsahl

While table understanding increasingly relies on pixel-only settings, current benchmarks predominantly use synthetic renderings that lack the complexity and visual diversity of real-world tables. Additionally, existing visual table…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Iñigo Alonso , Imanol Miranda , Eneko Agirre , Mirella Lapata

Fact verification aims to automatically probe the veracity of a claim based on several pieces of evidence. Existing works are always engaging in accuracy improvement, let alone explainability, a critical capability of fact verification…

Artificial Intelligence · Computer Science 2024-06-17 Huanhuan Ma , Weizhi Xu , Yifan Wei , Liuji Chen , Liang Wang , Qiang Liu , Shu Wu , Liang Wang

Automated Fact-Checking has largely focused on verifying general knowledge against static corpora, overlooking high-stakes domains like law where truth is evolving and technically complex. We introduce CaseFacts, a benchmark for verifying…

Computation and Language · Computer Science 2026-04-21 Akshith Reddy Putta , Jacob Devasier , Chengkai Li

Recent years have witnessed the burgeoning of pretrained language models (LMs) for text-based natural language (NL) understanding tasks. Such models are typically trained on free-form NL text, hence may not be suitable for tasks like…

Computation and Language · Computer Science 2020-05-19 Pengcheng Yin , Graham Neubig , Wen-tau Yih , Sebastian Riedel

In this work, we introduce X-FACT: the largest publicly available multilingual dataset for factual verification of naturally existing real-world claims. The dataset contains short statements in 25 languages and is labeled for veracity by…

Computation and Language · Computer Science 2021-06-18 Ashim Gupta , Vivek Srikumar

In this paper we introduce a new publicly available dataset for verification against textual sources, FEVER: Fact Extraction and VERification. It consists of 185,445 claims generated by altering sentences extracted from Wikipedia and…

Computation and Language · Computer Science 2018-12-19 James Thorne , Andreas Vlachos , Christos Christodoulopoulos , Arpit Mittal

Fact checking aims to predict claim veracity by reasoning over multiple evidence pieces. It usually involves evidence retrieval and veracity reasoning. In this paper, we focus on the latter, reasoning over unstructured text and structured…

Computation and Language · Computer Science 2024-02-21 Haisong Gong , Weizhi Xu , Shu wu , Qiang Liu , Liang Wang

Semi-structured data, such as Infobox tables, often include temporal information about entities, either implicitly or explicitly. Can current NLP systems reason about such information in semi-structured tables? To tackle this question, we…

Computation and Language · Computer Science 2023-11-15 Vivek Gupta , Pranshu Kandoi , Mahek Bhavesh Vora , Shuo Zhang , Yujie He , Ridho Reinanda , Vivek Srikumar

Fact verification is a challenging task that requires simultaneously reasoning and aggregating over multiple retrieved pieces of evidence to evaluate the truthfulness of a claim. Existing approaches typically (i) explore the semantic…

Computation and Language · Computer Science 2021-06-03 Jiasheng Si , Deyu Zhou , Tongzhe Li , Xingyu Shi , Yulan He

Judging the veracity of a sentence making one or more claims is an important and challenging problem with many dimensions. The recent FEVER task asked participants to classify input sentences as either SUPPORTED, REFUTED or NotEnoughInfo…

Computation and Language · Computer Science 2018-11-01 Ankur Padia , Francis Ferraro , Tim Finin

Fact checking is a challenging task because verifying the truthfulness of a claim requires reasoning about multiple retrievable evidence. In this work, we present a method suitable for reasoning about the semantic-level structure of…

Computation and Language · Computer Science 2020-04-28 Wanjun Zhong , Jingjing Xu , Duyu Tang , Zenan Xu , Nan Duan , Ming Zhou , Jiahai Wang , Jian Yin