English
Related papers

Related papers: PASTA: Table-Operations Aware Fact Verification vi…

200 papers

Fact-checking is necessary to address the increasing volume of misinformation. Traditional fact-checking relies on manual analysis to verify claims, but it is slow and resource-intensive. This study establishes baseline comparisons for…

Computation and Language · Computer Science 2025-02-14 Premtim Sahitaj , Iffat Maab , Junichi Yamagishi , Jawan Kolanowski , Sebastian Möller , Vera Schmitt

Reasoning over tabular data requires both table structure understanding and a broad set of table reasoning skills. Current models with table-specific architectures and pre-training methods perform well on understanding table structures, but…

Computation and Language · Computer Science 2022-10-25 Yilun Zhao , Linyong Nan , Zhenting Qi , Rui Zhang , Dragomir Radev

Fact tracing seeks to identify specific training examples that serve as the knowledge source for a given query. Existing approaches to fact tracing rely on assessing the similarity between each training sample and the query along a certain…

Computation and Language · Computer Science 2024-04-24 Si Chen , Feiyang Kang , Ning Yu , Ruoxi Jia

Evidence plays a crucial role in automated fact-checking. When verifying real-world claims, existing fact-checking systems either assume the evidence sentences are given or use the search snippets returned by the search engine. Such methods…

Computation and Language · Computer Science 2024-01-30 Xuming Hu , Junzhe Chen , Zhijiang Guo , Philip S. Yu

Despite the much discussed capabilities of today's language models, they are still prone to silly and unexpected commonsense failures. We consider a retrospective verification approach that reflects on the correctness of LM outputs, and…

Computation and Language · Computer Science 2023-10-19 Jiacheng Liu , Wenya Wang , Dianzhuo Wang , Noah A. Smith , Yejin Choi , Hannaneh Hajishirzi

Fact-checking benchmarks provide standardized testing criteria for automated fact-checking systems, driving technological advancement. With the surge of misinformation on social media and the emergence of various fact-checking methods,…

Computation and Language · Computer Science 2025-10-28 Xiaocheng Zhang , Xi Wang , Yifei Lu , Jianing Wang , Zhuangzhuang Ye , Mengjiao Bao , Peng Yan , Xiaohong Su

Large language models (LLMs) are reshaping automated fact-checking (AFC) by enabling unified, end-to-end verification pipelines rather than isolated components. While large proprietary models achieve strong performance, their closed…

Computation and Language · Computer Science 2026-01-19 Malin Astrid Larsson , Harald Fosen Grunnaleite , Vinay Setty

Fact checking aims to predict claim veracity by reasoning over multiple evidence pieces. It usually involves evidence retrieval and veracity reasoning. In this paper, we focus on the latter, reasoning over unstructured text and structured…

Computation and Language · Computer Science 2024-02-21 Haisong Gong , Weizhi Xu , Shu wu , Qiang Liu , Liang Wang

Automatic fact-checking systems detect misinformation, such as fake news, by (i) selecting check-worthy sentences for fact-checking, (ii) gathering related information to the sentences, and (iii) inferring the factuality of the sentences.…

Information Retrieval · Computer Science 2019-03-21 Casper Hansen , Christian Hansen , Stephen Alstrup , Jakob Grue Simonsen , Christina Lioma

We present FAKTA which is a unified framework that integrates various components of a fact checking process: document retrieval from media sources with various types of reliability, stance detection of documents with respect to given…

Computation and Language · Computer Science 2019-06-12 Moin Nadeem , Wei Fang , Brian Xu , Mitra Mohtarami , James Glass

Automated fact-checking based on machine learning is a promising approach to identify false information distributed on the web. In order to achieve satisfactory performance, machine learning methods require a large corpus with reliable…

Computation and Language · Computer Science 2019-11-05 Andreas Hanselowski , Christian Stab , Claudia Schulz , Zile Li , Iryna Gurevych

We present GraPPa, an effective pre-training approach for table semantic parsing that learns a compositional inductive bias in the joint representations of textual and tabular data. We construct synthetic question-SQL pairs over…

Computation and Language · Computer Science 2021-06-01 Tao Yu , Chien-Sheng Wu , Xi Victoria Lin , Bailin Wang , Yi Chern Tan , Xinyi Yang , Dragomir Radev , Richard Socher , Caiming Xiong

In an effort to assist factcheckers in the process of factchecking, we tackle the claim detection task, one of the necessary stages prior to determining the veracity of a claim. It consists of identifying the set of sentences, out of a long…

Computation and Language · Computer Science 2020-08-18 Lev Konstantinovskiy , Oliver Price , Mevan Babakar , Arkaitz Zubiaga

Synthetic data offers the promise of cheap and bountiful training data for settings where labeled real-world data is scarce. However, models trained on synthetic data significantly underperform when evaluated on real-world data. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Prithvijit Chattopadhyay , Kartik Sarangmath , Vivek Vijaykumar , Judy Hoffman

We investigate the internal behavior of Transformer-based Large Language Models (LLMs) when they generate factually incorrect text. We propose modeling factual queries as constraint satisfaction problems and use this framework to…

Computation and Language · Computer Science 2024-04-18 Mert Yuksekgonul , Varun Chandrasekaran , Erik Jones , Suriya Gunasekar , Ranjita Naik , Hamid Palangi , Ece Kamar , Besmira Nushi

Attention calculation is extremely time-consuming for long-sequence inference tasks, such as text or image/video generation, in large models. To accelerate this process, we developed a low-precision, mathematically-equivalent algorithm…

Table-based reasoning has shown remarkable progress in combining deep models with discrete reasoning, which requires reasoning over both free-form natural language (NL) questions and structured tabular data. However, previous table-based…

Computation and Language · Computer Science 2023-04-28 Yunhu Ye , Binyuan Hui , Min Yang , Binhua Li , Fei Huang , Yongbin Li

Tables convey factual and quantitative data with implicit conventions created by humans that are often challenging for machines to parse. Prior work on table recognition (TR) has mainly centered around complex task-specific combinations of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 ShengYun Peng , Aishwarya Chakravarthy , Seongmin Lee , Xiaojing Wang , Rajarajeswari Balasubramaniyan , Duen Horng Chau

Fact verification models have enjoyed a fast advancement in the last two years with the development of pre-trained language models like BERT and the release of large scale datasets such as FEVER. However, the challenging problem of fake…

Computation and Language · Computer Science 2020-10-13 Qifei Li , Wangchunshu Zhou

Scientific claim verification against tables typically requires predicting whether a claim is supported or refuted given a table. However, we argue that predicting the final label alone is insufficient: it reveals little about the model's…

Computation and Language · Computer Science 2025-09-18 Xanh Ho , Sunisth Kumar , Yun-Ang Wu , Florian Boudin , Atsuhiro Takasu , Akiko Aizawa