English
Related papers

Related papers: FEVER: a large-scale dataset for Fact Extraction a…

200 papers

We contribute the largest publicly available dataset of naturally occurring factual claims for the purpose of automatic claim verification. It is collected from 26 fact checking websites in English, paired with textual sources and rich…

Computation and Language · Computer Science 2019-10-22 Isabelle Augenstein , Christina Lioma , Dongsheng Wang , Lucas Chaves Lima , Casper Hansen , Christian Hansen , Jakob Grue Simonsen

Fact verification (FV) is a challenging task which aims to verify a claim using multiple evidential sentences from trustworthy corpora, e.g., Wikipedia. Most existing approaches follow a three-step pipeline framework, including document…

Computation and Language · Computer Science 2022-04-25 Jiangui Chen , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

Existing metrics for evaluating the factuality of long-form text, such as FACTSCORE (Min et al., 2023) and SAFE (Wei et al., 2024), decompose an input text into "atomic claims" and verify each against a knowledge base like Wikipedia. These…

Computation and Language · Computer Science 2024-06-28 Yixiao Song , Yekyung Kim , Mohit Iyyer

Detecting factual errors in textual information, whether generated by large language models (LLM) or curated by humans, is crucial for making informed decisions. LLMs' inability to attribute their claims to external knowledge and their…

Computation and Language · Computer Science 2023-10-27 Farima Fatahi Bayat , Kun Qian , Benjamin Han , Yisi Sang , Anton Belyi , Samira Khorshidi , Fei Wu , Ihab F. Ilyas , Yunyao Li

Textual knowledge bases such as Wikipedia require considerable effort to keep up to date and consistent. While automated writing assistants could potentially ease this burden, the problem of suggesting edits grounded in external knowledge…

Computation and Language · Computer Science 2022-07-14 Robert L. Logan , Alexandre Passos , Sameer Singh , Ming-Wei Chang

Information verification is quite a challenging task, this is because many times verifying a claim can require picking pieces of information from multiple pieces of evidence which can have a hierarchy of complex semantic relations.…

Computation and Language · Computer Science 2021-02-23 Usama Khalid , Mirza Omer Beg

Automatic fake news detection is a challenging problem in deception detection, and it has tremendous real-world political and social impacts. However, statistical approaches to combating fake news has been dramatically limited by the lack…

Computation and Language · Computer Science 2017-05-03 William Yang Wang

Fake information poses one of the major threats for society in the 21st century. Identifying misinformation has become a key challenge due to the amount of fake news that is published daily. Yet, no approach is established that addresses…

Information Retrieval · Computer Science 2021-03-30 Vishwani Gupta , Katharina Beckh , Sven Giesselbach , Dennis Wegener , Tim Wirtz

The rapid increase in fake news, which causes significant damage to society, triggers many fake news related studies, including the development of fake news detection and fact verification techniques. The resources for these studies are…

Machine Learning · Computer Science 2021-11-08 Taichi Murayama

Recent work on fact-checking addresses a realistic setting where models incorporate evidence retrieved from the web to decide the veracity of claims. A bottleneck in this pipeline is in retrieving relevant evidence: traditional methods may…

Computation and Language · Computer Science 2024-10-08 Aniruddh Sriram , Fangyuan Xu , Eunsol Choi , Greg Durrett

This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence. This extends the well-studied task of fact verification by providing a mechanism to…

Computation and Language · Computer Science 2021-06-18 James Thorne , Andreas Vlachos

This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence. This extends the well-studied task of fact verification by providing a mechanism to…

Computation and Language · Computer Science 2021-06-17 James Thorne , Andreas Vlachos

In an effort to assist factcheckers in the process of factchecking, we tackle the claim detection task, one of the necessary stages prior to determining the veracity of a claim. It consists of identifying the set of sentences, out of a long…

Computation and Language · Computer Science 2020-08-18 Lev Konstantinovskiy , Oliver Price , Mevan Babakar , Arkaitz Zubiaga

Fake news, misinformation, and unverifiable facts on social media platforms propagate disharmony and affect society, especially when dealing with an epidemic like COVID-19. The task of Fake News Detection aims to tackle the effects of such…

Computation and Language · Computer Science 2021-12-14 Mrinal Rawat , Diptesh Kanojia

Combating disinformation is one of the burning societal crises -- about 67% of the American population believes that disinformation produces a lot of uncertainty, and 10% of them knowingly propagate disinformation. Evidence shows that…

With the growing importance of detecting misinformation, many studies have focused on verifying factual claims by retrieving evidence. However, canonical fact verification tasks do not apply to catching subtle differences in factually…

Computation and Language · Computer Science 2023-06-13 Miyoung Ko , Ingyu Seong , Hwaran Lee , Joonsuk Park , Minsuk Chang , Minjoon Seo

Recent Deep Learning (DL) models have succeeded in achieving human-level accuracy on various natural language tasks such as question-answering, natural language inference (NLI), and textual entailment. These tasks not only require the…

Computation and Language · Computer Science 2019-10-17 Mayank Jobanputra

Our fight against false information is spearheaded by fact-checkers. They investigate the veracity of claims and document their findings as fact-checking reports. With the rapid increase in the amount of false information circulating…

Information Retrieval · Computer Science 2025-05-15 Enes Altuncu , Can Başkent , Sanjay Bhattacherjee , Shujun Li , Dwaipayan Roy

We introduce PerSenT, a dataset of crowd-sourced annotations of the sentiment expressed by the authors towards the main entities in news articles. The dataset also includes paragraph-level sentiment annotations to provide more fine-grained…

Computation and Language · Computer Science 2023-01-18 Mohaddeseh Bastan , Mahnaz Koupaee , Youngseo Son , Richard Sicoli , Niranjan Balasubramanian

Machine comprehension of texts longer than a single sentence often requires coreference resolution. However, most current reading comprehension benchmarks do not contain complex coreferential phenomena and hence fail to evaluate the ability…

Computation and Language · Computer Science 2019-09-06 Pradeep Dasigi , Nelson F. Liu , Ana Marasović , Noah A. Smith , Matt Gardner