English
Related papers

Related papers: CFEVER: A Chinese Fact Extraction and VERification…

200 papers

Enhancing the attribution in large language models (LLMs) is a crucial task. One feasible approach is to enable LLMs to cite external sources that support their generations. However, existing datasets and evaluation methods in this domain…

Computation and Language · Computer Science 2024-05-30 Haolin Deng , Chang Wang , Xin Li , Dezhang Yuan , Junlang Zhan , Tianhua Zhou , Jin Ma , Jun Gao , Ruifeng Xu

Research on misinformation has focused almost exclusively on supply, asking what falsehoods circulate, who produces them, and whether corrections work. A basic demand-side question remains unanswered. When ordinary people can fact-check…

Human-Computer Interaction · Computer Science 2026-02-12 Bijean Ghafouri , Dorsaf Sallami , Luca Luceri , Taylor Lynn Curtis , Jean-Francois Godbout , Emilio Ferrara , Reihaneh Rabbany

In this work, we introduce X-FACT: the largest publicly available multilingual dataset for factual verification of naturally existing real-world claims. The dataset contains short statements in 25 languages and is labeled for veracity by…

Computation and Language · Computer Science 2021-06-18 Ashim Gupta , Vivek Srikumar

Language models are increasingly being used in important decision pipelines, so ensuring the correctness of their outputs is crucial. Recent work has proposed evaluating the "factuality" of claims decomposed from a language model generation…

Computation and Language · Computer Science 2025-05-26 Maxon Rubin-Toles , Maya Gambhir , Keshav Ramji , Aaron Roth , Surbhi Goel

COVID-19 has impacted all lives. To maintain social distancing and avoiding exposure, works and lives have gradually moved online. Under this trend, social media usage to obtain COVID-19 news has increased. Also, misinformation on COVID-19…

Social and Information Networks · Computer Science 2021-06-15 Chen Yang , Xinyi Zhou , Reza Zafarani

Automating the fact checking (FC) process relies on information obtained from external sources. In this work, we posit that it is crucial for FC models to make veracity predictions only when there is sufficient evidence and otherwise…

Computation and Language · Computer Science 2022-04-06 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

During the development of large language models (LLMs), the scale and quality of the pre-training data play a crucial role in shaping LLMs' capabilities. To accelerate the research of LLMs, several large-scale datasets, such as C4 [1], Pile…

Computation and Language · Computer Science 2023-11-13 Jianghao Chen , Pu Jian , Tengxiao Xi , Dongyi Yi , Qianlong Du , Chenglin Ding , Guibo Zhu , Chengqing Zong , Jinqiao Wang , Jiajun Zhang

Existing cyberbullying detection benchmarks were organized by the polarity of speech, such as "offensive" and "non-offensive", which were essentially hate speech detection. However, in the real world, cyberbullying often attracted…

Computation and Language · Computer Science 2026-05-12 Yi Zhu , Xin Zou , Xindong Wu

The rapid increase in fake news, which causes significant damage to society, triggers many fake news related studies, including the development of fake news detection and fact verification techniques. The resources for these studies are…

Machine Learning · Computer Science 2021-11-08 Taichi Murayama

The scientific claim verification task requires an NLP system to label scientific documents which Support or Refute an input claim, and to select evidentiary sentences (or rationales) justifying each predicted label. In this work, we…

Computation and Language · Computer Science 2022-05-11 David Wadden , Kyle Lo , Lucy Lu Wang , Arman Cohan , Iz Beltagy , Hannaneh Hajishirzi

Evidence data for automated fact-checking (AFC) can be in multiple modalities such as text, tables, images, audio, or video. While there is increasing interest in using images for AFC, previous works mostly focus on detecting manipulated or…

Computation and Language · Computer Science 2023-01-30 Mubashara Akhtar , Oana Cocarascu , Elena Simperl

The internet gives the world an open platform to express their views and share their stories. While this is very valuable, it makes fake news one of our society's most pressing problems. Manual fact checking process is time consuming, which…

We present a new fact-checking benchmark, Check-COVID, that requires systems to verify claims about COVID-19 from news using evidence from scientific articles. This approach to fact-checking is particularly challenging as it requires…

Computation and Language · Computer Science 2023-05-30 Gengyu Wang , Kate Harwood , Lawrence Chillrud , Amith Ananthram , Melanie Subbiah , Kathleen McKeown

Fact verification (FV) aims to assess the veracity of a claim based on relevant evidence. The traditional approach for automated FV includes a three-part pipeline relying on short evidence snippets and encoder-only inference models. More…

Computation and Language · Computer Science 2025-02-21 Juraj Vladika , Ivana Hacajová , Florian Matthes

Automated fact-checking is a crucial task in the governance of internet content. Although various studies utilize advanced models to tackle this issue, a significant gap persists in addressing complex real-world rumors and deceptive claims.…

Computation and Language · Computer Science 2024-01-30 Wei-Yu Kao , An-Zi Yen

Textual claims are often accompanied by images to enhance their credibility and spread on social media, but this also raises concerns about the spread of misinformation. Existing datasets for automated verification of image-text claims…

Computation and Language · Computer Science 2025-10-08 Rui Cao , Zifeng Ding , Zhijiang Guo , Michael Schlichtkrull , Andreas Vlachos

Fact verification requires validating a claim in the context of evidence. We show, however, that in the popular FEVER dataset this might not necessarily be the case. Claim-only classifiers perform competitively with top evidence-aware…

Computation and Language · Computer Science 2019-09-04 Tal Schuster , Darsh J Shah , Yun Jie Serene Yeo , Daniel Filizzola , Enrico Santus , Regina Barzilay

Given the constantly growing proliferation of false claims online in recent years, there has been also a growing research interest in automatically distinguishing false rumors from factually true claims. Here, we propose a general-purpose…

Computation and Language · Computer Science 2017-10-03 Georgi Karadzhov , Preslav Nakov , Lluis Marquez , Alberto Barron-Cedeno , Ivan Koychev

Multimodal Named Entity Recognition (MNER) is a pivotal task designed to extract named entities from text with the support of pertinent images. Nonetheless, a notable paucity of data for Chinese MNER has considerably impeded the progress of…

Computation and Language · Computer Science 2024-03-04 Yuanze Ji , Bobo Li , Jun Zhou , Fei Li , Chong Teng , Donghong Ji

Citation faithfulness detection is critical for enhancing retrieval-augmented generation (RAG) systems, yet large-scale Chinese datasets for this task are scarce. Existing methods face prohibitive costs due to the need for manually…

Computation and Language · Computer Science 2025-02-18 Ziyao Xu , Shaohang Wei , Zhuoheng Han , Jing Jin , Zhe Yang , Xiaoguang Li , Haochen Tan , Zhijiang Guo , Houfeng Wang