English
Related papers

Related papers: Neural models for Factual Inconsistency Classifica…

200 papers

Recent advancements in text summarization, particularly with the advent of Large Language Models (LLMs), have shown remarkable performance. However, a notable challenge persists as a substantial number of automatically-generated summaries…

Computation and Language · Computer Science 2024-09-04 Alessandro Scirè , Karim Ghonim , Roberto Navigli

Grounded text generation systems often generate text that contains factual inconsistencies, hindering their real-world applicability. Automatic factual consistency evaluation may help alleviate this limitation by accelerating evaluation…

Ensuring factual consistency between the summary and the original document is paramount in summarization tasks. Consequently, considerable effort has been dedicated to detecting inconsistencies. With the advent of Large Language Models…

Computation and Language · Computer Science 2024-03-13 Jiuding Yang , Hui Liu , Weidong Guo , Zhuwei Rao , Yu Xu , Di Niu

Recent advances in large language models (LLMs) have enabled the large-scale generation of highly fluent and deceptive news-like content. While prior work has often treated fake news detection as a binary classification problem, modern fake…

Computation and Language · Computer Science 2026-04-13 Xinyu Wang , Sai Koneru , Wenbo Zhang , Wenliang Zheng , Saksham Ranjan , Sarah Rajtmajer

The rising growth of fake news and misleading information through online media outlets demands an automatic method for detecting such news articles. Of the few limited works which differentiate between trusted vs other types of news article…

Computation and Language · Computer Science 2019-10-29 Vaibhav Vaibhav , Raghuram Mandyam Annasamy , Eduard Hovy

Misinformation such as fake news is one of the big challenges of our society. Research on automated fact-checking has proposed methods based on supervised learning, but these approaches do not consider external evidence apart from labeled…

Computation and Language · Computer Science 2018-09-19 Kashyap Popat , Subhabrata Mukherjee , Andrew Yates , Gerhard Weikum

Stance detection in fake news is an important component in news veracity assessment because this process helps fact-checking by understanding stance to a central claim from different information sources. The Fake News Challenge Stage 1…

Computation and Language · Computer Science 2019-09-27 Wenjun Liao , Chenghua Lin

Existing benchmarks for fake news detection have significantly contributed to the advancement of models in assessing the authenticity of news content. However, these benchmarks typically focus solely on news pertaining to a single semantic…

Computation and Language · Computer Science 2024-10-16 Ziyi Zhou , Xiaoming Zhang , Litian Zhang , Jiacheng Liu , Senzhang Wang , Zheng Liu , Xi Zhang , Chaozhuo Li , Philip S. Yu

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Factual inconsistencies pose a significant hurdle for the faithful summarization by generative models. While a major direction to enhance inconsistency detection is to derive stronger Natural Language Inference (NLI) models, we propose an…

Computation and Language · Computer Science 2024-10-07 Liyan Xu , Zhenlin Su , Mo Yu , Jin Xu , Jinho D. Choi , Jie Zhou , Fei Liu

Media news are making a large part of public opinion and, therefore, must not be fake. News on web sites, blogs, and social media must be analyzed before being published. In this paper, we present linguistic characteristics of media news…

Computation and Language · Computer Science 2022-11-29 Sandhya Aneja , Nagender Aneja , Ponnurangam Kumaraguru

Identifying the veracity of a news article is an interesting problem while automating this process can be a challenging task. Detection of a news article as fake is still an open question as it is contingent on many factors which the…

Computation and Language · Computer Science 2017-12-12 Gaurav Bhatt , Aman Sharma , Shivam Sharma , Ankush Nagpal , Balasubramanian Raman , Ankush Mittal

Inconsistent political statements represent a form of misinformation. They erode public trust and pose challenges to accountability, when left unnoticed. Detecting inconsistencies automatically could support journalists in asking…

Computation and Language · Computer Science 2025-05-27 Nursulu Sagimbayeva , Ruveyda Betül Bahçeci , Ingmar Weber

The rise of large language models (LLMs) has significantly influenced the quality of information in decision-making systems, leading to the prevalence of AI-generated content and challenges in detecting misinformation and managing…

Computation and Language · Computer Science 2024-10-08 Cheng Jiayang , Chunkit Chan , Qianqian Zhuang , Lin Qiu , Tianhang Zhang , Tengxiao Liu , Yangqiu Song , Yue Zhang , Pengfei Liu , Zheng Zhang

Recently, various neural encoder-decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text. At a high level, such neural models…

Computation and Language · Computer Science 2023-04-11 Yichong Huang , Xiachong Feng , Xiaocheng Feng , Bing Qin

Large Language Models (LLMs) frequently hallucinate, impeding their reliability in mission-critical situations. One approach to address this issue is to provide citations to relevant sources alongside generated content, enhancing the…

Computation and Language · Computer Science 2024-07-16 Rami Aly , Zhiqiang Tang , Samson Tan , George Karypis

Disinformation has long been regarded as a severe social problem, where fake news is one of the most representative issues. What is worse, today's highly developed social media makes fake news widely spread at incredible speed, bringing in…

Social and Information Networks · Computer Science 2021-02-01 Hao Liao , Qixin Liu , Kai Shu , Xing xie

Detecting factual errors in textual information, whether generated by large language models (LLM) or curated by humans, is crucial for making informed decisions. LLMs' inability to attribute their claims to external knowledge and their…

Computation and Language · Computer Science 2023-10-27 Farima Fatahi Bayat , Kun Qian , Benjamin Han , Yisi Sang , Anton Belyi , Samira Khorshidi , Fei Wu , Ihab F. Ilyas , Yunyao Li

This paper describes our approach to the multi-modal fact verification (FACTIFY) challenge at AAAI2023. In recent years, with the widespread use of social media, fake news can spread rapidly and negatively impact social security. Automatic…

Machine Learning · Computer Science 2023-03-06 Yinuo Zhang , Zhulin Tao , Xi Wang , Tongyue Wang

The prevailing issue of factual inconsistency errors in conventional Retrieval Augmented Generation (RAG) motivates the study of Factual Consistency Evaluation (FCE). Despite the various FCE methods proposed earlier, these methods are…

Computation and Language · Computer Science 2024-07-10 Yunqi Xu , Tianchi Cai , Jiyan Jiang , Xierui Song