English
Related papers

Related papers: Real-time Factuality Assessment from Adversarial F…

200 papers

Prior research on training grounded factuality classification models to detect hallucinations in large language models (LLMs) has relied on public natural language inference (NLI) data and synthetic data. However, conventional NLI datasets…

Computation and Language · Computer Science 2025-01-29 Deren Lei , Yaxi Li , Siyao Li , Mengya Hu , Rui Xu , Ken Archer , Mingyu Wang , Emily Ching , Alex Deng

Adversarial factuality refers to the deliberate insertion of misinformation into input prompts by an adversary, characterized by varying levels of expressed confidence. In this study, we systematically evaluate the performance of several…

Computation and Language · Computer Science 2025-03-17 Shahnewaz Karim Sakib , Anindya Bijoy Das , Shibbir Ahmed

The proliferation of fake news has emerged as a critical issue in recent years, requiring significant efforts to detect it. However, the existing fake news detection datasets are sourced from human journalists, which are likely to have…

Computation and Language · Computer Science 2023-12-20 Zizhong Li , Haopeng Zhang , Jiawei Zhang

Retrieval-augmented generation (RAG) has shown impressive capabilities in mitigating hallucinations in large language models (LLMs). However, LLMs struggle to maintain consistent reasoning when exposed to misleading or conflicting evidence,…

Artificial Intelligence · Computer Science 2026-01-21 Linda Zeng , Rithwik Gupta , Divij Motwani , Yi Zhang , Diji Yang

Detecting fake news requires both a delicate sense of diverse clues and a profound understanding of the real-world background, which remains challenging for detectors based on small language models (SLMs) due to their knowledge and…

Computation and Language · Computer Science 2024-06-11 Beizhe Hu , Qiang Sheng , Juan Cao , Yuhui Shi , Yang Li , Danding Wang , Peng Qi

Incorporating specific knowledge into large language models via retrieval-augmented generation (RAG) is a widespread technique that fuels many of today's industry AI applications. A fundamental problem is to assess if the context retrieved…

Information Retrieval · Computer Science 2026-05-08 Florian Geissler , Francesco Carella , Laura Fieback , Jakob Spiegelberg

Given the widespread dissemination of misinformation on social media, implementing fact-checking mechanisms for online claims is essential. Manually verifying every claim is very challenging, underscoring the need for an automated…

Computation and Language · Computer Science 2024-10-08 Ronit Singhal , Pransh Patwa , Parth Patwa , Aman Chadha , Amitava Das

With the proliferation of online misinformation, fake news detection has gained importance in the artificial intelligence community. In this paper, we propose an adversarial benchmark that tests the ability of fake news detectors to reason…

Computation and Language · Computer Science 2022-01-05 Lorenzo Jaime Yu Flores , Yiding Hao

Misinformation and fake news have become a pressing societal challenge, driving the need for reliable automated detection methods. Prior research has highlighted sentiment as an important signal in fake news detection, either by analyzing…

Computation and Language · Computer Science 2026-01-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

Language models (LMs) are known to suffer from hallucinations and misinformation. Retrieval augmented generation (RAG) that retrieves verifiable information from an external knowledge corpus to complement the parametric knowledge in LMs…

Computation and Language · Computer Science 2024-10-14 Zhuohang Li , Jiaxin Zhang , Chao Yan , Kamalika Das , Sricharan Kumar , Murat Kantarcioglu , Bradley A. Malin

Artificial Intelligence has become a double edged sword in modern society being both a boon and a bane. While it empowers individuals it also enables malicious actors to perpetrate scams such as fraudulent phone calls and user…

Cryptography and Security · Computer Science 2025-01-28 Gurjot Singh , Prabhjot Singh , Maninder Singh

Online fake news profoundly distorts public judgment and erodes trust in social platforms. While existing detectors achieve competitive performance on benchmark datasets, they remain notably vulnerable to malicious comments designed…

Machine Learning · Computer Science 2026-02-06 Zhao Tong , Chunlin Gong , Yimeng Gu , Haichao Shi , Qiang Liu , Shu Wu , Xiao-Yu Zhang

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

LLMs and AI chatbots have improved people's efficiency in various fields. However, the necessary knowledge for answering the question may be beyond the models' knowledge boundaries. To mitigate this issue, many researchers try to introduce…

Computation and Language · Computer Science 2023-11-15 Yi Liu , Lianzhe Huang , Shicheng Li , Sishuo Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

While Large Language Models have transformed how we interact with AI systems, they suffer from a critical flaw: they confidently generate false information that sounds entirely plausible. This hallucination problem has become a major…

Artificial Intelligence · Computer Science 2025-10-28 Piyushkumar Patel

We study LLM judgments of misinformation expressed with uncertainty. Our experiments study the response of three widely used LLMs (GPT-4o, LlaMA3, DeepSeek-v2) to misinformation propositions that have been verified false and then are…

Computation and Language · Computer Science 2025-03-07 Yana van de Sande , Gunes Açar , Thabo van Woudenberg , Martha Larson

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

Computation and Language · Computer Science 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement…

Machine Learning · Computer Science 2025-10-15 Jeongyeon Hwang , Junyoung Park , Hyejin Park , Dongwoo Kim , Sangdon Park , Jungseul Ok

With the proliferation of Large Language Models (LLMs), the detection of misinformation has become increasingly important and complex. This research proposes an innovative verifiable misinformation detection LLM agent that goes beyond…

Artificial Intelligence · Computer Science 2025-08-06 Zikun Cui , Tianyi Huang , Chia-En Chiang , Cuiqianhe Du

Retrieval-Augmented Generation (RAG) systems have emerged as a promising solution to mitigate LLM hallucinations and enhance their performance in knowledge-intensive domains. However, these systems are vulnerable to adversarial poisoning…

Information Retrieval · Computer Science 2025-07-29 Jinyan Su , Jin Peng Zhou , Zhengxin Zhang , Preslav Nakov , Claire Cardie