English
Related papers

Related papers: Understanding Knowledge Drift in LLMs through Misi…

200 papers

Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflicts with real-world facts, and their persuasive style can…

Computation and Language · Computer Science 2024-09-19 Arslan Chaudhry , Sridhar Thiagarajan , Dilan Gorur

Question answering models can use rich knowledge sources -- up to one hundred retrieved passages and parametric knowledge in the large-scale language model (LM). Prior work assumes information in such knowledge sources is consistent with…

Computation and Language · Computer Science 2022-10-26 Hung-Ting Chen , Michael J. Q. Zhang , Eunsol Choi

This work presents a framework for assessing whether large language models (LLMs) encode more factual knowledge in their parameters than what they express in their outputs. While a few studies hint at this possibility, none has clearly…

Computation and Language · Computer Science 2025-08-07 Zorik Gekhman , Eyal Ben David , Hadas Orgad , Eran Ofek , Yonatan Belinkov , Idan Szpektor , Jonathan Herzig , Roi Reichart

Large language models (LLMs) often encounter knowledge conflicts, scenarios where discrepancy arises between the internal parametric knowledge of LLMs and non-parametric information provided in the prompt context. In this work we ask what…

Computation and Language · Computer Science 2024-10-16 Yike Wang , Shangbin Feng , Heng Wang , Weijia Shi , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

Computation and Language · Computer Science 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

Detecting deceptive conversations on dynamic platforms is increasingly difficult due to evolving language patterns and Concept Drift (CD)-i.e., semantic or topical shifts that alter the context or intent of interactions over time. These…

Computation and Language · Computer Science 2026-05-27 Ali Şenol , Garima Agrawal , Huan Liu

Large Language Models (LLMs) have demonstrated strong performance as knowledge repositories, enabling models to understand user queries and generate accurate and context-aware responses. Extensive evaluation setups have corroborated the…

Computation and Language · Computer Science 2024-11-19 Prasoon Bajpai , Sarah Masud , Tanmoy Chakraborty

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

Software Engineering · Computer Science 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

LLMs' sources of knowledge are data snapshots containing factual information about entities collected at different timestamps and from different media types (e.g. wikis, social media, etc.). Such unstructured knowledge is subject to change…

Computation and Language · Computer Science 2026-03-18 Seyed Mahed Mousavi , Simone Alghisi , Giuseppe Riccardi

A common solution for mitigating outdated or incorrect information in Large Language Models (LLMs) is to provide updated facts in-context or through knowledge editing. However, these methods introduce knowledge conflicts when the knowledge…

Artificial Intelligence · Computer Science 2026-01-23 Yiyang Feng , Zeming Chen , Haotian Wu , Jiawei Zhou , Antoine Bosselut

Large Language Models are known to capture real-world knowledge, allowing them to excel in many downstream tasks. Despite recent advances, these models are still prone to what are commonly known as hallucinations, causing them to emit…

Computation and Language · Computer Science 2025-05-28 Roi Cohen , Omri Fahn , Gerard de Melo

The proliferation of large language models (LLMs) has significantly advanced intelligent systems. Unfortunately, LLMs often face knowledge conflicts between internal memory and retrieved external information, arising from misinformation,…

Computation and Language · Computer Science 2025-11-18 Jiatai Wang , Zhiwei Xu , Di Jin , Xuewen Yang , Tao Li

Large language models (LLMs) can store a significant amount of factual knowledge in their parameters. However, their parametric knowledge may conflict with the information provided in the context. Such conflicts can lead to undesirable…

Computation and Language · Computer Science 2025-02-11 Yu Zhao , Xiaotang Du , Giwon Hong , Aryo Pradipta Gema , Alessio Devoto , Hongru Wang , Xuanli He , Kam-Fai Wong , Pasquale Minervini

Large Language Models (LLMs) have gained significant popularity in recent years for their ability to answer questions in various fields. However, these models have a tendency to "hallucinate" their responses, making it challenging to…

Computation and Language · Computer Science 2024-11-25 Elizaveta Reganova , Peter Steinbach

The emergence of Large Language Models (LLMs) presents a dual challenge in the fight against disinformation. These powerful tools, capable of generating human-like text at scale, can be weaponised to produce sophisticated and persuasive…

Large language models (LLMs) exhibit remarkable capabilities in question answering and reasoning thanks to their extensive parametric memory. However, their knowledge is inherently limited by the scope of their pre-training data, while…

Computation and Language · Computer Science 2025-06-10 Atahan Özer , Çağatay Yıldız

Large language models (LLMs) often miscommunicate their uncertainty: repeated queries can produce divergent answers, yet generated responses are typically unhedged or hedged in ways that do not reflect this variability. This conveys…

Computation and Language · Computer Science 2025-10-15 Bryan Eikema , Evgenia Ilia , José G. C. de Souza , Chrysoula Zerva , Wilker Aziz

While Large Language Models (LLMs) can amplify online misinformation, they also show promise in tackling misinformation. In this paper, we empirically study the capabilities of three LLMs -- ChatGPT, Gemini, and Claude -- in countering…

Computation and Language · Computer Science 2025-09-29 Adiba Mahbub Proma , Neeley Pate , James Druckman , Gourab Ghoshal , Hangfeng He , Ehsan Hoque

We investigate and observe the behaviour and performance of Large Language Model (LLM)-backed chatbots in addressing misinformed prompts and questions with demographic information within the domains of Climate Change and Mental Health.…

We explore uncertainty quantification in large language models (LLMs), with the goal to identify when uncertainty in responses given a query is large. We simultaneously consider both epistemic and aleatoric uncertainties, where the former…

Machine Learning · Computer Science 2024-07-18 Yasin Abbasi Yadkori , Ilja Kuzborskij , András György , Csaba Szepesvári