English
Related papers

Related papers: Evaluating Dependencies in Fact Editing for Langua…

200 papers

Large language models (LLMs) inevitably encode outdated or incorrect knowledge. Updating, deleting, and forgetting such knowledge is important for alignment, safety, and other issues. To address this issue, model editing has emerged as a…

Artificial Intelligence · Computer Science 2025-10-02 Wei Liu , Haomei Xu , Bingqing Liu , Zhiying Deng , Haozhao Wang , Jun Wang , Ruixuan Li , Yee Whye Teh , Wee Sun Lee

This survey addresses the crucial issue of factuality in Large Language Models (LLMs). As LLMs find applications across diverse domains, the reliability and accuracy of their outputs become vital. We define the Factuality Issue as the…

Large Language Models (LLMs) contain large amounts of facts about the world. These facts can become outdated over time, which has led to the development of knowledge editing methods (KEs) that can change specific facts in LLMs with limited…

Computation and Language · Computer Science 2025-06-18 Paul Youssef , Zhixue Zhao , Daniel Braun , Jörg Schlötterer , Christin Seifert

Large language models (LLMs) require frequent knowledge updates to reflect changing facts and mitigate hallucinations. To meet this demand, lifelong knowledge editing has emerged as a continual approach to modify specific pieces of…

Artificial Intelligence · Computer Science 2026-04-22 Dahyun Jung , Jaewook Lee , Heuiseok Lim

Knowledge editing aims to change language models' performance on several special cases (i.e., editing scope) by infusing the corresponding expected knowledge into them. With the recent advancements in large language models (LLMs), knowledge…

Computation and Language · Computer Science 2024-05-31 Jiaan Wang , Yunlong Liang , Zengkui Sun , Yuxuan Cao , Jiarong Xu , Fandong Meng

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world…

Computation and Language · Computer Science 2024-04-23 Hao Peng , Xiaozhi Wang , Chunyang Li , Kaisheng Zeng , Jiangshan Duo , Yixin Cao , Lei Hou , Juanzi Li

Large Language Models (LLMs) are increasingly embedded in evaluative processes, from information filtering to assessing and addressing knowledge gaps through explanation and credibility judgments. This raises the need to examine how such…

The increasing prevalence of online misinformation has heightened the demand for automated fact-checking solutions. Large Language Models (LLMs) have emerged as potential tools for assisting in this task, but their effectiveness remains…

Computers and Society · Computer Science 2025-03-10 Nicolo' Fontana , Francesco Corso , Enrico Zuccolotto , Francesco Pierri

Large Language Models (LLMs) internalize vast world knowledge as parametric memory, yet inevitably inherit the staleness and errors of their source corpora. Consequently, ensuring the reliability and malleability of these internal…

Computation and Language · Computer Science 2026-04-08 Xiaojie Gu , Ziying Huang , Weicong Hong , Jian Xie , Renze Lou , Kai Zhang

LLMs acquire knowledge from massive data snapshots collected at different timestamps. Their knowledge is then commonly evaluated using static benchmarks. However, factual knowledge is generally subject to time-sensitive changes, and static…

Computation and Language · Computer Science 2024-10-03 Seyed Mahed Mousavi , Simone Alghisi , Giuseppe Riccardi

Pre-trained Language Models (PLMs) are trained on vast unlabeled data, rich in world knowledge. This fact has sparked the interest of the community in quantifying the amount of factual knowledge present in PLMs, as this explains their…

Computation and Language · Computer Science 2023-12-06 Paul Youssef , Osman Alperen Koraş , Meijie Li , Jörg Schlötterer , Christin Seifert

LLMs' sources of knowledge are data snapshots containing factual information about entities collected at different timestamps and from different media types (e.g. wikis, social media, etc.). Such unstructured knowledge is subject to change…

Computation and Language · Computer Science 2026-03-18 Seyed Mahed Mousavi , Simone Alghisi , Giuseppe Riccardi

Large language models (LLMs) have recently transformed both the academic and industrial landscapes due to their remarkable capacity to understand, analyze, and generate texts based on their vast knowledge and reasoning ability.…

Computation and Language · Computer Science 2024-09-23 Song Wang , Yaochen Zhu , Haochen Liu , Zaiyi Zheng , Chen Chen , Jundong Li

Pre-trained language models (LMs) are used for knowledge intensive tasks like question answering, but their knowledge gets continuously outdated as the world changes. Prior work has studied targeted updates to LMs, injecting individual…

Computation and Language · Computer Science 2023-05-03 Yasumasa Onoe , Michael J. Q. Zhang , Shankar Padmanabhan , Greg Durrett , Eunsol Choi

How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs). The difficulty arises because the hallucinations of LLMs during multi-step reasoning often lead…

Computation and Language · Computer Science 2024-11-12 Yiwei Wang , Muhao Chen , Nanyun Peng , Kai-Wei Chang

The paper introduces a framework for the evaluation of the encoding of factual scientific knowledge, designed to streamline the manual evaluation process typically conducted by domain experts. Inferring over and extracting information from…

Computation and Language · Computer Science 2024-10-21 Magdalena Wysocka , Oskar Wysocki , Maxime Delmas , Vincent Mutel , Andre Freitas

Large language models (LLMs) have recently driven striking performance improvements across a range of natural language processing tasks. The factual knowledge acquired during pretraining and instruction tuning can be useful in various…

Computation and Language · Computer Science 2023-10-10 Xuming Hu , Junzhe Chen , Xiaochuan Li , Yufei Guo , Lijie Wen , Philip S. Yu , Zhijiang Guo

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

Computation and Language · Computer Science 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

Knowledge editing technology is crucial for maintaining the accuracy and timeliness of large language models (LLMs) . However, the setting of this task overlooks a significant portion of commonsense knowledge based on free-text in the real…

Computation and Language · Computer Science 2024-11-01 Xiusheng Huang , Yequan Wang , Jun Zhao , Kang Liu

The storage and recall of factual associations in auto-regressive transformer language models (LMs) have drawn a great deal of attention, inspiring knowledge editing by directly modifying the located model weights. Most editing works…

Computation and Language · Computer Science 2025-02-28 Xiyu Liu , Zhengxiao Liu , Naibin Gu , Zheng Lin , Wanli Ma , Ji Xiang , Weiping Wang