English
Related papers

Related papers: Stable Knowledge Editing in Large Language Models

200 papers

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Large Audio-Language Models (LALMs) have shown strong performance in speech understanding, making speech a natural interface for accessing factual information. Yet they are trained on static corpora and may encode incorrect facts. Existing…

Machine Learning · Computer Science 2026-03-17 Sung Kyun Chung , Jiaheng Dong , Qiuchi Hu , Gongping Huang , Hong Jia , Ting Dang

As Large Langue Models have been shown to memorize real-world facts, the need to update this knowledge in a controlled and efficient manner arises. Designed with these constraints in mind, Knowledge Editing (KE) approaches propose to alter…

Artificial Intelligence · Computer Science 2025-07-30 Marco Scialanga , Thibault Laugel , Vincent Grari , Marcin Detyniecki

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang

As real-world knowledge evolves, the information embedded within large language models (LLMs) can become outdated, inadequate, or erroneous. Model editing has emerged as a prominent approach for updating LLMs' knowledge with minimal…

Computation and Language · Computer Science 2025-03-10 Guoxiu He , Xin Song , Aixin Sun

Large Language Models (LLMs) usually suffer from knowledge cutoff or fallacy issues, which means they are unaware of unseen events or generate text with incorrect facts owing to outdated/noisy data. To this end, many knowledge editing…

Large Language Models (LLMs) have demonstrated impressive capability in different tasks and are bringing transformative changes to many domains. However, keeping the knowledge in LLMs up-to-date remains a challenge once pretraining is…

Computation and Language · Computer Science 2024-07-24 Xiou Ge , Ali Mousavi , Edouard Grave , Armand Joulin , Kun Qian , Benjamin Han , Mostafa Arefiyan , Yunyao Li

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model…

Computation and Language · Computer Science 2024-10-30 Han Huang , Haitian Zhong , Tao Yu , Qiang Liu , Shu Wu , Liang Wang , Tieniu Tan

Knowledge editing enables targeted updates without retraining, but prior work focuses on textual or visual facts, leaving abstract auditory perceptual knowledge underexplored. We introduce SAKE, the first benchmark for editing perceptual…

Knowledge Editing (KE) enables the modification of outdated or incorrect information in large language models (LLMs). While existing KE methods can update isolated facts, they often fail to generalize these updates to multi-hop reasoning…

Computation and Language · Computer Science 2025-11-21 Yunzhi Yao , Jizhan Fang , Jia-Chen Gu , Ningyu Zhang , Shumin Deng , Huajun Chen , Nanyun Peng

Model editing, the process of efficiently modifying factual knowledge in pre-trained language models, is critical for maintaining their accuracy and relevance. However, existing editing methods often introduce unintended side effects,…

Computation and Language · Computer Science 2025-09-23 Tsung-Hsuan Pan , Chung-Chi Chen , Hen-Hsen Huang , Hsin-Hsi Chen

As the modern tool of choice for question answering, large language models (LLMs) are expected to deliver answers with up-to-date knowledge. To achieve such ideal question-answering systems, locating and then editing outdated knowledge in…

Computation and Language · Computer Science 2024-09-17 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Hongcheng Gao , Junfeng Fang , Xueqi Cheng

Lifelong knowledge editing enables continuous, precise updates to outdated knowledge in large language models (LLMs) without computationally expensive full retraining. However, existing methods often accumulate errors throughout the editing…

Machine Learning · Computer Science 2025-10-28 Jinzhe Liu , Junshu Sun , Shufan Shen , Chenxue Yang , Shuhui Wang

Large language models store not only isolated facts but also rules that support reasoning across symbolic expressions, natural language explanations, and concrete instances. Yet most model editing methods are built for fact-level knowledge,…

Computation and Language · Computer Science 2026-04-10 Yating Wang , Wenting Zhao , Yaqi Zhao , Yongshun Gong , Yilong Yin , Haoliang Sun

Large language models (LLMs) encode vast amounts of world knowledge but remain static once trained, making the timely integration of emerging facts prohibitively expensive via full retraining. Knowledge-editing techniques have thus emerged…

Computation and Language · Computer Science 2025-09-03 Yuchen Wu , Liang Ding , Li Shen , Dacheng Tao

Knowledge Editing (KE) is a field that studies how to modify some knowledge in Large Language Models (LLMs) at a low cost (compared to pre-training). Currently, performing large-scale edits on LLMs while ensuring the Reliability,…

Artificial Intelligence · Computer Science 2026-03-24 Wentao Wan , Qiqing Lao , Zhiwei Xie , Hefeng Wu , Runnan Lin , Liang Lin , Keze Wang

While Knowledge Editing has been extensively studied in monolingual settings, it remains underexplored in multilingual contexts. This survey systematizes recent research on Multilingual Knowledge Editing (MKE), a growing subdomain of model…

Computation and Language · Computer Science 2025-11-04 Nadir Durrani , Basel Mousi , Fahim Dalvi

Knowledge editing is a promising way to improve factuality in large language models, but recent studies have shown significant model degradation during sequential editing. In this paper, we formalize the popular locate-then-edit methods as…

Computation and Language · Computer Science 2025-05-22 Akshat Gupta , Phudish Prateepamornkul , Maochuan Lu , Ahmed Alaa , Thomas Hartvigsen , Gopala Anumanchipalli

Existing debiasing methods inevitably make unreasonable or undesired predictions as they are designated and evaluated to achieve parity across different social groups but leave aside individual facts, resulting in modified existing…

Computation and Language · Computer Science 2024-07-02 Ruizhe Chen , Yichen Li , Zikai Xiao , Zuozhu Liu

Enabling artificial intelligence systems, particularly large language models, to integrate new knowledge and flexibly apply it during reasoning remains a central challenge. Existing knowledge editing approaches emphasize atomic facts,…

Artificial Intelligence · Computer Science 2026-02-03 Ya Gao , Kalle Kujanpää , Pekka Marttinen , Harri Valpola , Alexander Ilin