English
Related papers

Related papers: Towards Scalable Lifelong Knowledge Editing with S…

200 papers

Model editing aims to precisely alter the behaviors of large language models (LLMs) in relation to specific knowledge, while leaving unrelated knowledge intact. This approach has proven effective in addressing issues of hallucination and…

Computation and Language · Computer Science 2024-09-24 Derong Xu , Ziheng Zhang , Zhihong Zhu , Zhenxi Lin , Qidong Liu , Xian Wu , Tong Xu , Wanyu Wang , Yuyang Ye , Xiangyu Zhao , Enhong Chen , Yefeng Zheng

Large Language Models (LLMs) often retain inaccurate or outdated information from pre-training, leading to incorrect predictions or biased outputs during inference. While existing model editing methods can address this challenge, they…

Machine Learning · Computer Science 2025-08-07 Xin Liu , Qiyang Song , Shaowen Xu , Kerou Zhou , Wenbo Jiang , Xiaoqi Jia , Weijuan Zhang , Heqing Huang , Yakai Li

Model editing aims to correct outdated or erroneous knowledge in large language models (LLMs) without the need for costly retraining. Lifelong model editing is the most challenging task that caters to the continuous editing requirements of…

Computation and Language · Computer Science 2025-03-17 Qizhou Chen , Taolin Zhang , Xiaofeng He , Dongyang Li , Chengyu Wang , Longtao Huang , Hui Xue

Large Language Models (LLMs) require continuous updates to maintain accurate and current knowledge as the world evolves. While existing knowledge editing approaches offer various solutions for knowledge updating, they often struggle with…

Artificial Intelligence · Computer Science 2025-06-17 Zichuan Fu , Xian Wu , Guojing Li , Yingying Zhang , Yefeng Zheng , Tianshi Ming , Yejing Wang , Wanyu Wang , Xiangyu Zhao

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

Computation and Language · Computer Science 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Large language models (LLMs) require continual updates to rectify outdated or erroneous knowledge. Model editing has emerged as a compelling paradigm for introducing targeted modifications without the computational burden of full…

Computation and Language · Computer Science 2026-04-07 Sicheng Lyu , Yu Gu , Xinyu Wang , Jerry Huang , Sitao Luan , Yufei Cui , Xiao-Wen Chang , Peng Lu

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang

Language models deployed in real-world systems often require post-hoc updates to incorporate new or corrected knowledge. However, editing such models efficiently and reliably-without retraining or forgetting previous information-remains a…

Computation and Language · Computer Science 2026-02-03 Ke Wang , Yiming Qin , Nikolaos Dimitriadis , Alessandro Favero , Pascal Frossard

Knowledge editing and machine unlearning are two popular approaches for large language models (LLMs) to stay up-to-date. However, the knowledge updating mechanism of LLMs remains largely unexplored due to insufficient, isolated, and…

Computation and Language · Computer Science 2026-03-26 Yinyi Luo , Zhexian Zhou , Hao Chen , Kai Qiu , Marios Savvides , Sharon Li , Jindong Wang

Recently, there has been a growing interest in knowledge editing for Large Language Models (LLMs). Current approaches and evaluations merely explore the instance-level editing, while whether LLMs possess the capability to modify concepts…

Computation and Language · Computer Science 2024-10-08 Xiaohan Wang , Shengyu Mao , Ningyu Zhang , Shumin Deng , Yunzhi Yao , Yue Shen , Lei Liang , Jinjie Gu , Huajun Chen

Efficient knowledge editing of large language models is crucial for replacing obsolete information or incorporating specialized knowledge on a large scale. However, previous methods implicitly assume that knowledge is localized and isolated…

Computation and Language · Computer Science 2024-02-21 Zihao Wei , Liang Pang , Hanxing Ding , Jingcheng Deng , Huawei Shen , Xueqi Cheng

Large language models (LLMs) face challenges with internal knowledge inaccuracies and outdated information. Knowledge editing has emerged as a pivotal approach to mitigate these issues. Although current knowledge editing techniques exhibit…

Computation and Language · Computer Science 2024-08-23 Mengqi Zhang , Bowen Fang , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen , Liang Wang

Knowledge editing techniques, aiming to efficiently modify a minor proportion of knowledge in large language models (LLMs) without negatively impacting performance across other inputs, have garnered widespread attention. However, existing…

Computation and Language · Computer Science 2024-06-06 Yuxin Jiang , Yufei Wang , Chuhan Wu , Wanjun Zhong , Xingshan Zeng , Jiahui Gao , Liangyou Li , Xin Jiang , Lifeng Shang , Ruiming Tang , Qun Liu , Wei Wang

Knowledge editing has emerged as a lightweight alternative to retraining for correcting or injecting specific facts in large language models (LLMs). Meanwhile, fine-tuning remains the default operation for adapting LLMs to new domains and…

Computation and Language · Computer Science 2025-12-09 Yinjie Cheng , Paul Youssef , Christin Seifert , Jörg Schlötterer , Zhixue Zhao

Large Language Models (LLMs) are widely deployed in downstream tasks, but keeping their knowledge up-to-date via retraining or fine-tuning is often computationally expensive. Model editing provides a more efficient alternative by updating a…

Computation and Language · Computer Science 2025-10-02 Bhiman Kumar Baghel , Emma Jordan , Zheyuan Ryan Shi , Xiang Lorraine Li

As the modern tool of choice for question answering, large language models (LLMs) are expected to deliver answers with up-to-date knowledge. To achieve such ideal question-answering systems, locating and then editing outdated knowledge in…

Computation and Language · Computer Science 2024-09-17 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Hongcheng Gao , Junfeng Fang , Xueqi Cheng

Knowledge editing is a technique for efficiently and accurately updating the knowledge of large language models (LLMs) to alleviate obsolescence and correct errors. However, most existing methods overfit to specific models, causing edited…

Artificial Intelligence · Computer Science 2025-03-05 Shuaike Li , Kai Zhang , Qi Liu , Enhong Chen

Efficiently updating multilingual knowledge in large language models (LLMs), while preserving consistent factual representations across languages, remains a long-standing and unresolved challenge. While deploying separate editing systems…

Computation and Language · Computer Science 2025-06-13 Wei Sun , Tingyu Qu , Mingxiao Li , Jesse Davis , Marie-Francine Moens

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world…

Computation and Language · Computer Science 2024-04-23 Hao Peng , Xiaozhi Wang , Chunyang Li , Kaisheng Zeng , Jiangshan Duo , Yixin Cao , Lei Hou , Juanzi Li

Knowledge editing is a rising technique for efficiently updating factual knowledge in large language models (LLMs) with minimal alteration of parameters. However, recent studies have identified side effects, such as knowledge distortion and…

Computation and Language · Computer Science 2024-10-28 Cheng-Hsun Hsueh , Paul Kuo-Ming Huang , Tzu-Han Lin , Che-Wei Liao , Hung-Chieh Fang , Chao-Wei Huang , Yun-Nung Chen