English
Related papers

Related papers: SetKE: Knowledge Editing for Knowledge Elements Ov…

200 papers

Large language models (LLMs) are pivotal in advancing natural language processing (NLP) tasks, yet their efficacy is hampered by inaccuracies and outdated knowledge. Model editing emerges as a promising solution to address these challenges.…

Computation and Language · Computer Science 2024-02-22 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Knowledge Editing is a technique that updates large language models (LLMs) with new information to maintain their world knowledge. This approach avoids the need to rebuild the model from scratch, thereby addressing the high costs associated…

Computation and Language · Computer Science 2025-09-09 Changyue Wang , Weihang Su , Qingyao Ai , Yichen Tang , Yiqun Liu

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

Computation and Language · Computer Science 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Large Language Models (LLMs) have demonstrated impressive capability in different tasks and are bringing transformative changes to many domains. However, keeping the knowledge in LLMs up-to-date remains a challenge once pretraining is…

Computation and Language · Computer Science 2024-07-24 Xiou Ge , Ali Mousavi , Edouard Grave , Armand Joulin , Kun Qian , Benjamin Han , Mostafa Arefiyan , Yunyao Li

Knowledge editing aims to rectify inaccuracies in large language models (LLMs) without costly retraining for outdated or erroneous knowledge. However, current knowledge editing methods primarily focus on single editing, failing to meet the…

Computation and Language · Computer Science 2024-06-06 Chenhui Hu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Knowledge Editing has emerged as a promising solution for efficiently updating embedded knowledge in large language models (LLMs). While existing approaches demonstrate effectiveness in integrating new knowledge and preserving the original…

Computation and Language · Computer Science 2026-03-26 Mengqi Zhang , Zisheng Zhou , Xiaotian Ye , Qiang Liu , Zhaochun Ren , Zhumin Chen , Pengjie Ren

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs). The difficulty arises because the hallucinations of LLMs during multi-step reasoning often lead…

Computation and Language · Computer Science 2024-11-12 Yiwei Wang , Muhao Chen , Nanyun Peng , Kai-Wei Chang

The imperative task of revising or updating the knowledge stored within large language models arises from two distinct sources: intrinsic errors inherent in the model which should be corrected and outdated knowledge due to external shifts…

Computation and Language · Computer Science 2023-12-15 Xunjian Yin , Jin Jiang , Liming Yang , Xiaojun Wan

As Large Langue Models have been shown to memorize real-world facts, the need to update this knowledge in a controlled and efficient manner arises. Designed with these constraints in mind, Knowledge Editing (KE) approaches propose to alter…

Artificial Intelligence · Computer Science 2025-07-30 Marco Scialanga , Thibault Laugel , Vincent Grari , Marcin Detyniecki

As real-world knowledge is constantly evolving, ensuring the timeliness and accuracy of a model's knowledge is crucial. This has made knowledge editing in large language models increasingly important. However, existing knowledge editing…

Computation and Language · Computer Science 2024-12-31 Yongchang Li , Yujin Zhu , Tao Yan , Shijian Fan , Gang Wu , Liang Xu

Locate-then-Edit Knowledge Editing (LEKE) is a key technique for updating large language models (LLMs) without full retraining. However, existing methods assume a single-user setting and become inefficient in real-world multi-client…

Computation and Language · Computer Science 2025-02-24 Zongkai Zhao , Guozeng Xu , Xiuhua Li , Kaiwen Wei , Jiang Zhong

Knowledge editing allows for efficient adaptation of large language models (LLMs) to new information or corrections without requiring full retraining. However, prior methods typically focus on either single-language editing or basic…

Computation and Language · Computer Science 2025-05-26 Yuchen Wu , Liang Ding , Li Shen , Dacheng Tao

Collaborative learning of large language models (LLMs) has emerged as a new paradigm for utilizing private data from different parties to guarantee efficiency and privacy. Meanwhile, Knowledge Editing (KE) for LLMs has also garnered…

Computation and Language · Computer Science 2025-02-25 Jiamu Zheng , Jinghuai Zhang , Tianyu Du , Xuhong Zhang , Jianwei Yin , Tao Lin

Knowledge editing aims to change language models' performance on several special cases (i.e., editing scope) by infusing the corresponding expected knowledge into them. With the recent advancements in large language models (LLMs), knowledge…

Computation and Language · Computer Science 2024-05-31 Jiaan Wang , Yunlong Liang , Zengkui Sun , Yuxuan Cao , Jiarong Xu , Fandong Meng

Knowledge editing methods (KEs) can update language models' obsolete or inaccurate knowledge learned from pre-training. However, KEs can be used for malicious applications, e.g., inserting misinformation and toxic content. Knowing whether a…

Computation and Language · Computer Science 2025-02-11 Paul Youssef , Zhixue Zhao , Christin Seifert , Jörg Schlötterer

Large language models (LLMs) acquire knowledge during pre-training, but over time, this knowledge may become incorrect or outdated, necessitating updates after training. Knowledge editing techniques address this issue without the need for…

Computation and Language · Computer Science 2024-10-16 Yuchen Cai , Ding Cao

Large Language Models (LLMs) have become indispensable tools in science, technology, and society, enabling transformative advances across diverse fields. However, errors or outdated information within these models can undermine their…

Computation and Language · Computer Science 2025-12-19 Qizhou Chen , Chengyu Wang , Taolin Zhang , Xiaofeng He

Knowledge Editing (KE) aims to correct and update factual information in Large Language Models (LLMs) to ensure accuracy and relevance without computationally expensive fine-tuning. Though it has been proven effective in several domains,…

Computation and Language · Computer Science 2024-10-21 Ching Ming Samuel Lau , Weiqi Wang , Haochen Shi , Baixuan Xu , Jiaxin Bai , Yangqiu Song

Existing methods in Multimodal Knowledge Editing (MKE) have advanced the ability to correct outdated or inaccurate knowledge in Multimodal Large Language Models (MLLMs). However, they exhibit a critical limitation: while effectively…

Computation and Language · Computer Science 2026-05-29 Leijiang Gu , Zhen Zeng , Feng Li , Xinjian Gao , Zenglin Shi