English
Related papers

Related papers: Benchmarking and Rethinking Knowledge Editing for …

200 papers

Large Language Models (LLMs) store an extensive amount of factual knowledge obtained from vast collections of text. To effectively utilize these models for downstream tasks, it is crucial to have reliable methods for measuring their…

Computation and Language · Computer Science 2023-06-13 Pouya Pezeshkpour

Keeping large language models factually up-to-date is crucial for deployment, yet costly retraining remains a challenge. Knowledge editing offers a promising alternative, but methods are only tested on small-scale or synthetic edit…

Computation and Language · Computer Science 2025-09-23 Lukas Thede , Karsten Roth , Matthias Bethge , Zeynep Akata , Tom Hartvigsen

Large Language Models (LLMs) internalize vast world knowledge as parametric memory, yet inevitably inherit the staleness and errors of their source corpora. Consequently, ensuring the reliability and malleability of these internal…

Computation and Language · Computer Science 2026-04-08 Xiaojie Gu , Ziying Huang , Weicong Hong , Jian Xie , Renze Lou , Kai Zhang

How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs). The difficulty arises because the hallucinations of LLMs during multi-step reasoning often lead…

Computation and Language · Computer Science 2024-11-12 Yiwei Wang , Muhao Chen , Nanyun Peng , Kai-Wei Chang

Large Language Models store extensive factual knowledge acquired during large-scale pre-training. However, this knowledge is inherently static, reflecting only the state of the world at the time of training. Knowledge editing has emerged as…

Computation and Language · Computer Science 2025-10-14 Geunyeong Jeong , Juoh Sun , Seonghee Lee , Harksoo Kim

Model editing aims to correct errors and outdated knowledge in the Large language models (LLMs) with minimal cost. Prior research has proposed a variety of datasets to assess the effectiveness of these model editing methods. However, most…

Computation and Language · Computer Science 2025-05-27 Li Zeng , Zeming Liu , Chong Feng , Heyan Huang , Yuhang Guo

Memory Editing (ME) has emerged as an efficient method to modify erroneous facts or inject new facts into Large Language Models (LLMs). Two mainstream ME methods exist: parameter-modifying ME and parameter-preserving ME (integrating extra…

Computation and Language · Computer Science 2024-02-20 Zihao Lin , Mohammad Beigi , Hongxuan Li , Yufan Zhou , Yuxiang Zhang , Qifan Wang , Wenpeng Yin , Lifu Huang

Knowledge editing enables multimodal large language models (MLLMs) to efficiently update outdated or incorrect information. However, existing benchmarks primarily emphasize cognitive-level modifications while lacking a focus on deeper…

Artificial Intelligence · Computer Science 2025-09-09 Zhaoyu Fan , Kaihang Pan , Mingze Zhou , Bosheng Qin , Juncheng Li , Shengyu Zhang , Wenqiao Zhang , Siliang Tang , Fei Wu , Yueting Zhuang

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

Computation and Language · Computer Science 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Knowledge Editing (KE) for modifying factual knowledge in Large Language Models (LLMs) has been receiving increasing attention. However, existing knowledge editing methods are entity-centric, and it is unclear whether this approach is…

Computation and Language · Computer Science 2023-11-16 Yifan Wei , Xiaoyan Yu , Huanhuan Ma , Fangyu Lei , Yixuan Weng , Ran Song , Kang Liu

Large language models (LLMs) have achieved remarkable performance on various natural language tasks. However, they are trained on static corpora and their knowledge can become outdated quickly in the fast-changing world. This motivates the…

Computation and Language · Computer Science 2025-03-04 Tianci Liu , Ruirui Li , Yunzhe Qi , Hui Liu , Xianfeng Tang , Tianqi Zheng , Qingyu Yin , Monica Xiao Cheng , Jun Huan , Haoyu Wang , Jing Gao

Large language models (LLMs) are pivotal in advancing natural language processing (NLP) tasks, yet their efficacy is hampered by inaccuracies and outdated knowledge. Model editing emerges as a promising solution to address these challenges.…

Computation and Language · Computer Science 2024-02-22 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

The extensive utilization of large language models (LLMs) underscores the crucial necessity for precise and contemporary knowledge embedded within their intrinsic parameters. Existing research on knowledge editing primarily concentrates on…

Computation and Language · Computer Science 2025-02-20 Zihao Wei , Jingcheng Deng , Liang Pang , Hanxing Ding , Huawei Shen , Xueqi Cheng

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmarks have not…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Junzhe Zhang , Huixuan Zhang , Xunjian Yin , Baizhou Huang , Xu Zhang , Xinyu Hu , Xiaojun Wan

Knowledge editing and machine unlearning are two popular approaches for large language models (LLMs) to stay up-to-date. However, the knowledge updating mechanism of LLMs remains largely unexplored due to insufficient, isolated, and…

Computation and Language · Computer Science 2026-03-26 Yinyi Luo , Zhexian Zhou , Hao Chen , Kai Qiu , Marios Savvides , Sharon Li , Jindong Wang

Knowledge editing methods for large language models are commonly evaluated using predefined benchmarks that assess edited facts together with a limited set of related or neighboring knowledge. While effective, such evaluations remain…

Computation and Language · Computer Science 2026-05-12 Shuainan Liu , Xuanang Chen , Ben He , Le Sun

Knowledge Editing (KE) has gained increasing attention, yet current KE tasks remain relatively simple. Under current evaluation frameworks, many editing methods achieve exceptionally high scores, sometimes nearing perfection. However, few…

Computation and Language · Computer Science 2025-06-03 Xinye Li , Zunwen Zheng , Qian Zhang , Dekai Zhuang , Jiabao Kang , Liyan Xu , Qingbin Liu , Xi Chen , Zhiying Tu , Dianhui Chu , Dianbo Sui

Knowledge Editing, which efficiently modifies the knowledge in large language models, has gathered great attention. Current benchmarks primarily use multi-hop question answering to assess and analyze newly injected or updated knowledge.…

Computation and Language · Computer Science 2025-06-04 Keyuan Cheng , Zijian Kan , Zhixian He , Zhuoran Zhang , Muhammad Asif Ali , Ke Xu , Lijie Hu , Di Wang

Knowledge editing techniques have emerged as essential tools for updating the factual knowledge of large language models (LLMs) and multimodal models (LMMs), allowing them to correct outdated or inaccurate information without retraining…

Computation and Language · Computer Science 2025-03-04 Yuntao Du , Kailin Jiang , Zhi Gao , Chenrui Shi , Zilong Zheng , Siyuan Qi , Qing Li

Knowledge editing aims to adjust the knowledge within large language models (LLMs) to prevent their responses from becoming obsolete or inaccurate. However, existing works on knowledge editing are primarily conducted in a single language,…

Computation and Language · Computer Science 2024-06-18 Jiakuan Xie , Pengfei Cao , Yuheng Chen , Yubo Chen , Kang Liu , Jun Zhao