English
Related papers

Related papers: Edit Less, Achieve More: Dynamic Sparse Neuron Mas…

200 papers

Knowledge editing aims to update outdated or incorrect knowledge in large language models (LLMs). However, current knowledge editing methods have limited scalability for lifelong editing. This study explores the fundamental reason why…

Computation and Language · Computer Science 2025-02-27 Chenhui Hu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

The extensive utilization of large language models (LLMs) underscores the crucial necessity for precise and contemporary knowledge embedded within their intrinsic parameters. Existing research on knowledge editing primarily concentrates on…

Computation and Language · Computer Science 2025-02-20 Zihao Wei , Jingcheng Deng , Liang Pang , Hanxing Ding , Huawei Shen , Xueqi Cheng

Model editing aims to precisely alter the behaviors of large language models (LLMs) in relation to specific knowledge, while leaving unrelated knowledge intact. This approach has proven effective in addressing issues of hallucination and…

Computation and Language · Computer Science 2024-09-24 Derong Xu , Ziheng Zhang , Zhihong Zhu , Zhenxi Lin , Qidong Liu , Xian Wu , Tong Xu , Wanyu Wang , Yuyang Ye , Xiangyu Zhao , Enhong Chen , Yefeng Zheng

Knowledge Editing (KE) enables the modification of outdated or incorrect information in large language models (LLMs). While existing KE methods can update isolated facts, they often fail to generalize these updates to multi-hop reasoning…

Computation and Language · Computer Science 2025-11-21 Yunzhi Yao , Jizhan Fang , Jia-Chen Gu , Ningyu Zhang , Shumin Deng , Huajun Chen , Nanyun Peng

Large language models (LLMs) are pivotal in advancing natural language processing (NLP) tasks, yet their efficacy is hampered by inaccuracies and outdated knowledge. Model editing emerges as a promising solution to address these challenges.…

Computation and Language · Computer Science 2024-02-22 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Large Language Models (LLMs) require continuous updates to maintain accurate and current knowledge as the world evolves. While existing knowledge editing approaches offer various solutions for knowledge updating, they often struggle with…

Artificial Intelligence · Computer Science 2025-06-17 Zichuan Fu , Xian Wu , Guojing Li , Yingying Zhang , Yefeng Zheng , Tianshi Ming , Yejing Wang , Wanyu Wang , Xiangyu Zhao

Knowledge editing techniques have emerged as essential tools for updating the factual knowledge of large language models (LLMs) and multimodal models (LMMs), allowing them to correct outdated or inaccurate information without retraining…

Computation and Language · Computer Science 2025-03-04 Yuntao Du , Kailin Jiang , Zhi Gao , Chenrui Shi , Zilong Zheng , Siyuan Qi , Qing Li

Large Language Models (LLMs) have become indispensable tools in science, technology, and society, enabling transformative advances across diverse fields. However, errors or outdated information within these models can undermine their…

Computation and Language · Computer Science 2025-12-19 Qizhou Chen , Chengyu Wang , Taolin Zhang , Xiaofeng He

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmarks have not…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Junzhe Zhang , Huixuan Zhang , Xunjian Yin , Baizhou Huang , Xu Zhang , Xinyu Hu , Xiaojun Wan

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world…

Computation and Language · Computer Science 2024-04-23 Hao Peng , Xiaozhi Wang , Chunyang Li , Kaisheng Zeng , Jiangshan Duo , Yixin Cao , Lei Hou , Juanzi Li

As Large Langue Models have been shown to memorize real-world facts, the need to update this knowledge in a controlled and efficient manner arises. Designed with these constraints in mind, Knowledge Editing (KE) approaches propose to alter…

Artificial Intelligence · Computer Science 2025-07-30 Marco Scialanga , Thibault Laugel , Vincent Grari , Marcin Detyniecki

Knowledge editing (KE) enables precise modifications to factual content in large language models (LLMs). Existing KE methods are largely designed for dense architectures, limiting their applicability to the increasingly prevalent sparse…

Machine Learning · Computer Science 2026-02-12 Yupu Gu , Rongzhe Wei , Andy Zhu , Pan Li

Regular updates are essential for maintaining up-to-date knowledge in large language models (LLMs). Consequently, various model editing methods have been developed to update specific knowledge within LLMs. However, training-based approaches…

Computation and Language · Computer Science 2025-05-27 Yujie Feng , Liming Zhan , Zexin Lu , Yongxin Xu , Xu Chu , Yasha Wang , Jiannong Cao , Philip S. Yu , Xiao-Ming Wu

While Knowledge Editing has been extensively studied in monolingual settings, it remains underexplored in multilingual contexts. This survey systematizes recent research on Multilingual Knowledge Editing (MKE), a growing subdomain of model…

Computation and Language · Computer Science 2025-11-04 Nadir Durrani , Basel Mousi , Fahim Dalvi

Knowledge Editing (KE) aims to adjust a Large Language Model's (LLM) internal representations and parameters to correct inaccuracies and improve output consistency without incurring the computational expense of re-training the entire model.…

Computation and Language · Computer Science 2025-05-29 Liyu Zhang , Weiqi Wang , Tianqing Fang , Yangqiu Song

Knowledge Editing has emerged as a promising solution for efficiently updating embedded knowledge in large language models (LLMs). While existing approaches demonstrate effectiveness in integrating new knowledge and preserving the original…

Computation and Language · Computer Science 2026-03-26 Mengqi Zhang , Zisheng Zhou , Xiaotian Ye , Qiang Liu , Zhaochun Ren , Zhumin Chen , Pengjie Ren

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Knowledge editing and machine unlearning are two popular approaches for large language models (LLMs) to stay up-to-date. However, the knowledge updating mechanism of LLMs remains largely unexplored due to insufficient, isolated, and…

Computation and Language · Computer Science 2026-03-26 Yinyi Luo , Zhexian Zhou , Hao Chen , Kai Qiu , Marios Savvides , Sharon Li , Jindong Wang

Language models deployed in real-world systems often require post-hoc updates to incorporate new or corrected knowledge. However, editing such models efficiently and reliably-without retraining or forgetting previous information-remains a…

Computation and Language · Computer Science 2026-02-03 Ke Wang , Yiming Qin , Nikolaos Dimitriadis , Alessandro Favero , Pascal Frossard

Large language models (LLMs) have emerged as powerful knowledge bases yet are limited by static training data, leading to issues such as hallucinations and safety risks. Editing a model's internal knowledge through the locate-and-edit…

Computation and Language · Computer Science 2025-08-12 Zian Su , Ziyang Huang , Kaiyuan Zhang , Xiangyu Zhang