English
Related papers

Related papers: One for All: Update Parameterized Knowledge Across…

200 papers

Knowledge Editing is a technique that updates large language models (LLMs) with new information to maintain their world knowledge. This approach avoids the need to rebuild the model from scratch, thereby addressing the high costs associated…

Computation and Language · Computer Science 2025-09-09 Changyue Wang , Weihang Su , Qingyao Ai , Yichen Tang , Yiqun Liu

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Knowledge editing is a technique for efficiently and accurately updating the knowledge of large language models (LLMs) to alleviate obsolescence and correct errors. However, most existing methods overfit to specific models, causing edited…

Artificial Intelligence · Computer Science 2025-03-05 Shuaike Li , Kai Zhang , Qi Liu , Enhong Chen

Large Language Models (LLMs) have become indispensable tools in science, technology, and society, enabling transformative advances across diverse fields. However, errors or outdated information within these models can undermine their…

Computation and Language · Computer Science 2025-12-19 Qizhou Chen , Chengyu Wang , Taolin Zhang , Xiaofeng He

Knowledge editing allows for efficient adaptation of large language models (LLMs) to new information or corrections without requiring full retraining. However, prior methods typically focus on either single-language editing or basic…

Computation and Language · Computer Science 2025-05-26 Yuchen Wu , Liang Ding , Li Shen , Dacheng Tao

Knowledge editing and machine unlearning are two popular approaches for large language models (LLMs) to stay up-to-date. However, the knowledge updating mechanism of LLMs remains largely unexplored due to insufficient, isolated, and…

Computation and Language · Computer Science 2026-03-26 Yinyi Luo , Zhexian Zhou , Hao Chen , Kai Qiu , Marios Savvides , Sharon Li , Jindong Wang

Large language models (LLMs) often exhibit hallucinations due to incorrect or outdated knowledge. Hence, model editing methods have emerged to enable targeted knowledge updates. To achieve this, a prevailing paradigm is the…

Computation and Language · Computer Science 2025-04-23 Junfeng Fang , Houcheng Jiang , Kun Wang , Yunshan Ma , Shi Jie , Xiang Wang , Xiangnan He , Tat-seng Chua

As real-world knowledge is constantly evolving, ensuring the timeliness and accuracy of a model's knowledge is crucial. This has made knowledge editing in large language models increasingly important. However, existing knowledge editing…

Computation and Language · Computer Science 2024-12-31 Yongchang Li , Yujin Zhu , Tao Yan , Shijian Fan , Gang Wu , Liang Xu

As the world changes, we need to be able to update our models and correct false information without costly retraining. Knowledge-based model editing enables precise modifications to the weights of large language models in order to modify…

Machine Learning · Computer Science 2025-02-28 Elan Markowitz , Anil Ramakrishna , Ninareh Mehrabi , Charith Peris , Rahul Gupta , Kai-Wei Chang , Aram Galstyan

Regular updates are essential for maintaining up-to-date knowledge in large language models (LLMs). Consequently, various model editing methods have been developed to update specific knowledge within LLMs. However, training-based approaches…

Computation and Language · Computer Science 2025-05-27 Yujie Feng , Liming Zhan , Zexin Lu , Yongxin Xu , Xu Chu , Yasha Wang , Jiannong Cao , Philip S. Yu , Xiao-Ming Wu

Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring…

Computation and Language · Computer Science 2026-04-08 Jinhu Fu , Yan Bai , Longzhu He , Yihang Lou , Yanxiao Zhao , Li Sun , Sen Su

The swift advancement in Multimodal LLMs (MLLMs) also presents significant challenges for effective knowledge editing. Current methods, including intrinsic knowledge editing and external knowledge resorting, each possess strengths and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kaihang Pan , Zhaoyu Fan , Juncheng Li , Qifan Yu , Hao Fei , Siliang Tang , Richang Hong , Hanwang Zhang , Qianru Sun

Large language models (LLMs) have shown remarkable promise but remain challenging to continually improve through traditional finetuning, particularly when integrating capabilities from other specialized LLMs. Popular methods like ensemble…

Computation and Language · Computer Science 2025-06-02 Zhenglun Kong , Zheng Zhan , Shiyue Hou , Yifan Gong , Xin Meng , Pengwei Sui , Peiyan Dong , Xuan Shen , Zifeng Wang , Pu Zhao , Hao Tang , Stratis Ioannidis , Yanzhi Wang

Large language models (LLMs) have recently transformed both the academic and industrial landscapes due to their remarkable capacity to understand, analyze, and generate texts based on their vast knowledge and reasoning ability.…

Computation and Language · Computer Science 2024-09-23 Song Wang , Yaochen Zhu , Haochen Liu , Zaiyi Zheng , Chen Chen , Jundong Li

Knowledge editing is a rising technique for efficiently updating factual knowledge in large language models (LLMs) with minimal alteration of parameters. However, recent studies have identified side effects, such as knowledge distortion and…

Computation and Language · Computer Science 2024-10-28 Cheng-Hsun Hsueh , Paul Kuo-Ming Huang , Tzu-Han Lin , Che-Wei Liao , Hung-Chieh Fang , Chao-Wei Huang , Yun-Nung Chen

Knowledge editing emerges as a crucial technique for efficiently correcting incorrect or outdated knowledge in large language models (LLM). Existing editing methods rely on a rigid mapping from parameter or module modifications to output,…

Machine Learning · Computer Science 2026-02-02 Jiajie Su , Haoyuan Wang , Xiaohua Feng , Yunshan Ma , Xiaobo Xia , Yuyuan Li , Xiaolin Zheng , Jianmao Xiao , Chaochao Chen

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model…

Computation and Language · Computer Science 2024-10-30 Han Huang , Haitian Zhong , Tao Yu , Qiang Liu , Shu Wu , Liang Wang , Tieniu Tan

Lifelong model editing (LME) aims to sequentially rectify outdated or inaccurate knowledge in deployed LLMs while minimizing side effects on unrelated inputs. However, existing approaches typically apply parameter perturbations to a static…

Computation and Language · Computer Science 2026-04-14 Yangfan Wang , Tianyang Sun , Chen Tang , Jie Liu , Wei Cai , Jingchi Jiang

Knowledge editing (KE) aims to efficiently and precisely modify the behavior of large language models (LLMs) to update specific knowledge without negatively influencing other knowledge. Current research primarily focuses on white-box LLMs…

Computation and Language · Computer Science 2024-02-20 Xiaoshuai Song , Zhengyang Wang , Keqing He , Guanting Dong , Yutao Mou , Jinxu Zhao , Weiran Xu

Large Language Models (LLMs) require frequent updates to correct errors and keep pace with continuously evolving knowledge in a timely and effective manner. Recent research in it model editing has highlighted the challenges in balancing…

Machine Learning · Computer Science 2024-10-02 Tai D. Nguyen , Long H. Pham , Jun Sun