English
Related papers

Related papers: Massive Editing for Large Language Models Based on…

200 papers

Knowledge editing techniques, aiming to efficiently modify a minor proportion of knowledge in large language models (LLMs) without negatively impacting performance across other inputs, have garnered widespread attention. However, existing…

Computation and Language · Computer Science 2024-06-06 Yuxin Jiang , Yufei Wang , Chuhan Wu , Wanjun Zhong , Xingshan Zeng , Jiahui Gao , Liangyou Li , Xin Jiang , Lifeng Shang , Ruiming Tang , Qun Liu , Wei Wang

Large language models (LLMs) demonstrate remarkable text comprehension and generation capabilities but often lack the ability to utilize up-to-date or domain-specific knowledge not included in their training data. To address this gap, we…

Computation and Language · Computer Science 2025-09-26 Bo Zhang , Hui Ma , Dailin Li , Jian Ding , Jian Wang , Bo Xu , HongFei Lin

The extensive utilization of large language models (LLMs) underscores the crucial necessity for precise and contemporary knowledge embedded within their intrinsic parameters. Existing research on knowledge editing primarily concentrates on…

Computation and Language · Computer Science 2025-02-20 Zihao Wei , Jingcheng Deng , Liang Pang , Hanxing Ding , Huawei Shen , Xueqi Cheng

Large Language Models (LLMs) require continuous updates to maintain accurate and current knowledge as the world evolves. While existing knowledge editing approaches offer various solutions for knowledge updating, they often struggle with…

Artificial Intelligence · Computer Science 2025-06-17 Zichuan Fu , Xian Wu , Guojing Li , Yingying Zhang , Yefeng Zheng , Tianshi Ming , Yejing Wang , Wanyu Wang , Xiangyu Zhao

Knowledge editing aims to rectify inaccuracies in large language models (LLMs) without costly retraining for outdated or erroneous knowledge. However, current knowledge editing methods primarily focus on single editing, failing to meet the…

Computation and Language · Computer Science 2024-06-06 Chenhui Hu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Knowledge editing technology is crucial for maintaining the accuracy and timeliness of large language models (LLMs) . However, the setting of this task overlooks a significant portion of commonsense knowledge based on free-text in the real…

Computation and Language · Computer Science 2024-11-01 Xiusheng Huang , Yequan Wang , Jun Zhao , Kang Liu

Knowledge Editing has emerged as a promising solution for efficiently updating embedded knowledge in large language models (LLMs). While existing approaches demonstrate effectiveness in integrating new knowledge and preserving the original…

Computation and Language · Computer Science 2026-03-26 Mengqi Zhang , Zisheng Zhou , Xiaotian Ye , Qiang Liu , Zhaochun Ren , Zhumin Chen , Pengjie Ren

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large…

Computation and Language · Computer Science 2025-04-09 Bingchen Liu , Yuanyuan Fang , Naixing Xu , Shihao Hou , Xin Li , Qian Li

Knowledge editing is a rising technique for efficiently updating factual knowledge in large language models (LLMs) with minimal alteration of parameters. However, recent studies have identified side effects, such as knowledge distortion and…

Computation and Language · Computer Science 2024-10-28 Cheng-Hsun Hsueh , Paul Kuo-Ming Huang , Tzu-Han Lin , Che-Wei Liao , Hung-Chieh Fang , Chao-Wei Huang , Yun-Nung Chen

As the field of Large Language Models (LLMs) evolves at an accelerated pace, the critical need to assess and monitor their performance emerges. We introduce a benchmarking framework focused on knowledge graph engineering (KGE) accompanied…

Artificial Intelligence · Computer Science 2023-09-01 Lars-Peter Meyer , Johannes Frey , Kurt Junghanns , Felix Brei , Kirill Bulert , Sabine Gründer-Fahrer , Michael Martin

Large language models (LLMs) can make predictions using parametric knowledge--knowledge encoded in the model weights--or contextual knowledge--knowledge presented in the context. In many scenarios, a desirable behavior is that LLMs give…

Computation and Language · Computer Science 2024-03-27 Yingfa Chen , Zhengyan Zhang , Xu Han , Chaojun Xiao , Zhiyuan Liu , Chen Chen , Kuai Li , Tao Yang , Maosong Sun

How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs). The difficulty arises because the hallucinations of LLMs during multi-step reasoning often lead…

Computation and Language · Computer Science 2024-11-12 Yiwei Wang , Muhao Chen , Nanyun Peng , Kai-Wei Chang

Large language models (LLMs) have shown remarkable promise but remain challenging to continually improve through traditional finetuning, particularly when integrating capabilities from other specialized LLMs. Popular methods like ensemble…

Computation and Language · Computer Science 2025-06-02 Zhenglun Kong , Zheng Zhan , Shiyue Hou , Yifan Gong , Xin Meng , Pengwei Sui , Peiyan Dong , Xuan Shen , Zifeng Wang , Pu Zhao , Hao Tang , Stratis Ioannidis , Yanzhi Wang

Regular updates are essential for maintaining up-to-date knowledge in large language models (LLMs). Consequently, various model editing methods have been developed to update specific knowledge within LLMs. However, training-based approaches…

Computation and Language · Computer Science 2025-05-27 Yujie Feng , Liming Zhan , Zexin Lu , Yongxin Xu , Xu Chu , Yasha Wang , Jiannong Cao , Philip S. Yu , Xiao-Ming Wu

Large Language Models (LLMs) have demonstrated significant capabilities across numerous application domains. A key challenge is to keep these models updated with latest available information, which limits the true potential of these models…

Computation and Language · Computer Science 2024-09-20 Muhammad Asif Ali , Nawal Daftardar , Mutayyaba Waheed , Jianbin Qin , Di Wang

Knowledge editing enables multimodal large language models (MLLMs) to efficiently update outdated or incorrect information. However, existing benchmarks primarily emphasize cognitive-level modifications while lacking a focus on deeper…

Artificial Intelligence · Computer Science 2025-09-09 Zhaoyu Fan , Kaihang Pan , Mingze Zhou , Bosheng Qin , Juncheng Li , Shengyu Zhang , Wenqiao Zhang , Siliang Tang , Fei Wu , Yueting Zhuang

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Recent knowledge editing methods have primarily focused on modifying structured knowledge in large language models. However, this task setting overlooks the fact that a significant portion of real-world knowledge is stored in an…

Computation and Language · Computer Science 2025-02-26 Jingcheng Deng , Zihao Wei , Liang Pang , Hanxing Ding , Huawei Shen , Xueqi Cheng

Large language models (LLMs) require frequent knowledge updates to reflect changing facts and mitigate hallucinations. To meet this demand, lifelong knowledge editing has emerged as a continual approach to modify specific pieces of…

Artificial Intelligence · Computer Science 2026-04-22 Dahyun Jung , Jaewook Lee , Heuiseok Lim

Model editing is a technique that edits the large language models (LLMs) with updated knowledge to alleviate hallucinations without resource-intensive retraining. While current model editing methods can effectively modify a model's behavior…

Computation and Language · Computer Science 2024-10-08 Jia-Chen Gu , Hao-Xiang Xu , Jun-Yu Ma , Pan Lu , Zhen-Hua Ling , Kai-Wei Chang , Nanyun Peng