English
Related papers

Related papers: Edit Less, Achieve More: Dynamic Sparse Neuron Mas…

200 papers

How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs). The difficulty arises because the hallucinations of LLMs during multi-step reasoning often lead…

Computation and Language · Computer Science 2024-11-12 Yiwei Wang , Muhao Chen , Nanyun Peng , Kai-Wei Chang

Model editing aims to update knowledge to add new concepts and change relevant information without retraining. Lifelong editing is a challenging task, prone to disrupting previously learned concepts, especially for Vision Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Gyanendra Das , Sai Satyam Jena

Large Language Models (LLMs) suffer from a critical limitation: their knowledge is static and quickly becomes outdated. Retraining these massive models is computationally prohibitive, while existing knowledge editing techniques can be slow…

Computation and Language · Computer Science 2025-12-30 Kabir Khan , Priya Sharma , Arjun Mehta , Neha Gupta , Ravi Narayanan

Knowledge editing enables targeted updates without retraining, but prior work focuses on textual or visual facts, leaving abstract auditory perceptual knowledge underexplored. We introduce SAKE, the first benchmark for editing perceptual…

Knowledge editing has emerged as an effective approach for updating large language models (LLMs) by modifying their internal knowledge. However, their application to the biomedical domain faces unique challenges due to the long-tailed…

Computation and Language · Computer Science 2025-04-15 Xinhao Yi , Jake Lever , Kevin Bryson , Zaiqiao Meng

Large language models (LLMs) have shown great success in various Natural Language Processing (NLP) tasks, whist they still need updates after deployment to fix errors or keep pace with the changing knowledge in the world. Researchers…

Computation and Language · Computer Science 2023-12-20 Lang Yu , Qin Chen , Jie Zhou , Liang He

Large language models (LLMs) acquire information from pre-training corpora, but their stored knowledge can become inaccurate or outdated over time. Model editing addresses this challenge by modifying model parameters without retraining, and…

Computation and Language · Computer Science 2025-09-09 Zherui Li , Houcheng Jiang , Hao Chen , Baolong Bi , Zhenhong Zhou , Fei Sun , Junfeng Fang , Xiang Wang

Knowledge editing enables multimodal large language models (MLLMs) to efficiently update outdated or incorrect information. However, existing benchmarks primarily emphasize cognitive-level modifications while lacking a focus on deeper…

Artificial Intelligence · Computer Science 2025-09-09 Zhaoyu Fan , Kaihang Pan , Mingze Zhou , Bosheng Qin , Juncheng Li , Shengyu Zhang , Wenqiao Zhang , Siliang Tang , Fei Wu , Yueting Zhuang

Large language models (LLMs) exhibit social biases that reinforce harmful stereotypes, limiting their safe deployment. Most existing debiasing methods adopt a suppressive paradigm by modifying parameters, prompts, or neurons associated with…

Artificial Intelligence · Computer Science 2026-01-30 Jinhao Pan , Chahat Raj , Anjishnu Mukherjee , Sina Mansouri , Bowen Wei , Shloka Yada , Ziwei Zhu

Deploying Large Language Models (LLMs) in real-world dynamic environments raises the challenge of updating their pre-trained knowledge. While existing knowledge editing methods can reliably patch isolated facts, they frequently suffer from…

Computation and Language · Computer Science 2026-04-08 Tianyi Zhao , Yinhan He , Wendy Zheng , Chen Chen

Large Language Models (LLMs) usually suffer from knowledge cutoff or fallacy issues, which means they are unaware of unseen events or generate text with incorrect facts owing to outdated/noisy data. To this end, many knowledge editing…

Recently, knowledge editing (KE) has emerged as a promising approach to update specific facts in Large Language Models (LLMs) without the need for full retraining. Despite the effectiveness in general-domain benchmarks, their applicability…

Computation and Language · Computer Science 2026-02-17 Shigeng Chen , Linhao Luo , Zhangchi Qiu , Yanan Cao , Carl Yang , Shirui Pan

Knowledge editing (KE) aims to efficiently and precisely modify the behavior of large language models (LLMs) to update specific knowledge without negatively influencing other knowledge. Current research primarily focuses on white-box LLMs…

Computation and Language · Computer Science 2024-02-20 Xiaoshuai Song , Zhengyang Wang , Keqing He , Guanting Dong , Yutao Mou , Jinxu Zhao , Weiran Xu

Knowledge editing is a technique for efficiently and accurately updating the knowledge of large language models (LLMs) to alleviate obsolescence and correct errors. However, most existing methods overfit to specific models, causing edited…

Artificial Intelligence · Computer Science 2025-03-05 Shuaike Li , Kai Zhang , Qi Liu , Enhong Chen

Knowledge editing has become a promising approach for efficiently and precisely updating knowledge embedded in large language models (LLMs). In this work, we focus on Same-Subject Editing, which involves modifying multiple attributes of a…

Computation and Language · Computer Science 2025-02-12 Zenghao Duan , Wenbin Duan , Zhiyi Yin , Yinghan Shen , Shaoling Jing , Jie Zhang , Huawei Shen , Xueqi Cheng

Language Models (LMs) have become widely used in software engineering, especially for tasks such as code generation, where they are referred to as code LMs. These models have proven effective in generating code, making it easier for…

Software Engineering · Computer Science 2024-11-21 Jian Gu , Aldeida Aleti , Chunyang Chen , Hongyu Zhang

Knowledge editing allows for efficient adaptation of large language models (LLMs) to new information or corrections without requiring full retraining. However, prior methods typically focus on either single-language editing or basic…

Computation and Language · Computer Science 2025-05-26 Yuchen Wu , Liang Ding , Li Shen , Dacheng Tao

Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring…

Computation and Language · Computer Science 2026-04-08 Jinhu Fu , Yan Bai , Longzhu He , Yihang Lou , Yanxiao Zhao , Li Sun , Sen Su

Efficiently updating multilingual knowledge in large language models (LLMs), while preserving consistent factual representations across languages, remains a long-standing and unresolved challenge. While deploying separate editing systems…

Computation and Language · Computer Science 2025-06-13 Wei Sun , Tingyu Qu , Mingxiao Li , Jesse Davis , Marie-Francine Moens

Multimodal Large Language Models (MLLMs) extend foundation models to real-world applications by integrating inputs such as text and vision. However, their broad knowledge capacity raises growing concerns about privacy leakage, toxicity…

Machine Learning · Computer Science 2025-11-11 Kunhao Li , Wenhao Li , Di Wu , Lei Yang , Jun Bai , Ju Jia , Jason Xue