English
Related papers

Related papers: Balancing Knowledge Updates: Toward Unified Modula…

200 papers

A Large Language Model (LLM) tends to generate inconsistent and sometimes contradictory outputs when presented with a prompt that has equivalent semantics but is expressed differently from the original prompt. To achieve semantic…

Computation and Language · Computer Science 2025-01-22 Jingyuan Yang , Dapeng Chen , Yajing Sun , Rongjun Li , Zhiyong Feng , Wei Peng

Knowledge editing for large language models can offer an efficient solution to alter a model's behavior without negatively impacting the overall performance. However, the current approaches encounter issues with limited generalizability…

Computation and Language · Computer Science 2024-04-30 Ningyu Zhang , Bozhong Tian , Siyuan Cheng , Xiaozhuan Liang , Yi Hu , Kouying Xue , Yanjie Gou , Xi Chen , Huajun Chen

Keeping large language models factually up-to-date is crucial for deployment, yet costly retraining remains a challenge. Knowledge editing offers a promising alternative, but methods are only tested on small-scale or synthetic edit…

Computation and Language · Computer Science 2025-09-23 Lukas Thede , Karsten Roth , Matthias Bethge , Zeynep Akata , Tom Hartvigsen

Model editing aims to correct inaccurate knowledge, update outdated information, and incorporate new data into Large Language Models (LLMs) without the need for retraining. This task poses challenges in lifelong scenarios where edits must…

Computation and Language · Computer Science 2025-03-17 Qizhou Chen , Chengyu Wang , Dakan Wang , Taolin Zhang , Wangyue Li , Xiaofeng He

Large Language Models~(LLMs) struggle with providing current information due to the outdated pre-training data. Existing methods for updating LLMs, such as knowledge editing and continual fine-tuning, have significant drawbacks in…

Computation and Language · Computer Science 2024-02-12 Pengfei Yu , Heng Ji

Knowledge editing has emerged as an effective approach for updating large language models (LLMs) by modifying their internal knowledge. However, their application to the biomedical domain faces unique challenges due to the long-tailed…

Computation and Language · Computer Science 2025-04-15 Xinhao Yi , Jake Lever , Kevin Bryson , Zaiqiao Meng

Knowledge editing aims to adjust the knowledge within large language models (LLMs) to prevent their responses from becoming obsolete or inaccurate. However, existing works on knowledge editing are primarily conducted in a single language,…

Computation and Language · Computer Science 2024-06-18 Jiakuan Xie , Pengfei Cao , Yuheng Chen , Yubo Chen , Kang Liu , Jun Zhao

Model editing is a technique that edits the large language models (LLMs) with updated knowledge to alleviate hallucinations without resource-intensive retraining. While current model editing methods can effectively modify a model's behavior…

Computation and Language · Computer Science 2024-10-08 Jia-Chen Gu , Hao-Xiang Xu , Jun-Yu Ma , Pan Lu , Zhen-Hua Ling , Kai-Wei Chang , Nanyun Peng

Large language models (LLMs) have played a pivotal role in building communicative AI, yet they encounter the challenge of efficient updates. Model editing enables the manipulation of specific knowledge memories and the behavior of language…

Computation and Language · Computer Science 2024-10-28 Xinbei Ma , Tianjie Ju , Jiyang Qiu , Zhuosheng Zhang , Hai Zhao , Lifeng Liu , Yulong Wang

Regular updates are essential for maintaining up-to-date knowledge in large language models (LLMs). Consequently, various model editing methods have been developed to update specific knowledge within LLMs. However, training-based approaches…

Computation and Language · Computer Science 2025-05-27 Yujie Feng , Liming Zhan , Zexin Lu , Yongxin Xu , Xu Chu , Yasha Wang , Jiannong Cao , Philip S. Yu , Xiao-Ming Wu

Model editing has been gaining increasing attention over the past few years. For Knowledge Editing in particular, more challenging evaluation datasets have recently been released. These datasets use different methodologies to score the…

Computation and Language · Computer Science 2025-07-09 Sebastian Pohl , Max Ploner , Alan Akbik

Large Language Models (LLMs) suffer from hallucinations, referring to the non-factual information in generated content, despite their superior capacities across tasks. Meanwhile, knowledge editing has been developed as a new popular…

Computation and Language · Computer Science 2025-03-04 Baixiang Huang , Canyu Chen , Xiongxiao Xu , Ali Payani , Kai Shu

Recent advances in AI-generated content (AIGC) have significantly accelerated image editing techniques, driving increasing demand for diverse and fine-grained edits. Despite these advances, existing image editing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shuyu Wang , Weiqi Li , Qian Wang , Shijie Zhao , Jian Zhang

Model editing aims to correct outdated or erroneous knowledge in large language models (LLMs) without the need for costly retraining. Lifelong model editing is the most challenging task that caters to the continuous editing requirements of…

Computation and Language · Computer Science 2025-03-17 Qizhou Chen , Taolin Zhang , Xiaofeng He , Dongyang Li , Chengyu Wang , Longtao Huang , Hui Xue

Model editing techniques are essential for efficiently updating knowledge in large language models (LLMs). However, the effectiveness of existing approaches degrades in massive editing scenarios, particularly when evaluated with practical…

Computation and Language · Computer Science 2026-02-25 Yanbo Dai , Zhenlan Ji , Zongjie Li , Shuai Wang

Knowledge editing, which aims to update the knowledge encoded in language models, can be deceptive. Despite the fact that many existing knowledge editing algorithms achieve near-perfect performance on conventional metrics, the models edited…

Computation and Language · Computer Science 2025-05-20 Jiakuan Xie , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Knowledge editing has become a promising approach for efficiently and precisely updating knowledge embedded in large language models (LLMs). In this work, we focus on Same-Subject Editing, which involves modifying multiple attributes of a…

Computation and Language · Computer Science 2025-02-12 Zenghao Duan , Wenbin Duan , Zhiyi Yin , Yinghan Shen , Shaoling Jing , Jie Zhang , Huawei Shen , Xueqi Cheng

Efficient knowledge editing of large language models is crucial for replacing obsolete information or incorporating specialized knowledge on a large scale. However, previous methods implicitly assume that knowledge is localized and isolated…

Computation and Language · Computer Science 2024-02-21 Zihao Wei , Liang Pang , Hanxing Ding , Jingcheng Deng , Huawei Shen , Xueqi Cheng

Large Language Models (LLMs) excel in natural language processing by encoding extensive human knowledge, but their utility relies on timely updates as knowledge evolves. Updating LLMs involves two key tasks simultaneously: unlearning to…

Computation and Language · Computer Science 2025-02-04 Binchi Zhang , Zhengzhang Chen , Zaiyi Zheng , Jundong Li , Haifeng Chen

Large language models (LLMs) have shown remarkable promise but remain challenging to continually improve through traditional finetuning, particularly when integrating capabilities from other specialized LLMs. Popular methods like ensemble…

Computation and Language · Computer Science 2025-06-02 Zhenglun Kong , Zheng Zhan , Shiyue Hou , Yifan Gong , Xin Meng , Pengwei Sui , Peiyan Dong , Xuan Shen , Zifeng Wang , Pu Zhao , Hao Tang , Stratis Ioannidis , Yanzhi Wang