English
Related papers

Related papers: AlphaEdit: Null-Space Constrained Knowledge Editin…

200 papers

Model editing aims to enhance the accuracy and reliability of large language models (LLMs) by efficiently adjusting their internal parameters. Currently, most LLM editing datasets are confined to narrow knowledge domains and cover a limited…

Computation and Language · Computer Science 2025-11-12 Qizhou Chen , Dakan Wang , Taolin Zhang , Zaoming Yan , Chengsong You , Chengyu Wang , Xiaofeng He

Knowledge editing aims to change language models' performance on several special cases (i.e., editing scope) by infusing the corresponding expected knowledge into them. With the recent advancements in large language models (LLMs), knowledge…

Computation and Language · Computer Science 2024-05-31 Jiaan Wang , Yunlong Liang , Zengkui Sun , Yuxuan Cao , Jiarong Xu , Fandong Meng

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model…

Computation and Language · Computer Science 2024-10-30 Han Huang , Haitian Zhong , Tao Yu , Qiang Liu , Shu Wu , Liang Wang , Tieniu Tan

Knowledge editing is a promising way to improve factuality in large language models, but recent studies have shown significant model degradation during sequential editing. In this paper, we formalize the popular locate-then-edit methods as…

Computation and Language · Computer Science 2025-05-22 Akshat Gupta , Phudish Prateepamornkul , Maochuan Lu , Ahmed Alaa , Thomas Hartvigsen , Gopala Anumanchipalli

Model editing aims to efficiently update a pre-trained model's knowledge without the need for time-consuming full retraining. While existing pioneering editing methods achieve promising results, they primarily focus on editing single-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Zhiyi Shi , Binjie Wang , Chongjie Si , Yichen Wu , Junsik Kim , Hanspeter Pfister

Knowledge editing has emerged as an efficient approach for updating factual knowledge in large language models (LLMs). It typically locates knowledge storage modules and then modifies their parameters. However, most existing methods focus…

Computation and Language · Computer Science 2025-11-03 Jiahao Liu , Zijian Wang , Kuo Zhao , Dong Hu

Understanding and continuously refining multimodal molecular knowledge is crucial for advancing biomedicine, chemistry, and materials science. Molecule language models (MoLMs) have become powerful tools in these domains, integrating…

Machine Learning · Computer Science 2025-12-01 Zhenyu Lei , Patrick Soga , Yaochen Zhu , Yinhan He , Yushun Dong , Jundong Li

Despite the ability to train capable LLMs, the methodology for maintaining their relevancy and rectifying errors remains elusive. To this end, the past few years have witnessed a surge in techniques for editing LLMs, the objective of which…

Computation and Language · Computer Science 2023-12-01 Yunzhi Yao , Peng Wang , Bozhong Tian , Siyuan Cheng , Zhoubo Li , Shumin Deng , Huajun Chen , Ningyu Zhang

Model editing techniques are essential for efficiently updating knowledge in large language models (LLMs). However, the effectiveness of existing approaches degrades in massive editing scenarios, particularly when evaluated with practical…

Computation and Language · Computer Science 2026-02-25 Yanbo Dai , Zhenlan Ji , Zongjie Li , Shuai Wang

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang

Knowledge editing aims to update outdated or incorrect knowledge in large language models (LLMs). However, current knowledge editing methods have limited scalability for lifelong editing. This study explores the fundamental reason why…

Computation and Language · Computer Science 2025-02-27 Chenhui Hu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Large Language Models often contain factually incorrect or outdated knowledge, giving rise to model editing methods for precise knowledge updates. However, current mainstream locate-then-edit approaches exhibit a progressive performance…

Computation and Language · Computer Science 2025-10-28 Peng Wang , Biyu Zhou , Xuehai Tang , Jizhong Han , Songlin Hu

Knowledge editing aims to update specific facts in large language models (LLMs) without full retraining. Prior efforts sought to tune the knowledge layers of LLMs, achieving improved performance in controlled, teacher-forced evaluations.…

Computation and Language · Computer Science 2026-02-02 Ruilin Li , Yibin Wang , Wenhong Zhu , Chenglin Li , Jinghao Zhang , Chenliang Li , Junchi Yan , Jiaqi Wang

Knowledge editing (KE) aims to efficiently and precisely modify the behavior of large language models (LLMs) to update specific knowledge without negatively influencing other knowledge. Current research primarily focuses on white-box LLMs…

Computation and Language · Computer Science 2024-02-20 Xiaoshuai Song , Zhengyang Wang , Keqing He , Guanting Dong , Yutao Mou , Jinxu Zhao , Weiran Xu

Model editing is a technique that edits the large language models (LLMs) with updated knowledge to alleviate hallucinations without resource-intensive retraining. While current model editing methods can effectively modify a model's behavior…

Computation and Language · Computer Science 2024-10-08 Jia-Chen Gu , Hao-Xiang Xu , Jun-Yu Ma , Pan Lu , Zhen-Hua Ling , Kai-Wei Chang , Nanyun Peng

Large language models (LLMs) are deployed on mobile devices to power killer applications such as intelligent assistants. LLMs pre-trained on general corpora often hallucinate when handling personalized or unseen queries, leading to…

Machine Learning · Computer Science 2025-06-18 Zhenyan Lu , Daliang Xu , Dongqi Cai , Zexi Li , Wei Liu , Fangming Liu , Shangguang Wang , Mengwei Xu

Knowledge editing techniques, aiming to efficiently modify a minor proportion of knowledge in large language models (LLMs) without negatively impacting performance across other inputs, have garnered widespread attention. However, existing…

Computation and Language · Computer Science 2024-06-06 Yuxin Jiang , Yufei Wang , Chuhan Wu , Wanjun Zhong , Xingshan Zeng , Jiahui Gao , Liangyou Li , Xin Jiang , Lifeng Shang , Ruiming Tang , Qun Liu , Wei Wang

Model editing has become an increasingly popular alternative for efficiently updating knowledge within language models. Current methods mainly focus on reliability, generalization, and locality, with many methods excelling across these…

Artificial Intelligence · Computer Science 2024-10-25 Qi Li , Xiang Liu , Zhenheng Tang , Peijie Dong , Zeyu Li , Xinglin Pan , Xiaowen Chu

Large language models (LLMs) need knowledge updates to meet the ever-growing world facts and correct the hallucinated responses, facilitating the methods of lifelong model editing. Where the updated knowledge resides in memories is a…

Computation and Language · Computer Science 2024-12-20 Peng Wang , Zexi Li , Ningyu Zhang , Ziwen Xu , Yunzhi Yao , Yong Jiang , Pengjun Xie , Fei Huang , Huajun Chen