English
Related papers

Related papers: MobiEdit: Resource-efficient Knowledge Editing for…

200 papers

Large Language Models (LLMs) are currently pre-trained and fine-tuned on large cloud servers. The next frontier is LLM personalization, where a foundation model can be fine-tuned with user/task-specific data. Given the sensitive nature of…

Machine Learning · Computer Science 2025-09-23 Lei Gao , Amir Ziashahabi , Yue Niu , Salman Avestimehr , Murali Annavaram

Large language models (LLMs) often exhibit hallucinations due to incorrect or outdated knowledge. Hence, model editing methods have emerged to enable targeted knowledge updates. To achieve this, a prevailing paradigm is the…

Computation and Language · Computer Science 2025-04-23 Junfeng Fang , Houcheng Jiang , Kun Wang , Yunshan Ma , Shi Jie , Xiang Wang , Xiangnan He , Tat-seng Chua

Large Language Models (LLMs) are widely deployed in downstream tasks, but keeping their knowledge up-to-date via retraining or fine-tuning is often computationally expensive. Model editing provides a more efficient alternative by updating a…

Computation and Language · Computer Science 2025-10-02 Bhiman Kumar Baghel , Emma Jordan , Zheyuan Ryan Shi , Xiang Lorraine Li

Model editing aims to enhance the accuracy and reliability of large language models (LLMs) by efficiently adjusting their internal parameters. Currently, most LLM editing datasets are confined to narrow knowledge domains and cover a limited…

Computation and Language · Computer Science 2025-11-12 Qizhou Chen , Dakan Wang , Taolin Zhang , Zaoming Yan , Chengsong You , Chengyu Wang , Xiaofeng He

Knowledge editing for large language models can offer an efficient solution to alter a model's behavior without negatively impacting the overall performance. However, the current approaches encounter issues with limited generalizability…

Computation and Language · Computer Science 2024-04-30 Ningyu Zhang , Bozhong Tian , Siyuan Cheng , Xiaozhuan Liang , Yi Hu , Kouying Xue , Yanjie Gou , Xi Chen , Huajun Chen

Large language models (LLMs) often produce incorrect or outdated information, necessitating efficient and precise knowledge updates. Current model editing methods, however, struggle with long-form knowledge in diverse formats, such as…

Computation and Language · Computer Science 2025-10-13 Houcheng Jiang , Junfeng Fang , Ningyu Zhang , Guojun Ma , Mingyang Wan , Xiang Wang , Xiangnan He , Tat-seng Chua

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model…

Computation and Language · Computer Science 2024-10-30 Han Huang , Haitian Zhong , Tao Yu , Qiang Liu , Shu Wu , Liang Wang , Tieniu Tan

Recently, large language models (LLMs) have demonstrated impressive results but still suffer from hallucinations. Model editing has been proposed to correct factual inaccuracies in LLMs. A challenging case is sequential model editing (SME),…

Computation and Language · Computer Science 2025-06-24 Taolin Zhang , Haidong Kang , Dongyang Li , Qizhou Chen , Chengyu Wang Xiaofeng He , Richang Hong

Large language models (LLMs) have revolutionized various domains, yet their utility comes with significant challenges related to outdated or problematic knowledge embedded during pretraining. This paper addresses the challenge of modifying…

Computation and Language · Computer Science 2024-09-23 Akshaj Kumar Veldanda , Shi-Xiong Zhang , Anirban Das , Supriyo Chakraborty , Stephen Rawls , Sambit Sahu , Milind Naphade

Model editing aims to efficiently update a pre-trained model's knowledge without the need for time-consuming full retraining. While existing pioneering editing methods achieve promising results, they primarily focus on editing single-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Zhiyi Shi , Binjie Wang , Chongjie Si , Yichen Wu , Junsik Kim , Hanspeter Pfister

Large Language Models (LLMs) have demonstrated impressive capability in different tasks and are bringing transformative changes to many domains. However, keeping the knowledge in LLMs up-to-date remains a challenge once pretraining is…

Computation and Language · Computer Science 2024-07-24 Xiou Ge , Ali Mousavi , Edouard Grave , Armand Joulin , Kun Qian , Benjamin Han , Mostafa Arefiyan , Yunyao Li

Knowledge Editing is a technique that updates large language models (LLMs) with new information to maintain their world knowledge. This approach avoids the need to rebuild the model from scratch, thereby addressing the high costs associated…

Computation and Language · Computer Science 2025-09-09 Changyue Wang , Weihang Su , Qingyao Ai , Yichen Tang , Yiqun Liu

Knowledge editing is a rising technique for efficiently updating factual knowledge in large language models (LLMs) with minimal alteration of parameters. However, recent studies have identified side effects, such as knowledge distortion and…

Computation and Language · Computer Science 2024-10-28 Cheng-Hsun Hsueh , Paul Kuo-Ming Huang , Tzu-Han Lin , Che-Wei Liao , Hung-Chieh Fang , Chao-Wei Huang , Yun-Nung Chen

Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring…

Computation and Language · Computer Science 2026-04-08 Jinhu Fu , Yan Bai , Longzhu He , Yihang Lou , Yanxiao Zhao , Li Sun , Sen Su

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Knowledge Editing (KE) aims to adjust a Large Language Model's (LLM) internal representations and parameters to correct inaccuracies and improve output consistency without incurring the computational expense of re-training the entire model.…

Computation and Language · Computer Science 2025-05-29 Liyu Zhang , Weiqi Wang , Tianqing Fang , Yangqiu Song

As the modern tool of choice for question answering, large language models (LLMs) are expected to deliver answers with up-to-date knowledge. To achieve such ideal question-answering systems, locating and then editing outdated knowledge in…

Computation and Language · Computer Science 2024-09-17 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Hongcheng Gao , Junfeng Fang , Xueqi Cheng

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

Computation and Language · Computer Science 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Large language models (LLMs) have recently transformed both the academic and industrial landscapes due to their remarkable capacity to understand, analyze, and generate texts based on their vast knowledge and reasoning ability.…

Computation and Language · Computer Science 2024-09-23 Song Wang , Yaochen Zhu , Haochen Liu , Zaiyi Zheng , Chen Chen , Jundong Li

Knowledge editing aims to change language models' performance on several special cases (i.e., editing scope) by infusing the corresponding expected knowledge into them. With the recent advancements in large language models (LLMs), knowledge…

Computation and Language · Computer Science 2024-05-31 Jiaan Wang , Yunlong Liang , Zengkui Sun , Yuxuan Cao , Jiarong Xu , Fandong Meng