English
Related papers

Related papers: Commonsense Knowledge Editing Based on Free-Text i…

200 papers

Large Language Models (LLMs) demonstrate exceptional capabilities in factual question answering, yet they sometimes provide incorrect responses. To address this issue, knowledge editing techniques have emerged as effective methods for…

Human-Computer Interaction · Computer Science 2026-04-01 Zhenning Chen , Hanbei Zhan , Yanwei Huang , Xin Wu , Dazhen Deng , Di Weng , Yingcai Wu

Efficiently updating multilingual knowledge in large language models (LLMs), while preserving consistent factual representations across languages, remains a long-standing and unresolved challenge. While deploying separate editing systems…

Computation and Language · Computer Science 2025-06-13 Wei Sun , Tingyu Qu , Mingxiao Li , Jesse Davis , Marie-Francine Moens

Knowledge editing (KE) enables precise modifications to factual content in large language models (LLMs). Existing KE methods are largely designed for dense architectures, limiting their applicability to the increasingly prevalent sparse…

Machine Learning · Computer Science 2026-02-12 Yupu Gu , Rongzhe Wei , Andy Zhu , Pan Li

Large language Model (LLM) unlearning, i.e., selectively removing information from LLMs, is vital for responsible model deployment. Differently, LLM knowledge editing aims to modify LLM knowledge instead of removing it. Though editing and…

Machine Learning · Computer Science 2025-05-27 Zexi Li , Xiangzhu Wang , William F. Shen , Meghdad Kurmanji , Xinchi Qiu , Dongqi Cai , Chao Wu , Nicholas D. Lane

Large language models (LLMs) face challenges with internal knowledge inaccuracies and outdated information. Knowledge editing has emerged as a pivotal approach to mitigate these issues. Although current knowledge editing techniques exhibit…

Computation and Language · Computer Science 2024-08-23 Mengqi Zhang , Bowen Fang , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen , Liang Wang

Large language models (LLMs) encode vast world knowledge but struggle to stay up-to-date, often leading to errors and hallucinations. Knowledge editing offers an efficient alternative to retraining, enabling targeted modifications by…

Computation and Language · Computer Science 2025-06-03 Weitao Ma , Xiyuan Du , Xiaocheng Feng , Lei Huang , Yichong Huang , Huiyi Zhang , Xiaoliang Yang , Baohang Li , Xiachong Feng , Ting Liu , Bing Qin

Knowledge editing aims to update outdated or incorrect knowledge in large language models (LLMs). However, current knowledge editing methods have limited scalability for lifelong editing. This study explores the fundamental reason why…

Computation and Language · Computer Science 2025-02-27 Chenhui Hu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Knowledge-editing updates knowledge of large language models (LLMs) and contributes to the interpretability and application of LLMs. However, knowledge applying is context-consistent: LLMs can recall the same knowledge in different…

Computation and Language · Computer Science 2024-01-18 Youcheng Huang , Wenqiang Lei , Zheng Zhang , Jiancheng Lv , Shuicheng Yan

Large Language Models (LLMs) store an extensive amount of factual knowledge obtained from vast collections of text. To effectively utilize these models for downstream tasks, it is crucial to have reliable methods for measuring their…

Computation and Language · Computer Science 2023-06-13 Pouya Pezeshkpour

Large Language Models (LLMs) have demonstrated remarkable success in various tasks such as natural language understanding, text summarization, and machine translation. However, their general-purpose nature often limits their effectiveness…

Computation and Language · Computer Science 2025-09-03 Zirui Song , Bin Yan , Yuhan Liu , Miao Fang , Mingzhe Li , Rui Yan , Xiuying Chen

Knowledge editing for large language models can offer an efficient solution to alter a model's behavior without negatively impacting the overall performance. However, the current approaches encounter issues with limited generalizability…

Computation and Language · Computer Science 2024-04-30 Ningyu Zhang , Bozhong Tian , Siyuan Cheng , Xiaozhuan Liang , Yi Hu , Kouying Xue , Yanjie Gou , Xi Chen , Huajun Chen

As the cost associated with fine-tuning Large Language Models (LLMs) continues to rise, recent research efforts have pivoted towards developing methodologies to edit implicit knowledge embedded within LLMs. Yet, there's still a dark cloud…

Computation and Language · Computer Science 2024-05-14 Zhoubo Li , Ningyu Zhang , Yunzhi Yao , Mengru Wang , Xi Chen , Huajun Chen

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmarks have not…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Junzhe Zhang , Huixuan Zhang , Xunjian Yin , Baizhou Huang , Xu Zhang , Xinyu Hu , Xiaojun Wan

Large Language Models (LLMs) suffer from a critical limitation: their knowledge is static and quickly becomes outdated. Retraining these massive models is computationally prohibitive, while existing knowledge editing techniques can be slow…

Computation and Language · Computer Science 2025-12-30 Kabir Khan , Priya Sharma , Arjun Mehta , Neha Gupta , Ravi Narayanan

Large language models (LLMs) exhibit strong performance on factual recall and general reasoning but struggle to adapt to user-specific, commonsense knowledge, a challenge particularly acute in small-parameter settings where computational…

Artificial Intelligence · Computer Science 2025-05-27 Varun Reddy , Yen-Ling Kuo

Knowledge editing is a technique for efficiently and accurately updating the knowledge of large language models (LLMs) to alleviate obsolescence and correct errors. However, most existing methods overfit to specific models, causing edited…

Artificial Intelligence · Computer Science 2025-03-05 Shuaike Li , Kai Zhang , Qi Liu , Enhong Chen

Large Language Models (LLMs) have become indispensable tools in science, technology, and society, enabling transformative advances across diverse fields. However, errors or outdated information within these models can undermine their…

Computation and Language · Computer Science 2025-12-19 Qizhou Chen , Chengyu Wang , Taolin Zhang , Xiaofeng He

Knowledge editing has emerged as an efficient technique for updating the knowledge of large language models (LLMs), attracting increasing attention in recent years. However, there is a lack of effective measures to prevent the malicious…

Computation and Language · Computer Science 2025-05-27 Xiaopeng Li , Shasha Li , Shangwen Wang , Shezheng Song , Bin Ji , Huijun Liu , Jun Ma , Jie Yu

As the world changes, we need to be able to update our models and correct false information without costly retraining. Knowledge-based model editing enables precise modifications to the weights of large language models in order to modify…

Machine Learning · Computer Science 2025-02-28 Elan Markowitz , Anil Ramakrishna , Ninareh Mehrabi , Charith Peris , Rahul Gupta , Kai-Wei Chang , Aram Galstyan

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang