English
Related papers

Related papers: A Comprehensive Study of Knowledge Editing for Lar…

200 papers

With the development of large language models (LLMs) like the GPT series, their widespread use across various application scenarios presents a myriad of challenges. This review initially explores the issue of domain specificity, where LLMs…

Computation and Language · Computer Science 2023-10-23 Xiaoliang Chen , Liangbin Li , Le Chang , Yunhe Huang , Yuxuan Zhao , Yuxiao Zhang , Dinuo Li

In this paper, we focus on editing Multimodal Large Language Models (MLLMs). Compared to editing single-modal LLMs, multimodal model editing is more challenging, which demands a higher level of scrutiny and careful consideration in the…

Computation and Language · Computer Science 2024-04-19 Siyuan Cheng , Bozhong Tian , Qingbin Liu , Xi Chen , Yongheng Wang , Huajun Chen , Ningyu Zhang

Understanding and continuously refining multimodal molecular knowledge is crucial for advancing biomedicine, chemistry, and materials science. Molecule language models (MoLMs) have become powerful tools in these domains, integrating…

Machine Learning · Computer Science 2025-12-01 Zhenyu Lei , Patrick Soga , Yaochen Zhu , Yinhan He , Yushun Dong , Jundong Li

Knowledge editing is a technique for efficiently and accurately updating the knowledge of large language models (LLMs) to alleviate obsolescence and correct errors. However, most existing methods overfit to specific models, causing edited…

Artificial Intelligence · Computer Science 2025-03-05 Shuaike Li , Kai Zhang , Qi Liu , Enhong Chen

Knowledge Tracing (KT) is a research field that aims to estimate a student's knowledge state through learning interactions-a crucial component of Intelligent Tutoring Systems (ITSs). Despite significant advancements, no current KT models…

Computers and Society · Computer Science 2024-12-13 Yongwan Cho , Rabia Emhamed AlMamlook , Tasnim Gharaibeh

Adapting large language models (LLMs) to new and diverse knowledge is essential for their lasting effectiveness in real-world applications. This survey provides an overview of state-of-the-art methods for expanding the knowledge of LLMs,…

Computation and Language · Computer Science 2025-02-19 Mingyang Wang , Alisa Stoll , Lukas Lange , Heike Adel , Hinrich Schütze , Jannik Strötgen

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

Efficiently updating multilingual knowledge in large language models (LLMs), while preserving consistent factual representations across languages, remains a long-standing and unresolved challenge. While deploying separate editing systems…

Computation and Language · Computer Science 2025-06-13 Wei Sun , Tingyu Qu , Mingxiao Li , Jesse Davis , Marie-Francine Moens

Large language models (LLMs) acquire information from pre-training corpora, but their stored knowledge can become inaccurate or outdated over time. Model editing addresses this challenge by modifying model parameters without retraining, and…

Computation and Language · Computer Science 2025-09-09 Zherui Li , Houcheng Jiang , Hao Chen , Baolong Bi , Zhenhong Zhou , Fei Sun , Junfeng Fang , Xiang Wang

Large Language Models (LLMs) demonstrate remarkable capabilities, but their training on massive corpora poses significant risks from memorized sensitive information. To mitigate these issues and align with legal standards, unlearning has…

Computation and Language · Computer Science 2025-11-18 Ruichen Qiu , Jiajun Tan , Jiayue Pu , Honglin Wang , Xiao-Shan Gao , Fei Sun

Knowledge Editing (KE) aims to adjust a Large Language Model's (LLM) internal representations and parameters to correct inaccuracies and improve output consistency without incurring the computational expense of re-training the entire model.…

Computation and Language · Computer Science 2025-05-29 Liyu Zhang , Weiqi Wang , Tianqing Fang , Yangqiu Song

Model editing aims to efficiently update a pre-trained model's knowledge without the need for time-consuming full retraining. While existing pioneering editing methods achieve promising results, they primarily focus on editing single-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Zhiyi Shi , Binjie Wang , Chongjie Si , Yichen Wu , Junsik Kim , Hanspeter Pfister

Instruction-based text editing is increasingly critical for real-world applications such as code editors (e.g., Cursor), but Large Language Models (LLMs) continue to struggle with this task. Unlike free-form generation, editing requires…

Computation and Language · Computer Science 2025-12-16 Yiming Zeng , Jinghan Cao , Zexin Li , Wanhao Yu , Zhankai Ye , Dawei Xiang , Ting Hua , Xin Liu , Shangqian Gao , Tingting Yu

Lifelong learning enables large language models (LLMs) to adapt to evolving information by continually updating their internal knowledge. An ideal system should support efficient, wide-ranging updates while preserving existing capabilities…

Computation and Language · Computer Science 2026-03-11 Xiaojie Gu , Ziying Huang , Jia-Chen Gu , Kai Zhang

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

Computation and Language · Computer Science 2026-01-21 Tyler Lizzo , Larry Heck

The model editing problem concerns how language models should learn new facts about the world over time. While empirical research on model editing has drawn widespread attention, the conceptual foundations of model editing remain shaky --…

Computation and Language · Computer Science 2024-06-28 Peter Hase , Thomas Hofweber , Xiang Zhou , Elias Stengel-Eskin , Mohit Bansal

Large language models (LLMs) face challenges with internal knowledge inaccuracies and outdated information. Knowledge editing has emerged as a pivotal approach to mitigate these issues. Although current knowledge editing techniques exhibit…

Computation and Language · Computer Science 2024-08-23 Mengqi Zhang , Bowen Fang , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen , Liang Wang

Large language models (LLMs) have emerged as powerful tools in natural language processing (NLP), showing a promising future of artificial generated intelligence (AGI). Despite their notable performance in the general domain, LLMs have…

Computation and Language · Computer Science 2025-01-23 Jingyuan Chen , Tao Wu , Wei Ji , Fei Wu

Large Language Models (LLMs) suffer from hallucinations, referring to the non-factual information in generated content, despite their superior capacities across tasks. Meanwhile, knowledge editing has been developed as a new popular…

Computation and Language · Computer Science 2025-03-04 Baixiang Huang , Canyu Chen , Xiongxiao Xu , Ali Payani , Kai Shu

Knowledge editing has emerged as an efficient technique for updating the knowledge of large language models (LLMs), attracting increasing attention in recent years. However, there is a lack of effective measures to prevent the malicious…

Computation and Language · Computer Science 2025-05-27 Xiaopeng Li , Shasha Li , Shangwen Wang , Shezheng Song , Bin Ji , Huijun Liu , Jun Ma , Jie Yu