中文
相关论文

相关论文: Edit Once, Update Everywhere: A Simple Framework f…

200 篇论文

The swift advancement in Multimodal LLMs (MLLMs) also presents significant challenges for effective knowledge editing. Current methods, including intrinsic knowledge editing and external knowledge resorting, each possess strengths and…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Kaihang Pan , Zhaoyu Fan , Juncheng Li , Qifan Yu , Hao Fei , Siliang Tang , Richang Hong , Hanwang Zhang , Qianru Sun

Multilingual knowledge editing (MKE) aims to simultaneously update factual knowledge across multiple languages within large language models (LLMs). Previous research indicates that the same knowledge across different languages within LLMs…

计算与语言 · 计算机科学 2024-12-18 Xue Zhang , Yunlong Liang , Fandong Meng , Songming Zhang , Yufeng Chen , Jinan Xu , Jie Zhou

As the world changes, we need to be able to update our models and correct false information without costly retraining. Knowledge-based model editing enables precise modifications to the weights of large language models in order to modify…

Large Language Models (LLMs) excel in natural language processing by encoding extensive human knowledge, but their utility relies on timely updates as knowledge evolves. Updating LLMs involves two key tasks simultaneously: unlearning to…

计算与语言 · 计算机科学 2025-02-04 Binchi Zhang , Zhengzhang Chen , Zaiyi Zheng , Jundong Li , Haifeng Chen

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmarks have not…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Junzhe Zhang , Huixuan Zhang , Xunjian Yin , Baizhou Huang , Xu Zhang , Xinyu Hu , Xiaojun Wan

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

计算与语言 · 计算机科学 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring…

计算与语言 · 计算机科学 2026-04-08 Jinhu Fu , Yan Bai , Longzhu He , Yihang Lou , Yanxiao Zhao , Li Sun , Sen Su

The vast amount of online information today poses challenges for non-English speakers, as much of it is concentrated in high-resource languages such as English and French. Wikipedia reflects this imbalance, with content in low-resource…

计算与语言 · 计算机科学 2025-04-08 Siddharth Khincha , Tushar Kataria , Ankita Anand , Dan Roth , Vivek Gupta

Large language models (LLMs) often retain outdated or incorrect information from pre-training, which undermines their reliability. While model editing methods have been developed to address such errors without full re-training, they…

计算与语言 · 计算机科学 2025-02-25 Dahyun Jung , Jaehyung Seo , Jaewook Lee , Chanjun Park , Heuiseok Lim

Locate-then-Edit Knowledge Editing (LEKE) is a key technique for updating large language models (LLMs) without full retraining. However, existing methods assume a single-user setting and become inefficient in real-world multi-client…

计算与语言 · 计算机科学 2025-02-24 Zongkai Zhao , Guozeng Xu , Xiuhua Li , Kaiwen Wei , Jiang Zhong

Knowledge editing (KE) provides a lightweight alternative to repeated fine-tuning of LLMs. However, most existing KE methods target dense feed-forward layers, while modern LLMs increasingly adopt Mixture-of-Experts (MoE) architectures for…

Large Language Models (LLMs) have demonstrated impressive capability in different tasks and are bringing transformative changes to many domains. However, keeping the knowledge in LLMs up-to-date remains a challenge once pretraining is…

计算与语言 · 计算机科学 2024-07-24 Xiou Ge , Ali Mousavi , Edouard Grave , Armand Joulin , Kun Qian , Benjamin Han , Mostafa Arefiyan , Yunyao Li

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

计算与语言 · 计算机科学 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Knowledge editing is a technique for efficiently and accurately updating the knowledge of large language models (LLMs) to alleviate obsolescence and correct errors. However, most existing methods overfit to specific models, causing edited…

人工智能 · 计算机科学 2025-03-05 Shuaike Li , Kai Zhang , Qi Liu , Enhong Chen

Large Language Models (LLMs) can become outdated over time as they may lack updated world knowledge, leading to factual knowledge errors and gaps. Knowledge Editing (KE) aims to overcome this challenge using weight updates that do not…

计算与语言 · 计算机科学 2024-09-25 Amit Rozner , Barak Battash , Lior Wolf , Ofir Lindenbaum

As real-world knowledge evolves, the information embedded within large language models (LLMs) can become outdated, inadequate, or erroneous. Model editing has emerged as a prominent approach for updating LLMs' knowledge with minimal…

计算与语言 · 计算机科学 2025-03-10 Guoxiu He , Xin Song , Aixin Sun

Knowledge Editing (KE) aims to correct and update factual information in Large Language Models (LLMs) to ensure accuracy and relevance without computationally expensive fine-tuning. Though it has been proven effective in several domains,…

计算与语言 · 计算机科学 2024-10-21 Ching Ming Samuel Lau , Weiqi Wang , Haochen Shi , Baixuan Xu , Jiaxin Bai , Yangqiu Song

Efficient knowledge editing of large language models is crucial for replacing obsolete information or incorporating specialized knowledge on a large scale. However, previous methods implicitly assume that knowledge is localized and isolated…

计算与语言 · 计算机科学 2024-02-21 Zihao Wei , Liang Pang , Hanxing Ding , Jingcheng Deng , Huawei Shen , Xueqi Cheng

Large language models (LLMs) face challenges with internal knowledge inaccuracies and outdated information. Knowledge editing has emerged as a pivotal approach to mitigate these issues. Although current knowledge editing techniques exhibit…

计算与语言 · 计算机科学 2024-08-23 Mengqi Zhang , Bowen Fang , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen , Liang Wang

Adjusting the outdated knowledge of large language models (LLMs) after deployment remains a major challenge. This difficulty has spurred the development of knowledge editing, which seeks to accurately and efficiently modify a model's…

计算与语言 · 计算机科学 2025-12-05 Pengfei Cao , Zeao Ji , Daojian Zeng , Jun Zhao , Kang Liu