中文
相关论文

相关论文: Massive Editing for Large Language Models Based on…

200 篇论文

A recent trend in Natural Language Processing is the exponential growth in Language Model (LM) size, which prevents research groups without a necessary hardware infrastructure from participating in the development process. This study…

计算与语言 · 计算机科学 2023-01-31 Jan Philip Wahle

Large language models (LLMs) need knowledge updates to meet the ever-growing world facts and correct the hallucinated responses, facilitating the methods of lifelong model editing. Where the updated knowledge resides in memories is a…

计算与语言 · 计算机科学 2024-12-20 Peng Wang , Zexi Li , Ningyu Zhang , Ziwen Xu , Yunzhi Yao , Yong Jiang , Pengjun Xie , Fei Huang , Huajun Chen

Efficiently editing knowledge stored in large language models (LLMs) enables model updates without large-scale training. One possible solution is Locate-and-Edit (L\&E), allowing simultaneous modifications of a massive number of facts.…

计算与语言 · 计算机科学 2025-07-25 Weizhi Fei , Hao Shi , Jing Xu , Jingchen Peng , Jiazheng Li , Jingzhao Zhang , Bo Bai , Wei Han , Zhenyuan Chen , Xueyan Niu

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

计算与语言 · 计算机科学 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Efficient knowledge editing of large language models is crucial for replacing obsolete information or incorporating specialized knowledge on a large scale. However, previous methods implicitly assume that knowledge is localized and isolated…

计算与语言 · 计算机科学 2024-02-21 Zihao Wei , Liang Pang , Hanxing Ding , Jingcheng Deng , Huawei Shen , Xueqi Cheng

The important challenge of keeping knowledge in Large Language Models (LLMs) up-to-date has led to the development of various methods for incorporating new facts. However, existing methods for such knowledge editing still face difficulties…

计算与语言 · 计算机科学 2024-12-05 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Ishaan Singh Rawal , Cheston Tan , Dongkyu Choi , Bo Xiong , Bo Ai

Large language models (LLMs) often require vast amounts of text to effectively acquire new knowledge. While continuing pre-training on large corpora or employing retrieval-augmented generation (RAG) has proven successful, updating an LLM…

计算与语言 · 计算机科学 2025-08-11 Hugo Abonizio , Thales Almeida , Roberto Lotufo , Rodrigo Nogueira

Knowledge editing (KE) provides a scalable approach for updating factual knowledge in large language models without full retraining. While previous studies have demonstrated effectiveness in general domains and medical QA tasks, little…

人工智能 · 计算机科学 2025-08-12 Shengtao Wen , Haodong Chen , Yadong Wang , Zhongying Pan , Xiang Chen , Yu Tian , Bo Qian , Dong Liang , Sheng-Jun Huang

Large language models (LLMs) have achieved remarkable performance on various natural language tasks. However, they are trained on static corpora and their knowledge can become outdated quickly in the fast-changing world. This motivates the…

计算与语言 · 计算机科学 2025-03-04 Tianci Liu , Ruirui Li , Yunzhe Qi , Hui Liu , Xianfeng Tang , Tianqi Zheng , Qingyu Yin , Monica Xiao Cheng , Jun Huan , Haoyu Wang , Jing Gao

Pre-trained Language Models (PLMs) which are trained on large text corpus via self-supervised learning method, have yielded promising performance on various tasks in Natural Language Processing (NLP). However, though PLMs with huge…

计算与语言 · 计算机科学 2023-08-31 Linmei Hu , Zeyi Liu , Ziwang Zhao , Lei Hou , Liqiang Nie , Juanzi Li

Large Language Models (LLMs) require lightweight avenues of updating stored information that has fallen out of date. Knowledge Editing (KE) approaches have been successful in updating model knowledge for simple factual queries but struggle…

人工智能 · 计算机科学 2025-08-05 Dominic Simon , Rickard Ewetz

Collaborative learning of large language models (LLMs) has emerged as a new paradigm for utilizing private data from different parties to guarantee efficiency and privacy. Meanwhile, Knowledge Editing (KE) for LLMs has also garnered…

计算与语言 · 计算机科学 2025-02-25 Jiamu Zheng , Jinghuai Zhang , Tianyu Du , Xuhong Zhang , Jianwei Yin , Tao Lin

Large Language Models (LLMs) power numerous AI applications, yet updating their knowledge remains costly. Model editing provides a lightweight alternative through targeted parameter modifications, with meta-learning-based model editing…

计算与语言 · 计算机科学 2026-01-30 Xiaopeng Li , Shasha Li , Xi Wang , Shezheng Song , Bin Ji , Shangwen Wang , Jun Ma , Xiaodong Liu , Mina Liu , Jie Yu

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmarks have not…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Junzhe Zhang , Huixuan Zhang , Xunjian Yin , Baizhou Huang , Xu Zhang , Xinyu Hu , Xiaojun Wan

Large Language Models (LLMs) have become indispensable tools in science, technology, and society, enabling transformative advances across diverse fields. However, errors or outdated information within these models can undermine their…

计算与语言 · 计算机科学 2025-12-19 Qizhou Chen , Chengyu Wang , Taolin Zhang , Xiaofeng He

Knowledge Editing (KE) aims to correct and update factual information in Large Language Models (LLMs) to ensure accuracy and relevance without computationally expensive fine-tuning. Though it has been proven effective in several domains,…

计算与语言 · 计算机科学 2024-10-21 Ching Ming Samuel Lau , Weiqi Wang , Haochen Shi , Baixuan Xu , Jiaxin Bai , Yangqiu Song

Knowledge editing aims to efficiently and cost-effectively correct inaccuracies and update outdated information. Recently, there has been growing interest in extending knowledge editing from Large Language Models (LLMs) to Multimodal Large…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Zhen Zeng , Leijiang Gu , Xun Yang , Zhangling Duan , Zenglin Shi , Meng Wang

Knowledge editing enables targeted updates without retraining, but prior work focuses on textual or visual facts, leaving abstract auditory perceptual knowledge underexplored. We introduce SAKE, the first benchmark for editing perceptual…

This paper investigates using knowledge editing techniques to detoxify Large Language Models (LLMs). We construct a benchmark, SafeEdit, which covers nine unsafe categories with various powerful attack prompts and equips comprehensive…

计算与语言 · 计算机科学 2024-05-29 Mengru Wang , Ningyu Zhang , Ziwen Xu , Zekun Xi , Shumin Deng , Yunzhi Yao , Qishen Zhang , Linyi Yang , Jindong Wang , Huajun Chen

The swift advancement in Multimodal LLMs (MLLMs) also presents significant challenges for effective knowledge editing. Current methods, including intrinsic knowledge editing and external knowledge resorting, each possess strengths and…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Kaihang Pan , Zhaoyu Fan , Juncheng Li , Qifan Yu , Hao Fei , Siliang Tang , Richang Hong , Hanwang Zhang , Qianru Sun