中文
相关论文

相关论文: Unveiling the Pitfalls of Knowledge Editing for La…

200 篇论文

Despite their exceptional capabilities, large language models (LLMs) are prone to generating unintended text due to false or outdated knowledge. Given the resource-intensive nature of retraining LLMs, there has been a notable increase in…

计算与语言 · 计算机科学 2024-05-28 Jun-Yu Ma , Zhen-Hua Ling , Ningyu Zhang , Jia-Chen Gu

Large Language Models (LLMs) suffer from hallucinations, referring to the non-factual information in generated content, despite their superior capacities across tasks. Meanwhile, knowledge editing has been developed as a new popular…

计算与语言 · 计算机科学 2025-03-04 Baixiang Huang , Canyu Chen , Xiongxiao Xu , Ali Payani , Kai Shu

Knowledge editing, which aims to update the knowledge encoded in language models, can be deceptive. Despite the fact that many existing knowledge editing algorithms achieve near-perfect performance on conventional metrics, the models edited…

计算与语言 · 计算机科学 2025-05-20 Jiakuan Xie , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Large language models (LLMs) have played a pivotal role in building communicative AI, yet they encounter the challenge of efficient updates. Model editing enables the manipulation of specific knowledge memories and the behavior of language…

计算与语言 · 计算机科学 2024-10-28 Xinbei Ma , Tianjie Ju , Jiyang Qiu , Zhuosheng Zhang , Hai Zhao , Lifeng Liu , Yulong Wang

Large language models (LLMs) increasingly rely on knowledge editing to support knowledge-intensive reasoning, but this flexibility also introduces critical safety risks: adversaries can inject malicious or misleading knowledge that corrupts…

人工智能 · 计算机科学 2026-05-12 Qinghua Mao , Xi Lin , Jinze Gu , Jun Wu , Siyuan Li , Yuliang Chen

Large language models (LLMs) have demonstrated remarkable capabilities, but updating their knowledge post-training remains a critical challenge. While recent model editing techniques like Rank-One Model Editing (ROME) show promise, their…

计算与语言 · 计算机科学 2025-07-17 Huaizhi Ge , Frank Rudzicz , Zining Zhu

Large Language Models (LLMs) require continuous updates to maintain accurate and current knowledge as the world evolves. While existing knowledge editing approaches offer various solutions for knowledge updating, they often struggle with…

人工智能 · 计算机科学 2025-06-17 Zichuan Fu , Xian Wu , Guojing Li , Yingying Zhang , Yefeng Zheng , Tianshi Ming , Yejing Wang , Wanyu Wang , Xiangyu Zhao

Large Language Models (LLMs) often retain inaccurate or outdated information from pre-training, leading to incorrect predictions or biased outputs during inference. While existing model editing methods can address this challenge, they…

机器学习 · 计算机科学 2025-08-07 Xin Liu , Qiyang Song , Shaowen Xu , Kerou Zhou , Wenbo Jiang , Xiaoqi Jia , Weijuan Zhang , Heqing Huang , Yakai Li

Current knowledge editing methods for large language models (LLMs) struggle to maintain logical consistency when propagating ripple effects to associated facts. We propose ChainEdit, a framework that synergizes knowledge graph-derived…

计算与语言 · 计算机科学 2025-07-14 Zilu Dong , Xiangqing Shen , Zinong Yang , Rui Xia

Large language models (LLMs) require frequent knowledge updates to reflect changing facts and mitigate hallucinations. To meet this demand, lifelong knowledge editing has emerged as a continual approach to modify specific pieces of…

人工智能 · 计算机科学 2026-04-22 Dahyun Jung , Jaewook Lee , Heuiseok Lim

Keeping large language models factually up-to-date is crucial for deployment, yet costly retraining remains a challenge. Knowledge editing offers a promising alternative, but methods are only tested on small-scale or synthetic edit…

计算与语言 · 计算机科学 2025-09-23 Lukas Thede , Karsten Roth , Matthias Bethge , Zeynep Akata , Tom Hartvigsen

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

计算与语言 · 计算机科学 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Large language models (LLMs) inevitably encode outdated or incorrect knowledge. Updating, deleting, and forgetting such knowledge is important for alignment, safety, and other issues. To address this issue, model editing has emerged as a…

人工智能 · 计算机科学 2025-10-02 Wei Liu , Haomei Xu , Bingqing Liu , Zhiying Deng , Haozhao Wang , Jun Wang , Ruixuan Li , Yee Whye Teh , Wee Sun Lee

In the rapidly advancing field of artificial intelligence, the concept of Red-Teaming or Jailbreaking large language models (LLMs) has emerged as a crucial area of study. This approach is especially significant in terms of assessing and…

计算与语言 · 计算机科学 2024-05-17 Rima Hazra , Sayan Layek , Somnath Banerjee , Soujanya Poria

Knowledge editing methods (KEs) can update language models' obsolete or inaccurate knowledge learned from pre-training. However, KEs can be used for malicious applications, e.g., inserting misinformation and toxic content. Knowing whether a…

计算与语言 · 计算机科学 2025-02-11 Paul Youssef , Zhixue Zhao , Christin Seifert , Jörg Schlötterer

Knowledge editing has emerged as an efficient technique for updating the knowledge of large language models (LLMs), attracting increasing attention in recent years. However, there is a lack of effective measures to prevent the malicious…

计算与语言 · 计算机科学 2025-05-27 Xiaopeng Li , Shasha Li , Shangwen Wang , Shezheng Song , Bin Ji , Huijun Liu , Jun Ma , Jie Yu

Large Language Models (LLMs) contain large amounts of facts about the world. These facts can become outdated over time, which has led to the development of knowledge editing methods (KEs) that can change specific facts in LLMs with limited…

计算与语言 · 计算机科学 2025-06-18 Paul Youssef , Zhixue Zhao , Daniel Braun , Jörg Schlötterer , Christin Seifert

Adjusting the outdated knowledge of large language models (LLMs) after deployment remains a major challenge. This difficulty has spurred the development of knowledge editing, which seeks to accurately and efficiently modify a model's…

计算与语言 · 计算机科学 2025-12-05 Pengfei Cao , Zeao Ji , Daojian Zeng , Jun Zhao , Kang Liu

Large language models (LLMs) often produce incorrect or outdated information, necessitating efficient and precise knowledge updates. Current model editing methods, however, struggle with long-form knowledge in diverse formats, such as…

计算与语言 · 计算机科学 2025-10-13 Houcheng Jiang , Junfeng Fang , Ningyu Zhang , Guojun Ma , Mingyang Wan , Xiang Wang , Xiangnan He , Tat-seng Chua

Model editing aims to enhance the accuracy and reliability of large language models (LLMs) by efficiently adjusting their internal parameters. Currently, most LLM editing datasets are confined to narrow knowledge domains and cover a limited…

计算与语言 · 计算机科学 2025-11-12 Qizhou Chen , Dakan Wang , Taolin Zhang , Zaoming Yan , Chengsong You , Chengyu Wang , Xiaofeng He