中文
相关论文

相关论文: Beyond Memorization: A Rigorous Evaluation Framewo…

200 篇论文

Multi-hop Question Answering (MQA) under knowledge editing (KE) is a key challenge in Large Language Models (LLMs). While best-performing solutions in this domain use a plan and solve paradigm to split a question into sub-questions followed…

计算与语言 · 计算机科学 2024-05-28 Keyuan Cheng , Muhammad Asif Ali , Shu Yang , Gang Lin , Yuxuan Zhai , Haoyang Fei , Ke Xu , Lu Yu , Lijie Hu , Di Wang

Recently, there has been a growing interest in knowledge editing for Large Language Models (LLMs). Current approaches and evaluations merely explore the instance-level editing, while whether LLMs possess the capability to modify concepts…

计算与语言 · 计算机科学 2024-10-08 Xiaohan Wang , Shengyu Mao , Ningyu Zhang , Shumin Deng , Yunzhi Yao , Yue Shen , Lei Liang , Jinjie Gu , Huajun Chen

Knowledge editing has emerged as an efficient technique for updating the knowledge of large language models (LLMs), attracting increasing attention in recent years. However, there is a lack of effective measures to prevent the malicious…

计算与语言 · 计算机科学 2025-05-27 Xiaopeng Li , Shasha Li , Shangwen Wang , Shezheng Song , Bin Ji , Huijun Liu , Jun Ma , Jie Yu

Memory Editing (ME) has emerged as an efficient method to modify erroneous facts or inject new facts into Large Language Models (LLMs). Two mainstream ME methods exist: parameter-modifying ME and parameter-preserving ME (integrating extra…

计算与语言 · 计算机科学 2024-02-20 Zihao Lin , Mohammad Beigi , Hongxuan Li , Yufan Zhou , Yuxiang Zhang , Qifan Wang , Wenpeng Yin , Lifu Huang

Natural language processing evaluation has made significant progress, largely driven by the proliferation of powerful large language mod-els (LLMs). New evaluation benchmarks are of increasing priority as the reasoning capabilities of LLMs…

计算与语言 · 计算机科学 2025-06-19 Joseph J. Peper , Wenzhao Qiu , Ali Payani , Lu Wang

Knowledge editing aims to update outdated information in Large Language Models (LLMs). A representative line of study is locate-then-edit methods, which typically employ causal tracing to identify the modules responsible for recalling…

计算与语言 · 计算机科学 2025-03-18 Haowen Pan , Xiaozhi Wang , Yixin Cao , Zenglin Shi , Xun Yang , Juanzi Li , Meng Wang

Knowledge editing is a rising technique for efficiently updating factual knowledge in large language models (LLMs) with minimal alteration of parameters. However, recent studies have identified side effects, such as knowledge distortion and…

Large Language Models (LLMs) excel in tasks such as retrieval and question answering but require updates to incorporate new knowledge and reduce inaccuracies and hallucinations. Traditional updating methods, like fine-tuning and incremental…

计算与语言 · 计算机科学 2025-04-30 Yifan Wei , Xiaoyan Yu , Ran Song , Hao Peng , Angsheng Li

Recent knowledge editing methods have primarily focused on modifying structured knowledge in large language models. However, this task setting overlooks the fact that a significant portion of real-world knowledge is stored in an…

计算与语言 · 计算机科学 2025-02-26 Jingcheng Deng , Zihao Wei , Liang Pang , Hanxing Ding , Huawei Shen , Xueqi Cheng

As real-world knowledge is constantly evolving, ensuring the timeliness and accuracy of a model's knowledge is crucial. This has made knowledge editing in large language models increasingly important. However, existing knowledge editing…

计算与语言 · 计算机科学 2024-12-31 Yongchang Li , Yujin Zhu , Tao Yan , Shijian Fan , Gang Wu , Liang Xu

Knowledge editing (KE) methods offer an efficient way to modify knowledge in large language models. Current KE evaluations typically assess editing success by considering only the edited knowledge without any preceding contexts. In…

计算与语言 · 计算机科学 2025-06-03 Haewon Park , Gyubin Choi , Minjun Kim , Yohan Jo

As the field of Large Language Models (LLMs) evolves at an accelerated pace, the critical need to assess and monitor their performance emerges. We introduce a benchmarking framework focused on knowledge graph engineering (KGE) accompanied…

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning.…

计算与语言 · 计算机科学 2025-06-18 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Large language models (LLMs) are increasingly used as knowledge bases, but keeping them up to date requires targeted knowledge editing (KE). However, it remains unclear how edits are implemented inside the model once applied. In this work,…

计算与语言 · 计算机科学 2026-03-24 Yuan Cao , Mingyang Wang , Hinrich Schütze

Large Language Models (LLMs) usually suffer from knowledge cutoff or fallacy issues, which means they are unaware of unseen events or generate text with incorrect facts owing to outdated/noisy data. To this end, many knowledge editing…

Knowledge editing (KE) enables precise modifications to factual content in large language models (LLMs). Existing KE methods are largely designed for dense architectures, limiting their applicability to the increasingly prevalent sparse…

机器学习 · 计算机科学 2026-02-12 Yupu Gu , Rongzhe Wei , Andy Zhu , Pan Li

Large Language Models (LLMs) require continuous updates to maintain accurate and current knowledge as the world evolves. While existing knowledge editing approaches offer various solutions for knowledge updating, they often struggle with…

人工智能 · 计算机科学 2025-06-17 Zichuan Fu , Xian Wu , Guojing Li , Yingying Zhang , Yefeng Zheng , Tianshi Ming , Yejing Wang , Wanyu Wang , Xiangyu Zhao

Knowledge editing aims to change language models' performance on several special cases (i.e., editing scope) by infusing the corresponding expected knowledge into them. With the recent advancements in large language models (LLMs), knowledge…

计算与语言 · 计算机科学 2024-05-31 Jiaan Wang , Yunlong Liang , Zengkui Sun , Yuxuan Cao , Jiarong Xu , Fandong Meng

The dynamic nature of real-world information necessitates efficient knowledge editing (KE) in large language models (LLMs) for knowledge updating. However, current KE approaches, which typically operate on (subject, relation, object)…

计算与语言 · 计算机科学 2024-02-20 Jiateng Liu , Pengfei Yu , Yuji Zhang , Sha Li , Zixuan Zhang , Heng Ji

Large language models (LLMs) have demonstrated significant potential in clinical decision support. Yet LLMs still suffer from hallucinations and lack fine-grained contextual medical knowledge, limiting their high-stake healthcare…

计算与语言 · 计算机科学 2025-04-22 Pengcheng Jiang , Cao Xiao , Minhao Jiang , Parminder Bhatia , Taha Kass-Hout , Jimeng Sun , Jiawei Han