中文
相关论文

相关论文: Beyond Memorization: A Rigorous Evaluation Framewo…

200 篇论文

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

计算与语言 · 计算机科学 2025-10-27 Fufang Wen , Shichang Zhang

Pretrained Language Models (PLMs) store extensive knowledge within their weights, enabling them to recall vast amount of information. However, relying on this parametric knowledge brings some limitations such as outdated information or gaps…

计算与语言 · 计算机科学 2024-06-18 Alessio Galatolo , Meriem Beloucif , Katie Winkle

The existing methods for evaluating the medical knowledge of Large Language Models (LLMs) are largely based on atemporal examination-style benchmarks, while in reality, medical knowledge is inherently dynamic and continuously evolves as new…

机器学习 · 计算机科学 2026-05-14 Zihan Guan , Qiao Jin , Guangzhi Xiong , Fangyuan Chen , Mengxuan Hu , Qingyu Chen , Yifan Peng , Zhiyong Lu , Anil Vullikanti

Large language models (LLMs) require frequent knowledge updates to reflect changing facts and mitigate hallucinations. To meet this demand, lifelong knowledge editing has emerged as a continual approach to modify specific pieces of…

人工智能 · 计算机科学 2026-04-22 Dahyun Jung , Jaewook Lee , Heuiseok Lim

The dynamic nature of information necessitates continuously updating large vision-language models (LVLMs). While recent knowledge editing techniques hint at promising directions, they often focus on editing a single modality (vision or…

机器学习 · 计算机科学 2025-10-31 Jin Seong , Jiyun Park , Wencke Liermann , Hongseok Choi , Yoonji Nam , Hyun Kim , Soojong Lim , Namhoon Lee

Large Language Models (LLMs) have become indispensable tools in science, technology, and society, enabling transformative advances across diverse fields. However, errors or outdated information within these models can undermine their…

计算与语言 · 计算机科学 2025-12-19 Qizhou Chen , Chengyu Wang , Taolin Zhang , Xiaofeng He

As large language models (LLMs) become increasingly integrated into clinical decision-making, ensuring transparent and trustworthy reasoning is essential. However, existing evaluation strategies of LLMs' medical reasoning capability either…

Efficient knowledge editing of large language models is crucial for replacing obsolete information or incorporating specialized knowledge on a large scale. However, previous methods implicitly assume that knowledge is localized and isolated…

计算与语言 · 计算机科学 2024-02-21 Zihao Wei , Liang Pang , Hanxing Ding , Jingcheng Deng , Huawei Shen , Xueqi Cheng

Medical concept extraction from electronic health records underpins many downstream applications, yet remains challenging because medically meaningful concepts are frequently implied rather than explicitly stated in medical narratives.…

计算与语言 · 计算机科学 2026-05-21 Zhichao Yang , Gregory D. Lyng , Sanjit Singh Batra , Robert E. Tillman

Question answering is a natural language understanding task that involves reasoning over both explicit context, and unstated relevant domain knowledge. Despite the high cost of training, large language models (LLMs) -- the backbone of most…

计算与语言 · 计算机科学 2025-04-24 Laura Cabello , Carmen Martin-Turrero , Uchenna Akujuobi , Anders Søgaard , Carlos Bobed

Knowledge editing enables targeted updates without retraining, but prior work focuses on textual or visual facts, leaving abstract auditory perceptual knowledge underexplored. We introduce SAKE, the first benchmark for editing perceptual…

Knowledge augmentation has significantly enhanced the performance of Large Language Models (LLMs) in knowledge-intensive tasks. However, existing methods typically operate on the simplistic premise that model performance equates with…

计算与语言 · 计算机科学 2026-02-16 Hao Chen , Ye He , Yuchun Fan , Yukun Yan , Zhenghao Liu , Qingfu Zhu , Maosong Sun , Wanxiang Che

Recently, large language models (LLMs) have demonstrated impressive results but still suffer from hallucinations. Model editing has been proposed to correct factual inaccuracies in LLMs. A challenging case is sequential model editing (SME),…

计算与语言 · 计算机科学 2025-06-24 Taolin Zhang , Haidong Kang , Dongyang Li , Qizhou Chen , Chengyu Wang Xiaofeng He , Richang Hong

Locate-then-Edit Knowledge Editing (LEKE) is a key technique for updating large language models (LLMs) without full retraining. However, existing methods assume a single-user setting and become inefficient in real-world multi-client…

计算与语言 · 计算机科学 2025-02-24 Zongkai Zhao , Guozeng Xu , Xiuhua Li , Kaiwen Wei , Jiang Zhong

Multilingual knowledge editing (MKE) aims to simultaneously update factual knowledge across multiple languages within large language models (LLMs). Previous research indicates that the same knowledge across different languages within LLMs…

计算与语言 · 计算机科学 2024-12-18 Xue Zhang , Yunlong Liang , Fandong Meng , Songming Zhang , Yufeng Chen , Jinan Xu , Jie Zhou

Deploying Large Language Models (LLMs) in real-world dynamic environments raises the challenge of updating their pre-trained knowledge. While existing knowledge editing methods can reliably patch isolated facts, they frequently suffer from…

计算与语言 · 计算机科学 2026-04-08 Tianyi Zhao , Yinhan He , Wendy Zheng , Chen Chen

Large language models (LLMs) encode vast amounts of world knowledge but remain static once trained, making the timely integration of emerging facts prohibitively expensive via full retraining. Knowledge-editing techniques have thus emerged…

计算与语言 · 计算机科学 2025-09-03 Yuchen Wu , Liang Ding , Li Shen , Dacheng Tao

As Large Langue Models have been shown to memorize real-world facts, the need to update this knowledge in a controlled and efficient manner arises. Designed with these constraints in mind, Knowledge Editing (KE) approaches propose to alter…

人工智能 · 计算机科学 2025-07-30 Marco Scialanga , Thibault Laugel , Vincent Grari , Marcin Detyniecki

Recent advances in multi-modal generative models have enabled significant progress in instruction-based image editing. However, while these models produce visually plausible outputs, their capacity for knowledge-based reasoning editing…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Yongliang Wu , Zonghui Li , Xinting Hu , Xinyu Ye , Xianfang Zeng , Gang Yu , Wenbo Zhu , Bernt Schiele , Ming-Hsuan Yang , Xu Yang

Large language models (LLMs) encode vast amounts of pre-trained knowledge in their parameters, but updating them as real-world information evolves remains a challenge. Existing methodologies and benchmarks primarily target entity…

计算与语言 · 计算机科学 2025-04-18 Aochong Oliver Li , Tanya Goyal