中文
相关论文

相关论文: KnowledgeSmith: Uncovering Knowledge Updating in L…

200 篇论文

Large language models (LLMs) acquire knowledge during pre-training, but over time, this knowledge may become incorrect or outdated, necessitating updates after training. Knowledge editing techniques address this issue without the need for…

计算与语言 · 计算机科学 2024-10-16 Yuchen Cai , Ding Cao

Knowledge-editing updates knowledge of large language models (LLMs) and contributes to the interpretability and application of LLMs. However, knowledge applying is context-consistent: LLMs can recall the same knowledge in different…

计算与语言 · 计算机科学 2024-01-18 Youcheng Huang , Wenqiang Lei , Zheng Zhang , Jiancheng Lv , Shuicheng Yan

Knowledge editing has emerged as a lightweight alternative to retraining for correcting or injecting specific facts in large language models (LLMs). Meanwhile, fine-tuning remains the default operation for adapting LLMs to new domains and…

计算与语言 · 计算机科学 2025-12-09 Yinjie Cheng , Paul Youssef , Christin Seifert , Jörg Schlötterer , Zhixue Zhao

Model editing aims to enhance the accuracy and reliability of large language models (LLMs) by efficiently adjusting their internal parameters. Currently, most LLM editing datasets are confined to narrow knowledge domains and cover a limited…

计算与语言 · 计算机科学 2025-11-12 Qizhou Chen , Dakan Wang , Taolin Zhang , Zaoming Yan , Chengsong You , Chengyu Wang , Xiaofeng He

Knowledge editing aims to change language models' performance on several special cases (i.e., editing scope) by infusing the corresponding expected knowledge into them. With the recent advancements in large language models (LLMs), knowledge…

计算与语言 · 计算机科学 2024-05-31 Jiaan Wang , Yunlong Liang , Zengkui Sun , Yuxuan Cao , Jiarong Xu , Fandong Meng

Large language models (LLMs) have recently transformed both the academic and industrial landscapes due to their remarkable capacity to understand, analyze, and generate texts based on their vast knowledge and reasoning ability.…

计算与语言 · 计算机科学 2024-09-23 Song Wang , Yaochen Zhu , Haochen Liu , Zaiyi Zheng , Chen Chen , Jundong Li

Large Language Models (LLMs) often retain inaccurate or outdated information from pre-training, leading to incorrect predictions or biased outputs during inference. While existing model editing methods can address this challenge, they…

机器学习 · 计算机科学 2025-08-07 Xin Liu , Qiyang Song , Shaowen Xu , Kerou Zhou , Wenbo Jiang , Xiaoqi Jia , Weijuan Zhang , Heqing Huang , Yakai Li

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

计算与语言 · 计算机科学 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

计算与语言 · 计算机科学 2026-01-21 Tyler Lizzo , Larry Heck

Knowledge editing has emerged as an effective approach for updating large language models (LLMs) by modifying their internal knowledge. However, their application to the biomedical domain faces unique challenges due to the long-tailed…

计算与语言 · 计算机科学 2025-04-15 Xinhao Yi , Jake Lever , Kevin Bryson , Zaiqiao Meng

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

人工智能 · 计算机科学 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

This study investigates the machine unlearning techniques within the context of large language models (LLMs), referred to as \textit{LLM unlearning}. LLM unlearning offers a principled approach to removing the influence of undesirable data…

Large language models (LLMs) have emerged as powerful knowledge bases yet are limited by static training data, leading to issues such as hallucinations and safety risks. Editing a model's internal knowledge through the locate-and-edit…

计算与语言 · 计算机科学 2025-08-12 Zian Su , Ziyang Huang , Kaiyuan Zhang , Xiangyu Zhang

Knowledge editing has emerged as an efficient approach for updating factual knowledge in large language models (LLMs). It typically locates knowledge storage modules and then modifies their parameters. However, most existing methods focus…

计算与语言 · 计算机科学 2025-11-03 Jiahao Liu , Zijian Wang , Kuo Zhao , Dong Hu

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world…

计算与语言 · 计算机科学 2024-04-23 Hao Peng , Xiaozhi Wang , Chunyang Li , Kaisheng Zeng , Jiangshan Duo , Yixin Cao , Lei Hou , Juanzi Li

Large language models (LLMs) often require vast amounts of text to effectively acquire new knowledge. While continuing pre-training on large corpora or employing retrieval-augmented generation (RAG) has proven successful, updating an LLM…

计算与语言 · 计算机科学 2025-08-11 Hugo Abonizio , Thales Almeida , Roberto Lotufo , Rodrigo Nogueira

Knowledge editing technology is crucial for maintaining the accuracy and timeliness of large language models (LLMs) . However, the setting of this task overlooks a significant portion of commonsense knowledge based on free-text in the real…

计算与语言 · 计算机科学 2024-11-01 Xiusheng Huang , Yequan Wang , Jun Zhao , Kang Liu

In recent years, Large Language Models (LLMs) have achieved remarkable advancements, drawing significant attention from the research community. Their capabilities are largely attributed to large-scale architectures, which require extensive…

As real-world knowledge evolves, the information embedded within large language models (LLMs) can become outdated, inadequate, or erroneous. Model editing has emerged as a prominent approach for updating LLMs' knowledge with minimal…

计算与语言 · 计算机科学 2025-03-10 Guoxiu He , Xin Song , Aixin Sun

Regular updates are essential for maintaining up-to-date knowledge in large language models (LLMs). Consequently, various model editing methods have been developed to update specific knowledge within LLMs. However, training-based approaches…

计算与语言 · 计算机科学 2025-05-27 Yujie Feng , Liming Zhan , Zexin Lu , Yongxin Xu , Xu Chu , Yasha Wang , Jiannong Cao , Philip S. Yu , Xiao-Ming Wu