中文
相关论文

相关论文: GeoEdit: Geometric Knowledge Editing for Large Lan…

200 篇论文

Knowledge editing has emerged as a lightweight alternative to retraining for correcting or injecting specific facts in large language models (LLMs). Meanwhile, fine-tuning remains the default operation for adapting LLMs to new domains and…

计算与语言 · 计算机科学 2025-12-09 Yinjie Cheng , Paul Youssef , Christin Seifert , Jörg Schlötterer , Zhixue Zhao

Large Language Models (LLMs) internalize vast world knowledge as parametric memory, yet inevitably inherit the staleness and errors of their source corpora. Consequently, ensuring the reliability and malleability of these internal…

计算与语言 · 计算机科学 2026-04-08 Xiaojie Gu , Ziying Huang , Weicong Hong , Jian Xie , Renze Lou , Kai Zhang

Current knowledge editing methods for large language models (LLMs) struggle to maintain logical consistency when propagating ripple effects to associated facts. We propose ChainEdit, a framework that synergizes knowledge graph-derived…

计算与语言 · 计算机科学 2025-07-14 Zilu Dong , Xiangqing Shen , Zinong Yang , Rui Xia

The important challenge of keeping knowledge in Large Language Models (LLMs) up-to-date has led to the development of various methods for incorporating new facts. However, existing methods for such knowledge editing still face difficulties…

计算与语言 · 计算机科学 2024-12-05 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Ishaan Singh Rawal , Cheston Tan , Dongkyu Choi , Bo Xiong , Bo Ai

Deep neural networks are becoming increasingly pervasive in academia and industry, matching and surpassing human performance on a wide variety of fields and related tasks. However, just as humans, even the largest artificial neural networks…

机器学习 · 计算机科学 2024-09-02 Vittorio Mazzia , Alessandro Pedrani , Andrea Caciolai , Kay Rottmann , Davide Bernardi

Large Language Models (LLMs) require frequent updates to correct errors and keep pace with continuously evolving knowledge in a timely and effective manner. Recent research in it model editing has highlighted the challenges in balancing…

机器学习 · 计算机科学 2024-10-02 Tai D. Nguyen , Long H. Pham , Jun Sun

Large language Model (LLM) unlearning, i.e., selectively removing information from LLMs, is vital for responsible model deployment. Differently, LLM knowledge editing aims to modify LLM knowledge instead of removing it. Though editing and…

机器学习 · 计算机科学 2025-05-27 Zexi Li , Xiangzhu Wang , William F. Shen , Meghdad Kurmanji , Xinchi Qiu , Dongqi Cai , Chao Wu , Nicholas D. Lane

Large Language Models (LLMs) excel in natural language processing by encoding extensive human knowledge, but their utility relies on timely updates as knowledge evolves. Updating LLMs involves two key tasks simultaneously: unlearning to…

计算与语言 · 计算机科学 2025-02-04 Binchi Zhang , Zhengzhang Chen , Zaiyi Zheng , Jundong Li , Haifeng Chen

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

计算与语言 · 计算机科学 2025-10-27 Fufang Wen , Shichang Zhang

Knowledge editing aims to update specific facts in large language models (LLMs) without full retraining. Prior efforts sought to tune the knowledge layers of LLMs, achieving improved performance in controlled, teacher-forced evaluations.…

计算与语言 · 计算机科学 2026-02-02 Ruilin Li , Yibin Wang , Wenhong Zhu , Chenglin Li , Jinghao Zhang , Chenliang Li , Junchi Yan , Jiaqi Wang

Knowledge editing techniques for large language models (LLMs) can inject knowledge that is later reproducible verbatim, but they fall short on propagating that knowledge: models cannot answer questions that require reasoning with the…

计算与语言 · 计算机科学 2025-06-11 Zeyu Leo Liu , Greg Durrett , Eunsol Choi

Large language models (LLMs) have achieved remarkable performance on various natural language tasks. However, they are trained on static corpora and their knowledge can become outdated quickly in the fast-changing world. This motivates the…

计算与语言 · 计算机科学 2025-03-04 Tianci Liu , Ruirui Li , Yunzhe Qi , Hui Liu , Xianfeng Tang , Tianqi Zheng , Qingyu Yin , Monica Xiao Cheng , Jun Huan , Haoyu Wang , Jing Gao

Knowledge-editing updates knowledge of large language models (LLMs) and contributes to the interpretability and application of LLMs. However, knowledge applying is context-consistent: LLMs can recall the same knowledge in different…

计算与语言 · 计算机科学 2024-01-18 Youcheng Huang , Wenqiang Lei , Zheng Zhang , Jiancheng Lv , Shuicheng Yan

Knowledge editing has emerged as an effective approach for updating large language models (LLMs) by modifying their internal knowledge. However, their application to the biomedical domain faces unique challenges due to the long-tailed…

计算与语言 · 计算机科学 2025-04-15 Xinhao Yi , Jake Lever , Kevin Bryson , Zaiqiao Meng

We propose an interactive editing method that allows humans to help deep neural networks (DNNs) learn a latent space more consistent with human knowledge, thereby improving classification accuracy on indistinguishable ambiguous data.…

机器学习 · 计算机科学 2022-12-09 Jiafu Wei , Ding Xia , Haoran Xie , Chia-Ming Chang , Chuntao Li , Xi Yang

Large language models (LLMs) exhibit impressive language capabilities but remain vulnerable to malicious prompts and jailbreaking attacks. Existing knowledge editing methods for LLM detoxification face two major challenges. First, they…

计算与语言 · 计算机科学 2025-05-29 Yifan Lu , Jing Li , Yigeng Zhou , Yihui Zhang , Wenya Wang , Xiucheng Li , Meishan Zhang , Fangming Liu , Jun Yu , Min Zhang

Instruction-based text editing is increasingly critical for real-world applications such as code editors (e.g., Cursor), but Large Language Models (LLMs) continue to struggle with this task. Unlike free-form generation, editing requires…

计算与语言 · 计算机科学 2025-12-16 Yiming Zeng , Jinghan Cao , Zexin Li , Wanhao Yu , Zhankai Ye , Dawei Xiang , Ting Hua , Xin Liu , Shangqian Gao , Tingting Yu

Large language models (LLMs) have demonstrated strong reasoning capabilities in text-based mathematical problem solving; however, when adapted to visual reasoning tasks, particularly geometric problem solving, their performance…

人工智能 · 计算机科学 2025-10-28 Nannan Shi , Chuanyu Qin , Shipeng Song , Man Luo

Efficiently editing knowledge stored in large language models (LLMs) enables model updates without large-scale training. One possible solution is Locate-and-Edit (L\&E), allowing simultaneous modifications of a massive number of facts.…

计算与语言 · 计算机科学 2025-07-25 Weizhi Fei , Hao Shi , Jing Xu , Jingchen Peng , Jiazheng Li , Jingzhao Zhang , Bo Bai , Wei Han , Zhenyuan Chen , Xueyan Niu

Continual post-training aims to extend large language models (LLMs) with new knowledge, skills, and behaviors, yet it remains unclear when sequential updates enable capability transfer and when they cause catastrophic forgetting. Existing…