English
Related papers

Related papers: Massive Editing for Large Language Models Based on…

200 papers

Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring…

Computation and Language · Computer Science 2026-04-08 Jinhu Fu , Yan Bai , Longzhu He , Yihang Lou , Yanxiao Zhao , Li Sun , Sen Su

Large language models (LLMs) excel at factual recall yet still propagate stale or incorrect knowledge. In-context knowledge editing offers a gradient-free remedy suitable for black-box APIs, but current editors rely on static demonstration…

Computation and Language · Computer Science 2025-10-28 Mahmud Wasif Nafee , Maiqi Jiang , Haipeng Chen , Yanfu Zhang

Knowledge editing aims to modify outdated knowledge in language models efficiently while retaining their original capabilities. Mainstream datasets for knowledge editing are predominantly static and fail to keep in pace with the evolving…

Computation and Language · Computer Science 2026-04-24 Chenming Tang , Yutong Yang , Kexue Wang , Yunfang Wu

Post-editing machine translation (MT) for creative texts, such as literature, requires balancing efficiency with the preservation of creativity and style. While neural MT systems struggle with these challenges, large language models (LLMs)…

Computation and Language · Computer Science 2025-04-07 Antonio Castaldo , Sheila Castilho , Joss Moorkens , Johanna Monti

Lifelong model editing (LME) aims to sequentially rectify outdated or inaccurate knowledge in deployed LLMs while minimizing side effects on unrelated inputs. However, existing approaches typically apply parameter perturbations to a static…

Computation and Language · Computer Science 2026-04-14 Yangfan Wang , Tianyang Sun , Chen Tang , Jie Liu , Wei Cai , Jingchi Jiang

Large Language Models (LLMs) store an extensive amount of factual knowledge obtained from vast collections of text. To effectively utilize these models for downstream tasks, it is crucial to have reliable methods for measuring their…

Computation and Language · Computer Science 2023-06-13 Pouya Pezeshkpour

Large Language Models bear the promise of significant acceleration of key Knowledge Graph and Ontology Engineering tasks, including ontology modeling, extension, modification, population, alignment, as well as entity disambiguation. We lay…

Artificial Intelligence · Computer Science 2024-11-15 Cogan Shimizu , Pascal Hitzler

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

Information Retrieval · Computer Science 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

Large language models store not only isolated facts but also rules that support reasoning across symbolic expressions, natural language explanations, and concrete instances. Yet most model editing methods are built for fact-level knowledge,…

Computation and Language · Computer Science 2026-04-10 Yating Wang , Wenting Zhao , Yaqi Zhao , Yongshun Gong , Yilong Yin , Haoliang Sun

Knowledge embeddings (KE) represent a knowledge graph (KG) by embedding entities and relations into continuous vector spaces. Existing methods are mainly structure-based or description-based. Structure-based methods learn representations…

Computation and Language · Computer Science 2023-06-30 Xintao Wang , Qianyu He , Jiaqing Liang , Yanghua Xiao

Deploying Large Language Models (LLMs) in real-world dynamic environments raises the challenge of updating their pre-trained knowledge. While existing knowledge editing methods can reliably patch isolated facts, they frequently suffer from…

Computation and Language · Computer Science 2026-04-08 Tianyi Zhao , Yinhan He , Wendy Zheng , Chen Chen

Large Language Models (LLMs) have shown remarkable capabilities as AI agents. However, existing methods for enhancing LLM-agent abilities often lack a focus on data quality, leading to inefficiencies and suboptimal results in both…

Machine Learning · Computer Science 2025-02-19 Yunxiao Zhang , Guanming Xiong , Haochen Li , Wen Zhao

In this paper, we focus on editing Multimodal Large Language Models (MLLMs). Compared to editing single-modal LLMs, multimodal model editing is more challenging, which demands a higher level of scrutiny and careful consideration in the…

Computation and Language · Computer Science 2024-04-19 Siyuan Cheng , Bozhong Tian , Qingbin Liu , Xi Chen , Yongheng Wang , Huajun Chen , Ningyu Zhang

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity…

Machine Learning · Computer Science 2025-05-13 Erica Coppolillo

Knowledge Editing, which efficiently modifies the knowledge in large language models, has gathered great attention. Current benchmarks primarily use multi-hop question answering to assess and analyze newly injected or updated knowledge.…

Computation and Language · Computer Science 2025-06-04 Keyuan Cheng , Zijian Kan , Zhixian He , Zhuoran Zhang , Muhammad Asif Ali , Ke Xu , Lijie Hu , Di Wang

Knowledge representation has been a central aim of AI since its inception. Symbolic Knowledge Graphs (KGs) and neural Large Language Models (LLMs) can both represent knowledge. KGs provide highly accurate and explicit knowledge…

Knowledge editing techniques for large language models (LLMs) can inject knowledge that is later reproducible verbatim, but they fall short on propagating that knowledge: models cannot answer questions that require reasoning with the…

Computation and Language · Computer Science 2025-06-11 Zeyu Leo Liu , Greg Durrett , Eunsol Choi

In recent years, with the maturation of large language model (LLM) technology and the emergence of high-quality programming code datasets, researchers have become increasingly confident in addressing the challenges of program synthesis…

Software Engineering · Computer Science 2024-10-11 Zhanyue Qin , Haochuan Wang , Zecheng Wang , Deyuan Liu , Cunhang Fan , Zhao Lv , Zhiying Tu , Dianhui Chu , Dianbo Sui

Knowledge editing has emerged as an effective approach for updating large language models (LLMs) by modifying their internal knowledge. However, their application to the biomedical domain faces unique challenges due to the long-tailed…

Computation and Language · Computer Science 2025-04-15 Xinhao Yi , Jake Lever , Kevin Bryson , Zaiqiao Meng

Knowledge editing (KE) methods offer an efficient way to modify knowledge in large language models. Current KE evaluations typically assess editing success by considering only the edited knowledge without any preceding contexts. In…

Computation and Language · Computer Science 2025-06-03 Haewon Park , Gyubin Choi , Minjun Kim , Yohan Jo