English
Related papers

Related papers: MQuAKE: Assessing Knowledge Editing in Language Mo…

200 papers

Multi-hop question answering (MHQA) poses a significant challenge for large language models (LLMs) due to the extensive knowledge demands involved. Knowledge editing, which aims to precisely modify the LLMs to incorporate specific knowledge…

Computation and Language · Computer Science 2024-12-30 Yifan Lu , Yigeng Zhou , Jing Li , Yequan Wang , Xuebo Liu , Daojing He , Fangming Liu , Min Zhang

Large language models store not only isolated facts but also rules that support reasoning across symbolic expressions, natural language explanations, and concrete instances. Yet most model editing methods are built for fact-level knowledge,…

Computation and Language · Computer Science 2026-04-10 Yating Wang , Wenting Zhao , Yaqi Zhao , Yongshun Gong , Yilong Yin , Haoliang Sun

Large language models (LLMs) have demonstrated impressive capabilities in various reasoning tasks but face significant challenges with complex, knowledge-intensive multi-hop queries, particularly those involving new or long-tail knowledge.…

Computation and Language · Computer Science 2025-08-25 Jie He , Nan Hu , Wanqiu Long , Jiaoyan Chen , Jeff Z. Pan

Knowledge editing has emerged as an efficient approach for updating factual knowledge in large language models (LLMs). It typically locates knowledge storage modules and then modifies their parameters. However, most existing methods focus…

Computation and Language · Computer Science 2025-11-03 Jiahao Liu , Zijian Wang , Kuo Zhao , Dong Hu

Large language models (LLMs) have recently driven striking performance improvements across a range of natural language processing tasks. The factual knowledge acquired during pretraining and instruction tuning can be useful in various…

Computation and Language · Computer Science 2023-10-10 Xuming Hu , Junzhe Chen , Xiaochuan Li , Yufei Guo , Lijie Wen , Philip S. Yu , Zhijiang Guo

Large Multimodal Models (LMMs) store vast amounts of pretrained knowledge but struggle to remain aligned with real-world updates, making it difficult to avoid capability degradation when acquiring evolving knowledge. Furthermore, most…

Computation and Language · Computer Science 2026-02-27 Kailin Jiang , Yuntao Du , Yukai Ding , Yuchen Ren , Ning Jiang , Zhi Gao , Zilong Zheng , Lei Liu , Bin Li , Qing Li

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang

Knowledge Editing is a technique that updates large language models (LLMs) with new information to maintain their world knowledge. This approach avoids the need to rebuild the model from scratch, thereby addressing the high costs associated…

Computation and Language · Computer Science 2025-09-09 Changyue Wang , Weihang Su , Qingyao Ai , Yichen Tang , Yiqun Liu

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world…

Computation and Language · Computer Science 2024-04-23 Hao Peng , Xiaozhi Wang , Chunyang Li , Kaisheng Zeng , Jiangshan Duo , Yixin Cao , Lei Hou , Juanzi Li

Enabling artificial intelligence systems, particularly large language models, to integrate new knowledge and flexibly apply it during reasoning remains a central challenge. Existing knowledge editing approaches emphasize atomic facts,…

Artificial Intelligence · Computer Science 2026-02-03 Ya Gao , Kalle Kujanpää , Pekka Marttinen , Harri Valpola , Alexander Ilin

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Large Language Models (LLMs) require continuous updates to maintain accurate and current knowledge as the world evolves. While existing knowledge editing approaches offer various solutions for knowledge updating, they often struggle with…

Artificial Intelligence · Computer Science 2025-06-17 Zichuan Fu , Xian Wu , Guojing Li , Yingying Zhang , Yefeng Zheng , Tianshi Ming , Yejing Wang , Wanyu Wang , Xiangyu Zhao

Large language models (LLMs) are pivotal in advancing natural language processing (NLP) tasks, yet their efficacy is hampered by inaccuracies and outdated knowledge. Model editing emerges as a promising solution to address these challenges.…

Computation and Language · Computer Science 2024-02-22 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

Knowledge editing (KE) aims to efficiently and precisely modify the behavior of large language models (LLMs) to update specific knowledge without negatively influencing other knowledge. Current research primarily focuses on white-box LLMs…

Computation and Language · Computer Science 2024-02-20 Xiaoshuai Song , Zhengyang Wang , Keqing He , Guanting Dong , Yutao Mou , Jinxu Zhao , Weiran Xu

Large language models (LLMs) encode vast amounts of pre-trained knowledge in their parameters, but updating them as real-world information evolves remains a challenge. Existing methodologies and benchmarks primarily target entity…

Computation and Language · Computer Science 2025-04-18 Aochong Oliver Li , Tanya Goyal

As Large Langue Models have been shown to memorize real-world facts, the need to update this knowledge in a controlled and efficient manner arises. Designed with these constraints in mind, Knowledge Editing (KE) approaches propose to alter…

Artificial Intelligence · Computer Science 2025-07-30 Marco Scialanga , Thibault Laugel , Vincent Grari , Marcin Detyniecki

The rapid development of social platforms exacerbates the dissemination of misinformation, which stimulates the research in fact verification. Recent studies tend to leverage semantic features to solve this problem as a single-hop task.…

Computation and Language · Computer Science 2025-03-12 Han Cao , Lingwei Wei , Wei Zhou , Songlin Hu

Model editing aims to efficiently alter the behavior of Large Language Models (LLMs) within a desired scope, while ensuring no adverse impact on other inputs. Recent years have witnessed various model editing methods been proposed. However,…

Computation and Language · Computer Science 2024-06-04 Renzhi Wang , Piji Li

The storage and recall of factual associations in auto-regressive transformer language models (LMs) have drawn a great deal of attention, inspiring knowledge editing by directly modifying the located model weights. Most editing works…

Computation and Language · Computer Science 2025-02-28 Xiyu Liu , Zhengxiao Liu , Naibin Gu , Zheng Lin , Wanli Ma , Ji Xiang , Weiping Wang

Knowledge editing techniques, aiming to efficiently modify a minor proportion of knowledge in large language models (LLMs) without negatively impacting performance across other inputs, have garnered widespread attention. However, existing…

Computation and Language · Computer Science 2024-06-06 Yuxin Jiang , Yufei Wang , Chuhan Wu , Wanjun Zhong , Xingshan Zeng , Jiahui Gao , Liangyou Li , Xin Jiang , Lifeng Shang , Ruiming Tang , Qun Liu , Wei Wang