English
Related papers

Related papers: Mechanistic Circuit-Based Knowledge Editing in Lar…

200 papers

Efficient knowledge editing of large language models is crucial for replacing obsolete information or incorporating specialized knowledge on a large scale. However, previous methods implicitly assume that knowledge is localized and isolated…

Computation and Language · Computer Science 2024-02-21 Zihao Wei , Liang Pang , Hanxing Ding , Jingcheng Deng , Huawei Shen , Xueqi Cheng

Knowledge editing aims to rectify inaccuracies in large language models (LLMs) without costly retraining for outdated or erroneous knowledge. However, current knowledge editing methods primarily focus on single editing, failing to meet the…

Computation and Language · Computer Science 2024-06-06 Chenhui Hu , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Large language models (LLMs) often produce incorrect or outdated content after being employed. Efficient and accurate knowledge updates without costly retraining are a major challenge. This problem is particularly challenging in lifelong…

Artificial Intelligence · Computer Science 2026-04-17 Xuyuan Liu , Shengyu Chen , Xinshuai Dong , Yanchi Liu , Xujiang Zhao , Haoyu Wang , Yujun Yan , Haifeng Chen , Zhengzhang Chen

Knowledge Editing (KE) for modifying factual knowledge in Large Language Models (LLMs) has been receiving increasing attention. However, existing knowledge editing methods are entity-centric, and it is unclear whether this approach is…

Computation and Language · Computer Science 2023-11-16 Yifan Wei , Xiaoyan Yu , Huanhuan Ma , Fangyu Lei , Yixuan Weng , Ran Song , Kang Liu

Large language models (LLMs) are pivotal in advancing natural language processing (NLP) tasks, yet their efficacy is hampered by inaccuracies and outdated knowledge. Model editing emerges as a promising solution to address these challenges.…

Computation and Language · Computer Science 2024-02-22 Mengqi Zhang , Xiaotian Ye , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen

The remarkable capabilities of modern large language models are rooted in their vast repositories of knowledge encoded within their parameters, enabling them to perceive the world and engage in reasoning. The inner workings of how these…

Computation and Language · Computer Science 2025-01-06 Yunzhi Yao , Ningyu Zhang , Zekun Xi , Mengru Wang , Ziwen Xu , Shumin Deng , Huajun Chen

Large Language Models (LLMs) require continuous updates to maintain accurate and current knowledge as the world evolves. While existing knowledge editing approaches offer various solutions for knowledge updating, they often struggle with…

Artificial Intelligence · Computer Science 2025-06-17 Zichuan Fu , Xian Wu , Guojing Li , Yingying Zhang , Yefeng Zheng , Tianshi Ming , Yejing Wang , Wanyu Wang , Xiangyu Zhao

Knowledge editing techniques have emerged as essential tools for updating the factual knowledge of large language models (LLMs) and multimodal models (LMMs), allowing them to correct outdated or inaccurate information without retraining…

Computation and Language · Computer Science 2025-03-04 Yuntao Du , Kailin Jiang , Zhi Gao , Chenrui Shi , Zilong Zheng , Siyuan Qi , Qing Li

Knowledge editing is a technique for efficiently and accurately updating the knowledge of large language models (LLMs) to alleviate obsolescence and correct errors. However, most existing methods overfit to specific models, causing edited…

Artificial Intelligence · Computer Science 2025-03-05 Shuaike Li , Kai Zhang , Qi Liu , Enhong Chen

Knowledge editing techniques, aiming to efficiently modify a minor proportion of knowledge in large language models (LLMs) without negatively impacting performance across other inputs, have garnered widespread attention. However, existing…

Computation and Language · Computer Science 2024-06-06 Yuxin Jiang , Yufei Wang , Chuhan Wu , Wanjun Zhong , Xingshan Zeng , Jiahui Gao , Liangyou Li , Xin Jiang , Lifeng Shang , Ruiming Tang , Qun Liu , Wei Wang

Knowledge editing aims to change language models' performance on several special cases (i.e., editing scope) by infusing the corresponding expected knowledge into them. With the recent advancements in large language models (LLMs), knowledge…

Computation and Language · Computer Science 2024-05-31 Jiaan Wang , Yunlong Liang , Zengkui Sun , Yuxuan Cao , Jiarong Xu , Fandong Meng

Current knowledge editing methods for large language models (LLMs) struggle to maintain logical consistency when propagating ripple effects to associated facts. We propose ChainEdit, a framework that synergizes knowledge graph-derived…

Computation and Language · Computer Science 2025-07-14 Zilu Dong , Xiangqing Shen , Zinong Yang , Rui Xia

Knowledge editing aims to adjust the knowledge within large language models (LLMs) to prevent their responses from becoming obsolete or inaccurate. However, existing works on knowledge editing are primarily conducted in a single language,…

Computation and Language · Computer Science 2024-06-18 Jiakuan Xie , Pengfei Cao , Yuheng Chen , Yubo Chen , Kang Liu , Jun Zhao

Large language models (LLMs) frequently encode factual and reasoning knowledge in their internal representations that is not faithfully reflected in their surface-level outputs -- a phenomenon known as \emph{latent knowledge}. Existing…

Computation and Language · Computer Science 2026-05-29 Ji-jun Park , Soo-joon Choi , Jiwon Jeong , Taeyang Yoon , Ju-Wan Lee

Large Language Models (LLMs) have shown extraordinary capabilities in understanding and generating text that closely mirrors human communication. However, a primary limitation lies in the significant computational demands during training,…

Multilingual knowledge editing (MKE) aims to simultaneously update factual knowledge across multiple languages within large language models (LLMs). Previous research indicates that the same knowledge across different languages within LLMs…

Computation and Language · Computer Science 2024-12-18 Xue Zhang , Yunlong Liang , Fandong Meng , Songming Zhang , Yufeng Chen , Jinan Xu , Jie Zhou

Lifelong knowledge editing enables continuous, precise updates to outdated knowledge in large language models (LLMs) without computationally expensive full retraining. However, existing methods often accumulate errors throughout the editing…

Machine Learning · Computer Science 2025-10-28 Jinzhe Liu , Junshu Sun , Shufan Shen , Chenxue Yang , Shuhui Wang

Understanding complex biomolecular mechanisms requires multi-step reasoning across molecular interactions, signaling cascades, and metabolic pathways. While large language models(LLMs) show promise in such tasks, their application to…

Artificial Intelligence · Computer Science 2025-11-12 Tianwen Lyu , Xiang Zhuang , Keyan Ding , Xinzhe Cao , Lei Liang , Wei Zhao , Qiang Zhang , Huajun Chen

Large language models (LLMs) need knowledge updates to meet the ever-growing world facts and correct the hallucinated responses, facilitating the methods of lifelong model editing. Where the updated knowledge resides in memories is a…

Computation and Language · Computer Science 2024-12-20 Peng Wang , Zexi Li , Ningyu Zhang , Ziwen Xu , Yunzhi Yao , Yong Jiang , Pengjun Xie , Fei Huang , Huajun Chen

Recent advances in image editing models have shown remarkable progress. A common architectural design couples a multimodal large language model (MLLM) encoder with a diffusion decoder, as seen in systems such as Step1X-Edit and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Fukun Yin , Shiyu Liu , Yucheng Han , Zhibo Wang , Peng Xing , Rui Wang , Wei Cheng , Yingming Wang , Aojie Li , Zixin Yin , Pengtao Chen , Xiangyu Zhang , Daxin Jiang , Xianfang Zeng , Gang Yu