English
Related papers

Related papers: DeepEdit: Knowledge Editing as Decoding with Const…

200 papers

Pretrained Language Models (PLMs) store extensive knowledge within their weights, enabling them to recall vast amount of information. However, relying on this parametric knowledge brings some limitations such as outdated information or gaps…

Computation and Language · Computer Science 2024-06-18 Alessio Galatolo , Meriem Beloucif , Katie Winkle

Large language models (LLMs) have demonstrated remarkable capabilities, but they also pose risks related to the generation of toxic or harmful content. This work introduces Precision Knowledge Editing (PKE), an advanced technique that…

Computation and Language · Computer Science 2024-10-14 Xuying Li , Zhuo Li , Yuji Kosuga , Yasuhiro Yoshida , Victor Bian

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model…

Computation and Language · Computer Science 2024-10-30 Han Huang , Haitian Zhong , Tao Yu , Qiang Liu , Shu Wu , Liang Wang , Tieniu Tan

This paper investigates using knowledge editing techniques to detoxify Large Language Models (LLMs). We construct a benchmark, SafeEdit, which covers nine unsafe categories with various powerful attack prompts and equips comprehensive…

Computation and Language · Computer Science 2024-05-29 Mengru Wang , Ningyu Zhang , Ziwen Xu , Zekun Xi , Shumin Deng , Yunzhi Yao , Qishen Zhang , Linyi Yang , Jindong Wang , Huajun Chen

Understanding complex biomolecular mechanisms requires multi-step reasoning across molecular interactions, signaling cascades, and metabolic pathways. While large language models(LLMs) show promise in such tasks, their application to…

Artificial Intelligence · Computer Science 2025-11-12 Tianwen Lyu , Xiang Zhuang , Keyan Ding , Xinzhe Cao , Lei Liang , Wei Zhao , Qiang Zhang , Huajun Chen

Large vision-language models (LVLMs) have demonstrated remarkable capabilities by integrating pre-trained vision encoders with large language models (LLMs). Similar to single-modal LLMs, chain-of-thought (CoT) prompting has been adapted for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Shin'ya Yamaguchi , Kosuke Nishida , Daiki Chijiwa

Existing locate-then-edit Knowledge Editing (KE) methods typically decompose editing into two stages: upstream target representation optimization and downstream constrained parameter optimization. The optimization across the two stages is…

Computation and Language · Computer Science 2026-05-08 Shuxin Liu , Di Gao , Ou Wu

Equipped with Chain-of-Thought (CoT), Large language models (LLMs) have shown impressive reasoning ability in various downstream tasks. Even so, suffering from hallucinations and the inability to access external knowledge, LLMs often come…

Computation and Language · Computer Science 2023-10-31 Keheng Wang , Feiyu Duan , Sirui Wang , Peiguang Li , Yunsen Xian , Chuantao Yin , Wenge Rong , Zhang Xiong

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world…

Computation and Language · Computer Science 2024-04-23 Hao Peng , Xiaozhi Wang , Chunyang Li , Kaisheng Zeng , Jiangshan Duo , Yixin Cao , Lei Hou , Juanzi Li

Large Language Models (LLMs) have exhibited impressive proficiency in various natural language processing (NLP) tasks, which involve increasingly complex reasoning. Knowledge reasoning, a primary type of reasoning, aims at deriving new…

Computation and Language · Computer Science 2024-07-02 Yifei Zhang , Xintao Wang , Jiaqing Liang , Sirui Xia , Lida Chen , Yanghua Xiao

Knowledge Editing, which efficiently modifies the knowledge in large language models, has gathered great attention. Current benchmarks primarily use multi-hop question answering to assess and analyze newly injected or updated knowledge.…

Computation and Language · Computer Science 2025-06-04 Keyuan Cheng , Zijian Kan , Zhixian He , Zhuoran Zhang , Muhammad Asif Ali , Ke Xu , Lijie Hu , Di Wang

Knowledge Editing (KE) is a field that studies how to modify some knowledge in Large Language Models (LLMs) at a low cost (compared to pre-training). Currently, performing large-scale edits on LLMs while ensuring the Reliability,…

Artificial Intelligence · Computer Science 2026-03-24 Wentao Wan , Qiqing Lao , Zhiwei Xie , Hefeng Wu , Runnan Lin , Liang Lin , Keze Wang

Large multimodal language models (MLLMs) have revolutionized natural language processing and visual understanding, but often contain outdated or inaccurate information. Current multimodal knowledge editing evaluations are limited in scope…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Yaohui Ma , Xiaopeng Hong , Shizhou Zhang , Huiyun Li , Zhilin Zhu , Wei Luo , Zhiheng Ma

Adjusting the outdated knowledge of large language models (LLMs) after deployment remains a major challenge. This difficulty has spurred the development of knowledge editing, which seeks to accurately and efficiently modify a model's…

Computation and Language · Computer Science 2025-12-05 Pengfei Cao , Zeao Ji , Daojian Zeng , Jun Zhao , Kang Liu

Large language models (LLMs) acquire vast knowledge from large text corpora, but this information can become outdated or inaccurate. Since retraining is computationally expensive, knowledge editing offers an efficient alternative --…

Artificial Intelligence · Computer Science 2025-08-13 Amir Mohammad Salehoof , Ali Ramezani , Yadollah Yaghoobzadeh , Majid Nili Ahmadabadi

As real-world knowledge evolves, the information embedded within large language models (LLMs) can become outdated, inadequate, or erroneous. Model editing has emerged as a prominent approach for updating LLMs' knowledge with minimal…

Computation and Language · Computer Science 2025-03-10 Guoxiu He , Xin Song , Aixin Sun

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Model editing aims to enhance the accuracy and reliability of large language models (LLMs) by efficiently adjusting their internal parameters. Currently, most LLM editing datasets are confined to narrow knowledge domains and cover a limited…

Computation and Language · Computer Science 2025-11-12 Qizhou Chen , Dakan Wang , Taolin Zhang , Zaoming Yan , Chengsong You , Chengyu Wang , Xiaofeng He

Knowledge Editing (KE) has gained increasing attention, yet current KE tasks remain relatively simple. Under current evaluation frameworks, many editing methods achieve exceptionally high scores, sometimes nearing perfection. However, few…

Computation and Language · Computer Science 2025-06-03 Xinye Li , Zunwen Zheng , Qian Zhang , Dekai Zhuang , Jiabao Kang , Liyan Xu , Qingbin Liu , Xi Chen , Zhiying Tu , Dianhui Chu , Dianbo Sui

Knowledge Editing (KE) has emerged as a promising paradigm for updating facts in Large Language Models (LLMs) without retraining. However, progress in Multilingual Knowledge Editing (MKE) is currently hindered by biased evaluation…

Computation and Language · Computer Science 2026-01-27 Yucheng Hu , Wei Zhou , Juesi Xiao