English
Related papers

Related papers: EvoEdit: Evolving Null-space Alignment for Robust …

200 papers

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world…

Computation and Language · Computer Science 2024-04-23 Hao Peng , Xiaozhi Wang , Chunyang Li , Kaisheng Zeng , Jiangshan Duo , Yixin Cao , Lei Hou , Juanzi Li

Knowledge editing technology is crucial for maintaining the accuracy and timeliness of large language models (LLMs) . However, the setting of this task overlooks a significant portion of commonsense knowledge based on free-text in the real…

Computation and Language · Computer Science 2024-11-01 Xiusheng Huang , Yequan Wang , Jun Zhao , Kang Liu

Large language models (LLMs) risk retaining sensitive, copyrighted, or harmful information from their training data. Entity-level unlearning addresses this issue by removing all knowledge of a specific entity while preserving the model's…

Computation and Language · Computer Science 2026-01-15 Xiaoqi Han , Víctor Gutiérrez-Basulto , Ru Li , Xiaoli Li , Jiye Liang , Jeff Z. Pan

Knowledge editing has emerged as an efficient approach for updating factual knowledge in large language models (LLMs). It typically locates knowledge storage modules and then modifies their parameters. However, most existing methods focus…

Computation and Language · Computer Science 2025-11-03 Jiahao Liu , Zijian Wang , Kuo Zhao , Dong Hu

While Unified Vision-Language Models promise to synergistically combine the high-level semantic understanding of vision-language models with the generative fidelity of diffusion models, current editing methodologies remain fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Chengyu Bai , Jintao Chen , Xiang Bai , Yilong Chen , Qi She , Ming Lu , Shanghang Zhang

Sequential editing of structured knowledge in large language models allows targeted factual updates without retraining, yet existing methods often rely on complex regularization or constraint mechanisms whose necessity remains unclear. In…

Computation and Language · Computer Science 2026-05-27 Zheng Wang , Kaixuan Zhang , Wanfang Chen , Jingwen Zhang , Xiaonan Lu

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang

Knowledge editing allows for efficient adaptation of large language models (LLMs) to new information or corrections without requiring full retraining. However, prior methods typically focus on either single-language editing or basic…

Computation and Language · Computer Science 2025-05-26 Yuchen Wu , Liang Ding , Li Shen , Dacheng Tao

Knowledge Editing (KE) aims to correct and update factual information in Large Language Models (LLMs) to ensure accuracy and relevance without computationally expensive fine-tuning. Though it has been proven effective in several domains,…

Computation and Language · Computer Science 2024-10-21 Ching Ming Samuel Lau , Weiqi Wang , Haochen Shi , Baixuan Xu , Jiaxin Bai , Yangqiu Song

Despite the ability to train capable LLMs, the methodology for maintaining their relevancy and rectifying errors remains elusive. To this end, the past few years have witnessed a surge in techniques for editing LLMs, the objective of which…

Computation and Language · Computer Science 2023-12-01 Yunzhi Yao , Peng Wang , Bozhong Tian , Siyuan Cheng , Zhoubo Li , Shumin Deng , Huajun Chen , Ningyu Zhang

Object hallucination in Large Vision-Language Models (LVLMs) significantly hinders their reliable deployment. Existing methods struggle to balance efficiency and accuracy: they often require expensive reference models and multiple forward…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yangguang Lin , Quan Fang , Yufei Li , Jiachen Sun , Junyu Gao , Jitao Sang

Instruction-based text editing is increasingly critical for real-world applications such as code editors (e.g., Cursor), but Large Language Models (LLMs) continue to struggle with this task. Unlike free-form generation, editing requires…

Computation and Language · Computer Science 2025-12-16 Yiming Zeng , Jinghan Cao , Zexin Li , Wanhao Yu , Zhankai Ye , Dawei Xiang , Ting Hua , Xin Liu , Shangqian Gao , Tingting Yu

Instruction-based image editing aims to modify source content according to textual instructions. However, existing methods built upon flow matching often struggle to maintain consistency in non-edited regions due to denoising-induced…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zongqing Li , Zhihui Liu , Yujie Xie , Shansiyuan Wu , Hongshen Lv , Songzhi Su

Lifelong Model Editing aims to continuously update evolving facts in Large Language Models while preserving unrelated knowledge and general capabilities, yet it remains plagued by catastrophic forgetting and model collapse. Empirically, we…

Machine Learning · Computer Science 2026-05-13 Xin Ma , Wei Chen , Qi Liu , Derong Xu , Zhi Zheng , Tong Xu , Enhong Chen

Knowledge editing aims to modify outdated knowledge in language models efficiently while retaining their original capabilities. Mainstream datasets for knowledge editing are predominantly static and fail to keep in pace with the evolving…

Computation and Language · Computer Science 2026-04-24 Chenming Tang , Yutong Yang , Kexue Wang , Yunfang Wu

Sequential knowledge editing in large language models often causes catastrophic collapse of the model's general abilities, especially for parameter-modifying methods. Existing approaches mitigate this issue through heuristic constraints on…

Computation and Language · Computer Science 2026-05-12 Chi Zhang , Mengqi Zhang , Xiaotian Ye , Runxi Cheng , Zisheng Zhou , Ying Zhou , Pengjie Ren , Zhumin Chen

The high computational costs of large language models (LLMs) have led to a flurry of research on LLM compression, via methods such as quantization, sparsification, or structured pruning. A new frontier in this area is given by dynamic,…

Machine Learning · Computer Science 2025-07-02 Oliver Sieberling , Denis Kuznedelev , Eldar Kurtic , Dan Alistarh

While LLM-based agents have shown promise for deep research, most existing approaches rely on fixed workflows that struggle to adapt to real-world, open-ended queries. Recent work therefore explores self-evolution by allowing agents to…

Artificial Intelligence · Computer Science 2026-02-05 Shuo Zhang , Chaofa Yuan , Ryan Guo , Xiaomin Yu , Rui Xu , Zhangquan Chen , Zinuo Li , Zhi Yang , Shuhao Guan , Zhenheng Tang , Sen Hu , Liwen Zhang , Ronghao Chen , Huacan Wang

Ontologies and knowledge graphs require continuous evolution to remain comprehensive and accurate, but manual curation is labor intensive. Large Language Models (LLMs) possess vast unstructured knowledge but struggle with maintaining…

Artificial Intelligence · Computer Science 2025-07-30 Vishal Raman , Vijai Aravindh R

Knowledge editing is a rising technique for efficiently updating factual knowledge in large language models (LLMs) with minimal alteration of parameters. However, recent studies have identified side effects, such as knowledge distortion and…

Computation and Language · Computer Science 2024-10-28 Cheng-Hsun Hsueh , Paul Kuo-Ming Huang , Tzu-Han Lin , Che-Wei Liao , Hung-Chieh Fang , Chao-Wei Huang , Yun-Nung Chen