English
Related papers

Related papers: ACE: Attribution-Controlled Knowledge Editing for …

200 papers

Chain-of-thought explanations are widely used to inspect the decision process of large language models (LLMs) and to evaluate the trustworthiness of model outputs, making them important for effective collaboration between LLMs and humans.…

Computation and Language · Computer Science 2025-07-16 Pedro Ferreira , Wilker Aziz , Ivan Titov

Recent advancements in long-context modeling have enhanced language models (LMs) for complex tasks across multiple NLP applications. Despite this progress, we find that these models struggle with multi-hop reasoning and exhibit decreased…

Computation and Language · Computer Science 2024-08-07 Yanyang Li , Shuo Liang , Michael R. Lyu , Liwei Wang

Multimodal Large Language Models (MLLMs) extend foundation models to real-world applications by integrating inputs such as text and vision. However, their broad knowledge capacity raises growing concerns about privacy leakage, toxicity…

Machine Learning · Computer Science 2025-11-11 Kunhao Li , Wenhao Li , Di Wu , Lei Yang , Jun Bai , Ju Jia , Jason Xue

Knowledge stored in large language models requires timely updates to reflect the dynamic nature of real-world information. To update the knowledge, most knowledge editing methods focus on the low layers, since recent probes into the…

Computation and Language · Computer Science 2024-12-25 Wenhang Shi , Yiren Chen , Shuqing Bian , Xinyi Zhang , Zhe Zhao , Pengfei Hu , Wei Lu , Xiaoyong Du

Knowledge extrapolation is the process of inferring novel information by combining and extending existing knowledge that is explicitly available. It is essential for solving complex questions in specialized domains where retrieving…

Computation and Language · Computer Science 2026-04-03 Jiashu He , Jinxuan Fan , Bowen Jiang , Ignacio Houine , Dan Roth , Alejandro Ribeiro

An important open question in the use of large language models for knowledge-intensive tasks is how to effectively integrate knowledge from three sources: the model's parametric memory, external structured knowledge, and external…

Computation and Language · Computer Science 2024-04-03 Xin Su , Tiep Le , Steven Bethard , Phillip Howard

Knowledge editing (KE) provides a scalable approach for updating factual knowledge in large language models without full retraining. While previous studies have demonstrated effectiveness in general domains and medical QA tasks, little…

Artificial Intelligence · Computer Science 2025-08-12 Shengtao Wen , Haodong Chen , Yadong Wang , Zhongying Pan , Xiang Chen , Yu Tian , Bo Qian , Dong Liang , Sheng-Jun Huang

While Knowledge Editing has been extensively studied in monolingual settings, it remains underexplored in multilingual contexts. This survey systematizes recent research on Multilingual Knowledge Editing (MKE), a growing subdomain of model…

Computation and Language · Computer Science 2025-11-04 Nadir Durrani , Basel Mousi , Fahim Dalvi

Pretrained Language Models (PLMs) store extensive knowledge within their weights, enabling them to recall vast amount of information. However, relying on this parametric knowledge brings some limitations such as outdated information or gaps…

Computation and Language · Computer Science 2024-06-18 Alessio Galatolo , Meriem Beloucif , Katie Winkle

The swift advancement in Multimodal LLMs (MLLMs) also presents significant challenges for effective knowledge editing. Current methods, including intrinsic knowledge editing and external knowledge resorting, each possess strengths and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kaihang Pan , Zhaoyu Fan , Juncheng Li , Qifan Yu , Hao Fei , Siliang Tang , Richang Hong , Hanwang Zhang , Qianru Sun

Previous studies have shown that large language models (LLMs) like GPTs store massive factual knowledge in their parameters. However, the stored knowledge could be false or out-dated. Traditional knowledge editing methods refine LLMs via…

Computation and Language · Computer Science 2023-05-23 Ce Zheng , Lei Li , Qingxiu Dong , Yuxuan Fan , Zhiyong Wu , Jingjing Xu , Baobao Chang

The paper presents two approaches submitted to the WMT 2025 Automated Translation Quality Evaluation Systems Task 3 - Quality Estimation (QE)-informed Segment-level Error Correction. While jointly training QE systems with Automatic…

Computation and Language · Computer Science 2025-11-19 Govardhan Padmanabhan

Large Language Models (LLMs) struggle with dynamic knowledge updates, especially when new information conflicts with deeply embedded facts. Such conflicting factual edits often lead to two critical issues: resistance to adopting the new…

Machine Learning · Computer Science 2025-08-12 Stanley Ngugi

Large language models (LLMs) struggle with hallucinations due to false or outdated knowledge. Given the high resource demands of retraining these models, there is an increasing focus on developing model editing. However, the general…

Computation and Language · Computer Science 2026-04-13 Hao-Xiang Xu , Jun-Yu Ma , Zhen-Hua Ling , Ningyu Zhang , Jia-Chen Gu

This work presents a novel approach to Automatic Post-Editing (APE) and Word-Level Quality Estimation (QE) using ensembles of specialized Neural Machine Translation (NMT) systems. Word-level features that have proven effective for QE are…

Computation and Language · Computer Science 2017-07-18 Chris Hokamp

Aligning large language models (LLMs) with human values has become increasingly important as their influence on human behavior and decision-making expands. However, existing steering-based alignment methods suffer from limited…

Machine Learning · Computer Science 2026-02-10 Yonghui Yang , Junwei Li , Jilong Liu , Yicheng He , Fengbin Zhu , Weibiao Huang , Le Wu , Richang Hong , Tat-Seng Chua

Knowledge editing (KE) methods offer an efficient way to modify knowledge in large language models. Current KE evaluations typically assess editing success by considering only the edited knowledge without any preceding contexts. In…

Computation and Language · Computer Science 2025-06-03 Haewon Park , Gyubin Choi , Minjun Kim , Yohan Jo

We reassess the Knowledge Neuron (KN) Thesis: an interpretation of the mechanism underlying the ability of large language models to recall facts from a training corpus. This nascent thesis proposes that facts are recalled from the training…

Computation and Language · Computer Science 2024-05-07 Jingcheng Niu , Andrew Liu , Zining Zhu , Gerald Penn

Large language models (LLMs) often retain outdated or incorrect information from pre-training, which undermines their reliability. While model editing methods have been developed to address such errors without full re-training, they…

Computation and Language · Computer Science 2025-02-25 Dahyun Jung , Jaehyung Seo , Jaewook Lee , Chanjun Park , Heuiseok Lim

Large language models (LLMs) store vast amounts of knowledge, which often requires updates to correct factual errors, incorporate newly acquired information, or adapt model behavior. Model editing methods have emerged as efficient solutions…

Computation and Language · Computer Science 2025-10-27 Fufang Wen , Shichang Zhang