English
Related papers

Related papers: Evaluating the Ripple Effects of Knowledge Editing…

200 papers

Training large language models (LLMs) from scratch is an expensive endeavor, particularly as world knowledge continually evolves. To maintain relevance and accuracy of LLMs, model editing has emerged as a pivotal research area. While these…

Computation and Language · Computer Science 2024-09-30 Tsung-Hsuan Pan , Chung-Chi Chen , Hen-Hsen Huang , Hsin-Hsi Chen

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge triplets. However, natural knowledge updates in the real world…

Computation and Language · Computer Science 2024-04-23 Hao Peng , Xiaozhi Wang , Chunyang Li , Kaisheng Zeng , Jiangshan Duo , Yixin Cao , Lei Hou , Juanzi Li

Neural language models (LMs) have been extensively trained on vast corpora to store factual knowledge about various aspects of the world described in texts. Current technologies typically employ knowledge editing methods or specific prompts…

Computation and Language · Computer Science 2024-05-14 Yuchen Cai , Ding Cao , Rongxi Guo , Yaqin Wen , Guiquan Liu , Enhong Chen

Large language models (LLMs) face challenges with internal knowledge inaccuracies and outdated information. Knowledge editing has emerged as a pivotal approach to mitigate these issues. Although current knowledge editing techniques exhibit…

Computation and Language · Computer Science 2024-08-23 Mengqi Zhang , Bowen Fang , Qiang Liu , Pengjie Ren , Shu Wu , Zhumin Chen , Liang Wang

Automatic multi-hop fact verification task has gained significant attention in recent years. Despite impressive results, these well-designed models perform poorly on out-of-domain data. One possible solution is to augment the training data…

Computation and Language · Computer Science 2023-10-24 Yingjie Zhu , Jiasheng Si , Yibo Zhao , Haiyang Zhu , Deyu Zhou , Yulan He

Data distortion is commonly applied in vision models during both training (e.g methods like MixUp and CutMix) and evaluation (e.g. shape-texture bias and robustness). This data modification can introduce artificial information. It is often…

Machine Learning · Computer Science 2022-07-07 Antonia Marcu , Adam Prügel-Bennett

Although model editing has shown promise in revising knowledge in Large Language Models (LLMs), its impact on the inherent capabilities of LLMs is often overlooked. In this work, we reveal a critical phenomenon: even a single edit can…

Artificial Intelligence · Computer Science 2024-06-06 Wanli Yang , Fei Sun , Xinyu Ma , Xun Liu , Dawei Yin , Xueqi Cheng

Recent advances in multimodal language models (MLLMs) have made thinking with images a dominant paradigm for multimodal reasoning. However, existing methods still fail to ensure evidence-answer consistency, where correct answers must be…

Artificial Intelligence · Computer Science 2026-05-22 Tianrun Xu , Haoda Jing , Ye Li , Yuquan Wei , Jun Feng , Guanyu Chen , Haichuan Gao , Tianren Zhang , Feng Chen

Improvements in large language models have led to increasing optimism that they can serve as reliable evaluators of natural language generation outputs. In this paper, we challenge this optimism by thoroughly re-evaluating five…

Computation and Language · Computer Science 2025-01-31 Ameya Godbole , Robin Jia

As events progress, news articles often update with new information: if we are not cautious, we risk propagating outdated facts. In this work, we hypothesize that linguistic features indicate factual fluidity, and that we can predict which…

Computation and Language · Computer Science 2024-12-02 Alexander Spangher , Kung-Hsiang Huang , Hyundong Cho , Jonathan May

Due to language models' propensity to generate toxic or hateful responses, several techniques were developed to align model generations with users' preferences. Despite the effectiveness of such methods in improving the safety of model…

Computation and Language · Computer Science 2023-09-06 Daniel Scalena , Gabriele Sarti , Malvina Nissim , Elisabetta Fersini

Model editing has emerged as a cost-effective strategy to update knowledge stored in language models. However, model editing can have unintended consequences after edits are applied: information unrelated to the edits can also be changed,…

Computation and Language · Computer Science 2024-10-07 Karina Halevy , Anna Sotnikova , Badr AlKhamissi , Syrielle Montariol , Antoine Bosselut

Knowledge editing has become a promising approach for efficiently and precisely updating knowledge embedded in large language models (LLMs). In this work, we focus on Same-Subject Editing, which involves modifying multiple attributes of a…

Computation and Language · Computer Science 2025-02-12 Zenghao Duan , Wenbin Duan , Zhiyi Yin , Yinghan Shen , Shaoling Jing , Jie Zhang , Huawei Shen , Xueqi Cheng

Large language models store not only isolated facts but also rules that support reasoning across symbolic expressions, natural language explanations, and concrete instances. Yet most model editing methods are built for fact-level knowledge,…

Computation and Language · Computer Science 2026-04-10 Yating Wang , Wenting Zhao , Yaqi Zhao , Yongshun Gong , Yilong Yin , Haoliang Sun

Model editing aims to enhance the accuracy and reliability of large language models (LLMs) by efficiently adjusting their internal parameters. Currently, most LLM editing datasets are confined to narrow knowledge domains and cover a limited…

Computation and Language · Computer Science 2025-11-12 Qizhou Chen , Dakan Wang , Taolin Zhang , Zaoming Yan , Chengsong You , Chengyu Wang , Xiaofeng He

Large Language Models (LLMs) have shown proficiency in question-answering tasks but often struggle to integrate real-time knowledge, leading to potentially outdated or inaccurate responses. This problem becomes even more challenging when…

Computation and Language · Computer Science 2024-08-15 Yucheng Shi , Qiaoyu Tan , Xuansheng Wu , Shaochen Zhong , Kaixiong Zhou , Ninghao Liu

Prior research demonstrates that performance of language models on reasoning tasks can be influenced by suggestions, hints and endorsements. However, the influence of endorsement source credibility remains underexplored. We investigate…

Computation and Language · Computer Science 2026-05-28 Priyanka Mary Mammen , Emil Joswin , Shankar Venkitachalam

Large language models (LLMs) embed extensive knowledge and utilize it to perform exceptionally well across various tasks. Nevertheless, outdated knowledge or factual errors within LLMs can lead to misleading or incorrect responses, causing…

Computation and Language · Computer Science 2024-10-21 Li Zeng , Yingyu Shan , Zeming Liu , Jiashu Yao , Yuhang Guo

While Knowledge Editing (KE) enables efficient updates, its dominant Static Fact Overwriting paradigm treats LLMs as discrete databases, forcibly injecting isolated facts. Fracturing pre-trained logical topologies, this triggers Epistemic…

Artificial Intelligence · Computer Science 2026-05-28 Shuaike Li , Kai Zhang , Xianquan Wang , Jiachen Liu , Shengpeng Mo

The factuality of large language model (LLMs) tends to decay over time since events posterior to their training are "unknown" to them. One way to keep models up-to-date could be factual update: the task of inserting, replacing, or removing…

Computation and Language · Computer Science 2024-03-22 Hichem Ammar Khodja , Frédéric Béchet , Quentin Brabant , Alexis Nasr , Gwénolé Lecorvé