English
Related papers

Related papers: Assessing Knowledge Editing in Language Models via…

200 papers

Large language models (LLMs) outperform information retrieval techniques for downstream knowledge-intensive tasks when being prompted to generate world knowledge. However, community concerns abound regarding the factuality and potential…

Computation and Language · Computer Science 2023-10-12 Liang Chen , Yang Deng , Yatao Bian , Zeyu Qin , Bingzhe Wu , Tat-Seng Chua , Kam-Fai Wong

Large language models (LLMs) excel at factual recall yet still propagate stale or incorrect knowledge. In-context knowledge editing offers a gradient-free remedy suitable for black-box APIs, but current editors rely on static demonstration…

Computation and Language · Computer Science 2025-10-28 Mahmud Wasif Nafee , Maiqi Jiang , Haipeng Chen , Yanfu Zhang

Large language models (LLMs) have played a pivotal role in building communicative AI, yet they encounter the challenge of efficient updates. Model editing enables the manipulation of specific knowledge memories and the behavior of language…

Computation and Language · Computer Science 2024-10-28 Xinbei Ma , Tianjie Ju , Jiyang Qiu , Zhuosheng Zhang , Hai Zhao , Lifeng Liu , Yulong Wang

Large Language Models store extensive factual knowledge acquired during large-scale pre-training. However, this knowledge is inherently static, reflecting only the state of the world at the time of training. Knowledge editing has emerged as…

Computation and Language · Computer Science 2025-10-14 Geunyeong Jeong , Juoh Sun , Seonghee Lee , Harksoo Kim

Knowledge representation and reasoning (KRR) systems represent knowledge as collections of facts and rules. Like databases, KRR systems contain information about domains of human activities like industrial enterprises, science, and…

Logic in Computer Science · Computer Science 2022-08-08 Yuheng Wang , Giorgian Borca-Tasciuc , Nikhil Goel , Paul Fodor , Michael Kifer

This paper introduces BMIKE-53, a comprehensive benchmark for cross-lingual in-context knowledge editing (IKE) across 53 languages, unifying three knowledge editing (KE) datasets: zsRE, CounterFact, and WikiFactDiff. Cross-lingual KE, which…

Computation and Language · Computer Science 2025-06-03 Ercong Nie , Bo Shao , Zifeng Ding , Mingyang Wang , Helmut Schmid , Hinrich Schütze

Recent progress in pretraining language models on large textual corpora led to a surge of improvements for downstream NLP tasks. Whilst learning linguistic knowledge, these models may also be storing relational knowledge present in the…

Computation and Language · Computer Science 2019-09-05 Fabio Petroni , Tim Rocktäschel , Patrick Lewis , Anton Bakhtin , Yuxiang Wu , Alexander H. Miller , Sebastian Riedel

Knowledge base question answering (KBQA) is a challenging task that aims to retrieve correct answers from large-scale knowledge bases. Existing attempts primarily focus on entity representation and final answer reasoning, which results in…

Computation and Language · Computer Science 2023-05-26 Yong Cao , Xianzhi Li , Huiwen Liu , Wen Dai , Shuai Chen , Bin Wang , Min Chen , Daniel Hershcovich

Factuality in Large Language Models (LLMs) is a persistent challenge. Current benchmarks often assess short factual answers, overlooking the critical ability to generate structured, multi-record tabular outputs from parametric knowledge. We…

Computation and Language · Computer Science 2025-05-28 Dario Satriani , Enzo Veltri , Donatello Santoro , Paolo Papotti

Large Language Models (LLMs) are increasingly explored as knowledge bases (KBs), yet current evaluation methods focus too narrowly on knowledge retention, overlooking other crucial criteria for reliable performance. In this work, we rethink…

Computation and Language · Computer Science 2024-12-17 Danna Zheng , Mirella Lapata , Jeff Z. Pan

Locating and editing knowledge in large language models (LLMs) is crucial for enhancing their accuracy, safety, and inference rationale. We introduce ``concept editing'', an innovative variation of knowledge editing that uncovers…

Computation and Language · Computer Science 2024-08-23 Nura Aljaafari , Danilo S. Carvalho , André Freitas

Knowledge-enhanced language models (KELMs) have emerged as promising tools to bridge the gap between large-scale language models and domain-specific knowledge. KELMs can achieve higher factual accuracy and mitigate hallucinations by…

Computation and Language · Computer Science 2024-11-26 Alexander Fichtl , Juraj Vladika , Georg Groh

Knowledge Bases (KBs) require constant up-dating to reflect changes to the world they represent. For general purpose KBs, this is often done through Relation Extraction (RE), the task of predicting KB relations expressed in text mentioning…

Computation and Language · Computer Science 2019-05-13 Peng Xu , Denilson Barbosa

Model editing aims to enhance the accuracy and reliability of large language models (LLMs) by efficiently adjusting their internal parameters. Currently, most LLM editing datasets are confined to narrow knowledge domains and cover a limited…

Computation and Language · Computer Science 2025-11-12 Qizhou Chen , Dakan Wang , Taolin Zhang , Zaoming Yan , Chengsong You , Chengyu Wang , Xiaofeng He

Automatic relationship extraction (RE) from biomedical literature is critical for managing the vast amount of scientific knowledge produced each year. In recent years, utilizing pre-trained language models (PLMs) has become the prevalent…

Computation and Language · Computer Science 2025-11-04 Mario Sänger , Ulf Leser

Knowledge graphs, a powerful tool for structuring information through relational triplets, have recently become the new front-runner in enhancing question-answering systems. While traditional Retrieval Augmented Generation (RAG) approaches…

Artificial Intelligence · Computer Science 2025-09-12 Vaibhav Chaudhary , Neha Soni , Narotam Singh , Amita Kapoor

The world has transitioned into a new phase of online learning in response to the recent Covid19 pandemic. Now more than ever, it has become paramount to push the limits of online learning in every manner to keep flourishing the education…

Machine Learning · Computer Science 2020-08-31 Shalini Pandey , Jaideep Srivastava

Large language models (LLMs) acquire knowledge across diverse domains such as science, history, and geography encountered during generative pre-training. However, due to their stochasticity, it is difficult to predict what LLMs have…

Computation and Language · Computer Science 2026-01-27 Kartik Sharma , Yiqiao Jin , Rakshit Trivedi , Srijan Kumar

Keeping large language models factually up-to-date is crucial for deployment, yet costly retraining remains a challenge. Knowledge editing offers a promising alternative, but methods are only tested on small-scale or synthetic edit…

Computation and Language · Computer Science 2025-09-23 Lukas Thede , Karsten Roth , Matthias Bethge , Zeynep Akata , Tom Hartvigsen

Model editing techniques are essential for efficiently updating knowledge in large language models (LLMs). However, the effectiveness of existing approaches degrades in massive editing scenarios, particularly when evaluated with practical…

Computation and Language · Computer Science 2026-02-25 Yanbo Dai , Zhenlan Ji , Zongjie Li , Shuai Wang