English
Related papers

Related papers: Context-Robust Knowledge Editing for Language Mode…

200 papers

Current approaches of knowledge editing struggle to effectively propagate updates to interconnected facts. In this work, we delve into the barriers that hinder the appropriate propagation of updated knowledge within these models for…

Computation and Language · Computer Science 2024-02-01 Wenyue Hua , Jiang Guo , Mingwen Dong , Henghui Zhu , Patrick Ng , Zhiguo Wang

Knowledge editing enables multimodal large language models (MLLMs) to efficiently update outdated or incorrect information. However, existing benchmarks primarily emphasize cognitive-level modifications while lacking a focus on deeper…

Artificial Intelligence · Computer Science 2025-09-09 Zhaoyu Fan , Kaihang Pan , Mingze Zhou , Bosheng Qin , Juncheng Li , Shengyu Zhang , Wenqiao Zhang , Siliang Tang , Fei Wu , Yueting Zhuang

Large Language Models (LLMs) have shown proficiency in question-answering tasks but often struggle to integrate real-time knowledge, leading to potentially outdated or inaccurate responses. This problem becomes even more challenging when…

Computation and Language · Computer Science 2024-08-15 Yucheng Shi , Qiaoyu Tan , Xuansheng Wu , Shaochen Zhong , Kaixiong Zhou , Ninghao Liu

Language models can use verifiable rewards to improve at a wide variety of reasoning tasks. However, both parametric (e.g. RLVR) and non-parametric (e.g. prompt optimization) approaches to doing so typically require hundreds of training…

Artificial Intelligence · Computer Science 2026-05-28 Linas Nasvytis , Simon Jerome Han , Ben Prystawski , Satchel Grant , Noah D. Goodman , Judith E. Fan

We describe a modern deep learning system that automatically identifies informative contextual examples (\qu{contexts}) for first language vocabulary instruction for high school student. Our paper compares three modeling approaches: (i) an…

Computation and Language · Computer Science 2026-02-23 Tao Wu , Adam Kapelner

While Knowledge Editing (KE) enables efficient updates, its dominant Static Fact Overwriting paradigm treats LLMs as discrete databases, forcibly injecting isolated facts. Fracturing pre-trained logical topologies, this triggers Epistemic…

Artificial Intelligence · Computer Science 2026-05-28 Shuaike Li , Kai Zhang , Xianquan Wang , Jiachen Liu , Shengpeng Mo

To answer a question, language models often need to integrate prior knowledge learned during pretraining and new information presented in context. We hypothesize that models perform this integration in a predictable way across different…

Computation and Language · Computer Science 2024-06-18 Kevin Du , Vésteinn Snæbjarnarson , Niklas Stoehr , Jennifer C. White , Aaron Schein , Ryan Cotterell

Retrieval-augmented generation (RAG) improves performance on knowledge-intensive tasks but can be derailed by wrong, irrelevant, or conflicting retrieved text, causing models to rely on inaccurate evidence and cascade errors. We propose…

Computation and Language · Computer Science 2026-02-26 Chenyu Lin , Yilin Wen , Du Su , Hexiang Tan , Fei Sun , Muhan Chen , Chenfu Bao , Zhonghou Lyu

Most studies on word-level Quality Estimation (QE) of machine translation focus on language-specific models. The obvious disadvantages of these approaches are the need for labelled data for each language pair and the high cost required to…

Computation and Language · Computer Science 2021-06-02 Tharindu Ranasinghe , Constantin Orasan , Ruslan Mitkov

Knowledge editing aims to efficiently modify the internal knowledge of large language models (LLMs) without compromising their other capabilities. The prevailing editing paradigm, which appends an update matrix to the original parameter…

Machine Learning · Computer Science 2026-01-14 Hao-Xiang Xu , Jun-Yu Ma , Ziqi Peng , Yuhao Sun , Zhen-Hua Ling , Jia-Chen Gu

This paper introduces the Contextual Evaluation Model (CEM), a novel method for knowledge representation and manipulation. The CEM differs from existing models in that it integrates facts, patterns and sequences into a single contextual…

Artificial Intelligence · Computer Science 2019-06-10 Victor E Hansen

Model editing aims to efficiently alter the behavior of Large Language Models (LLMs) within a desired scope, while ensuring no adverse impact on other inputs. Recent years have witnessed various model editing methods been proposed. However,…

Computation and Language · Computer Science 2024-06-04 Renzhi Wang , Piji Li

The operational efficacy of large language models relies heavily on their inference-time context. This has established Context Engineering (CE) as a formal discipline for optimizing these inputs. Current CE methods rely on manually crafted…

Artificial Intelligence · Computer Science 2026-02-12 Haoran Ye , Xuning He , Vincent Arak , Haonan Dong , Guojie Song

Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm for improving the timeliness of knowledge updates and the factual accuracy of large language models. However, incorporating a large volume of retrieved documents…

Computation and Language · Computer Science 2026-05-29 Ziqiang Cui , Yunpeng Weng , Xing Tang , Peiyang Liu , Shiwei Li , Bowei He , Jiamin Chen , Yansen Zhang , Xiuqiang He , Chen Ma

Modern emotion recognition systems are trained to recognize only a small set of emotions, and hence fail to capture the broad spectrum of emotions people experience and express in daily life. In order to engage in more empathetic…

Computation and Language · Computer Science 2021-08-03 Varsha Suresh , Desmond C. Ong

Recently, knowledge-enhanced methods leveraging auxiliary knowledge graphs have emerged in relation extraction, surpassing traditional text-based approaches. However, to our best knowledge, there is currently no public dataset available…

Machine Learning · Computer Science 2023-04-26 Yucong Lin , Hongming Xiao , Jiani Liu , Zichao Lin , Keming Lu , Feifei Wang , Wei Wei

Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others. Obtaining text representations or embeddings using these…

Computation and Language · Computer Science 2021-08-30 Richard Plant , Dimitra Gkatzia , Valerio Giuffrida

Retrieval-Augmented Generation (RAG) has become an essential approach for extending the reasoning and knowledge capacity of large language models (LLMs). While prior research has primarily focused on retrieval quality and prompting…

Computation and Language · Computer Science 2025-12-09 Jiamin Chen , Yuchen Li , Xinyu Ma , Xinran Chen , Xiaokun Zhang , Shuaiqiang Wang , Chen Ma , Dawei Yin

Context-aware processing mechanisms have increasingly become a critical area of exploration for improving the semantic and contextual capabilities of language generation models. The Context-Aware Semantic Recomposition Mechanism (CASRM) was…

Computation and Language · Computer Science 2025-03-27 Richard Katrix , Quentin Carroway , Rowan Hawkesbury , Matthias Heathfield

Text matching is the task of matching two texts and determining the relationship between them, which has extensive applications in natural language processing tasks such as reading comprehension, and Question-Answering systems. The…

Computation and Language · Computer Science 2023-08-14 Kexin Jiang , Yahui Zhao , Guozhe Jin , Zhenguo Zhang , Rongyi Cui