English

MemEIC: A Step Toward Continual and Compositional Knowledge Editing

Machine Learning 2025-10-31 v1 Artificial Intelligence Computation and Language

Abstract

The dynamic nature of information necessitates continuously updating large vision-language models (LVLMs). While recent knowledge editing techniques hint at promising directions, they often focus on editing a single modality (vision or language) in isolation. This prevalent practice neglects the inherent multimodality of LVLMs and the continuous nature of knowledge updates, potentially leading to suboptimal editing outcomes when considering the interplay between modalities and the need for ongoing knowledge refinement. To address these limitations, we propose MemEIC, a novel method for Continual and Compositional Knowledge Editing (CCKE) in LVLMs. MemEIC enables compositional editing of both visual and textual knowledge sequentially. Our approach employs a hybrid external-internal editor featuring a dual external memory for cross-modal evidence retrieval and dual LoRA adapters that facilitate disentangled parameter updates for each modality. A key component is a brain-inspired knowledge connector, activated selectively for compositional reasoning, that integrates information across different modalities. Experiments demonstrate that MemEIC significantly improves performance on complex multimodal questions and effectively preserves prior edits, setting a new benchmark for CCKE in LVLMs.

Keywords

Cite

@article{arxiv.2510.25798,
  title  = {MemEIC: A Step Toward Continual and Compositional Knowledge Editing},
  author = {Jin Seong and Jiyun Park and Wencke Liermann and Hongseok Choi and Yoonji Nam and Hyun Kim and Soojong Lim and Namhoon Lee},
  journal= {arXiv preprint arXiv:2510.25798},
  year   = {2025}
}

Comments

NeurIPS 2025, 38 pages, 8 figures

R2 v1 2026-07-01T07:12:32.998Z