English

FABLE: Fine-grained Fact Anchoring for Unstructured Model Editing

Computation and Language 2026-04-15 v1

Abstract

Unstructured model editing aims to update models with real-world text, yet existing methods often memorize text holistically without reliable fine-grained fact access. To address this, we propose FABLE, a hierarchical framework that decouples fine-grained fact injection from holistic text generation. FABLE follows a two-stage, fact-first strategy: discrete facts are anchored in shallow layers, followed by minimal updates to deeper layers to produce coherent text. This decoupling resolves the mismatch between holistic recall and fine-grained fact access, reflecting the unidirectional Transformer flow in which surface-form generation amplifies rather than corrects underlying fact representations. We also introduce UnFine, a diagnostic benchmark with fine-grained question-answer pairs and fact-level metrics for systematic evaluation. Experiments show that FABLE substantially improves fine-grained question answering while maintaining state-of-the-art holistic editing performance. Our code is publicly available at https://github.com/caskcsg/FABLE.

Keywords

Cite

@article{arxiv.2604.12559,
  title  = {FABLE: Fine-grained Fact Anchoring for Unstructured Model Editing},
  author = {Peng Wang and Biyu Zhou and Xuehai Tang and Jizhong Han and Songlin Hu},
  journal= {arXiv preprint arXiv:2604.12559},
  year   = {2026}
}

Comments

ACL 2026 findings

R2 v1 2026-07-01T12:08:30.411Z