English

Decoupling Skeleton and Flesh: Efficient Multimodal Table Reasoning with Disentangled Alignment and Structure-aware Guidance

Computer Vision and Pattern Recognition 2026-05-28 v2 Computation and Language

Abstract

Reasoning over table images remains challenging for Large Vision-Language Models (LVLMs) due to complex layouts and tightly coupled structure-content information. Existing solutions often depend on expensive supervised training, reinforcement learning, or external tools, limiting efficiency and scalability. This work addresses a key question: how to adapt LVLMs to table reasoning with minimal annotation and no external tools? Specifically, we first introduce DiSCo, a Disentangled Structure-Content alignment framework that explicitly separates structural abstraction from semantic grounding during multimodal alignment, efficiently adapting LVLMs to tables structures. Building on DiSCo, we further present Table-GLS, a Global-to-Local Structure-guided reasoning framework that performs table reasoning via structured exploration and evidence-grounded inference. Extensive experiments across diverse benchmarks demonstrate that our framework efficiently enhances LVLM's table understanding and reasoning capabilities, particularly generalizing to unseen table structures. Our data and code are available at https://github.com/AAAndy-Zhu/TableVLM.

Keywords

Cite

@article{arxiv.2602.03491,
  title  = {Decoupling Skeleton and Flesh: Efficient Multimodal Table Reasoning with Disentangled Alignment and Structure-aware Guidance},
  author = {Yingjie Zhu and Xuefeng Bai and Kehai Chen and Yang Xiang and Youcheng Pan and Xiaoqiang Zhou and Min Zhang},
  journal= {arXiv preprint arXiv:2602.03491},
  year   = {2026}
}

Comments

Accepted as a Spotlight Paper at ICML 2026

R2 v1 2026-07-01T09:34:06.216Z