English

MMFCTUB: Multi-Modal Financial Credit Table Understanding Benchmark

Computational Engineering, Finance, and Science 2026-01-13 v2

Abstract

The advent of multi-modal language models (MLLMs) has spurred research into their application across various table understanding tasks. However, their performance in credit table understanding (CTU) for financial credit review remains largely unexplored due to the following barriers: low data consistency, high annotation costs stemming from domain-specific knowledge and complex calculations, and evaluation paradigm gaps between benchmark and real-world scenarios. To address these challenges, we introduce MMFCTUB (Multi-Modal Financial Credit Table Understanding Benchmark), a practical benchmark, encompassing more than 7,600 high quality CTU samples across 5 table types. MMFCTUB employ a minimally supervised pipeline that adheres to inter-table constraints and maintains data distributions consistency. The benchmark leverages capacity-driven questions and mask-and-recovery strategy to evaluate models' cross-table structure perception, domain knowledge utilization, and numerical calculation capabilities. Utilizing MMFCTUB, we conduct comprehensive evaluations of both proprietary and open-source MLLMs, revealing their strengths and limitations in CTU tasks. MMFCTUB serves as a valuable resource for the research community, facilitating rigorous evaluation of MLLMs in the domain of CTU.

Keywords

Cite

@article{arxiv.2601.04643,
  title  = {MMFCTUB: Multi-Modal Financial Credit Table Understanding Benchmark},
  author = {Cui Yakun and Yanting Zhang and Zhu Lei and Jian Xie and Zhizhuo Kou and Hang Du and Zhenghao Zhu and Sirui Han},
  journal= {arXiv preprint arXiv:2601.04643},
  year   = {2026}
}
R2 v1 2026-07-01T08:55:37.015Z