English

DocTron-Formula: Generalized Formula Recognition in Complex and Structured Scenarios

Computer Vision and Pattern Recognition 2025-08-04 v1

Abstract

Optical Character Recognition (OCR) for mathematical formula is essential for the intelligent analysis of scientific literature. However, both task-specific and general vision-language models often struggle to handle the structural diversity, complexity, and real-world variability inherent in mathematical content. In this work, we present DocTron-Formula, a unified framework built upon general vision-language models, thereby eliminating the need for specialized architectures. Furthermore, we introduce CSFormula, a large-scale and challenging dataset that encompasses multidisciplinary and structurally complex formulas at the line, paragraph, and page levels. Through straightforward supervised fine-tuning, our approach achieves state-of-the-art performance across a variety of styles, scientific domains, and complex layouts. Experimental results demonstrate that our method not only surpasses specialized models in terms of accuracy and robustness, but also establishes a new paradigm for the automated understanding of complex scientific documents.

Keywords

Cite

@article{arxiv.2508.00311,
  title  = {DocTron-Formula: Generalized Formula Recognition in Complex and Structured Scenarios},
  author = {Yufeng Zhong and Zhixiong Zeng and Lei Chen and Longrong Yang and Liming Zheng and Jing Huang and Siqi Yang and Lin Ma},
  journal= {arXiv preprint arXiv:2508.00311},
  year   = {2025}
}
R2 v1 2026-07-01T04:28:52.139Z