English

A Hybrid Vision Transformer Approach for Mathematical Expression Recognition

Computer Vision and Pattern Recognition 2026-03-10 v1

Abstract

One of the crucial challenges taken in document analysis is mathematical expression recognition. Unlike text recognition which only focuses on one-dimensional structure images, mathematical expression recognition is a much more complicated problem because of its two-dimensional structure and different symbol size. In this paper, we propose using a Hybrid Vision Transformer (HVT) with 2D positional encoding as the encoder to extract the complex relationship between symbols from the image. A coverage attention decoder is used to better track attention's history to handle the under-parsing and over-parsing problems. We also showed the benefit of using the [CLS] token of ViT as the initial embedding of the decoder. Experiments performed on the IM2LATEX-100K dataset have shown the effectiveness of our method by achieving a BLEU score of 89.94 and outperforming current state-of-the-art methods.

Keywords

Cite

@article{arxiv.2603.07929,
  title  = {A Hybrid Vision Transformer Approach for Mathematical Expression Recognition},
  author = {Anh Duy Le and Van Linh Pham and Vinh Loi Ly and Nam Quan Nguyen and Huu Thang Nguyen and Tuan Anh Tran},
  journal= {arXiv preprint arXiv:2603.07929},
  year   = {2026}
}

Comments

Accepted as oral presentation at DICTA 2022

R2 v1 2026-07-01T11:09:36.798Z