English

Symbol-Aware Reasoning with Masked Discrete Diffusion for Handwritten Mathematical Expression Recognition

Computer Vision and Pattern Recognition 2026-02-04 v1 Machine Learning

Abstract

Handwritten Mathematical Expression Recognition (HMER) requires reasoning over diverse symbols and 2D structural layouts, yet autoregressive models struggle with exposure bias and syntactic inconsistency. We present a discrete diffusion framework that reformulates HMER as iterative symbolic refinement instead of sequential generation. Through multi-step remasking, the proposal progressively refines both symbols and structural relations, removing causal dependencies and improving structural consistency. A symbol-aware tokenization and Random-Masking Mutual Learning further enhance syntactic alignment and robustness to handwriting diversity. On the MathWriting benchmark, the proposal achieves 5.56\% CER and 60.42\% EM, outperforming strong Transformer and commercial baselines. Consistent gains on CROHME 2014--2023 demonstrate that discrete diffusion provides a new paradigm for structure-aware visual recognition beyond generative modeling.

Keywords

Cite

@article{arxiv.2602.03370,
  title  = {Symbol-Aware Reasoning with Masked Discrete Diffusion for Handwritten Mathematical Expression Recognition},
  author = {Takaya Kawakatsu and Ryo Ishiyama},
  journal= {arXiv preprint arXiv:2602.03370},
  year   = {2026}
}
R2 v1 2026-07-01T09:33:54.819Z