English

Link prediction Graph Neural Networks for structure recognition of Handwritten Mathematical Expressions

Computer Vision and Pattern Recognition 2025-11-05 v1 Computation and Language

Abstract

We propose a Graph Neural Network (GNN)-based approach for Handwritten Mathematical Expression (HME) recognition by modeling HMEs as graphs, where nodes represent symbols and edges capture spatial dependencies. A deep BLSTM network is used for symbol segmentation, recognition, and spatial relation classification, forming an initial primitive graph. A 2D-CFG parser then generates all possible spatial relations, while the GNN-based link prediction model refines the structure by removing unnecessary connections, ultimately forming the Symbol Label Graph. Experimental results demonstrate the effectiveness of our approach, showing promising performance in HME structure recognition.

Keywords

Cite

@article{arxiv.2511.02288,
  title  = {Link prediction Graph Neural Networks for structure recognition of Handwritten Mathematical Expressions},
  author = {Cuong Tuan Nguyen and Ngoc Tuan Nguyen and Triet Hoang Minh Dao and Huy Minh Nhat and Huy Truong Dinh},
  journal= {arXiv preprint arXiv:2511.02288},
  year   = {2025}
}

Comments

accepted for ICDAR2025-WML