English

Large Language Models for Page Stream Segmentation

Computation and Language 2024-08-23 v1

Abstract

Page Stream Segmentation (PSS) is an essential prerequisite for automated document processing at scale. However, research progress has been limited by the absence of realistic public benchmarks. This paper works towards addressing this gap by introducing TABME++, an enhanced benchmark featuring commercial Optical Character Recognition (OCR) annotations. We evaluate the performance of large language models (LLMs) on PSS, focusing on decoder-based models fine-tuned with parameter-efficient methods. Our results show that decoder-based LLMs outperform smaller multimodal encoders. Through a review of existing PSS research and datasets, we identify key challenges and advancements in the field. Our findings highlight the key importance of robust OCR, providing valuable insights for the development of more effective document processing systems.

Keywords

Cite

@article{arxiv.2408.11981,
  title  = {Large Language Models for Page Stream Segmentation},
  author = {Hunter Heidenreich and Ratish Dalvi and Rohith Mukku and Nikhil Verma and Neven Pičuljan},
  journal= {arXiv preprint arXiv:2408.11981},
  year   = {2024}
}
R2 v1 2026-06-28T18:20:06.999Z