English

Accelerating End-to-End PDF to Markdown Conversion Through Assisted Generation

Multimedia 2025-12-23 v1 Digital Libraries

Abstract

Converting data from machine-unreadable formats like PDFs into Markdown has the potential to enhance the accessibility of scientific research. Existing end-to-end decoder transformer models can transform screenshots of PDFs into Markdown, offering more flexibility than pipeline-based methods. Yet, decoding text token by token from scratch is inefficient, especially when dense text can be directly copied from the PDF. To address this challenge, this paper modifies Prompt Lookup Decoding (PLD) to extract candidate sequences directly from PDF files, leveraging the high n-gram overlap between PDFs and their Markdown equivalents. A new method, Copy Lookup Decoding (CLD), is introduced here to enhance PLD's candidate generation mechanism. Experiments demonstrate that CLD can accelerate the conversion process by up to 1.70×\times at original quality. The codebase for this paper is open-source on GitHub (https://github.com/Fireblossom/CopyLookup).

Keywords

Cite

@article{arxiv.2512.18122,
  title  = {Accelerating End-to-End PDF to Markdown Conversion Through Assisted Generation},
  author = {Changxu Duan},
  journal= {arXiv preprint arXiv:2512.18122},
  year   = {2025}
}

Comments

Accepted NLDB 2025

R2 v1 2026-07-01T08:34:28.995Z