English
Related papers

Related papers: olmOCR 2: Unit Test Rewards for Document OCR

200 papers

PDF documents have the potential to provide trillions of novel, high-quality tokens for training language models. However, these documents come in a diversity of types with differing formats and visual layouts that pose a challenge when…

We present \textbf{LightOnOCR-2-1B}, a 1B-parameter end-to-end multilingual vision--language model that converts document images (e.g., PDFs) into clean, naturally ordered text without brittle OCR pipelines. Trained on a large-scale,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Said Taghadouini , Adrien Cavaillès , Baptiste Aubertin

Large Multimodal Models (LMMs) have recently shown strong performance on Optical Character Recognition (OCR) tasks, demonstrating their promising capability in document literacy. However, their effectiveness in real-world applications…

Computation and Language · Computer Science 2026-05-06 Zhipeng Xu , Junhao Ji , Zulong Chen , Zhenghao Liu , Qing Liu , Chunyi Peng , Zubao Qin , Ze Xu , Jianqiang Wan , Jun Tang , Zhibo Yang , Shuai Bai , Dayiheng Liu

Existing document OCR largely targets plain text or Markdown, discarding the structural and executable properties that make LaTeX essential for scientific publishing. We study page-level reconstruction of scientific PDFs into compilable…

Computation and Language · Computer Science 2026-04-28 Chengye Wang , Lin Fu , Zexi Kuang , Yilun Zhao

Scoring the Optical Character Recognition (OCR) capabilities of Large Multimodal Models (LMMs) has witnessed growing interest. Existing benchmarks have highlighted the impressive performance of LMMs in text recognition; however, their…

Reading text from images or scanned documents via OCR models has been a longstanding focus of researchers. Intuitively, text reading is perceived as a straightforward perceptual task, and existing work primarily focuses on constructing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yufeng Zhong , Lei Chen , Zhixiong Zeng , Xuanle Zhao , Deyang Jiang , Liming Zheng , Jing Huang , Haibo Qiu , Peng Shi , Siqi Yang , Lin Ma

Optical Character Recognition (OCR) systems have been widely used in various of application scenarios. Designing an OCR system is still a challenging task. In previous work, we proposed a practical ultra lightweight OCR system (PP-OCR) to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Yuning Du , Chenxia Li , Ruoyu Guo , Cheng Cui , Weiwei Liu , Jun Zhou , Bin Lu , Yehua Yang , Qiwen Liu , Xiaoguang Hu , Dianhai Yu , Yanjun Ma

We present Multimodal OCR (MOCR), a document parsing paradigm that jointly parses text and graphics into unified textual representations. Unlike conventional OCR systems that focus on text recognition and leave graphical regions as cropped…

Retrieving accurate details from documents is a crucial task, especially when handling a combination of scanned images and native digital formats. This document presents a combined framework for text extraction that merges Optical Character…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Rasha Sinha , Rekha B S

Large Multimodal Models (LMMs) have demonstrated impressive performance in recognizing document images with natural language instructions. However, it remains unclear to what extent capabilities in literacy with rich structure and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Zhibo Yang , Jun Tang , Zhaohai Li , Pengfei Wang , Jianqiang Wan , Humen Zhong , Xuejing Liu , Mingkun Yang , Peng Wang , Shuai Bai , LianWen Jin , Junyang Lin

Vision-Language Models (VLMs) excel in diverse visual tasks but face challenges in document understanding, which requires fine-grained text processing. While typical visual tasks perform well with low-resolution inputs, reading-intensive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Mor Shpigel Nacson , Aviad Aberdam , Roy Ganz , Elad Ben Avraham , Alona Golts , Yair Kittenplon , Shai Mazor , Ron Litman

Document parsing is a core task in document intelligence, supporting applications such as information extraction, retrieval-augmented generation, and automated document analysis. However, real-world documents often feature complex layouts…

We present FireRed-OCR, a systematic framework to specialize general VLMs into high-performance OCR models. Large Vision-Language Models (VLMs) have demonstrated impressive general capabilities but frequently suffer from ``structural…

Text is ubiquitous in our visual world, conveying crucial information, such as in documents, websites, and everyday photographs. In this work, we propose UReader, a first exploration of universal OCR-free visually-situated language…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Jiabo Ye , Anwen Hu , Haiyang Xu , Qinghao Ye , Ming Yan , Guohai Xu , Chenliang Li , Junfeng Tian , Qi Qian , Ji Zhang , Qin Jin , Liang He , Xin Alex Lin , Fei Huang

GLM-OCR is an efficient 0.9B-parameter compact multimodal model designed for real-world document understanding. It combines a 0.4B-parameter CogViT visual encoder with a 0.5B-parameter GLM language decoder, achieving a strong balance…

The advent of "OCR 2.0" and large-scale vision-language models (VLMs) has set new benchmarks in text recognition. However, these unified architectures often come with significant computational demands, challenges in precise text…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Cheng Cui , Yubo Zhang , Ting Sun , Xueqing Wang , Hongen Liu , Manhui Lin , Yue Zhang , Tingquan Gao , Changda Zhou , Jiaxuan Liu , Zelun Zhang , Jing Zhang , Jun Zhang , Yi Liu

The development of large vision language models drives the demand for managing, and applying massive amounts of multimodal data, making OCR technology, which extracts information from visual images, increasingly popular. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yufeng Zhong , Lei Chen , Xuanle Zhao , Wenkang Han , Liming Zheng , Jing Huang , Deyang Jiang , Yilin Cao , Lin Ma , Zhixiong Zeng

Large Language Models (LLMs) have achieved remarkable success on reasoning benchmarks through Reinforcement Learning with Verifiable Rewards (RLVR), excelling at tasks such as math, coding, logic, and puzzles. However, existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-12 Xiaozhe Li , Xinyu Fang , Shengyuan Ding , Yang Li , Linyang Li , Haodong Duan , Qingwen Liu , Kai Chen

Information extraction from copy-heavy documents, characterized by massive volumes of structurally similar content, represents a critical yet understudied challenge in enterprise document processing. We present a systematic framework that…

Computation and Language · Computer Science 2025-10-14 Zilong Wang , Xiaoyu Shen

This paper presents a specialized methodology for digitizing and segmenting mathematical documents from zbMATH Open, a comprehensive database of mathematical literature, to enhance machine processing capabilities. Currently, approximately…

Digital Libraries · Computer Science 2026-04-02 Ivan Pluzhnikov , Ankit Satpute , Moritz Schubotz , Olaf Teschke , Bela Gipp
‹ Prev 1 2 3 10 Next ›