English
Related papers

Related papers: GutenOCR: A Grounded Vision-Language Front-End for…

200 papers

Recent work has shown that Vision-Language Models (VLMs) used for optical character recognition (OCR) can generate plausible but visually unsupported text, suggesting reliance on language priors. Comparing open-weight VLMs with traditional…

Computation and Language · Computer Science 2026-05-28 Antonia Karamolegkou , Nicolas Angleraud , Benoît Sagot , Thibault Clérice

Document Layout Parsing serves as a critical gateway for Artificial Intelligence (AI) to access and interpret the world's vast stores of structured knowledge. This process,which encompasses layout detection, text recognition, and relational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yumeng Li , Guang Yang , Hao Liu , Bowen Wang , Colin Zhang

Models like OpenAI-o3 pioneer visual grounded reasoning by dynamically referencing visual regions, just like human "thinking with images". However, no benchmark exists to evaluate these capabilities holistically. To bridge this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Haochen Wang , Xiangtai Li , Zilong Huang , Anran Wang , Jiacong Wang , Tao Zhang , Jiani Zheng , Sule Bai , Zijian Kang , Jiashi Feng , Zhuochen Wang , Zhaoxiang Zhang

Despite significant advances in document understanding, determining the correct orientation of scanned or photographed documents remains a critical pre-processing step in the real world settings. Accurate rotation correction is essential…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Suranjan Goswami , Abhinav Ravi , Raja Kolla , Ali Faraz , Shaharukh Khan , Akash , Chandra Khatri , Shubham Agarwal

We present Multimodal OCR (MOCR), a document parsing paradigm that jointly parses text and graphics into unified textual representations. Unlike conventional OCR systems that focus on text recognition and leave graphical regions as cropped…

Language models have been supervised with both language-only objective and visual grounding in existing studies of visual-grounded language learning. However, due to differences in the distribution and scale of visual-grounded datasets and…

Computation and Language · Computer Science 2024-01-10 Cong-Duy Nguyen , The-Anh Vu-Le , Thong Nguyen , Tho Quan , Luu Anh Tuan

Multimodal Large Language Models (MLLMs) have increasingly localized and interleaved visual evidence for deliberative reasoning. Grounding-based approaches typically focus on regions of interest (RoIs) by injecting cropped image patches or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Guannan Lv , Ren Nie , Hongjian Dou , Tingting Gao

In this paper, we present ZonUI-3B, a lightweight Vision-Language Model (VLM) that can be fully trained on a single consumer-grade GPU (RTX 4090) while delivering performance comparable to significantly larger models on GUI grounding tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 ZongHan Hsieh , Tzer-Jen Wei , ShengJing Yang

In recent years, multimodal large models have continued to improve on general benchmarks. However, in real-world content moderation and adversarial settings, mainstream models still suffer from degraded generalization and catastrophic…

Artificial Intelligence · Computer Science 2026-04-01 Zhiqian Zhang , Xu Zhao , Xiaoqing Xu , Guangdong Liang , Weijia Wang , Xiaolei Lv , Bo Li , Jun Gao

Manchu, a critically endangered language essential for understanding early modern Eastern Eurasian history, lacks effective OCR systems that can handle real-world historical documents. This study develops high-performing OCR systems by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Yan Hon Michael Chung , Donghyeok Choi

Document parsing is a fine-grained task where image resolution significantly impacts performance. While advanced research leveraging vision-language models benefits from high-resolution input to boost model performance, this often leads to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Cheng Cui , Ting Sun , Suyin Liang , Tingquan Gao , Zelun Zhang , Jiaxuan Liu , Xueqing Wang , Changda Zhou , Hongen Liu , Manhui Lin , Yue Zhang , Yubo Zhang , Jing Zhang , Jun Zhang , Xing Wei , Yi Liu , Dianhai Yu , Yanjun Ma

Vision-Language Models (VLMs) have shown strong promise on Optical Character Recognition (OCR), yet the sheer number of visual tokens required to encode dense documents incurs prohibitive inference cost. Existing pruning methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zihan Tang , Leqi Shen , Hui Chen , Ao Wang , Ben Wan , Yan Feng , Ke Zhang , Sicheng Zhao , Tongxuan Liu , Guiguang Ding

Visual grounding aims to identify objects or regions in a scene based on natural language descriptions, essential for spatially aware perception in autonomous driving. However, existing visual grounding tasks typically depend on bounding…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Zhan Shi , Song Wang , Junbo Chen , Jianke Zhu

Visual grounding in text-rich document images is a critical yet underexplored challenge for Document Intelligence and Visual Question Answering (VQA) systems. We present DRISHTIKON, a multi-granular and multi-block visual grounding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Badri Vishal Kasuba , Parag Chaudhuri , Ganesh Ramakrishnan

We present DeepSeek-OCR as an initial investigation into the feasibility of compressing long contexts via optical 2D mapping. DeepSeek-OCR consists of two components: DeepEncoder and DeepSeek3B-MoE-A570M as the decoder. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Haoran Wei , Yaofeng Sun , Yukun Li

We introduce MinerU2.5, a 1.2B-parameter document parsing vision-language model that achieves state-of-the-art recognition accuracy while maintaining exceptional computational efficiency. Our approach employs a coarse-to-fine, two-stage…

Current visual grounding models are either based on a Multimodal Large Language Model (MLLM) that performs auto-regressive decoding, which is slow and risks hallucinations, or on re-aligning an LLM with vision features to learn new special…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Weitai Kang , Jason Kuen , Mengwei Ren , Zijun Wei , Yan Yan , Kangning Liu

We open-source MiMo-VL-7B-SFT and MiMo-VL-7B-RL, two powerful vision-language models delivering state-of-the-art performance in both general visual understanding and multimodal reasoning. MiMo-VL-7B-RL outperforms Qwen2.5-VL-7B on 35 out of…

We introduce Qwen3-VL, the most capable vision-language model in the Qwen series to date, achieving superior performance across a broad range of multimodal benchmarks. It natively supports interleaved contexts of up to 256K tokens,…

Multimodal reasoning has become a cornerstone of modern AI research. Standardized exam questions offer a uniquely rigorous testbed for such reasoning, providing structured visual contexts and verifiable answers. While recent progress has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Egemen Sert , Şeyda Ertekin